-- Logs begin at Thu 2022-03-24 01:32:41 UTC, end at Thu 2022-03-24 02:36:57 UTC. -- Mar 24 02:03:40.401444 dv-neutron-834874-3-hyperv systemd[1]: Started Devstack devstack@q-svc.service. Mar 24 02:03:43.332364 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.common.config [-] Logging enabled! Mar 24 02:03:43.332971 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 20.1.0.dev52 Mar 24 02:03:43.333158 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103927) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Mar 24 02:03:43.336498 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.common.config [-] Logging enabled! Mar 24 02:03:43.336756 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 20.1.0.dev52 Mar 24 02:03:43.337071 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103927) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Mar 24 02:03:43.338014 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 24 02:03:43.338255 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 24 02:03:43.338673 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 24 02:03:43.338930 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 24 02:03:43.339165 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 24 02:03:43.339920 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.340352 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Mar 24 02:03:43.340669 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.340972 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.341269 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.341569 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.341864 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.342149 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.342444 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.342774 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.343064 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.343349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.343640 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.343936 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.344227 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] config_source = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.344517 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.344813 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.345101 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] debug = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.345388 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.345826 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.346256 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.346557 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.346853 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.347135 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.347426 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.347693 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.347982 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.348315 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] host = dv-neutron-834874-3-hyperv {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.348604 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.348896 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.349186 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.349478 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.349760 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.350043 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.350332 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.351157 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] log_dir = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.351438 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] log_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.351720 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.352016 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.352311 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.352608 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.352839 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.353068 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.353361 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.353655 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.353939 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.354223 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.354503 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.354810 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.355094 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.355371 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.355662 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.355955 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.356245 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.356525 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.356804 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.357083 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.357359 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.357648 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.357928 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.358208 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.358488 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.358804 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.359084 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.359364 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.359668 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.359961 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.360251 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.360542 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.360823 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.361111 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.361387 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.361664 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] use_journal = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.361940 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] use_json = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.362220 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.362496 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.362807 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.363084 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.363362 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.363641 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.363918 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.364208 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.364489 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] wsgi_server_debug = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:43.364790 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.365092 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.365395 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.365695 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.365990 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.366874 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.367172 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.367459 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.367753 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.368049 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.368341 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.368626 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.368936 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.369232 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.369535 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.369848 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.370149 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.370448 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.370766 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.371048 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.371328 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.371615 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.371908 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.372192 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.372485 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.372782 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.373067 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.373369 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.373660 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.373958 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.374253 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.374552 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.374844 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.375142 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.375425 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.375704 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.375988 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.376282 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.376566 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.376846 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.377133 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.377416 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.377693 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.377969 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.378249 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.378572 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.378863 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.379148 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.379423 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.379705 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.379979 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.380266 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.380547 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.380823 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.381099 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.381380 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.381676 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.381955 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.382238 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.382541 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.382814 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.383091 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.383367 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.383644 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.383920 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.384195 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.384470 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.384744 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.385024 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.385301 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.385577 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.385851 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.386127 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.386400 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.386721 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.387026 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.387309 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.387592 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.387874 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.388154 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.388435 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.388715 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.389003 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.389285 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.389560 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.389853 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.390140 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.390427 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.390755 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.391040 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.391338 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.391619 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.391901 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.392188 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.392469 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.392749 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.393036 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.393324 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.393616 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.393911 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.394207 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.394499 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.394822 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.395107 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.395418 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.395702 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:43.395924 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 24 02:03:43.396166 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=103927) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Mar 24 02:03:43.769102 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 24 02:03:43.769392 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 24 02:03:43.769706 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 24 02:03:43.770188 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.manager [-] Loading core plugin: ml2 Mar 24 02:03:44.098925 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.099218 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.099496 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.101221 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.101497 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.101887 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.157238 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.157587 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.157877 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.172861 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.173151 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.173429 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.202487 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.202794 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.203065 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.344503 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.345123 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.345123 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.578719 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.579014 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.579304 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.579600 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.580363 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.681483 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.681806 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.682089 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.682655 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.682928 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.683239 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.683501 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.683761 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.684016 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.684299 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.684561 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.684830 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.685093 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.685349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.685609 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.685874 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.686130 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.686400 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.686705 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.686975 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.687252 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.687509 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.687791 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.688169 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.688421 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.688671 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.689069 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=103927) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Mar 24 02:03:44.689317 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=103927) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Mar 24 02:03:44.689555 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=103927) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Mar 24 02:03:44.689795 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=103927) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Mar 24 02:03:44.690033 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=103927) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Mar 24 02:03:44.690271 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=103927) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Mar 24 02:03:44.690660 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Mar 24 02:03:44.693761 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Mar 24 02:03:44.697896 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Mar 24 02:03:44.701627 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(100, 149)])]) Mar 24 02:03:44.703318 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Mar 24 02:03:44.703787 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Mar 24 02:03:44.704128 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Mar 24 02:03:44.704515 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Mar 24 02:03:44.707385 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Mar 24 02:03:44.707642 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Mar 24 02:03:44.707996 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Mar 24 02:03:44.712903 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Mar 24 02:03:44.737096 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Mar 24 02:03:44.737553 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.737870 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=103927) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Mar 24 02:03:44.738231 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.739642 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=103927) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Mar 24 02:03:44.739928 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Mar 24 02:03:44.740179 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Mar 24 02:03:44.744122 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.744411 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:44.807958 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Mar 24 02:03:44.808231 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Mar 24 02:03:44.808501 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Mar 24 02:03:44.808899 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Mar 24 02:03:44.829390 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_db.sqlalchemy.engines [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 24 02:03:45.277955 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Initializing driver for type 'gre' Mar 24 02:03:45.278487 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] gre ID ranges: [(1, 1000)] Mar 24 02:03:45.332136 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Initializing driver for type 'local' Mar 24 02:03:45.332480 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Initializing driver for type 'vlan' Mar 24 02:03:45.344500 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] VlanTypeDriver initialization complete Mar 24 02:03:45.344833 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Initializing driver for type 'vxlan' Mar 24 02:03:45.345392 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] vxlan ID ranges: [(1, 1000)] Mar 24 02:03:45.397494 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Initializing extension driver 'port_security' Mar 24 02:03:45.397838 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.extensions.port_security [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] PortSecurityExtensionDriver initialization complete Mar 24 02:03:45.398186 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Initializing mechanism driver 'openvswitch' Mar 24 02:03:45.398505 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Initializing mechanism driver 'hyperv' Mar 24 02:03:45.405080 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.plugins.ml2.plugin [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=103927) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:03:45.405763 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > port after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.406139 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > port after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.406493 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > port after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.407051 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=103927) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} Mar 24 02:03:45.407488 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > subnet after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.407846 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > subnet after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.408197 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > subnet after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.408596 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=103927) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} Mar 24 02:03:45.409007 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > network after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.409596 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > network after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.409949 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > network after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.410349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=103927) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} Mar 24 02:03:45.410785 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > security_group after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.411136 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > security_group after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.411478 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > security_group after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.412017 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=103927) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} Mar 24 02:03:45.412442 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.412802 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.413686 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.414090 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=103927) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} Mar 24 02:03:45.414504 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > address_group after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.414924 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > address_group after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.415225 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > address_group after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.415626 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=103927) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:112}} Mar 24 02:03:45.416075 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] ML2 OVO RPC backend initialized. {{(pid=103927) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:162}} Mar 24 02:03:45.416782 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router_interface after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.417141 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.417561 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > network before_response 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.417913 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > networks before_response 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.418264 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > port before_response 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.418637 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > ports before_response 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.418987 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > subnet before_response 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.419332 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > subnets before_response 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.419679 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > network after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.420022 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > network after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.420359 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > network after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.420729 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > port after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.421105 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > port after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.421501 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > port after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.421836 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > subnet after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.422180 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > subnet after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.422538 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > subnet after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.430670 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded quota_driver: . Mar 24 02:03:45.431058 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.plugin [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Modular L2 Plugin initialization complete Mar 24 02:03:45.431453 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading services supported by the core plugin {{(pid=103927) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Mar 24 02:03:45.431847 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.plugins.ml2.managers [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Got port-security extension from driver 'port_security' Mar 24 02:03:45.432606 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.extensions.vlantransparent [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Disabled vlantransparent extension. Mar 24 02:03:45.433143 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=103927) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Mar 24 02:03:45.433511 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading Plugin: router Mar 24 02:03:45.468483 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router_interface before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.468878 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router after_create 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.469255 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router before_create 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.469629 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.470005 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.470364 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router after_delete 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.470758 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > floatingip after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.471114 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > floatingip after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.471474 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router after_create 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.471832 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router after_update 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.472185 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router after_update 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.472535 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.472896 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router after_update 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.473305 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router precommit_update 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.473684 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: port after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.474029 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: port after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.474376 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: subnet after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.474754 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.475114 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > port precommit_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.475975 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router precommit_create 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.476326 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: port before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.476673 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router precommit_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.477034 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router after_update 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.477378 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router precommit_delete 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.477731 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router precommit_create 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.478094 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router_interface after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.478441 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router precommit_update 55549900 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.478838 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > agent after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.479194 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > agent after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.479542 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > network after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.480384 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Tracking information for resource: router configured {{(pid=103927) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Mar 24 02:03:45.480717 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Tracking information for resource: floatingip configured {{(pid=103927) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Mar 24 02:03:45.485634 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.db.l3_agentschedulers_db [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Mar 24 02:03:45.486220 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: port after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.486612 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: port after_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.486977 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: port after_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.487336 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: port after_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.488131 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router before_create 55550100 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.488502 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router precommit_delete 55550100 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.488873 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router precommit_create 55550100 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.489234 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > router precommit_update 55550100 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.494745 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.services.provider_configuration [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service providers = [] {{(pid=103927) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Mar 24 02:03:45.495118 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.db.servicetype_db [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=103927) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Mar 24 02:03:45.498076 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.services.service_base [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=103927) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Mar 24 02:03:45.498433 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.services.service_base [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=103927) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Mar 24 02:03:45.498816 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.services.service_base [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=103927) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Mar 24 02:03:45.499709 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.services.service_base [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=103927) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Mar 24 02:03:45.500087 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.services.service_base [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Default provider is not specified for service type L3_ROUTER_NAT Mar 24 02:03:45.500468 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=103927) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Mar 24 02:03:45.500791 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Mar 24 02:03:45.511525 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=103927) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Mar 24 02:03:45.511870 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading Plugin: auto_allocate Mar 24 02:03:45.517780 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: network precommit_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.518158 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: network precommit_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.518718 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=103927) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Mar 24 02:03:45.519048 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading Plugin: tag Mar 24 02:03:45.525667 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=103927) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Mar 24 02:03:45.526003 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading Plugin: timestamp Mar 24 02:03:45.530080 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=103927) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Mar 24 02:03:45.530421 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading Plugin: network_ip_availability Mar 24 02:03:45.535920 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.536297 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.536660 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.537372 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=103927) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Mar 24 02:03:45.537697 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading Plugin: flavors Mar 24 02:03:45.543037 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=103927) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Mar 24 02:03:45.543374 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading Plugin: revisions Mar 24 02:03:45.547715 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=103927) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Mar 24 02:03:45.548111 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_concurrency.lockutils [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.778s {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 24 02:03:45.548857 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=103927) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Mar 24 02:03:45.549201 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Initializing extension manager. Mar 24 02:03:45.549730 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: __init__.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.550079 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: __pycache__ {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.550419 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: address_group.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.551211 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.551779 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: address-group Mar 24 02:03:45.552111 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: address_scope.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.552829 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.553345 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: address-scope Mar 24 02:03:45.554274 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: admin_state_down_before_update.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.555422 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.555944 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: router-admin-state-down-before-update Mar 24 02:03:45.556274 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: agent.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.556982 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.557747 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: agent Mar 24 02:03:45.558074 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: agent_resources_synced.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.559010 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.559523 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: agent-resources-synced Mar 24 02:03:45.559849 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: allowedaddresspairs.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.561656 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.562179 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: allowed-address-pairs Mar 24 02:03:45.562512 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: auto_allocated_topology.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.563633 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.564149 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: auto-allocated-topology Mar 24 02:03:45.564483 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: availability_zone.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.565185 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.565696 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: availability_zone Mar 24 02:03:45.566025 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: availability_zone_filter.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.566971 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.567483 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: availability_zone_filter Mar 24 02:03:45.567811 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: data_plane_status.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.568723 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.569262 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension data-plane-status not supported by any of loaded plugins Mar 24 02:03:45.569592 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: default_subnetpools.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.570509 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.571057 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: default-subnetpools Mar 24 02:03:45.571404 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: dhcpagentscheduler.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.572196 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.572706 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: dhcp_agent_scheduler Mar 24 02:03:45.573033 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: dns.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.573955 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.574463 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension dns-integration not supported by any of loaded plugins Mar 24 02:03:45.574823 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: dns_domain_ports.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.575739 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.576247 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension dns-domain-ports not supported by any of loaded plugins Mar 24 02:03:45.576575 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.577498 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.578010 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Mar 24 02:03:45.578343 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: dvr.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.579044 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.579553 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: dvr Mar 24 02:03:45.579879 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: ecmp_routes.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.580810 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.581317 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension ecmp_routes not supported by any of loaded plugins Mar 24 02:03:45.581643 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: empty_string_filtering.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.582576 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.583090 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: empty-string-filtering Mar 24 02:03:45.583415 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.584328 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.584863 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Mar 24 02:03:45.585189 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.586103 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.586640 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Mar 24 02:03:45.586966 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: external_net.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.587896 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.588405 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: external-net Mar 24 02:03:45.588729 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: extra_dhcp_opt.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.589645 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.590154 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: extra_dhcp_opt Mar 24 02:03:45.590477 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: extraroute.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.591416 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.591925 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: extraroute Mar 24 02:03:45.592248 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: extraroute_atomic.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.593286 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.593796 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: extraroute-atomic Mar 24 02:03:45.594121 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: filter_validation.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.594818 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.595322 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: filter-validation Mar 24 02:03:45.595646 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: fip_pf_description.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.596559 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.597062 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Mar 24 02:03:45.597385 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: fip_pf_port_range.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.598305 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Floating IP Port Forwarding support port ranges" alias="floating-ip-port-forwarding-port-ranges" description="Add suport to port ranges" updated="2020-07-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.598842 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension floating-ip-port-forwarding-port-ranges not supported by any of loaded plugins Mar 24 02:03:45.599170 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: fip_port_details.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.600089 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.601129 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: fip-port-details Mar 24 02:03:45.601459 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: flavors.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.602734 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.603257 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: flavors Mar 24 02:03:45.603605 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.605343 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.605916 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Mar 24 02:03:45.606285 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: floatingip_pools.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.607023 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.607542 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: floatingip-pools Mar 24 02:03:45.607872 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: ip_allocation.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.608803 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.609313 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension ip_allocation not supported by any of loaded plugins Mar 24 02:03:45.609639 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.610593 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.611111 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: ip-substring-filtering Mar 24 02:03:45.611443 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l2_adjacency.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.612371 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.612885 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension l2_adjacency not supported by any of loaded plugins Mar 24 02:03:45.613214 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l3.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.615708 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.616810 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: router Mar 24 02:03:45.617149 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l3_conntrack_helper.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.619459 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.620003 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Mar 24 02:03:45.620349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.621292 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.621816 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: ext-gw-mode Mar 24 02:03:45.622153 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.623120 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.623642 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: l3-ha Mar 24 02:03:45.623974 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.624896 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.625411 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins Mar 24 02:03:45.625742 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l3_flavors.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.626710 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.627233 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: l3-flavors Mar 24 02:03:45.627583 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l3_ndp_proxy.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.629035 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.629585 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension l3-ndp-proxy not supported by any of loaded plugins Mar 24 02:03:45.629920 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.630885 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.631411 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: l3-port-ip-change-not-allowed Mar 24 02:03:45.631770 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: l3agentscheduler.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.632823 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.633344 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: l3_agent_scheduler Mar 24 02:03:45.633681 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: local_ip.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.635535 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.636070 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension local_ip not supported by any of loaded plugins Mar 24 02:03:45.636408 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: logging.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.637905 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.638441 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension logging not supported by any of loaded plugins Mar 24 02:03:45.638808 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: metering.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.639558 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.640144 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: metering Mar 24 02:03:45.640478 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.641589 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.642117 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: metering_source_and_destination_fields Mar 24 02:03:45.642453 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: multiprovidernet.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.643409 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.643926 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: multi-provider Mar 24 02:03:45.644259 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: netmtu.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.645183 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.645699 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: net-mtu Mar 24 02:03:45.646029 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: netmtu_writable.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.646986 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.647531 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: net-mtu-writable Mar 24 02:03:45.647863 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: network_availability_zone.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.648538 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.649051 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: network_availability_zone Mar 24 02:03:45.649380 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: network_ip_availability.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.650493 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.651044 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: network-ip-availability Mar 24 02:03:45.651382 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: network_segment_range.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.652149 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.652656 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension network-segment-range not supported by any of loaded plugins Mar 24 02:03:45.652986 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: pagination.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.654106 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.654446 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: pagination Mar 24 02:03:45.654803 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: port_device_profile.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.655723 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.656246 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: port-device-profile Mar 24 02:03:45.656576 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.657514 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.658033 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: port-mac-address-regenerate Mar 24 02:03:45.658359 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.659307 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.659823 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: port-numa-affinity-policy Mar 24 02:03:45.660149 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: port_resource_request.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.661075 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.661588 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension port-resource-request not supported by any of loaded plugins Mar 24 02:03:45.661916 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: port_resource_request_groups.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.663449 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.663963 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension port-resource-request-groups not supported by any of loaded plugins Mar 24 02:03:45.664290 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: portbindings.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.665262 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.665733 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: binding Mar 24 02:03:45.666060 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: portbindings_extended.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.667364 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.667882 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: binding-extended Mar 24 02:03:45.668215 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: portsecurity.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.669136 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.669652 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: port-security Mar 24 02:03:45.669982 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: project_id.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.670985 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.671324 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: project-id Mar 24 02:03:45.671660 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: providernet.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.672581 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.673106 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: provider Mar 24 02:03:45.673437 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.677122 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.677655 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos not supported by any of loaded plugins Mar 24 02:03:45.677991 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.679847 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.680363 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Mar 24 02:03:45.680699 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.681648 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.682212 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Mar 24 02:03:45.682855 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_default.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.683792 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.684352 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-default not supported by any of loaded plugins Mar 24 02:03:45.684701 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_fip.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.685673 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.686246 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-fip not supported by any of loaded plugins Mar 24 02:03:45.686626 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_fip_network_policy.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.687552 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.688095 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-fip-network-policy not supported by any of loaded plugins Mar 24 02:03:45.688445 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_gateway_ip.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.689411 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.689951 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-gateway-ip not supported by any of loaded plugins Mar 24 02:03:45.690282 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_port_network_policy.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.691327 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.691847 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-port-network-policy not supported by any of loaded plugins Mar 24 02:03:45.692176 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.693258 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.693813 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-pps-minimum not supported by any of loaded plugins Mar 24 02:03:45.694163 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_pps_minimum_rule_alias.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.695252 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="QoS minimum packet rate rule alias" alias="qos-pps-minimum-rule-alias" description="API to enable GET, PUT and DELETE operations on QoS minimum packet rate rule without specifying policy ID" updated="2021-10-22T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.695769 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-pps-minimum-rule-alias not supported by any of loaded plugins Mar 24 02:03:45.696095 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_pps_rule.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.697290 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.697837 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-pps not supported by any of loaded plugins Mar 24 02:03:45.698169 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_rule_type_details.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.699118 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.699634 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-rule-type-details not supported by any of loaded plugins Mar 24 02:03:45.699962 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_rule_type_filter.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.700880 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Allow to filter the list of QoS rule types" alias="qos-rule-type-filter" description="Allows to filter the QoS rule type list adding two new flags. "all_rules" prints all implemented QoS rule types."all_supported" prints all supported QoS rule types by the loaded mechanism drivers" updated="2022-02-02T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.701416 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-rule-type-filter not supported by any of loaded plugins Mar 24 02:03:45.701776 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: qos_rules_alias.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.702875 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.703397 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension qos-rules-alias not supported by any of loaded plugins Mar 24 02:03:45.703725 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: quota_check_limit.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.704644 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.705161 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: quota-check-limit Mar 24 02:03:45.705491 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: quotasv2.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.706411 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.706777 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: quotas Mar 24 02:03:45.707106 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: quotasv2_detail.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.709075 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.709419 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: quota_details Mar 24 02:03:45.710279 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: rbac.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.711385 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.711928 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: rbac-policies Mar 24 02:03:45.712265 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: rbac_address_group.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.713208 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.713728 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: rbac-address-group Mar 24 02:03:45.714058 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: rbac_address_scope.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.715005 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.715518 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: rbac-address-scope Mar 24 02:03:45.715846 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: rbac_security_groups.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.716841 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.717354 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: rbac-security-groups Mar 24 02:03:45.717681 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: rbac_subnetpool.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.718638 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.719150 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: rbac-subnetpool Mar 24 02:03:45.719475 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: revisionifmatch.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.720406 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.720922 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: revision-if-match Mar 24 02:03:45.721251 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: revisions.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.722404 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.722952 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: standard-attr-revisions Mar 24 02:03:45.723284 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: router_availability_zone.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.723958 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.724472 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: router_availability_zone Mar 24 02:03:45.724799 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: routerservicetype.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.725815 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.726325 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension router-service-type not supported by any of loaded plugins Mar 24 02:03:45.726688 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.727623 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.728157 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: security-groups-normalized-cidr Mar 24 02:03:45.728506 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: security_groups_port_filtering.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.729471 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.730030 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: port-security-groups-filtering Mar 24 02:03:45.730359 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.731328 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.731851 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: security-groups-remote-address-group Mar 24 02:03:45.732180 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.733112 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.733624 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: security-groups-shared-filtering Mar 24 02:03:45.733951 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.734573 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Mar 24 02:03:45.734904 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: securitygroup.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.745058 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.745618 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: security-group Mar 24 02:03:45.745952 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: segment.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.746708 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.747227 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension segment not supported by any of loaded plugins Mar 24 02:03:45.747558 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.748512 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.749022 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Mar 24 02:03:45.749352 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: servicetype.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.750490 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.751043 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: service-type Mar 24 02:03:45.751375 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: sorting.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.752389 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.752724 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: sorting Mar 24 02:03:45.753050 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: standard_attr_segment.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.753973 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.754491 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension standard-attr-segment not supported by any of loaded plugins Mar 24 02:03:45.754856 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: standardattrdescription.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.755534 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.756056 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: standard-attr-description Mar 24 02:03:45.756387 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: stateful_security_group.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.757420 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.757951 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: stateful-security-group Mar 24 02:03:45.758283 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: stdattrs_common.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.758891 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Mar 24 02:03:45.759223 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.760252 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.760803 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Mar 24 02:03:45.761131 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: subnet_onboard.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.762223 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.762782 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: subnet_onboard Mar 24 02:03:45.763114 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.764052 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.764566 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Mar 24 02:03:45.764896 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: subnet_service_types.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.765831 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.766350 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: subnet-service-types Mar 24 02:03:45.766716 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: subnetallocation.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.767812 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.768333 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: subnet_allocation Mar 24 02:03:45.768668 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.769343 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.769858 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: subnetpool-prefix-ops Mar 24 02:03:45.770188 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.771162 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.771680 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Mar 24 02:03:45.772019 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: tagging.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.774089 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.774719 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: standard-attr-tag Mar 24 02:03:45.775076 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: timestamp.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.776415 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.777035 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loaded extension: standard-attr-timestamp Mar 24 02:03:45.777369 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: trunk.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.778503 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.779088 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension trunk not supported by any of loaded plugins Mar 24 02:03:45.779461 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: trunk_details.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.780643 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.781336 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension trunk-details not supported by any of loaded plugins Mar 24 02:03:45.781685 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: uplink_status_propagation.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.782765 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.783341 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension uplink-status-propagation not supported by any of loaded plugins Mar 24 02:03:45.783751 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Loading extension file: vlantransparent.py {{(pid=103927) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Mar 24 02:03:45.784491 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=103927) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Mar 24 02:03:45.785077 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extension vlan-transparent not supported by any of loaded plugins Mar 24 02:03:45.788556 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:network Mar 24 02:03:45.789141 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:subnet Mar 24 02:03:45.789581 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:subnetpool Mar 24 02:03:45.790031 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:port Mar 24 02:03:45.791471 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.791968 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service FLAVORS assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.792640 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.793138 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.793545 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:router Mar 24 02:03:45.794045 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:floatingip Mar 24 02:03:45.794634 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service METERING assigned prefix: /metering {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.796087 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.796466 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.796826 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103927) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:03:45.797825 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of CountableResource for resource:rbac_policy Mar 24 02:03:45.798282 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:security_group Mar 24 02:03:45.798755 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:security_group_rule Mar 24 02:03:45.799355 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service CORE assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.799692 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:subnetpool Mar 24 02:03:45.800040 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] subnetpool is already registered Mar 24 02:03:45.800477 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service CORE assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.800811 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:subnetpool Mar 24 02:03:45.801147 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] subnetpool is already registered Mar 24 02:03:45.803428 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.803893 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service FLAVORS assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.804488 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.804914 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.805249 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:router Mar 24 02:03:45.805592 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] router is already registered Mar 24 02:03:45.806007 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:floatingip Mar 24 02:03:45.806346 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] floatingip is already registered Mar 24 02:03:45.806836 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service METERING assigned prefix: /metering {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.807779 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of CountableResource for resource:rbac_policy Mar 24 02:03:45.808111 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] rbac_policy is already registered Mar 24 02:03:45.808533 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:security_group Mar 24 02:03:45.808872 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] security_group is already registered Mar 24 02:03:45.809281 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:security_group_rule Mar 24 02:03:45.809618 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] security_group_rule is already registered Mar 24 02:03:45.810250 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service CORE assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.810618 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:subnetpool Mar 24 02:03:45.810961 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] subnetpool is already registered Mar 24 02:03:45.811383 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.v2.resource_helper [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Service CORE assigned prefix: {{(pid=103927) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Mar 24 02:03:45.811714 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Creating instance of TrackedResource for resource:subnetpool Mar 24 02:03:45.812047 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING neutron.quota.resource_registry [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] subnetpool is already registered Mar 24 02:03:45.812519 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: extensions {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.814025 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: address-groups {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.815555 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: address-scopes {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.816882 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: agents {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.818055 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: auto-allocated-topology {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.819428 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: availability_zones {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.820656 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: dhcp-networks {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.822173 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: dhcp-agents {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.823642 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: routers {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.825861 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: flavors {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.827084 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: service_profiles {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.828321 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: next_providers {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.829776 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: service_profiles {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.832260 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: floatingip-pools {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.833508 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: routers {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.836217 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: floatingips {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.837513 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: l3-routers {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.838940 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: l3-agents {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.840358 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: metering-labels {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.841719 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: metering-label-rules {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.843044 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: network-ip-availabilities {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.844325 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: bindings {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.845973 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: quotas {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.847603 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: quotas {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.849142 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: rbac-policies {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.851141 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: security-groups {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.852392 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: security-group-rules {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.853645 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: service-providers {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.854903 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: subnetpools {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.856316 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: subnetpools {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.857785 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.859569 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.861384 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.863212 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.865027 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.867463 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.869147 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.871099 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.872891 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.874821 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron.api.extensions [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Extended resource: tags {{(pid=103927) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Mar 24 02:03:45.880684 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING keystonemiddleware.auth_token [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 24 02:03:45.886044 dv-neutron-834874-3-hyperv neutron-server[103927]: WARNING keystonemiddleware.auth_token [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 24 02:03:45.894668 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_concurrency.lockutils [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Acquired lock "singleton_lock" {{(pid=103927) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 24 02:03:45.895151 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_concurrency.lockutils [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Releasing lock "singleton_lock" {{(pid=103927) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 24 02:03:45.895805 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO oslo_service.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Starting 2 workers Mar 24 02:03:45.900692 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Started child 104036 {{(pid=103927) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Mar 24 02:03:45.905179 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Started child 104037 {{(pid=103927) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Mar 24 02:03:45.906168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process (None), after_init {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:03:45.906845 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO neutron.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Neutron service started, listening on 0.0.0.0:9696 Mar 24 02:03:45.907445 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Publish callbacks [] for process (None), before_spawn {{(pid=103927) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:03:45.907708 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [-] (104036) wsgi starting up on http://0.0.0.0:9696 Mar 24 02:03:45.909982 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO oslo_service.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Starting 1 workers Mar 24 02:03:45.910442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process (None), after_init {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:03:45.911948 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [-] (104037) wsgi starting up on http://0.0.0.0:9696 Mar 24 02:03:45.915424 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Started child 104038 {{(pid=103927) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Mar 24 02:03:45.915917 dv-neutron-834874-3-hyperv neutron-server[103927]: INFO oslo_service.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Starting 1 workers Mar 24 02:03:45.919063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] calling RpcWorker wait() {{(pid=104038) _wait /opt/stack/neutron/neutron/service.py:128}} Mar 24 02:03:45.919598 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] returning from RpcWorker wait() {{(pid=104038) _wait /opt/stack/neutron/neutron/service.py:135}} Mar 24 02:03:45.920408 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Started child 104039 {{(pid=103927) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Mar 24 02:03:45.920881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process (None), after_init {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:03:45.921225 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG neutron_lib.callbacks.manager [None req-4a4495aa-8ced-4276-a138-8f191da59b17 None None] Publish callbacks [] for process (None), after_spawn {{(pid=103927) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:03:45.921334 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:03:45.923288 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103927) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Mar 24 02:03:45.923501 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 24 02:03:45.923691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 24 02:03:45.923921 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 24 02:03:45.924271 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 24 02:03:45.924436 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 24 02:03:45.924939 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.925222 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.925490 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.925745 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.926045 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.926491 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process (None), after_init {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:03:45.926954 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.926954 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.927153 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.927424 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.927659 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.927831 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.927999 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.928205 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:03:45.928300 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.929011 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.929369 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.929621 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.929858 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.930125 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.930301 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.930599 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.930876 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.931108 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.931385 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] debug = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.931642 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.932117 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.932620 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.932858 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.933074 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.933350 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.933599 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.933895 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.934117 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.934351 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.934620 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.934889 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.935122 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.935332 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.935578 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.935818 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.936043 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.936262 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.936717 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] host = dv-neutron-834874-3-hyperv {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.936957 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.937172 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.937399 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.937655 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.937900 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.938135 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.938390 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.938683 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.938973 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.939158 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.939415 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.939675 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.939912 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.940149 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.940314 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_options = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.940550 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.940831 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.941077 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.941265 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.941434 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.941598 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.941857 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.942022 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.942270 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.942490 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.942731 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.942964 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.943185 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.943400 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.943642 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.943870 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.944167 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.944905 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.945168 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.945426 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.945681 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.945925 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.946141 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.946387 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.946671 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.947454 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.947454 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.947454 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.947957 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.947957 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.948291 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.948291 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.948538 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.948737 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.949014 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.949291 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.949518 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.950407 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.950407 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.950407 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.950695 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.950764 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.950954 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.951202 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.952379 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.952379 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.952379 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_json = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.952379 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.952379 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.952746 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.952814 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.953025 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.953247 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.953464 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.953718 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.953961 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:45.954403 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.954722 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.955018 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.955269 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.955506 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.955754 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.955989 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.956232 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.956488 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.958691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.958691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.958691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.958691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.958691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.958691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.958691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.958691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.959220 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.959220 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.959420 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.959491 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.959749 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.960043 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.960426 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.960824 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.961231 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.961625 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.962072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.962486 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.963024 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.963482 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.963744 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.20/identity {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.964018 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.964263 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.964510 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.964748 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.964985 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.965206 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.965443 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.965711 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.965932 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.966147 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.966374 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.966635 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.966883 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.967134 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.967378 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.967636 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.967899 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.968130 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.968334 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.968547 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.968761 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.968975 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.969202 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.969434 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.969690 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.969950 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.970168 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.970381 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.970617 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.970837 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.971101 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.971317 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.971548 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.971779 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.972011 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.972220 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.972460 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.972700 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.972911 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.973147 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.973362 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.973572 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.973802 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.974038 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.974250 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.974466 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.974704 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.974916 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.975297 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.975540 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.975923 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.976291 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.976637 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.976995 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.977350 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.977693 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.978089 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.978467 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.978864 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.979280 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.979819 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.980274 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.980691 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.980937 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.981225 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.981515 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.981790 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.982133 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.982363 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.982615 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.982875 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.983103 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.983340 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.983601 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.983806 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.984199 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.984606 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.984974 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.985362 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.985757 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.986157 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.986584 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.987019 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.987283 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.987556 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.987822 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.988076 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.988501 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.988898 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.989175 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.989399 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.989668 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.989938 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.990215 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.990644 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.991593 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.992009 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.992503 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.992747 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.993162 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.993560 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.993974 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.994374 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.994803 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.995072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.995297 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.995536 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.995841 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.996077 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.996298 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.996515 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.996822 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.997073 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.997314 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.997589 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.997843 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.998078 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.998323 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.998593 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.20/identity {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.998830 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.999065 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.999296 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.999511 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.999746 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:45.999980 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.000219 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.000433 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.000654 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.000914 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.001128 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.001347 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.001566 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.001784 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.002001 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.002256 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.002467 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.002711 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.002950 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.003166 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.003382 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.003600 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.003831 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.004077 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.004312 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.004586 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.004837 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.005054 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.005283 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.005507 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.005765 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.006001 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.006239 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.006458 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.006753 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.007490 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.007710 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.007942 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.008175 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.008403 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.008636 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.008867 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.009104 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.009450 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.009689 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.009937 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.010184 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.dead_timeout = 60.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.010550 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.011387 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.enable_retry_client = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.011387 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.enable_socket_keepalive = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.011387 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.011387 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.011734 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.hashclient_retry_attempts = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.011834 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.hashclient_retry_delay = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.012103 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.012340 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.012600 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.012802 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.013067 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.013324 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.013603 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.013847 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.014064 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.retry_attempts = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.014307 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.retry_delay = 0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.014552 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.socket_keepalive_count = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.014768 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.socket_keepalive_idle = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.015007 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.socket_keepalive_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.015221 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.015439 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.015650 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.015887 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.016097 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.016393 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.016672 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.016917 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.017179 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.017415 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.017682 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.017909 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.018149 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.018355 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.018763 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.018986 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.019225 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.019456 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.019673 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.019903 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.020147 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.020371 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.020574 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.020792 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.021023 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.021393 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.021615 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.022010 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.022399 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.022651 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.022889 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.023551 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.023551 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.023551 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.023798 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.023987 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.024196 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.024408 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.024648 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.024864 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.025072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.025352 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.025609 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.025986 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.026288 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.026536 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.026955 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.027224 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.027526 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.027738 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.027997 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.028232 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.028468 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.028690 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.028945 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.029277 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.029572 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.029818 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.030072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.030337 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.030633 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.031082 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.031460 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.031759 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.032108 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.032693 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.032693 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.032999 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.033137 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.033338 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.033559 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.033810 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.033983 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.034198 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.034464 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.034720 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.034941 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.035152 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.035374 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.035595 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.035839 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.036057 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.036276 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.036493 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.036649 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 24 02:03:46.037306 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103927) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Mar 24 02:03:46.037415 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 24 02:03:46.037590 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 24 02:03:46.037751 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 24 02:03:46.038105 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 24 02:03:46.038261 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 24 02:03:46.038471 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.038662 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.039219 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.039219 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.039219 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.039424 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.039424 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.039912 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.039912 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.039912 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.040116 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.040193 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.040326 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.040483 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.040642 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.040800 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.041816 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.041816 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.041816 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.041816 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.041816 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.041816 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.041816 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] debug = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.042247 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.042247 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.042386 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.042842 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.042842 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.042842 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.043096 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.043096 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.043243 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.043384 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.043543 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.043707 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.043865 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.044022 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.044181 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.044340 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.044497 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.044659 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.044810 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] host = dv-neutron-834874-3-hyperv {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.044969 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.045126 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.045281 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.045439 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.045616 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.045780 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047072 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047639 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_options = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047721 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:03:46.047803 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047803 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047803 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.047803 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.048024 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.048089 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.048194 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.048373 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051160 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051160 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051160 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051160 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051160 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051160 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051160 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051160 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051160 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051817 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051817 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051817 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051817 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051817 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051817 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051817 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.051817 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052349 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052863 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052863 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052863 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052863 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.052863 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.053231 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.053231 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.053231 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.053972 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.054173 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.054342 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.054564 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.054782 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.054992 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_json = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.055202 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.055414 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.055631 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.056034 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.056157 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.056414 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.056503 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.056705 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.056926 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 02:03:46.057177 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.057693 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.058023 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.058114 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.058320 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.058552 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.058768 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.058997 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.059231 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.059463 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.059708 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.059941 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.060220 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.060414 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.060892 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.060892 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.060892 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.061145 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.061226 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.061340 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.061501 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.061666 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.061834 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.061993 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.062154 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.062318 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.062478 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.062672 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.062836 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.063010 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.063395 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.063395 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.20/identity {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.063529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.063612 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.063763 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.063925 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.064091 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.064251 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.064455 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.064671 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.064881 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.065095 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.065306 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.065521 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.065753 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.066017 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.066219 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.066452 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.066712 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.066966 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.067188 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.067401 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.067616 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.067828 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.068041 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.068261 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.068493 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.068742 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.068975 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.069771 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.070019 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.070269 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.070433 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.070624 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.070748 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 53930) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:03:46.070843 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.070924 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.071077 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.071231 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072082 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072082 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072082 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072082 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072082 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072389 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072389 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072520 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072601 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072756 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.072925 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.073083 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.073245 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.073407 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.073568 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.073729 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.073889 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.074057 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.074218 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.074399 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.074646 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.075058 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.075278 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.075505 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.075748 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.076032 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.076271 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.076427 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.076659 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.077984 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.077984 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.077984 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.077984 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.077984 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.077984 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.078776 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.078776 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.078776 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.078776 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.079228 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.079228 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.079455 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.079670 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.079934 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.080106 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.080262 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.080687 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.080687 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.080915 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.080915 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.081118 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.081248 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.081371 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.081492 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.081629 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.081790 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.081956 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.082112 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.083529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.083529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.083529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.083529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.083529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.083529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.083529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.083529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.083529 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087611 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087611 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087784 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [-] 10.222.0.20 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0101094 Mar 24 02:03:46.087865 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087865 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087865 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087865 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087865 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087865 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087865 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.087865 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.088295 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.088295 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.088295 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.088295 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.088295 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.088295 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.20/identity {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.088295 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.088675 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.088746 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090222 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090222 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090222 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090222 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090222 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090222 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090222 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090697 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090697 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090697 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090922 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.090922 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.091061 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.091195 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.091356 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.091678 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.091828 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.091989 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.092163 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.092310 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.092471 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.092641 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.092771 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.092938 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.093101 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094086 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094086 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094086 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094086 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094086 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094086 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094477 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094477 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094477 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094701 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094876 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.094973 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.095177 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.095278 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.095409 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.095675 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.095773 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.095921 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.096051 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.dead_timeout = 60.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.096209 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.096371 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.enable_retry_client = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.096532 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.enable_socket_keepalive = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.096685 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.096847 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.097023 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.hashclient_retry_attempts = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.097194 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.hashclient_retry_delay = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.097365 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.097457 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.097630 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.097782 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.097925 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.098086 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.098246 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.098411 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.098629 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.retry_attempts = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.098776 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.retry_delay = 0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.098913 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.socket_keepalive_count = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.099058 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.socket_keepalive_idle = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.099193 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.socket_keepalive_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.099324 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.099455 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.099619 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.099780 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.099941 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.100116 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.100276 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.100956 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.101121 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.101282 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.101442 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.101616 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.101776 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.101936 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.102096 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.102257 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.102418 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.102620 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.102782 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.102942 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.103102 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.103261 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.103420 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.103596 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.103755 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.103914 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.104079 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.104232 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.104384 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.104557 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.104718 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.104879 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.105039 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.105198 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.105358 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.105528 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.105689 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.105849 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.106008 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.106167 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.106327 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.106558 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.107538 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.107704 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.107875 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.108037 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.108198 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.108417 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.108530 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.108693 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.108859 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.109022 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.109183 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.109344 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.109508 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.109674 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.109846 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.110045 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.110182 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.110329 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.110499 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.110710 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.110872 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.111040 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.111212 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.111373 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.111533 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.111693 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.111861 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.112019 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.112192 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.112328 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.112487 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.112648 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.112808 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.112967 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.113128 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.113338 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.113482 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.113629 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.113764 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.113901 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.114037 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.114170 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 02:03:46.114323 dv-neutron-834874-3-hyperv neutron-server[103927]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 24 02:03:57.383163 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2dd6a305-7f1f-4178-b5d5-15b50b2dfe7d None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:03:57.449389 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2dd6a305-7f1f-4178-b5d5-15b50b2dfe7d None None] No non-hosted networks {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Mar 24 02:03:57.476877 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.agentschedulers_db [None req-2dd6a305-7f1f-4178-b5d5-15b50b2dfe7d None None] DHCP Agent not found on host dv-neutron-834874-3-hyperv {{(pid=104038) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Mar 24 02:03:57.596795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-512fce5f-208b-42d1-8e87-0037e7d11fa2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1622305'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:03:59.690737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-25ed755e-ea5a-46a1-9ce3-690bc2a0f5b3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1622305'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:03:59.748861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d17648a2-c1e4-487b-ba12-6a552cf849c9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:00.785007 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1622305'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:02.390159 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1622305'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:03.562225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54012) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:03.674900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1622305'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:03.675681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.676016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.676350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.676681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.677011 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.677333 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.677704 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.678048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.678373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.678729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.679597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.679922 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.680246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.680564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.680879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:03.681315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-neutron-834874-3-hyperv', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.3', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0', 'NDPProxy': '1.0', 'Agent': '1.1'}) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:03.700380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-neutron-834874-3-hyperv', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.3', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0', 'NDPProxy': '1.0', 'Agent': '1.1'}} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:04.133450 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING oslo_policy.policy [None req-be4156e2-7c56-439d-94f5-a7883a389987 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Mar 24 02:04:04.134041 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING oslo_policy.policy [None req-be4156e2-7c56-439d-94f5-a7883a389987 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Mar 24 02:04:04.358411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-be4156e2-7c56-439d-94f5-a7883a389987 admin admin] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:04:04.370634 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-be4156e2-7c56-439d-94f5-a7883a389987 admin admin] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7961988 Mar 24 02:04:04.941096 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.db.l3_hamode_db [None req-4c48a4c3-91dc-46b2-a3e2-0b0b578df980 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Mar 24 02:04:05.016264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c48a4c3-91dc-46b2-a3e2-0b0b578df980 None None] Routers set() bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:04:05.016581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c48a4c3-91dc-46b2-a3e2-0b0b578df980 None None] Router IDs set() for agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:463}} Mar 24 02:04:06.927949 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54038) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:07.231548 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-82b38e42-61a2-422c-8547-eb0d28582109 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'is_default': True, 'default_prefixlen': 26, 'shared': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:04:07.323709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.policy [None req-82b38e42-61a2-422c-8547-eb0d28582109 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=104037) register_rules /opt/stack/neutron/neutron/policy.py:73}} Mar 24 02:04:07.365821 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING oslo_policy.policy [None req-82b38e42-61a2-422c-8547-eb0d28582109 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Mar 24 02:04:07.366189 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING oslo_policy.policy [None req-82b38e42-61a2-422c-8547-eb0d28582109 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Mar 24 02:04:07.458278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-82b38e42-61a2-422c-8547-eb0d28582109 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8790622743969', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8790622741390', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8790622790459', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8790622785388', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8790622785921', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8790622600676', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-7343408', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7368738', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1757452', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1685022'] for rbac-policy (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:07.521143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-82b38e42-61a2-422c-8547-eb0d28582109 admin admin] Publish callbacks [] for subnetpool (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:07.522307 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-82b38e42-61a2-422c-8547-eb0d28582109 admin admin] 10.222.0.20 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.5933957 Mar 24 02:04:09.984808 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54048) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:10.287307 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Request body: {'network': {'name': 'private', 'admin_state_up': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:04:10.316240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Made reservation on behalf of 7639f766c1674648bb5b73525f7f9ffd for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:04:10.320393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:10.336581 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:10.441978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Publish callbacks [] for security_group (6360e037-f20a-4d78-a2c2-ccdaa559e2de), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:10.445631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (6360e037-f20a-4d78-a2c2-ccdaa559e2de), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:10.469683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 117} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:04:10.503572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8790618681146', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:10.504141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Unsubscribe: segment precommit_create {{(pid=104037) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Mar 24 02:04:10.504635 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Added segment c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59 of type vlan for network 76d1a24d-8e14-4176-91af-1ffa9351f809 Mar 24 02:04:10.519520 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Pushing event updated for resources: {'SecurityGroup': ['ID=6360e037-f20a-4d78-a2c2-ccdaa559e2de,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:10.567259 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.567594 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.567944 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.568276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.568598 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.568916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.569234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.569574 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.570186 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.570507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.570860 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.571193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.571507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.571815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.572125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Tracked resource versions report: Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: pushed versions: Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: { 'AddressGroup': {'1.2'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Agent': {'1.1'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'ConntrackHelper': {'1.0'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'LocalIPAssociation': {'1.0'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Log': {'1.0'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'NDPProxy': {'1.0'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Network': {'1.1'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Port': {'1.7'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'PortForwarding': {'1.3'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'QosPolicy': {'1.10'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SecurityGroup': {'1.5'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SecurityGroupRule': {'1.2'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SubPort': {'1.0'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Subnet': {'1.1'}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Trunk': {'1.1'}} Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: consumer versions: Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: { DHCP agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: L3 agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: Metadata agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: Metering agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: Open vSwitch agent@dv-neutron-834874-3-hyperv: { 'AddressGroup': '1.2', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Agent': '1.1', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'ConntrackHelper': '1.0', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'LocalIPAssociation': '1.0', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Log': '1.0', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'NDPProxy': '1.0', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Network': '1.1', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Port': '1.7', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'PortForwarding': '1.3', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'QosPolicy': '1.10', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SecurityGroup': '1.5', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SecurityGroupRule': '1.2', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SubPort': '1.0', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Subnet': '1.1', Mar 24 02:04:10.573546 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Trunk': '1.1'}} Mar 24 02:04:10.575994 dv-neutron-834874-3-hyperv neutron-server[104037]: {{(pid=104037) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Mar 24 02:04:10.614986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (76d1a24d-8e14-4176-91af-1ffa9351f809), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:10.655217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (76d1a24d-8e14-4176-91af-1ffa9351f809), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:10.660432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:04:10.661140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:10.759857 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 748 time: 0.7736576 Mar 24 02:04:10.777385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62bf9c3b-6372-4601-9221-81ce63b48ddf demo demo] Pushing event updated for resources: {'Network': ['ID=76d1a24d-8e14-4176-91af-1ffa9351f809,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:10.792423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 76d1a24d-8e14-4176-91af-1ffa9351f809 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:04:13.318093 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54060) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:13.721209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02ac7c65-b04c-44d2-931b-f9e80b189a87 demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:04:13.722869 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-02ac7c65-b04c-44d2-931b-f9e80b189a87 demo admin] 10.222.0.20 "GET /v2.0/networks/76d1a24d-8e14-4176-91af-1ffa9351f809 HTTP/1.1" status: 200 len: 825 time: 0.4037709 Mar 24 02:04:13.747173 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dc01db71-7d4f-407a-a363-ec3487e04d25 demo admin] 10.222.0.20 "GET /v2.0/subnetpools/84e92a89-ac87-4b0c-b525-3a98de612976 HTTP/1.1" status: 200 len: 734 time: 0.0180869 Mar 24 02:04:13.755577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Request body: {'subnet': {'name': 'private-subnet', 'subnetpool_id': '84e92a89-ac87-4b0c-b525-3a98de612976', 'gateway_ip': '172.20.0.1', 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809', 'ip_version': 4}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:04:13.776681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Made reservation on behalf of 7639f766c1674648bb5b73525f7f9ffd for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:04:13.779215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Publish callbacks [] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:14.063153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:14.130511 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Pushing event updated for resources: {'Subnet': ['ID=9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:14.135857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Checking segment: {'id': 'c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:04:14.136244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Network hostable DHCP agents. Network: 76d1a24d-8e14-4176-91af-1ffa9351f809, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:04:14.156781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Network 76d1a24d-8e14-4176-91af-1ffa9351f809 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:04:14.167326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 76d1a24d-8e14-4176-91af-1ffa9351f809) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:04:14.172558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:04:14.173593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:14.177167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f521bf2e-ce42-4bb7-9853-5c6da5948cdf None None] Network 76d1a24d-8e14-4176-91af-1ffa9351f809 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:04:14.193551 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-258be0f7-201d-43aa-86c4-ccea13f92c3d demo admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4412577 Mar 24 02:04:14.559585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-76d1a24d-8e14-4176-91af-1ffa9351f809', 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809', 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'fixed_ips': [{'subnet_id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:04:14.560839 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:14.830027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Allocated IP 172.20.0.2 (76d1a24d-8e14-4176-91af-1ffa9351f809/9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9/d0713192-17a5-4111-83d8-5e720632e015) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:04:15.097810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Publish callbacks [] for port (d0713192-17a5-4111-83d8-5e720632e015), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:15.106296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (d0713192-17a5-4111-83d8-5e720632e015), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:15.196026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Pushing event updated for resources: {'Port': ['ID=d0713192-17a5-4111-83d8-5e720632e015,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:15.204289 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.204644 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.205168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.205517 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.205850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.206182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.206509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.206855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.207193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.207526 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.207872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.208216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.208536 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.208854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.209167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Tracked resource versions report: Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: pushed versions: Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: { 'AddressGroup': {'1.2'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Agent': {'1.1'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'ConntrackHelper': {'1.0'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'LocalIPAssociation': {'1.0'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Log': {'1.0'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'NDPProxy': {'1.0'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Network': {'1.1'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Port': {'1.7'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'PortForwarding': {'1.3'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'QosPolicy': {'1.10'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SecurityGroup': {'1.5'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SecurityGroupRule': {'1.2'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SubPort': {'1.0'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Subnet': {'1.1'}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Trunk': {'1.1'}} Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: consumer versions: Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: { DHCP agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: L3 agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: Metadata agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: Metering agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: Open vSwitch agent@dv-neutron-834874-3-hyperv: { 'AddressGroup': '1.2', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Agent': '1.1', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'ConntrackHelper': '1.0', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'LocalIPAssociation': '1.0', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Log': '1.0', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'NDPProxy': '1.0', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Network': '1.1', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Port': '1.7', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'PortForwarding': '1.3', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'QosPolicy': '1.10', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SecurityGroup': '1.5', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SecurityGroupRule': '1.2', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SubPort': '1.0', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Subnet': '1.1', Mar 24 02:04:15.210661 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Trunk': '1.1'}} Mar 24 02:04:15.212618 dv-neutron-834874-3-hyperv neutron-server[104038]: {{(pid=104038) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Mar 24 02:04:15.220069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Network 76d1a24d-8e14-4176-91af-1ffa9351f809 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:04:15.221815 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:04:15.226093 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:04:15.300604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Attempting to bind port d0713192-17a5-4111-83d8-5e720632e015 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:04:15.301001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Attempting to bind port d0713192-17a5-4111-83d8-5e720632e015 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:04:15.301442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Attempting to bind port d0713192-17a5-4111-83d8-5e720632e015 on network 76d1a24d-8e14-4176-91af-1ffa9351f809 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:04:15.307031 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 4, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:04:15.307396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Checking segment: {'id': 'c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:04:15.308129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:15.308515 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Bound using segment: {'id': 'c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:04:15.308993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Bound port: d0713192-17a5-4111-83d8-5e720632e015, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:04:15.309397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d0713192-17a5-4111-83d8-5e720632e015), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:15.371836 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] For port d0713192-17a5-4111-83d8-5e720632e015, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:04:15.376253 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] For port d0713192-17a5-4111-83d8-5e720632e015, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d0713192-17a5-4111-83d8-5e720632e015,segment=NetworkSegment(c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59),segment_id=c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:04:15.387297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d0713192-17a5-4111-83d8-5e720632e015), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:15.449636 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db66e36b-2fad-43ce-b63d-f7e0df629042 None None] Pushing event updated for resources: {'Port': ['ID=d0713192-17a5-4111-83d8-5e720632e015,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:16.748771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54068) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:17.071329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-2e6a8fd1-bc00-4169-af11-437214affec0 admin admin] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:04:17.072730 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2e6a8fd1-bc00-4169-af11-437214affec0 admin admin] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3228800 Mar 24 02:04:19.595853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54076) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:19.908107 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-f0d47ea7-a70d-4392-8d40-23a7d6205506 admin admin] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:04:19.909078 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f0d47ea7-a70d-4392-8d40-23a7d6205506 admin admin] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3123081 Mar 24 02:04:22.459433 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54084) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:22.759948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2a111d88-8baf-4f0d-95d0-c4d6d07f3392 demo demo] Request body: {'router': {'name': 'router1', 'admin_state_up': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:04:22.782953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2a111d88-8baf-4f0d-95d0-c4d6d07f3392 demo demo] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (7c73b072-791e-4be9-9d00-3635fa31e1af), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:22.784485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2a111d88-8baf-4f0d-95d0-c4d6d07f3392 demo demo] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (7c73b072-791e-4be9-9d00-3635fa31e1af), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:22.916517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2a111d88-8baf-4f0d-95d0-c4d6d07f3392 demo demo] Publish callbacks [] for router_controller (7c73b072-791e-4be9-9d00-3635fa31e1af), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:22.921176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2a111d88-8baf-4f0d-95d0-c4d6d07f3392 demo demo] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (7c73b072-791e-4be9-9d00-3635fa31e1af), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:22.938120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2a111d88-8baf-4f0d-95d0-c4d6d07f3392 demo demo] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:22.939838 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2a111d88-8baf-4f0d-95d0-c4d6d07f3392 demo demo] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 674 time: 0.4788842 Mar 24 02:04:25.456018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 54096) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:25.962850 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING oslo_policy.policy [None req-8553e33d-39c0-4de9-8860-cdb20ec4ba72 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Mar 24 02:04:25.963503 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING oslo_policy.policy [None req-8553e33d-39c0-4de9-8860-cdb20ec4ba72 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Mar 24 02:04:26.189222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-8553e33d-39c0-4de9-8860-cdb20ec4ba72 admin admin] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:04:26.190510 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8553e33d-39c0-4de9-8860-cdb20ec4ba72 admin admin] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7324638 Mar 24 02:04:26.441087 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d0713192-17a5-4111-83d8-5e720632e015 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:04:26.530930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d0713192-17a5-4111-83d8-5e720632e015 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:26.531345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d0713192-17a5-4111-83d8-5e720632e015), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:26.640563 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d0713192-17a5-4111-83d8-5e720632e015 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:04:26.641145 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d0713192-17a5-4111-83d8-5e720632e015), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:26.676069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d0713192-17a5-4111-83d8-5e720632e015, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d0713192-17a5-4111-83d8-5e720632e015,segment=NetworkSegment(c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59),segment_id=c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:04:26.678436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd2c16c9-5fc8-4c2c-8563-458512062f2c None None] Network 76d1a24d-8e14-4176-91af-1ffa9351f809 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:04:26.681650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d0713192-17a5-4111-83d8-5e720632e015), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:26.780372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d0713192-17a5-4111-83d8-5e720632e015,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:26.808842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-86557885-19a0-42a5-bf6e-19a73bc767b5 None None] Provisioning complete for port d0713192-17a5-4111-83d8-5e720632e015 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:26.809235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-86557885-19a0-42a5-bf6e-19a73bc767b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d0713192-17a5-4111-83d8-5e720632e015), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:26.921091 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-86557885-19a0-42a5-bf6e-19a73bc767b5 None None] Current status of the port d0713192-17a5-4111-83d8-5e720632e015 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:04:27.143329 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d06c11ef-bc4a-41ea-b63b-f4975a442398 None None] Provisioning complete for port d0713192-17a5-4111-83d8-5e720632e015 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:27.143643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d06c11ef-bc4a-41ea-b63b-f4975a442398 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d0713192-17a5-4111-83d8-5e720632e015), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:27.220742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d06c11ef-bc4a-41ea-b63b-f4975a442398 None None] Current status of the port d0713192-17a5-4111-83d8-5e720632e015 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:04:27.310914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cfb16f21-bd86-4d03-ae09-1c0dc61a4297 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:28.406903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d0713192-17a5-4111-83d8-5e720632e015 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:04:28.454480 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d0713192-17a5-4111-83d8-5e720632e015 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:28.454808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d0713192-17a5-4111-83d8-5e720632e015), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:28.531049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d0713192-17a5-4111-83d8-5e720632e015 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:04:28.764691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 54112) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:29.070086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Request body: {'network': {'router:external': True, 'admin_state_up': True, 'name': 'public', 'is_default': True, 'provider:physical_network': 'physnet1', 'provider:network_type': 'flat'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:04:29.128512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Made reservation on behalf of 4af97cb4dcc3444095ab94b4b9ad4054 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:04:29.190351 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.policy [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=104036) register_rules /opt/stack/neutron/neutron/policy.py:73}} Mar 24 02:04:29.232283 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING oslo_policy.policy [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Mar 24 02:04:29.232648 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING oslo_policy.policy [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Mar 24 02:04:29.242833 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:29.263264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:29.368374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Publish callbacks [] for security_group (1657f6fd-1cb0-49de-9051-102113f4c27d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:29.372482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1657f6fd-1cb0-49de-9051-102113f4c27d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:29.384027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Reserving flat network on physical network physnet1 {{(pid=104036) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Mar 24 02:04:29.415711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8790618681146', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (264954c7-3886-4156-b0b1-3c7a748de9f9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:29.416313 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Unsubscribe: segment precommit_create {{(pid=104036) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Mar 24 02:04:29.416835 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Added segment 264954c7-3886-4156-b0b1-3c7a748de9f9 of type flat for network 87077e4c-2cae-4de7-847c-fab7ddedd260 Mar 24 02:04:29.433695 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1657f6fd-1cb0-49de-9051-102113f4c27d,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:29.483237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.483585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.483934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.484269 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.484596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.484918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.485240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.485560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.485891 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.486212 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.486568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.486893 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.487206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.487516 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.487825 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Tracked resource versions report: Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: pushed versions: Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: { 'AddressGroup': {'1.2'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Agent': {'1.1'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'ConntrackHelper': {'1.0'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'LocalIPAssociation': {'1.0'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Log': {'1.0'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'NDPProxy': {'1.0'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Network': {'1.1'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Port': {'1.7'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'PortForwarding': {'1.3'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'QosPolicy': {'1.10'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SecurityGroup': {'1.5'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SecurityGroupRule': {'1.2'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SubPort': {'1.0'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Subnet': {'1.1'}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Trunk': {'1.1'}} Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: consumer versions: Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: { DHCP agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: L3 agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: Metadata agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: Metering agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: Open vSwitch agent@dv-neutron-834874-3-hyperv: { 'AddressGroup': '1.2', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Agent': '1.1', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'ConntrackHelper': '1.0', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'LocalIPAssociation': '1.0', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Log': '1.0', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'NDPProxy': '1.0', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Network': '1.1', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Port': '1.7', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'PortForwarding': '1.3', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'QosPolicy': '1.10', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SecurityGroup': '1.5', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SecurityGroupRule': '1.2', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SubPort': '1.0', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Subnet': '1.1', Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Trunk': '1.1'}} Mar 24 02:04:29.489271 dv-neutron-834874-3-hyperv neutron-server[104036]: {{(pid=104036) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Mar 24 02:04:29.534913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (87077e4c-2cae-4de7-847c-fab7ddedd260), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:29.577957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (87077e4c-2cae-4de7-847c-fab7ddedd260), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:29.579174 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:04:29.579877 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:29.664923 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.8991127 Mar 24 02:04:29.683200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ae973cc-92c0-4a09-a597-48880fe2b123 admin admin] Pushing event updated for resources: {'Network': ['ID=87077e4c-2cae-4de7-847c-fab7ddedd260,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:29.694742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:04:29.745181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-58a3b2bf-c721-427c-8d85-1447ab89f603 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:30.747131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:32.172099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54136) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:32.305338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:32.346231 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89b04547-7dcf-4a3a-a817-8152d72a2d98 demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:04:32.347567 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-89b04547-7dcf-4a3a-a817-8152d72a2d98 demo admin] 10.222.0.20 "GET /v2.0/subnets/9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9 HTTP/1.1" status: 200 len: 849 time: 0.1745446 Mar 24 02:04:32.467496 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a09a3a9b-634c-426b-9ba5-baa1ff53acb2 demo admin] 10.222.0.20 "GET /v2.0/routers/7c73b072-791e-4be9-9d00-3635fa31e1af HTTP/1.1" status: 200 len: 704 time: 0.1136127 Mar 24 02:04:32.735988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.024658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Allocated IP 172.20.0.1 (76d1a24d-8e14-4176-91af-1ffa9351f809/9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9/cca3c826-ec2e-482c-af1f-9a2edab75d3d) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:04:33.222466 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Publish callbacks [] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.286025 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.348369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Network 76d1a24d-8e14-4176-91af-1ffa9351f809 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:04:33.356126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:04:33.359355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:04:33.359822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (7c73b072-791e-4be9-9d00-3635fa31e1af), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.431384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Pushing event updated for resources: {'Port': ['ID=cca3c826-ec2e-482c-af1f-9a2edab75d3d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:33.571609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.619696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-465c4dbf-b7a3-4476-b4b6-d6b14777e0d9 None None] Provisioning complete for port cca3c826-ec2e-482c-af1f-9a2edab75d3d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:33.620292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-465c4dbf-b7a3-4476-b4b6-d6b14777e0d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.664397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-465c4dbf-b7a3-4476-b4b6-d6b14777e0d9 None None] Port cca3c826-ec2e-482c-af1f-9a2edab75d3d cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:04:33.670280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.780539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Publish callbacks [] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.784721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.785467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (7c73b072-791e-4be9-9d00-3635fa31e1af), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:33.857943 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Pushing event updated for resources: {'Port': ['ID=cca3c826-ec2e-482c-af1f-9a2edab75d3d,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:33.903683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Network 76d1a24d-8e14-4176-91af-1ffa9351f809 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:04:33.905242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:04:34.068690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Router 7c73b072-791e-4be9-9d00-3635fa31e1af is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:04:34.164083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:04:34.169304 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-34cd2253-ff0d-458a-9fd4-fbb536f8f4f6 demo admin] 10.222.0.20 "PUT /v2.0/routers/7c73b072-791e-4be9-9d00-3635fa31e1af/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.6901586 Mar 24 02:04:34.181958 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Sync routers for ids ['7c73b072-791e-4be9-9d00-3635fa31e1af'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:04:34.192846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fac1a6df-0d59-4f08-9e28-7509dfb308f4 None None] Provisioning complete for port cca3c826-ec2e-482c-af1f-9a2edab75d3d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:34.193240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fac1a6df-0d59-4f08-9e28-7509dfb308f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:34.193346 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Routers {'7c73b072-791e-4be9-9d00-3635fa31e1af'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:04:34.194151 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:04:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7c73b072-791e-4be9-9d00-3635fa31e1af'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:34.228683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fac1a6df-0d59-4f08-9e28-7509dfb308f4 None None] Port cca3c826-ec2e-482c-af1f-9a2edab75d3d cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:04:34.385607 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Set router 7c73b072-791e-4be9-9d00-3635fa31e1af gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:04:34.813058 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'name': 'router1', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:04:22Z', 'updated_at': '2022-03-24T02:04:33Z', 'revision_number': 2, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'gw_port_host': None, '_interfaces': [{'id': 'cca3c826-ec2e-482c-af1f-9a2edab75d3d', 'name': '', 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'mac_address': 'fa:16:3e:7d:3d:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:04:32Z', 'updated_at': '2022-03-24T02:04:33Z', 'revision_number': 2, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'subnets': [{'id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '84e92a89-ac87-4b0c-b525-3a98de612976'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:34.863754 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Checking router: 7c73b072-791e-4be9-9d00-3635fa31e1af for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:04:34.864127 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Updating router 7c73b072-791e-4be9-9d00-3635fa31e1af port cca3c826-ec2e-482c-af1f-9a2edab75d3d binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:04:34.915771 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:35.422278 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Publish callbacks [] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:35.428066 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:35.589921 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Pushing event updated for resources: {'Port': ['ID=cca3c826-ec2e-482c-af1f-9a2edab75d3d,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:35.601469 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Attempting to bind port cca3c826-ec2e-482c-af1f-9a2edab75d3d on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:04:35.601868 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Attempting to bind port cca3c826-ec2e-482c-af1f-9a2edab75d3d by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:04:35.602314 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Attempting to bind port cca3c826-ec2e-482c-af1f-9a2edab75d3d on network 76d1a24d-8e14-4176-91af-1ffa9351f809 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:04:35.605048 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.605389 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.605731 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.606066 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.606393 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.606743 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.607067 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.607386 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.607710 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.608028 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.608361 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.608693 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.609011 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.609322 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.609634 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Tracked resource versions report: Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: pushed versions: Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: { 'AddressGroup': {'1.2'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Agent': {'1.1'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'ConntrackHelper': {'1.0'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'LocalIPAssociation': {'1.0'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Log': {'1.0'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'NDPProxy': {'1.0'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Network': {'1.1'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Port': {'1.7'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'PortForwarding': {'1.3'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'QosPolicy': {'1.10'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SecurityGroup': {'1.5'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SecurityGroupRule': {'1.2'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SubPort': {'1.0'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Subnet': {'1.1'}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Trunk': {'1.1'}} Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: consumer versions: Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: { DHCP agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: L3 agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: Metadata agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: Metering agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: Open vSwitch agent@dv-neutron-834874-3-hyperv: { 'AddressGroup': '1.2', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Agent': '1.1', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'ConntrackHelper': '1.0', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'LocalIPAssociation': '1.0', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Log': '1.0', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'NDPProxy': '1.0', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Network': '1.1', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Port': '1.7', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'PortForwarding': '1.3', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'QosPolicy': '1.10', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SecurityGroup': '1.5', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SecurityGroupRule': '1.2', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SubPort': '1.0', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Subnet': '1.1', Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Trunk': '1.1'}} Mar 24 02:04:35.611112 dv-neutron-834874-3-hyperv neutron-server[104039]: {{(pid=104039) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Mar 24 02:04:35.618785 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 4, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:04:35.619185 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Checking segment: {'id': 'c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:04:35.619656 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:35.620033 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Bound using segment: {'id': 'c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:04:35.620536 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Bound port: cca3c826-ec2e-482c-af1f-9a2edab75d3d, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:04:35.620921 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:35.661105 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1125c1d4-9dcc-4239-99c8-5b78172bc5be None None] Provisioning complete for port cca3c826-ec2e-482c-af1f-9a2edab75d3d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:35.661648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1125c1d4-9dcc-4239-99c8-5b78172bc5be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:35.688834 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] For port cca3c826-ec2e-482c-af1f-9a2edab75d3d, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:04:35.695603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1125c1d4-9dcc-4239-99c8-5b78172bc5be None None] Port cca3c826-ec2e-482c-af1f-9a2edab75d3d cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:04:35.711020 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] For port cca3c826-ec2e-482c-af1f-9a2edab75d3d, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=cca3c826-ec2e-482c-af1f-9a2edab75d3d,segment=NetworkSegment(c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59),segment_id=c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:04:35.716764 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:35.775906 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476b7375-826f-40df-a334-0ae2e9d3e969 None None] Pushing event updated for resources: {'Port': ['ID=cca3c826-ec2e-482c-af1f-9a2edab75d3d,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:35.780940 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Routers {'7c73b072-791e-4be9-9d00-3635fa31e1af'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:04:35.781550 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:04:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7c73b072-791e-4be9-9d00-3635fa31e1af'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:35.872018 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] Set router 7c73b072-791e-4be9-9d00-3635fa31e1af gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:04:35.915141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f202c7f-95f1-43dc-bb9e-624fbcd3dd05 None None] Provisioning complete for port cca3c826-ec2e-482c-af1f-9a2edab75d3d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:35.915658 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f202c7f-95f1-43dc-bb9e-624fbcd3dd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:35.993467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f202c7f-95f1-43dc-bb9e-624fbcd3dd05 None None] Current status of the port cca3c826-ec2e-482c-af1f-9a2edab75d3d is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:04:35.993788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f202c7f-95f1-43dc-bb9e-624fbcd3dd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:36.029846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f202c7f-95f1-43dc-bb9e-624fbcd3dd05 None None] For port cca3c826-ec2e-482c-af1f-9a2edab75d3d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=cca3c826-ec2e-482c-af1f-9a2edab75d3d,segment=NetworkSegment(c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59),segment_id=c0fb6aa3-90de-4bf1-98a9-1ed6c2a40c59)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:04:36.034417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f202c7f-95f1-43dc-bb9e-624fbcd3dd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:36.085924 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f202c7f-95f1-43dc-bb9e-624fbcd3dd05 None None] Pushing event updated for resources: {'Port': ['ID=cca3c826-ec2e-482c-af1f-9a2edab75d3d,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:36.095820 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'name': 'router1', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:04:22Z', 'updated_at': '2022-03-24T02:04:33Z', 'revision_number': 2, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'gw_port_host': None, '_interfaces': [{'id': 'cca3c826-ec2e-482c-af1f-9a2edab75d3d', 'name': '', 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'mac_address': 'fa:16:3e:7d:3d:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:04:32Z', 'updated_at': '2022-03-24T02:04:35Z', 'revision_number': 4, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'subnets': [{'id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '84e92a89-ac87-4b0c-b525-3a98de612976'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:36.122133 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59b92c39-2653-43ba-b0e9-7233abb90655 None None] The sync data for ids ['7c73b072-791e-4be9-9d00-3635fa31e1af'] in dv-neutron-834874-3-hyperv is: [{'id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'name': 'router1', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:04:22Z', 'updated_at': '2022-03-24T02:04:33Z', 'revision_number': 2, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'gw_port_host': None, '_interfaces': [{'id': 'cca3c826-ec2e-482c-af1f-9a2edab75d3d', 'name': '', 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'mac_address': 'fa:16:3e:7d:3d:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:04:32Z', 'updated_at': '2022-03-24T02:04:35Z', 'revision_number': 4, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'subnets': [{'id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '84e92a89-ac87-4b0c-b525-3a98de612976'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:04:36.652153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54156) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:36.760813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4ec4e2d-8bf9-44e6-8ff8-13a80836c975 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:04:36.762184 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e4ec4e2d-8bf9-44e6-8ff8-13a80836c975 admin admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 842 time: 0.1090739 Mar 24 02:04:36.771487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Request body: {'subnet': {'enable_dhcp': False, 'gateway_ip': '172.26.2.1', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'cidr': '172.26.2.0/24', 'name': 'public-subnet', 'ip_version': 4}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:04:36.793647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Made reservation on behalf of 4af97cb4dcc3444095ab94b4b9ad4054 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:04:36.795977 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:37.070797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:04:37.071227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (955ffda0-7483-48fb-907d-2aae140ffeb8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:37.123015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Pushing event updated for resources: {'Subnet': ['ID=955ffda0-7483-48fb-907d-2aae140ffeb8,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:37.131201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:04:37.132090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Network hostable DHCP agents. Network: 87077e4c-2cae-4de7-847c-fab7ddedd260, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:04:37.148419 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:04:37.157383 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 87077e4c-2cae-4de7-847c-fab7ddedd260) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:04:37.164010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:04:37.164010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:37.173918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47c643cf-1fc7-42f3-abdf-33843c5f55ae None None] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:04:37.189931 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-027b22e6-ee66-4033-8552-f7dc54047c77 admin admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4216931 Mar 24 02:04:37.282452 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da0d3585-d4ab-4f07-a1fc-60175f380579 None None] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:04:39.582292 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 54164) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:39.843821 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-32aa6c0d-dbae-42f4-a691-14747495b07f demo admin] 10.222.0.20 "GET /v2.0/routers/7c73b072-791e-4be9-9d00-3635fa31e1af HTTP/1.1" status: 200 len: 710 time: 0.2604060 Mar 24 02:04:39.970462 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:04:40.008077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f84b78ee-05ad-473b-9daa-f8fd4f64681c demo admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:04:40.009468 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f84b78ee-05ad-473b-9daa-f8fd4f64681c demo admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 886 time: 0.1603658 Mar 24 02:04:40.018107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:04:40.268947 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Publish callbacks [] for router_gateway (7c73b072-791e-4be9-9d00-3635fa31e1af), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:40.503006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Publish callbacks [] for router_gateway (7c73b072-791e-4be9-9d00-3635fa31e1af), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:40.577241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:40.757092 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Allocated IP 172.26.2.168 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/47c99abf-01ca-4f5d-999b-846e6e335516) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:04:40.864592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Publish callbacks [] for port (47c99abf-01ca-4f5d-999b-846e6e335516), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:40.921793 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (47c99abf-01ca-4f5d-999b-846e6e335516), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:40.994694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:04:41.001185 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:04:41.013553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:04:41.016308 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Pushing event updated for resources: {'Port': ['ID=47c99abf-01ca-4f5d-999b-846e6e335516,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:41.343172 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Publish callbacks [] for router_gateway (7c73b072-791e-4be9-9d00-3635fa31e1af), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:41.558690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (7c73b072-791e-4be9-9d00-3635fa31e1af), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:41.564036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (7c73b072-791e-4be9-9d00-3635fa31e1af), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:41.674580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Router 7c73b072-791e-4be9-9d00-3635fa31e1af has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:04:41.782273 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:04:41.787301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:41.788514 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-903b05a9-1918-4df4-b20c-8a624c46f4e7 demo admin] 10.222.0.20 "PUT /v2.0/routers/7c73b072-791e-4be9-9d00-3635fa31e1af HTTP/1.1" status: 200 len: 890 time: 1.7734995 Mar 24 02:04:44.342395 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 54176) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:04:44.442094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device cca3c826-ec2e-482c-af1f-9a2edab75d3d up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:04:44.467062 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f7f69fd6-76b5-4b8a-b768-9769d4367a02 admin admin] 10.222.0.20 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1234288 Mar 24 02:04:44.492840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port cca3c826-ec2e-482c-af1f-9a2edab75d3d triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:44.493233 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:44.581308 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port cca3c826-ec2e-482c-af1f-9a2edab75d3d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:04:44.793391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Sync routers for ids ['7c73b072-791e-4be9-9d00-3635fa31e1af'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:04:44.807859 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Routers {'7c73b072-791e-4be9-9d00-3635fa31e1af'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:04:44.808860 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:04:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7c73b072-791e-4be9-9d00-3635fa31e1af'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:45.033404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Set router 7c73b072-791e-4be9-9d00-3635fa31e1af gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:04:45.489942 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'name': 'router1', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.168'}], 'enable_snat': True}, 'gw_port_id': '47c99abf-01ca-4f5d-999b-846e6e335516', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:04:22Z', 'updated_at': '2022-03-24T02:04:41Z', 'revision_number': 4, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'gw_port': {'id': '47c99abf-01ca-4f5d-999b-846e6e335516', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:73:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:04:40Z', 'updated_at': '2022-03-24T02:04:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'cca3c826-ec2e-482c-af1f-9a2edab75d3d', 'name': '', 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'mac_address': 'fa:16:3e:7d:3d:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:04:32Z', 'updated_at': '2022-03-24T02:04:36Z', 'revision_number': 5, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'subnets': [{'id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '84e92a89-ac87-4b0c-b525-3a98de612976'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:45.538190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Checking router: 7c73b072-791e-4be9-9d00-3635fa31e1af for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:04:45.538573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Updating router 7c73b072-791e-4be9-9d00-3635fa31e1af port 47c99abf-01ca-4f5d-999b-846e6e335516 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:04:45.589217 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (47c99abf-01ca-4f5d-999b-846e6e335516), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:45.917209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Publish callbacks [] for port (47c99abf-01ca-4f5d-999b-846e6e335516), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:45.923351 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (47c99abf-01ca-4f5d-999b-846e6e335516), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:45.968810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Attempting to bind port 47c99abf-01ca-4f5d-999b-846e6e335516 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:04:45.969181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Attempting to bind port 47c99abf-01ca-4f5d-999b-846e6e335516 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:04:45.969548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Attempting to bind port 47c99abf-01ca-4f5d-999b-846e6e335516 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:04:45.980541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 4, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:04:45.980918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:04:45.981317 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:45.981709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:04:45.982176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Bound port: 47c99abf-01ca-4f5d-999b-846e6e335516, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:04:45.982583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (47c99abf-01ca-4f5d-999b-846e6e335516), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:45.987332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d0093c-f4d7-42ec-b075-fa1505013640 None None] Pushing event updated for resources: {'Port': ['ID=47c99abf-01ca-4f5d-999b-846e6e335516,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:46.035149 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] For port 47c99abf-01ca-4f5d-999b-846e6e335516, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:04:46.039383 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] For port 47c99abf-01ca-4f5d-999b-846e6e335516, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=47c99abf-01ca-4f5d-999b-846e6e335516,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:04:46.044829 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (47c99abf-01ca-4f5d-999b-846e6e335516), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:46.092583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Routers {'7c73b072-791e-4be9-9d00-3635fa31e1af'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:04:46.093182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:04:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7c73b072-791e-4be9-9d00-3635fa31e1af'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:46.182376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d0093c-f4d7-42ec-b075-fa1505013640 None None] Pushing event updated for resources: {'Port': ['ID=47c99abf-01ca-4f5d-999b-846e6e335516,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:46.222659 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] Set router 7c73b072-791e-4be9-9d00-3635fa31e1af gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:04:46.446972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'name': 'router1', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.168'}], 'enable_snat': True}, 'gw_port_id': '47c99abf-01ca-4f5d-999b-846e6e335516', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:04:22Z', 'updated_at': '2022-03-24T02:04:41Z', 'revision_number': 4, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'gw_port': {'id': '47c99abf-01ca-4f5d-999b-846e6e335516', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:73:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:04:40Z', 'updated_at': '2022-03-24T02:04:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'cca3c826-ec2e-482c-af1f-9a2edab75d3d', 'name': '', 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'mac_address': 'fa:16:3e:7d:3d:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:04:32Z', 'updated_at': '2022-03-24T02:04:36Z', 'revision_number': 5, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'subnets': [{'id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '84e92a89-ac87-4b0c-b525-3a98de612976'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:04:46.474469 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15080f2e-4f28-4a76-8032-e4075b62b60a None None] The sync data for ids ['7c73b072-791e-4be9-9d00-3635fa31e1af'] in dv-neutron-834874-3-hyperv is: [{'id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'name': 'router1', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.168'}], 'enable_snat': True}, 'gw_port_id': '47c99abf-01ca-4f5d-999b-846e6e335516', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:04:22Z', 'updated_at': '2022-03-24T02:04:41Z', 'revision_number': 4, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'gw_port': {'id': '47c99abf-01ca-4f5d-999b-846e6e335516', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:73:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:04:40Z', 'updated_at': '2022-03-24T02:04:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'cca3c826-ec2e-482c-af1f-9a2edab75d3d', 'name': '', 'network_id': '76d1a24d-8e14-4176-91af-1ffa9351f809', 'tenant_id': '7639f766c1674648bb5b73525f7f9ffd', 'mac_address': 'fa:16:3e:7d:3d:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c73b072-791e-4be9-9d00-3635fa31e1af', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:04:32Z', 'updated_at': '2022-03-24T02:04:36Z', 'revision_number': 5, 'project_id': '7639f766c1674648bb5b73525f7f9ffd', 'subnets': [{'id': '9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '84e92a89-ac87-4b0c-b525-3a98de612976'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:04:48.515060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 47c99abf-01ca-4f5d-999b-846e6e335516 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:04:48.598044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 47c99abf-01ca-4f5d-999b-846e6e335516 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:48.598426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (47c99abf-01ca-4f5d-999b-846e6e335516), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:48.707676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 47c99abf-01ca-4f5d-999b-846e6e335516 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:04:48.708067 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (47c99abf-01ca-4f5d-999b-846e6e335516), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:48.733171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 47c99abf-01ca-4f5d-999b-846e6e335516, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=47c99abf-01ca-4f5d-999b-846e6e335516,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:04:48.745427 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (47c99abf-01ca-4f5d-999b-846e6e335516), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:48.806439 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=47c99abf-01ca-4f5d-999b-846e6e335516,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:04:50.478456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 47c99abf-01ca-4f5d-999b-846e6e335516 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:04:50.588315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 47c99abf-01ca-4f5d-999b-846e6e335516 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:04:50.588920 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (47c99abf-01ca-4f5d-999b-846e6e335516), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:50.840039 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 47c99abf-01ca-4f5d-999b-846e6e335516 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:04:57.314099 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8d877613-f93e-44d8-bcde-c9076e74c6bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:04:59.688541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b2fee486-7387-445d-a039-88a1ee4410b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:00.754870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:02.314643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:03.669539 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:16.968460 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:05:27.315809 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-eb8650bb-74ff-4a56-87c9-4104d55bb2ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:29.693478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-62d90b00-4c17-457c-bea6-af137a1ad137 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:30.761513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:32.323842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:33.669378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:53.966317 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:05:57.320281 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3bba771b-8276-40dc-8dd2-631a10aa8026 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:05:59.696058 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d114e542-dcc1-4446-9d82-7803fb7a479c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:00.757716 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:02.319987 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:03.664417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:10.331607 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 54692) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:10.392202 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-359f9d55-05fe-420b-aa99-7ce42da679ad admin admin] GET failed (client error): The resource could not be found. Mar 24 02:06:10.393481 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-359f9d55-05fe-420b-aa99-7ce42da679ad admin admin] 10.222.0.20 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0608392 Mar 24 02:06:10.555245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a132eac-03ce-4081-8667-d53918c07228 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:10.556731 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5a132eac-03ce-4081-8667-d53918c07228 admin admin] 10.222.0.20 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1586018 Mar 24 02:06:12.880786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54702) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:13.037368 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4f374eb-af6f-46ae-aab6-15f4bd5971f6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:13.038759 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d4f374eb-af6f-46ae-aab6-15f4bd5971f6 admin admin] 10.222.0.20 "GET /v2.0/subnets/9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9 HTTP/1.1" status: 200 len: 849 time: 0.1570139 Mar 24 02:06:13.048088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:06:13.129917 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Publish callbacks [] for subnet (9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:13.272334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8790618889355'] for subnet (9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:13.303999 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:13.304478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-773a9e02-5851-4199-b4e8-c75dd2292b92 None None] Network 76d1a24d-8e14-4176-91af-1ffa9351f809 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:06:13.304916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:13.322583 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] 10.222.0.20 "PUT /v2.0/subnets/9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9 HTTP/1.1" status: 200 len: 868 time: 0.2613826 Mar 24 02:06:13.324525 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:06:13.331942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.332380 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.333436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.333792 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.334230 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.334602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.334949 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.335310 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.335666 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.336006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.336357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.336693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.337023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.337353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.337680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-974203cc-88e1-4bfc-8a41-6dfbb45f3611 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:06:13.670337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f94a0732-6340-4a34-bf31-808e75089fb6 None None] Provisioning complete for port cca3c826-ec2e-482c-af1f-9a2edab75d3d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:06:13.670747 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f94a0732-6340-4a34-bf31-808e75089fb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cca3c826-ec2e-482c-af1f-9a2edab75d3d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:13.746030 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f94a0732-6340-4a34-bf31-808e75089fb6 None None] Current status of the port cca3c826-ec2e-482c-af1f-9a2edab75d3d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:06:13.756243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f94a0732-6340-4a34-bf31-808e75089fb6 None None] Provisioning complete for port d0713192-17a5-4111-83d8-5e720632e015 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:06:13.756626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f94a0732-6340-4a34-bf31-808e75089fb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d0713192-17a5-4111-83d8-5e720632e015), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:13.840064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f94a0732-6340-4a34-bf31-808e75089fb6 None None] Current status of the port d0713192-17a5-4111-83d8-5e720632e015 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:06:15.613071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54712) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:15.811613 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0df5b353-a003-4b8d-89d9-5ab05956e4bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:15.812099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0df5b353-a003-4b8d-89d9-5ab05956e4bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:15.813773 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0df5b353-a003-4b8d-89d9-5ab05956e4bf admin admin] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1995907 Mar 24 02:06:18.124329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54720) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:18.251458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b4e8938-de2c-4b85-8969-bbb8a6e58548 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:18.251940 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b4e8938-de2c-4b85-8969-bbb8a6e58548 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:18.253437 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1b4e8938-de2c-4b85-8969-bbb8a6e58548 admin admin] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1281633 Mar 24 02:06:20.580190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54728) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:20.706334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a55b5dec-c975-43bb-8260-6943cc37076e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:20.708161 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a55b5dec-c975-43bb-8260-6943cc37076e admin admin] 10.222.0.20 "GET /v2.0/networks/76d1a24d-8e14-4176-91af-1ffa9351f809 HTTP/1.1" status: 200 len: 869 time: 0.1270282 Mar 24 02:06:23.005527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54736) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:23.126818 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec6fe600-3f9f-448c-bddc-a0ae16688001 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:23.128170 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ec6fe600-3f9f-448c-bddc-a0ae16688001 admin admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 886 time: 0.1217244 Mar 24 02:06:25.430771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54744) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:25.553589 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5de993d-9876-4be4-8b9d-37807270f578 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:25.554044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5de993d-9876-4be4-8b9d-37807270f578 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:25.559347 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a5de993d-9876-4be4-8b9d-37807270f578 admin admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1239281 Mar 24 02:06:27.324626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1016d1a1-8ec6-4e89-b217-0f5ca8ce4034 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:27.851216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54752) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:27.940971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e4289e6-dbf0-441f-8ac2-9894f4d887db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:27.942055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e4289e6-dbf0-441f-8ac2-9894f4d887db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:27.943620 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3e4289e6-dbf0-441f-8ac2-9894f4d887db admin admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0914130 Mar 24 02:06:29.697546 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e722d5c5-faec-4c0b-a15a-920b69efd9fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:30.252333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54760) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:30.340271 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f3b91c7-28f0-4de6-85c1-721e4a8e8805 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:30.341577 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5f3b91c7-28f0-4de6-85c1-721e4a8e8805 admin admin] 10.222.0.20 "GET /v2.0/subnets/955ffda0-7483-48fb-907d-2aae140ffeb8 HTTP/1.1" status: 200 len: 816 time: 0.0883117 Mar 24 02:06:30.761112 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:30.964089 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:06:32.323753 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:32.654731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54768) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:06:32.744246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d46e2742-b5ef-4832-972b-2d19a9c5fe0c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:06:32.745576 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d46e2742-b5ef-4832-972b-2d19a9c5fe0c admin admin] 10.222.0.20 "GET /v2.0/subnets/9ee4219b-4bb6-44d5-ba1b-cd0e0205e5c9 HTTP/1.1" status: 200 len: 868 time: 0.0898638 Mar 24 02:06:33.667044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:57.325776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21721d9c-7e76-46e4-b0b6-d12439464eab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:06:59.698982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5a6b6242-7973-4fdb-8e1f-22d2c8a2dcff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:00.737052 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54820) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:07:00.764877 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:00.786017 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-5e2c4868-de78-4df8-9d0e-96b46e3c5d50 admin admin] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:07:00.787209 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5e2c4868-de78-4df8-9d0e-96b46e3c5d50 admin admin] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0486133 Mar 24 02:07:02.326540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:03.161430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54828) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:07:03.221482 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-52bfdbd0-16be-41b8-8a90-3e17bef62472 admin admin] GET failed (client error): The resource could not be found. Mar 24 02:07:03.222746 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-52bfdbd0-16be-41b8-8a90-3e17bef62472 admin admin] 10.222.0.20 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0602674 Mar 24 02:07:03.362417 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5971b6be-e520-4f1d-81c9-ae063270fb79 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:07:03.364377 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5971b6be-e520-4f1d-81c9-ae063270fb79 admin admin] 10.222.0.20 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1377118 Mar 24 02:07:03.669588 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:05.684159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54836) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:07:05.732341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:07:05.778286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Made reservation on behalf of 4af97cb4dcc3444095ab94b4b9ad4054 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:07:05.780612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:05.808132 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.services.revisions.revision_plugin [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Could not find related network for resource to bump revision. Mar 24 02:07:05.821152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 102} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:07:05.830971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (76741202-0c69-4dbc-a88b-8b38a2b342f8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:05.831950 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Added segment 76741202-0c69-4dbc-a88b-8b38a2b342f8 of type vlan for network 3906d9dc-7796-41c4-8459-9ad7e1623924 Mar 24 02:07:05.872089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (3906d9dc-7796-41c4-8459-9ad7e1623924), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:05.895443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (3906d9dc-7796-41c4-8459-9ad7e1623924), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:05.896844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:07:05.897408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:05.972022 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2867336 Mar 24 02:07:05.988961 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68e9d0f7-3100-4c12-bfa0-8cac71781ae0 admin admin] Pushing event updated for resources: {'Network': ['ID=3906d9dc-7796-41c4-8459-9ad7e1623924,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:07:05.999461 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 3906d9dc-7796-41c4-8459-9ad7e1623924 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:07:07.962625 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:07:08.302216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54844) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:07:08.360896 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-dcbb802e-5673-4c36-a593-9af53319b95a admin admin] GET failed (client error): The resource could not be found. Mar 24 02:07:08.362139 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dcbb802e-5673-4c36-a593-9af53319b95a admin admin] 10.222.0.20 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0589430 Mar 24 02:07:08.428368 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e073fbb-d6b5-42cc-90e3-ab7e1d26579e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:07:08.429762 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1e073fbb-d6b5-42cc-90e3-ab7e1d26579e admin admin] 10.222.0.20 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0632341 Mar 24 02:07:08.439787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Request body: {'subnet': {'network_id': '3906d9dc-7796-41c4-8459-9ad7e1623924', 'description': 'shared-subnet', 'name': 'shared-subnet', 'ip_version': 4, 'cidr': '192.168.233.0/24'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:07:08.457246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Made reservation on behalf of 4af97cb4dcc3444095ab94b4b9ad4054 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:07:08.459519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:08.613887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (7c6e51f9-7c19-41c7-8c7c-edca42ab9bbe), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:08.666825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Pushing event updated for resources: {'Subnet': ['ID=7c6e51f9-7c19-41c7-8c7c-edca42ab9bbe,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:07:08.673188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Checking segment: {'id': '76741202-0c69-4dbc-a88b-8b38a2b342f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '3906d9dc-7796-41c4-8459-9ad7e1623924'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:07:08.673539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Network hostable DHCP agents. Network: 3906d9dc-7796-41c4-8459-9ad7e1623924, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:07:08.688988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Network 3906d9dc-7796-41c4-8459-9ad7e1623924 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:07:08.697448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 3906d9dc-7796-41c4-8459-9ad7e1623924) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:07:08.701405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:07:08.701984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:08.710290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a916101-38d8-451b-88df-3cea8ac7768e None None] Network 3906d9dc-7796-41c4-8459-9ad7e1623924 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:07:08.717216 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-190b0d17-da4b-4e84-98c4-9b97a32dd36f admin admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.2810462 Mar 24 02:07:08.815197 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-3906d9dc-7796-41c4-8459-9ad7e1623924', 'network_id': '3906d9dc-7796-41c4-8459-9ad7e1623924', 'project_id': '4af97cb4dcc3444095ab94b4b9ad4054', 'fixed_ips': [{'subnet_id': '7c6e51f9-7c19-41c7-8c7c-edca42ab9bbe'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:07:08.816652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:08.957381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Allocated IP 192.168.233.2 (3906d9dc-7796-41c4-8459-9ad7e1623924/7c6e51f9-7c19-41c7-8c7c-edca42ab9bbe/c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:07:09.193455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Publish callbacks [] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:09.199126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:09.233914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Network 3906d9dc-7796-41c4-8459-9ad7e1623924 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:07:09.236577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:07:09.240538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:07:09.250950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Pushing event updated for resources: {'Port': ['ID=c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:07:09.273189 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.273527 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.273862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.274193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.274562 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.274851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.275164 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.275475 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.275806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.276124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.276455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.276780 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.277103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.277397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.277701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:07:09.312597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Attempting to bind port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:07:09.312954 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Attempting to bind port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '76741202-0c69-4dbc-a88b-8b38a2b342f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '3906d9dc-7796-41c4-8459-9ad7e1623924'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:07:09.313306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Attempting to bind port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 on network 3906d9dc-7796-41c4-8459-9ad7e1623924 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:07:09.318858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 7, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:07:09.319207 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Checking segment: {'id': '76741202-0c69-4dbc-a88b-8b38a2b342f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '3906d9dc-7796-41c4-8459-9ad7e1623924'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:07:09.319600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:09.319990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Bound using segment: {'id': '76741202-0c69-4dbc-a88b-8b38a2b342f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '3906d9dc-7796-41c4-8459-9ad7e1623924'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:07:09.320435 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Bound port: c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '76741202-0c69-4dbc-a88b-8b38a2b342f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '3906d9dc-7796-41c4-8459-9ad7e1623924'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:07:09.320802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:09.383719 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] For port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:07:09.387441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] For port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1,segment=NetworkSegment(76741202-0c69-4dbc-a88b-8b38a2b342f8),segment_id=76741202-0c69-4dbc-a88b-8b38a2b342f8)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:07:09.394023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:09.456850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614117b0-a231-4485-bb7a-accc2797e872 None None] Pushing event updated for resources: {'Port': ['ID=c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:07:10.314681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4dee6a89-02b5-4aac-9c8e-ec709a04db54 None None] Network 3906d9dc-7796-41c4-8459-9ad7e1623924 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:07:10.403231 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8a0cc984-59bf-4adc-af37-2ab17a0627e3 None None] Provisioning complete for port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:07:10.403614 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8a0cc984-59bf-4adc-af37-2ab17a0627e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:10.532604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8a0cc984-59bf-4adc-af37-2ab17a0627e3 None None] Current status of the port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:07:10.533138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8a0cc984-59bf-4adc-af37-2ab17a0627e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:10.577367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8a0cc984-59bf-4adc-af37-2ab17a0627e3 None None] For port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1,segment=NetworkSegment(76741202-0c69-4dbc-a88b-8b38a2b342f8),segment_id=76741202-0c69-4dbc-a88b-8b38a2b342f8)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:07:10.597026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8a0cc984-59bf-4adc-af37-2ab17a0627e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:10.636608 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:07:10.703951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a0cc984-59bf-4adc-af37-2ab17a0627e3 None None] Pushing event updated for resources: {'Port': ['ID=c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:07:10.722183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:07:10.723342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:10.815784 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:07:10.825776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-43ef3181-fd70-4191-8142-4ad5e1da1543 None None] Provisioning complete for port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:07:10.826163 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-43ef3181-fd70-4191-8142-4ad5e1da1543 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:10.905756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-43ef3181-fd70-4191-8142-4ad5e1da1543 None None] Current status of the port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:07:12.498451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:07:12.547581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:07:12.547965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:12.622150 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port c9ae59eb-a807-491e-b3c3-4f8c1fc5cad1 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:07:27.328140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b9eba777-778d-4b77-b5f6-c29b6e1deb4f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:29.699762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-471240f3-c86a-45f6-aa97-0f1524cd23e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:30.766906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:32.329788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:33.671359 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:44.962378 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:07:57.330569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4f51d77e-7193-41c1-b24c-b578d82523be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:07:59.701420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0038157c-e465-4647-b80a-2fa09147b046 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:00.770016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:02.336167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:03.674103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:21.961673 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:08:27.331286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1111bdfa-81bd-440f-ac13-ee555a65ed28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:29.703198 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2950cfa7-d493-4c14-a769-1873c09ba343 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:30.773061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:32.344717 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:33.676246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:54.961175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54882) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:08:54.966863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-431a1395-2d5e-4f42-b121-264f1ad449f3 tempest-verify_tempest_config-425385 tempest-verify_tempest_config-425385-project] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:08:54.967884 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-431a1395-2d5e-4f42-b121-264f1ad449f3 tempest-verify_tempest_config-425385 tempest-verify_tempest_config-425385-project] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0057662 Mar 24 02:08:55.248071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54900) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:08:55.352512 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:55.509958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Publish callbacks [] for security_group (05b33d28-b1d4-4ddc-a282-cae3e032bb3e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:55.513494 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (05b33d28-b1d4-4ddc-a282-cae3e032bb3e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:55.556958 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=febeb1debdbf4325b8a5538825778185&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3078711 Mar 24 02:08:55.558047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05b33d28-b1d4-4ddc-a282-cae3e032bb3e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:08:55.559993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 54904) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:08:55.565559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.565559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.566460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.566839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.567179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.567512 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.567841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.568168 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.568519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.568852 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.569214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.569521 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.569843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.570167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.570542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22549e59-70c6-4a1c-880b-104f668c229e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.619127 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Publish callbacks [] for security_group (05b33d28-b1d4-4ddc-a282-cae3e032bb3e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:55.639794 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Publish callbacks [] for security_group (05b33d28-b1d4-4ddc-a282-cae3e032bb3e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:55.730279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (05b33d28-b1d4-4ddc-a282-cae3e032bb3e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:55.732820 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:55.733988 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/05b33d28-b1d4-4ddc-a282-cae3e032bb3e HTTP/1.1" status: 204 len: 168 time: 0.1724663 Mar 24 02:08:55.742136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05b33d28-b1d4-4ddc-a282-cae3e032bb3e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:08:55.748669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.749021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.749374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.749715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.750046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.750373 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.750731 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.751057 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.751393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.751717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.752252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.752699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.753027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.753408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:55.754410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd8cac86-29f0-4cfe-b4ca-6f28ba66c4a1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:08:57.332459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e74b4474-e093-4a0b-92c9-10fae5c7a9cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:08:58.959859 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:08:59.705293 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-be757dfd-6f93-4db7-bdd6-1b2fcccaf840 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:00.775159 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:02.343202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:03.678656 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:27.333501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-30eeebdc-daf7-4b18-a1d8-3f8d1b920bdb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:29.705872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d9656216-49bb-4f02-9510-77e5a2ca411d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:30.777469 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:32.345960 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:33.680218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:35.958510 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:09:57.334658 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5c010f9-174c-4695-aca3-9905dff7a624 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:09:59.708230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c203b4fb-c397-465d-8066-7671551d6878 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:00.780065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:02.351065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:03.681237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:12.958329 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 5 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:10:14.859073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1622305'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:27.336259 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-579bda3a-fe88-44f2-aa08-0d3aef1fde44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:29.259006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 54976) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:10:29.359962 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dacf681e-647a-476d-8d29-059090d41c4e admin admin] 10.222.0.20 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.0998290 Mar 24 02:10:29.709646 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-408d5261-410e-4ea2-ac0c-3bcefd274092 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:30.782462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:31.679794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 54986) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:10:31.739201 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-09edc365-5b64-42a3-85c8-c1b8f1b5d49c admin admin] 10.222.0.20 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.0583346 Mar 24 02:10:32.352467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:33.681866 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:44.839786 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:49.959850 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:10:57.339048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f58ba303-3e9a-43b1-aec6-5770283c495c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:10:59.712026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-08f2ee3e-1ad5-4c7b-a750-a5dea41828b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:00.786360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:02.357001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:03.683674 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:14.838861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:26.959214 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:11:27.341585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f0ec23c4-eb4e-47cb-b4fb-2ffdb2ec0b62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:29.714666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5e8a00a8-41ea-4e7a-b0d4-e9ab9feace42 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:30.787442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:32.359415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:33.685455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:44.855173 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:50.553062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55144) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:50.889113 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-2127636339-network', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:50.908946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Made reservation on behalf of 2be0ccfa2a914550be8f84da5cb7afe4 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:50.911441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:50.921037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.004612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Publish callbacks [] for security_group (524237e9-a95b-45e4-a4bb-df2e94b5d3d8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.009137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (524237e9-a95b-45e4-a4bb-df2e94b5d3d8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.022669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 147} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:11:51.048556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3634fb13-0e49-49bf-a115-a9f2198a6323), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.048894 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Added segment 3634fb13-0e49-49bf-a115-a9f2198a6323 of type vlan for network 597625fc-4c02-4901-9b3e-46b781f61da1 Mar 24 02:11:51.060894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=524237e9-a95b-45e4-a4bb-df2e94b5d3d8,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:51.090391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.091044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.091618 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.092207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.092711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.093201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.093788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.094264 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.094806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.095136 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.095627 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.096120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.096442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.096910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.097375 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Tracked resource versions report: Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: pushed versions: Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: { 'AddressGroup': {'1.2'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Agent': {'1.1'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'ConntrackHelper': {'1.0'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'LocalIPAssociation': {'1.0'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Log': {'1.0'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'NDPProxy': {'1.0'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Network': {'1.1'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Port': {'1.7'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'PortForwarding': {'1.3'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'QosPolicy': {'1.10'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SecurityGroup': {'1.5'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SecurityGroupRule': {'1.2'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SubPort': {'1.0'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Subnet': {'1.1'}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Trunk': {'1.1'}} Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: consumer versions: Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: { DHCP agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: HyperV agent@hv-neutron-8348: {}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: L3 agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: Metadata agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: Metering agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: Open vSwitch agent@dv-neutron-834874-3-hyperv: { 'AddressGroup': '1.2', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Agent': '1.1', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'ConntrackHelper': '1.0', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'LocalIPAssociation': '1.0', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Log': '1.0', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'NDPProxy': '1.0', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Network': '1.1', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Port': '1.7', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'PortForwarding': '1.3', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'QosPolicy': '1.10', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SecurityGroup': '1.5', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SecurityGroupRule': '1.2', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'SubPort': '1.0', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Subnet': '1.1', Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: 'Trunk': '1.1'}} Mar 24 02:11:51.098788 dv-neutron-834874-3-hyperv neutron-server[104037]: {{(pid=104037) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Mar 24 02:11:51.119446 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (597625fc-4c02-4901-9b3e-46b781f61da1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.144625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (597625fc-4c02-4901-9b3e-46b781f61da1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.145854 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:51.146379 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.201449 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6439731 Mar 24 02:11:51.202241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55180) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:51.209960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Request body: {'subnet': {'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-2127636339-subnet', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:51.218636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bc0ab62-f4d6-4855-b061-3334735e4e6e admin admin] Pushing event updated for resources: {'Network': ['ID=597625fc-4c02-4901-9b3e-46b781f61da1,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:51.229880 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 597625fc-4c02-4901-9b3e-46b781f61da1 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:11:51.239575 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Made reservation on behalf of 2be0ccfa2a914550be8f84da5cb7afe4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:51.242669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.430458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55190) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:51.452306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (56374a24-4e35-434f-b4b8-860ef8289893), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.508521 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Pushing event updated for resources: {'Subnet': ['ID=56374a24-4e35-434f-b4b8-860ef8289893,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:51.527198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.527549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.527902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.528241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.528666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.528899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.529224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.529549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.529896 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.530218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.530573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.531095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.531421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.531743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.532060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Tracked resource versions report: Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: pushed versions: Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: { 'AddressGroup': {'1.2'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Agent': {'1.1'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'ConntrackHelper': {'1.0'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'LocalIPAssociation': {'1.0'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Log': {'1.0'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'NDPProxy': {'1.0'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Network': {'1.1'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Port': {'1.7'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'PortForwarding': {'1.3'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'QosPolicy': {'1.10'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SecurityGroup': {'1.5'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SecurityGroupRule': {'1.2'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SubPort': {'1.0'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Subnet': {'1.1'}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Trunk': {'1.1'}} Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: consumer versions: Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: { DHCP agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: HyperV agent@hv-neutron-8348: {}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: L3 agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: Metadata agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: Metering agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: Open vSwitch agent@dv-neutron-834874-3-hyperv: { 'AddressGroup': '1.2', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Agent': '1.1', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'ConntrackHelper': '1.0', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'LocalIPAssociation': '1.0', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Log': '1.0', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'NDPProxy': '1.0', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Network': '1.1', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Port': '1.7', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'PortForwarding': '1.3', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'QosPolicy': '1.10', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SecurityGroup': '1.5', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SecurityGroupRule': '1.2', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'SubPort': '1.0', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Subnet': '1.1', Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: 'Trunk': '1.1'}} Mar 24 02:11:51.533249 dv-neutron-834874-3-hyperv neutron-server[104036]: {{(pid=104036) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Mar 24 02:11:51.538171 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Checking segment: {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:51.538553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Network hostable DHCP agents. Network: 597625fc-4c02-4901-9b3e-46b781f61da1, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:11:51.559986 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Network 597625fc-4c02-4901-9b3e-46b781f61da1 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:11:51.575448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 597625fc-4c02-4901-9b3e-46b781f61da1) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:51.580239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:51.580844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.586820 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55198) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:51.593660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb107745-d291-46a6-88e7-bbd05c96d609 None None] Network 597625fc-4c02-4901-9b3e-46b781f61da1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:51.601674 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0de9745b-ccc4-4472-901f-00d069125d17 admin admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3952718 Mar 24 02:11:51.602553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55202) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:51.607841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:51.638035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (9c57e851-60dd-408a-bb81-1858bda320e9), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.639299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (9c57e851-60dd-408a-bb81-1858bda320e9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.708385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55206) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:51.729683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-597625fc-4c02-4901-9b3e-46b781f61da1', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:11:51.730651 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.856167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Request body: {'network': {'name': 'tempest-ServersTestManualDisk-666298631-network', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:51.886770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks [] for router_controller (9c57e851-60dd-408a-bb81-1858bda320e9), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.893934 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Made reservation on behalf of d597f5a6c32e40b9b8f2e09949c6fcfd for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:51.899812 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:51.913373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Allocated IP 172.20.0.2 (597625fc-4c02-4901-9b3e-46b781f61da1/56374a24-4e35-434f-b4b8-860ef8289893/38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:51.919011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.026167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Publish callbacks [] for security_group (dcd060eb-a52a-41a0-bd4b-b844070b56c8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.033657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-test-network-2059700533'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:52.040059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (dcd060eb-a52a-41a0-bd4b-b844070b56c8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.085678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcd060eb-a52a-41a0-bd4b-b844070b56c8,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:52.100512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Publish callbacks [] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.112084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.123403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 146} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:11:52.137597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0315a2ce-6d94-400b-b5e9-b545de04ccbc), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.138238 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Added segment 0315a2ce-6d94-400b-b5e9-b545de04ccbc of type vlan for network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 Mar 24 02:11:52.139835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Made reservation on behalf of c354b13cd84e43e7ae53c1614f8efe57 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:52.143469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.171376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.174164 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Pushing event updated for resources: {'Port': ['ID=38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:52.174311 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-1627273874-network', 'tenant_id': '70b00ff8787a4049967d01e358be86c2'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:52.187546 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.187890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.188472 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.189612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.190399 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.190775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.191367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.192312 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.193008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.193524 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.194071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.194896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.195581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.196755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.197447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Tracked resource versions report: Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: pushed versions: Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: { 'AddressGroup': {'1.2'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Agent': {'1.1'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'ConntrackHelper': {'1.0'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'LocalIPAssociation': {'1.0'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Log': {'1.0'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'NDPProxy': {'1.0'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Network': {'1.1'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Port': {'1.7'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'PortForwarding': {'1.3'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'QosPolicy': {'1.10'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SecurityGroup': {'1.5'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SecurityGroupRule': {'1.2'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SubPort': {'1.0'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Subnet': {'1.1'}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Trunk': {'1.1'}} Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: consumer versions: Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: { DHCP agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: HyperV agent@hv-neutron-8348: {}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: L3 agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: Metadata agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: Metering agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: Open vSwitch agent@dv-neutron-834874-3-hyperv: { 'AddressGroup': '1.2', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Agent': '1.1', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'ConntrackHelper': '1.0', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'LocalIPAssociation': '1.0', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Log': '1.0', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'NDPProxy': '1.0', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Network': '1.1', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Port': '1.7', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'PortForwarding': '1.3', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'QosPolicy': '1.10', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SecurityGroup': '1.5', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SecurityGroupRule': '1.2', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'SubPort': '1.0', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Subnet': '1.1', Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: 'Trunk': '1.1'}} Mar 24 02:11:52.199371 dv-neutron-834874-3-hyperv neutron-server[104038]: {{(pid=104038) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Mar 24 02:11:52.209097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks [] for router_gateway (9c57e851-60dd-408a-bb81-1858bda320e9), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.216305 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Network 597625fc-4c02-4901-9b3e-46b781f61da1 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:11:52.217961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:52.220746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:52.288736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Attempting to bind port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:52.289497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Attempting to bind port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:52.289897 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Attempting to bind port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b on network 597625fc-4c02-4901-9b3e-46b781f61da1 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:52.292566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks [] for security_group (e59a89ce-c6a5-42cb-a8d6-f2562253a6b5), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.296868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:11:52.297588 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Checking segment: {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:52.298307 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.298803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Bound using segment: {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:11:52.299402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Bound port: 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:11:52.299895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.302743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (c5ab8914-a9e8-4c4e-bd5d-f979c05148e6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.305626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e59a89ce-c6a5-42cb-a8d6-f2562253a6b5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.343122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 122} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:11:52.349655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Made reservation on behalf of 70b00ff8787a4049967d01e358be86c2 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:52.352529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.369002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e59a89ce-c6a5-42cb-a8d6-f2562253a6b5,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:52.387402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] For port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:11:52.387523 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (5c0034c6-6078-4b89-9711-c262747ced7f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.388482 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Added segment 5c0034c6-6078-4b89-9711-c262747ced7f of type vlan for network 2c18001a-08a3-4102-a103-ee446a81214d Mar 24 02:11:52.391976 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] For port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:11:52.394878 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.401118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (c5ab8914-a9e8-4c4e-bd5d-f979c05148e6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.402083 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.402322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:52.402722 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.477637 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-182a6782-d922-45b1-bb06-6eb0eebd705e None None] Pushing event updated for resources: {'Port': ['ID=38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:52.496161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (2c18001a-08a3-4102-a103-ee446a81214d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.519488 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.0868399 Mar 24 02:11:52.525886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64120a27-aa31-49f2-95b0-629466669170 admin admin] Pushing event updated for resources: {'Network': ['ID=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:52.528417 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55234) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:52.536262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Request body: {'subnet': {'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestManualDisk-666298631-subnet', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:52.540690 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:11:52.559562 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (2c18001a-08a3-4102-a103-ee446a81214d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.565599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:52.566319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.599908 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks [] for router_gateway (9c57e851-60dd-408a-bb81-1858bda320e9), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.622559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Made reservation on behalf of d597f5a6c32e40b9b8f2e09949c6fcfd for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:52.625454 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.643597 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 799 time: 1.0556729 Mar 24 02:11:52.647518 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.675506 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a43e0d43-f46e-44c3-b42e-1c9f8bb40499 tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Pushing event updated for resources: {'Network': ['ID=2c18001a-08a3-4102-a103-ee446a81214d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:52.691166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 2c18001a-08a3-4102-a103-ee446a81214d details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:11:52.830154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Allocated IP 172.26.2.164 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/df5a15e4-1066-41f3-b75b-6ab6d45ff057) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:52.879923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (dfc73b89-587b-4f56-aa2b-706a8f904224), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.948738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Publish callbacks [] for security_group (a125387d-092c-4cad-8cbe-d55230c2b87b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:52.973315 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a125387d-092c-4cad-8cbe-d55230c2b87b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.000465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dfc73b89-587b-4f56-aa2b-706a8f904224,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:53.025389 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 116} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:11:53.036921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Checking segment: {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:53.037856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Network hostable DHCP agents. Network: c5ab8914-a9e8-4c4e-bd5d-f979c05148e6, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:11:53.070856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:11:53.080890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (fadaf792-3bdd-4a39-9224-2e6bc940be47), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.081288 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Added segment fadaf792-3bdd-4a39-9224-2e6bc940be47 of type vlan for network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b Mar 24 02:11:53.085842 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, c5ab8914-a9e8-4c4e-bd5d-f979c05148e6) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:53.093569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:53.094797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdd9b76c-665e-456a-93fd-4f1f6e10a6ef None None] Network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:53.095625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.116817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a125387d-092c-4cad-8cbe-d55230c2b87b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:53.122811 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-948e4bfe-bb13-4a21-b0db-dd8b7f0bc1d2 admin admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.5915015 Mar 24 02:11:53.125464 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55258) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:53.134908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Request body: {'router': {'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:53.176926 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (d91de7c3-7e46-4c9d-8b0a-c988de7fd81b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.179633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.181683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.182721 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks [] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.241110 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (d91de7c3-7e46-4c9d-8b0a-c988de7fd81b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.246103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:53.247558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.263459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:11:53.264756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.283626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55262) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:53.299574 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks [] for router_controller (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.312247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.323595 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] Pushing event updated for resources: {'Network': ['ID=d91de7c3-7e46-4c9d-8b0a-c988de7fd81b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:53.379339 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:11:53.382844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:11:53.387524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Pushing event updated for resources: {'Port': ['ID=df5a15e4-1066-41f3-b75b-6ab6d45ff057,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:53.391528 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:53.412152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55268) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:53.413507 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-96ed81e5-a453-4c4c-b761-7b713688e8e1 admin admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 1.7036419 Mar 24 02:11:53.420035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Request body: {'subnet': {'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-1627273874-subnet', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:53.432868 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:53.539542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Allocated IP 172.20.0.2 (c5ab8914-a9e8-4c4e-bd5d-f979c05148e6/dfc73b89-587b-4f56-aa2b-706a8f904224/a1ab4cc2-ad21-4d40-97af-535f80fe85f7) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:53.544725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Made reservation on behalf of 70b00ff8787a4049967d01e358be86c2 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:53.547125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.556803 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks [] for router_gateway (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.714070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55276) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:53.817363 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Publish callbacks [] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.831962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.877448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-51e3f404-0721-4c1f-a013-c905b6c1a05d tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-1725273333'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:53.877978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-51e3f404-0721-4c1f-a013-c905b6c1a05d tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Unknown quota resources ['metering_label']. {{(pid=104037) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Mar 24 02:11:53.888825 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks [] for router_gateway (9c57e851-60dd-408a-bb81-1858bda320e9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.894151 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (02cc6c6a-e353-4d82-9d85-3973d8220a39), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:53.915968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:11:53.942755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:53.953664 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:53.969116 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55282) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:53.976564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Pushing event updated for resources: {'Port': ['ID=a1ab4cc2-ad21-4d40-97af-535f80fe85f7,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:54.068563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=02cc6c6a-e353-4d82-9d85-3973d8220a39,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:54.087473 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Attempting to bind port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:54.087640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Attempting to bind port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:54.090287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Attempting to bind port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 on network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:54.104426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db9051f5-c314-4f5e-8442-4a360cc82adb None None] Network 597625fc-4c02-4901-9b3e-46b781f61da1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:54.161466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (9c57e851-60dd-408a-bb81-1858bda320e9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.189809 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:11:54.190383 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Checking segment: {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:54.190825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.191258 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Bound using segment: {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:11:54.191756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Bound port: a1ab4cc2-ad21-4d40-97af-535f80fe85f7, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:11:54.192299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.204657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Checking segment: {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:54.206619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Network hostable DHCP agents. Network: d91de7c3-7e46-4c9d-8b0a-c988de7fd81b, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:11:54.244440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-e19ecf17-88a8-4b9b-9b25-485c48237ca5 None None] Provisioning complete for port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:54.245002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e19ecf17-88a8-4b9b-9b25-485c48237ca5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.377361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'network': {'name': 'tempest-RoutersIpV6AdminTest-401874424', 'router:external': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:54.393435 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] For port a1ab4cc2-ad21-4d40-97af-535f80fe85f7, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:11:54.400813 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] For port a1ab4cc2-ad21-4d40-97af-535f80fe85f7, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a1ab4cc2-ad21-4d40-97af-535f80fe85f7,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:11:54.415124 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Router 9c57e851-60dd-408a-bb81-1858bda320e9 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:11:54.420902 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.444919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Made reservation on behalf of de44dd991a01489cb0ad2761eac48843 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:54.447838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.485768 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f468aa01-cda4-4b15-bc46-4181ca1402ea None None] Pushing event updated for resources: {'Port': ['ID=a1ab4cc2-ad21-4d40-97af-535f80fe85f7,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:54.514994 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55290) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:54.521081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-51e3f404-0721-4c1f-a013-c905b6c1a05d tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Publish callbacks [] for metering_label (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.522257 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-51e3f404-0721-4c1f-a013-c905b6c1a05d tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 478 time: 1.2376842 Mar 24 02:11:54.528783 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55296) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:54.532254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeTest-1601558587', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:54.545011 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e19ecf17-88a8-4b9b-9b25-485c48237ca5 None None] Current status of the port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:11:54.545414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e19ecf17-88a8-4b9b-9b25-485c48237ca5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.572157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55298) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:54.575506 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1739584d-581d-4877-a18a-431ed0776e9b tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd02::/64', 'direction': 'ingress', 'metering_label_id': '10c1f48b-6704-46a1-bf05-05af7395445c'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:54.576016 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1739584d-581d-4877-a18a-431ed0776e9b tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=104037) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Mar 24 02:11:54.607441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e19ecf17-88a8-4b9b-9b25-485c48237ca5 None None] For port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:11:54.614969 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e19ecf17-88a8-4b9b-9b25-485c48237ca5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.707424 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e19ecf17-88a8-4b9b-9b25-485c48237ca5 None None] Pushing event updated for resources: {'Port': ['ID=38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:54.720030 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.774830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:11:54.775628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Request body: {'port': {'network_id': '2c18001a-08a3-4102-a103-ee446a81214d', 'binding:host_id': 'hv-neutron-8348', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1377256640'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:54.809950 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Made reservation on behalf of 79c9dac944a44ef6a5bad97bf03d9529 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:54.812605 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Sync routers for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:11:54.817604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:11:54.824150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.830796 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.services.metering.metering_plugin [None req-1739584d-581d-4877-a18a-431ed0776e9b tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Mar 24 02:11:54.836983 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:11:54.837605 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:11:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:11:54.935344 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.937630 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:11:54.949695 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for security_group (82cf2f8a-b25d-4080-a4f0-eb1f828acedc), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.963686 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.968466 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5bbe457a-1d31-4b33-9684-37d8f1d6ac1e admin admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 3.3641829 Mar 24 02:11:54.971547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (82cf2f8a-b25d-4080-a4f0-eb1f828acedc), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:54.981939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55304) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:55.046329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, d91de7c3-7e46-4c9d-8b0a-c988de7fd81b) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:55.069238 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-1892332854'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:55.098363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1739584d-581d-4877-a18a-431ed0776e9b tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Publish callbacks [] for metering_label_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.102249 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1739584d-581d-4877-a18a-431ed0776e9b tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.5321875 Mar 24 02:11:55.102482 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:55.103787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.108739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55306) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:55.109495 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 143} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:11:55.120234 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6fec7c1a-9e96-4fa7-b4ff-af99b94fd4cc tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd03::/64', 'direction': 'ingress', 'metering_label_id': '10c1f48b-6704-46a1-bf05-05af7395445c'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:55.121408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6fec7c1a-9e96-4fa7-b4ff-af99b94fd4cc tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=104036) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Mar 24 02:11:55.149518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Made reservation on behalf of e504d6bef7c748b89165f581c15466df for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:55.154773 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.173832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c444d9ab-dcbc-4234-bd9c-4fe51baf786d None None] Network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:55.206800 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks [] for router_gateway (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.208508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.214789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82cf2f8a-b25d-4080-a4f0-eb1f828acedc,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:55.226556 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4d1cd21b-c179-47fd-82c7-713e361e0eb8 admin admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 1.8099811 Mar 24 02:11:55.226730 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.services.metering.metering_plugin [None req-6fec7c1a-9e96-4fa7-b4ff-af99b94fd4cc tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Mar 24 02:11:55.226730 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55310) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:55.234529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Request body: {'router': {'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:55.241889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Made reservation on behalf of dfa9b9d47860473eaa1279e6fcd94aef for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:55.245790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.255378 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:11:55.258870 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d4c3dc20-eed8-4be0-b727-dc10bea780c3), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.259114 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Added segment d4c3dc20-eed8-4be0-b727-dc10bea780c3 of type vlan for network 1d54abbd-4eda-40cf-82ef-27bc3e194d08 Mar 24 02:11:55.263902 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.275194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.290136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.291237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.334658 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-d91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'project_id': '70b00ff8787a4049967d01e358be86c2', 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:11:55.335521 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.364979 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:55.365684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.398625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks [] for security_group (d7a785d9-65cd-45a7-8930-3ef0c50a7f5a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.415983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d7a785d9-65cd-45a7-8930-3ef0c50a7f5a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.441410 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-cc5dbfaf-80bf-48a3-9877-ea9addee145c None None] Provisioning complete for port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:55.443124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cc5dbfaf-80bf-48a3-9877-ea9addee145c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.443396 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] device_id is not set on port 36c21b04-65ce-4317-ac40-8cc25078b4fe yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:11:55.470550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks [] for router_controller (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.473558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6fec7c1a-9e96-4fa7-b4ff-af99b94fd4cc tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Publish callbacks [] for metering_label_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.474942 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6fec7c1a-9e96-4fa7-b4ff-af99b94fd4cc tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.3581464 Mar 24 02:11:55.479908 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55312) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:55.497216 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (1d54abbd-4eda-40cf-82ef-27bc3e194d08), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.539051 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:53Z', 'revision_number': 3, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:11:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:11:55.563765 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ba919777-20dc-477f-bb68-814915ee22a3 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-label-rules?id=91dcd768-8060-4ab8-b9f5-6081caecbca5 HTTP/1.1" status: 200 len: 462 time: 0.0783224 Mar 24 02:11:55.569927 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Checking router: 9c57e851-60dd-408a-bb81-1858bda320e9 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:11:55.570158 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Updating router 9c57e851-60dd-408a-bb81-1858bda320e9 port df5a15e4-1066-41f3-b75b-6ab6d45ff057 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:11:55.573988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55314) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:55.577009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks [] for security_group (f711af1f-6157-450a-ae2a-03d41cb95627), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.607069 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.637711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.db.resource_extend [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Mar 24 02:11:55.643385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f711af1f-6157-450a-ae2a-03d41cb95627), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.661462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7a785d9-65cd-45a7-8930-3ef0c50a7f5a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:55.684932 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:11:55.715771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Allocated IP 172.26.2.59 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/4c6d0a24-5d23-4334-adb5-b107b1a904a9) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:55.746587 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 136} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:11:55.790100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-cc5dbfaf-80bf-48a3-9877-ea9addee145c None None] Current status of the port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:11:55.794584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks [] for security_group (39b9b171-812e-4a01-a7ec-867a839de331), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.807152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (235dbb41-94ab-49ce-be94-ff55807a3130), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.807568 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Added segment 235dbb41-94ab-49ce-be94-ff55807a3130 of type vlan for network aeb576ca-23a4-4f01-8746-09a22baff84a Mar 24 02:11:55.808975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f711af1f-6157-450a-ae2a-03d41cb95627,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:55.810869 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (1d54abbd-4eda-40cf-82ef-27bc3e194d08), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.812173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:55.812833 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.868767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Allocated IP 172.20.0.2 (d91de7c3-7e46-4c9d-8b0a-c988de7fd81b/02cc6c6a-e353-4d82-9d85-3973d8220a39/f46e5e98-2578-4507-9699-7abe2faddbac) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:55.878431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (39b9b171-812e-4a01-a7ec-867a839de331), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:55.888390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] device_id is not set on port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:11:55.999033 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks [] for router_gateway (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.017841 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 874 time: 2.0475495 Mar 24 02:11:56.018904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55318) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:56.022641 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebbf855-6afe-467b-b7bb-7129c246d408 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event updated for resources: {'Network': ['ID=1d54abbd-4eda-40cf-82ef-27bc3e194d08,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:56.027959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'subnet': {'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:56.051425 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Publish callbacks [] for port (f46e5e98-2578-4507-9699-7abe2faddbac), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.060107 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 1d54abbd-4eda-40cf-82ef-27bc3e194d08 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:11:56.064910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4e30230-7f5b-4e48-bc66-29e8bcf37a5b None None] Network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:56.068752 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.079343 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (aeb576ca-23a4-4f01-8746-09a22baff84a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.111135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Made reservation on behalf of de44dd991a01489cb0ad2761eac48843 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:56.114508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.136810 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2ea17ca9-a00f-4078-8dfe-7293b83e681d tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Publish callbacks [] for metering_label_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.142017 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2ea17ca9-a00f-4078-8dfe-7293b83e681d tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "DELETE /v2.0/metering/metering-label-rules/91dcd768-8060-4ab8-b9f5-6081caecbca5 HTTP/1.1" status: 204 len: 168 time: 0.5535271 Mar 24 02:11:56.143558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39b9b171-812e-4a01-a7ec-867a839de331,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:56.155191 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55320) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:56.218267 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e3d5f00d-a035-4b50-a85b-215ef75324e6 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-label-rules?id=91dcd768-8060-4ab8-b9f5-6081caecbca5 HTTP/1.1" status: 200 len: 221 time: 0.0586619 Mar 24 02:11:56.218435 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:11:56.224100 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55324) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:56.237662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e64827a7-2504-4c36-8000-fcdf62b8af22 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--344911834', 'description': 'label created by tempest'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:56.237886 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-147e0c2b-4350-4af5-a160-fd9ec084dd17 None None] Provisioning complete for port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:56.238095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-147e0c2b-4350-4af5-a160-fd9ec084dd17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.238204 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e64827a7-2504-4c36-8000-fcdf62b8af22 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Unknown quota resources ['metering_label']. {{(pid=104037) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Mar 24 02:11:56.240329 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:56.246058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (aeb576ca-23a4-4f01-8746-09a22baff84a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.252540 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:56.253240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.259367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks [] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.270686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:56.273189 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Pushing event updated for resources: {'Port': ['ID=f46e5e98-2578-4507-9699-7abe2faddbac,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:56.377881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Attempting to bind port f46e5e98-2578-4507-9699-7abe2faddbac on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:56.378278 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Attempting to bind port f46e5e98-2578-4507-9699-7abe2faddbac by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:56.378682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Attempting to bind port f46e5e98-2578-4507-9699-7abe2faddbac on network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:56.393350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:11:56.393754 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Checking segment: {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:56.394128 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.394548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Bound using segment: {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:11:56.395036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Bound port: f46e5e98-2578-4507-9699-7abe2faddbac, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:11:56.395453 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.475448 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-147e0c2b-4350-4af5-a160-fd9ec084dd17 None None] Current status of the port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:11:56.476121 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-147e0c2b-4350-4af5-a160-fd9ec084dd17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.540267 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-147e0c2b-4350-4af5-a160-fd9ec084dd17 None None] For port a1ab4cc2-ad21-4d40-97af-535f80fe85f7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a1ab4cc2-ad21-4d40-97af-535f80fe85f7,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:11:56.560844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-147e0c2b-4350-4af5-a160-fd9ec084dd17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.592057 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] For port f46e5e98-2578-4507-9699-7abe2faddbac, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:11:56.598814 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 2.0753789 Mar 24 02:11:56.605442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55326) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:56.616062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Request body: {'subnet': {'network_id': 'aeb576ca-23a4-4f01-8746-09a22baff84a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:56.640372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-498dc68b-97b2-4ff5-b282-a9a38a14fcbd tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event updated for resources: {'Network': ['ID=aeb576ca-23a4-4f01-8746-09a22baff84a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:56.644990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] For port f46e5e98-2578-4507-9699-7abe2faddbac, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f46e5e98-2578-4507-9699-7abe2faddbac,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:11:56.668831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network aeb576ca-23a4-4f01-8746-09a22baff84a details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:11:56.683915 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.760172 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.805862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147e0c2b-4350-4af5-a160-fd9ec084dd17 None None] Pushing event updated for resources: {'Port': ['ID=a1ab4cc2-ad21-4d40-97af-535f80fe85f7,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:56.808519 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-87028358-3936-4959-898b-0deee3691e9a None None] Provisioning complete for port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:56.808905 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87028358-3936-4959-898b-0deee3691e9a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.827093 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks [] for router_gateway (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.864979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e64827a7-2504-4c36-8000-fcdf62b8af22 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Publish callbacks [] for metering_label (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.866151 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e64827a7-2504-4c36-8000-fcdf62b8af22 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 469 time: 0.6348746 Mar 24 02:11:56.871799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55328) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:56.880832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.909314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab5d2515-310f-4401-986f-ab5ba2874b78 None None] Pushing event updated for resources: {'Port': ['ID=f46e5e98-2578-4507-9699-7abe2faddbac,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:56.912582 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:11:56.926786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:56.967049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:11:56.973063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:56.975500 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:56.979459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] device_id is not set on port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:11:56.988130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-87028358-3936-4959-898b-0deee3691e9a None None] Current status of the port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:11:57.013135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:57.013547 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.072908 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-91eab66b-73be-43e0-9797-3400ec9bb4d1 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-labels?id=83a360c7-9178-4ed9-8f0c-4865f9f4e73c HTTP/1.1" status: 200 len: 467 time: 0.1617193 Mar 24 02:11:57.080276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Made reservation on behalf of dfa9b9d47860473eaa1279e6fcd94aef for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:57.082466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55330) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:57.083693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks [] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.095028 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks [] for port (829d14fb-ee3c-4acd-b2bc-eddf344e9bfb), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.102751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:11:57.103906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a1ab4cc2-ad21-4d40-97af-535f80fe85f7 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:11:57.115195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Allocated IP 172.26.2.116 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/36c21b04-65ce-4317-ac40-8cc25078b4fe) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:57.126438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Pushing event updated for resources: {'Port': ['ID=4c6d0a24-5d23-4334-adb5-b107b1a904a9,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:57.173016 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (829d14fb-ee3c-4acd-b2bc-eddf344e9bfb), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.173708 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:57.174085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.276993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:11:57.348136 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c340c33c-a1da-45cc-8daa-8a735da7e101 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.358175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'Port': ['ID=829d14fb-ee3c-4acd-b2bc-eddf344e9bfb,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:57.449770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Checking segment: {'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:57.450041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Network hostable DHCP agents. Network: 2c18001a-08a3-4102-a103-ee446a81214d, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:11:57.465404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Allocated IP 172.20.0.1 (597625fc-4c02-4901-9b3e-46b781f61da1/56374a24-4e35-434f-b4b8-860ef8289893/3a5a51e0-3aa4-497c-9582-6700ad4f221e) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:57.470400 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-053cd0d3-fbbe-4933-bebf-e762038dc6bd tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Publish callbacks [] for metering_label (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.471549 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-053cd0d3-fbbe-4933-bebf-e762038dc6bd tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "DELETE /v2.0/metering/metering-labels/83a360c7-9178-4ed9-8f0c-4865f9f4e73c HTTP/1.1" status: 204 len: 168 time: 0.3823340 Mar 24 02:11:57.476328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55332) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:57.502273 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-afc684fb-db7c-4b51-9898-0917a517da99 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-labels?id=83a360c7-9178-4ed9-8f0c-4865f9f4e73c HTTP/1.1" status: 200 len: 216 time: 0.0207911 Mar 24 02:11:57.503785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55334) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:57.581721 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-55dffb0d-5f60-4e76-8ed4-0fabd8e9c221 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0751963 Mar 24 02:11:57.584312 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:11:57.584920 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (6723a6f9-b722-45c9-8a12-6ff6721ad967), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.586936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55336) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:57.603204 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Network 2c18001a-08a3-4102-a103-ee446a81214d is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:11:57.665523 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b12a1131-9a3d-49f2-8fb3-aa7d54394562 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0708756 Mar 24 02:11:57.667126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 2c18001a-08a3-4102-a103-ee446a81214d) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:57.669591 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55340) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:57.671256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:57.676793 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0dcef604-6185-4ab4-a336-e43c521a52f7 None None] Network 2c18001a-08a3-4102-a103-ee446a81214d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:57.693204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event updated for resources: {'Subnet': ['ID=6723a6f9-b722-45c9-8a12-6ff6721ad967,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:57.730772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks [] for port (36c21b04-65ce-4317-ac40-8cc25078b4fe), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.732816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks [] for router_gateway (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.735163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:57.735163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:57.735467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:57.739626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.765839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Publish callbacks [] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.768488 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a59f3015-bafe-4190-b9f4-58d9b95aa06a tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-labels/10c1f48b-6704-46a1-bf05-05af7395445c HTTP/1.1" status: 200 len: 473 time: 0.0906787 Mar 24 02:11:57.771542 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Checking segment: {'id': 'd4c3dc20-eed8-4be0-b727-dc10bea780c3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:57.771542 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Network hostable DHCP agents. Network: 1d54abbd-4eda-40cf-82ef-27bc3e194d08, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:11:57.775382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55342) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:57.807014 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-781a5316-a348-43ba-ba08-c34b7101377a tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-label-rules/e0c45606-0165-4eb2-aaa0-a1abf831bf69 HTTP/1.1" status: 200 len: 459 time: 0.0312600 Mar 24 02:11:57.812056 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55344) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:57.833895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Network 1d54abbd-4eda-40cf-82ef-27bc3e194d08 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:11:57.838998 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:57.839330 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:57.844717 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 2 to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb Mar 24 02:11:57.860419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 1d54abbd-4eda-40cf-82ef-27bc3e194d08) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:57.875584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:57.876856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.880187 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:57.906471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a96bbe4-31a6-4f51-b366-4dde9738cd6a None None] Network 1d54abbd-4eda-40cf-82ef-27bc3e194d08 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:57.925761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:57.926328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:57.926559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:57.949672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:57.949998 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:57.950558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event updated for resources: {'Subnet': ['ID=cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:57.962979 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 3 to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb Mar 24 02:11:58.029146 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43ea13a2-185e-41f9-bd35-9adabaf952f8 None None] Network 1d54abbd-4eda-40cf-82ef-27bc3e194d08 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:58.069662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:58.069971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:58.070304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:58.074181 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (36c21b04-65ce-4317-ac40-8cc25078b4fe), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.099411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:58.099737 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:58.100364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Checking segment: {'id': '235dbb41-94ab-49ce-be94-ff55807a3130', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'aeb576ca-23a4-4f01-8746-09a22baff84a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:58.100714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Network hostable DHCP agents. Network: aeb576ca-23a4-4f01-8746-09a22baff84a, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:11:58.122752 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 4 to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb Mar 24 02:11:58.151529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:11:58.153670 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Pushing event updated for resources: {'Port': ['ID=3a5a51e0-3aa4-497c-9582-6700ad4f221e,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:58.161534 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:58.162620 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Network 597625fc-4c02-4901-9b3e-46b781f61da1 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:11:58.163962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:58.165634 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:58.166248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.171190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:58.171522 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:58.171896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:58.180033 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-19b9a13e-993d-422a-99da-26bb482cef92 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Publish callbacks [] for metering_label_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.183794 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-19b9a13e-993d-422a-99da-26bb482cef92 tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "DELETE /v2.0/metering/metering-label-rules/e0c45606-0165-4eb2-aaa0-a1abf831bf69 HTTP/1.1" status: 204 len: 168 time: 0.3688583 Mar 24 02:11:58.188587 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55346) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:58.193551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:58.198779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:58.199424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (9c57e851-60dd-408a-bb81-1858bda320e9), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.211113 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:58.212474 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:58.212843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Network aeb576ca-23a4-4f01-8746-09a22baff84a is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:11:58.215935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Pushing event updated for resources: {'Port': ['ID=36c21b04-65ce-4317-ac40-8cc25078b4fe,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:58.223153 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 5 to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb Mar 24 02:11:58.238784 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-87bcca0f-b1a2-4113-a793-463eb666bc05 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 4.5226066 Mar 24 02:11:58.251555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55348) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:58.252144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, aeb576ca-23a4-4f01-8746-09a22baff84a) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:58.257187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:11:58.257792 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.273454 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.278165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44536377-fffa-4e89-a6fe-c123f1b75718 None None] Network aeb576ca-23a4-4f01-8746-09a22baff84a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:58.281574 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.116'}]}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:58.319406 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-02870e47-066d-4e63-acc1-62d1eb1c1737 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7076766 Mar 24 02:11:58.320044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55350) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:58.326262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:58.328469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:58.328469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:58.343200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (b8943750-d96e-4456-bf7c-26b94213b0de), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.344327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (b8943750-d96e-4456-bf7c-26b94213b0de), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.360020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Request body: {'port': {'network_id': 'aeb576ca-23a4-4f01-8746-09a22baff84a', 'name': 'tempest-DHCPAgentSchedulersTestJSON-1256954218'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:58.368065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69bca2e3-387e-41fe-9fce-c6dd570ea39c None None] Network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:11:58.406376 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Publish callbacks [] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.415307 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.469550 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Pushing event updated for resources: {'Port': ['ID=df5a15e4-1066-41f3-b75b-6ab6d45ff057,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:58.494129 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.494858 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.495462 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.497102 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.497704 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.498373 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.498986 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.499500 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.500056 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.500577 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.501171 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.501851 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.502401 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.502939 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.503470 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Tracked resource versions report: Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: pushed versions: Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: { 'AddressGroup': {'1.2'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Agent': {'1.1'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'ConntrackHelper': {'1.0'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'LocalIPAssociation': {'1.0'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Log': {'1.0'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'NDPProxy': {'1.0'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Network': {'1.1'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Port': {'1.7'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'PortForwarding': {'1.3'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'QosPolicy': {'1.10'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SecurityGroup': {'1.5'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SecurityGroupRule': {'1.2'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SubPort': {'1.0'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Subnet': {'1.1'}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Trunk': {'1.1'}} Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: consumer versions: Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: { DHCP agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: HyperV agent@hv-neutron-8348: {}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: L3 agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: Metadata agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: Metering agent@dv-neutron-834874-3-hyperv: {}, Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: Open vSwitch agent@dv-neutron-834874-3-hyperv: { 'AddressGroup': '1.2', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Agent': '1.1', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'ConntrackHelper': '1.0', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'LocalIPAssociation': '1.0', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Log': '1.0', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'NDPProxy': '1.0', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Network': '1.1', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Port': '1.7', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'PortForwarding': '1.3', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'QosPolicy': '1.10', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SecurityGroup': '1.5', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SecurityGroupRule': '1.2', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'SubPort': '1.0', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Subnet': '1.1', Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: 'Trunk': '1.1'}} Mar 24 02:11:58.505018 dv-neutron-834874-3-hyperv neutron-server[104039]: {{(pid=104039) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Mar 24 02:11:58.510086 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Attempting to bind port df5a15e4-1066-41f3-b75b-6ab6d45ff057 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:58.510792 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Attempting to bind port df5a15e4-1066-41f3-b75b-6ab6d45ff057 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:58.511545 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Attempting to bind port df5a15e4-1066-41f3-b75b-6ab6d45ff057 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:58.518122 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:11:58.518789 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:11:58.519459 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.520040 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:11:58.520709 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Bound port: df5a15e4-1066-41f3-b75b-6ab6d45ff057, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:11:58.521311 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.581713 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] For port df5a15e4-1066-41f3-b75b-6ab6d45ff057, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:11:58.585931 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] For port df5a15e4-1066-41f3-b75b-6ab6d45ff057, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=df5a15e4-1066-41f3-b75b-6ab6d45ff057,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:11:58.591964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:58.592234 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:58.595422 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.599147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-64673175-39d8-4db6-b871-05aa61470c8d None None] Provisioning complete for port f46e5e98-2578-4507-9699-7abe2faddbac triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:58.599554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-64673175-39d8-4db6-b871-05aa61470c8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.601034 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 6 to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb Mar 24 02:11:58.665464 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f0d3bae-4606-43a6-8c33-5740930616f1 None None] Pushing event updated for resources: {'Port': ['ID=df5a15e4-1066-41f3-b75b-6ab6d45ff057,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:58.695211 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:11:58.696722 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:11:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:11:58.722203 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7aac0e69-4704-40e9-9d66-e0fabcc576a7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 822 time: 2.6979079 Mar 24 02:11:58.729277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55354) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:58.754174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'port': {'name': 'tempest-RoutersIpV6AdminTest-1699021439', 'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:11:58.795194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Made reservation on behalf of de44dd991a01489cb0ad2761eac48843 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:58.797494 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.797613 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-aeb576ca-23a4-4f01-8746-09a22baff84a', 'network_id': 'aeb576ca-23a4-4f01-8746-09a22baff84a', 'project_id': 'dfa9b9d47860473eaa1279e6fcd94aef', 'fixed_ips': [{'subnet_id': 'cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:11:58.799445 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:58.799773 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:58.800098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:58.801526 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:58.862457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:58.862948 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:58.871341 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 7 to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb Mar 24 02:11:58.885576 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:11:58.901124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] device_id is not set on port f6e7a11b-b7c7-436d-ad0d-49579584b59e yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:11:58.916898 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:11:58.964954 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.012169 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f46e5e98-2578-4507-9699-7abe2faddbac up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:11:59.031325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Allocated IP 2001:db8::188 (1d54abbd-4eda-40cf-82ef-27bc3e194d08/6723a6f9-b722-45c9-8a12-6ff6721ad967/f6e7a11b-b7c7-436d-ad0d-49579584b59e) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:59.046840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks [] for router_controller (b8943750-d96e-4456-bf7c-26b94213b0de), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.078879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:59.079223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:59.079446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-64673175-39d8-4db6-b871-05aa61470c8d None None] Current status of the port f46e5e98-2578-4507-9699-7abe2faddbac is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:11:59.079549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:59.079840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-64673175-39d8-4db6-b871-05aa61470c8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.127006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Allocated IP 172.20.0.2 (aeb576ca-23a4-4f01-8746-09a22baff84a/cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d/7ea84e71-731e-4ba0-8d65-8a7c06a58dd6) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:59.153176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-64673175-39d8-4db6-b871-05aa61470c8d None None] For port f46e5e98-2578-4507-9699-7abe2faddbac, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f46e5e98-2578-4507-9699-7abe2faddbac,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:11:59.160810 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:53Z', 'revision_number': 3, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:11:59.163264 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:59.163583 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:59.168200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-64673175-39d8-4db6-b871-05aa61470c8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.201750 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 8 to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb Mar 24 02:11:59.205349 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9402e45f-7d08-4e87-a5f5-c3af775ee247 None None] The sync data for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv is: [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:53Z', 'revision_number': 3, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:11:59.233279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5132a5f7-dc02-4ec1-ae45-2b190599dfef tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] Publish callbacks [] for metering_label (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.237236 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5132a5f7-dc02-4ec1-ae45-2b190599dfef tempest-MeteringIpV6TestJSON-1639227472 tempest-MeteringIpV6TestJSON-1639227472-project-admin] 10.222.0.20 "DELETE /v2.0/metering/metering-labels/10c1f48b-6704-46a1-bf05-05af7395445c HTTP/1.1" status: 204 len: 168 time: 0.5233574 Mar 24 02:11:59.238586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Allocated IP 172.26.2.100 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/9a4b70bd-f398-49e6-9234-c79d598e3a65) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:59.262465 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f46e5e98-2578-4507-9699-7abe2faddbac triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:59.262893 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.274681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Made reservation on behalf of dfa9b9d47860473eaa1279e6fcd94aef for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:11:59.279303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.282432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:59.282825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:59.283156 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:59.407226 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64673175-39d8-4db6-b871-05aa61470c8d None None] Pushing event updated for resources: {'Port': ['ID=f46e5e98-2578-4507-9699-7abe2faddbac,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:59.417166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:59.417477 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:59.422947 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ca0467c4-6475-4fad-8db0-aa8903401504 None None] Provisioning complete for port 3a5a51e0-3aa4-497c-9582-6700ad4f221e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:59.423343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ca0467c4-6475-4fad-8db0-aa8903401504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.423756 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 9 to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb Mar 24 02:11:59.445222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] device_id is not set on port 74c59c5f-2265-4166-8c34-c05a3c6a7857 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:11:59.455013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks [] for router_gateway (b8943750-d96e-4456-bf7c-26b94213b0de), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.472655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:59.473006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:59.473342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:59.501974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks [] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.552716 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Publish callbacks [] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.553105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:59.553435 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:59.560573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ca0467c4-6475-4fad-8db0-aa8903401504 None None] Port 3a5a51e0-3aa4-497c-9582-6700ad4f221e cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:11:59.563395 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.564414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (9c57e851-60dd-408a-bb81-1858bda320e9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.575219 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 10 to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb Mar 24 02:11:59.583153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Publish callbacks [] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.589397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:11:59.595264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f46e5e98-2578-4507-9699-7abe2faddbac is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:11:59.597730 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a1ab4cc2-ad21-4d40-97af-535f80fe85f7 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:11:59.602750 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Sync routers for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:11:59.608475 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.637745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ca0467c4-6475-4fad-8db0-aa8903401504 None None] Provisioning complete for port f46e5e98-2578-4507-9699-7abe2faddbac triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:11:59.638049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ca0467c4-6475-4fad-8db0-aa8903401504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.673213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.732457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:11:59.732894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:11:59.733296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:11:59.755661 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.759838 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-41ddcfad-7bfc-4e71-808d-22f66395ac7a admin admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 6.6302574 Mar 24 02:11:59.762023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55364) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:59.763752 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:11:59.774797 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Pushing event updated for resources: {'Port': ['ID=3a5a51e0-3aa4-497c-9582-6700ad4f221e,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:11:59.796641 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6446bf2f-3f12-4a08-95bc-fdd56747b9aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.798000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:11:59.798688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:11:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:11:59.802195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:11:59.802548 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:11:59.802915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (829d14fb-ee3c-4acd-b2bc-eddf344e9bfb), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.814992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for port (f6e7a11b-b7c7-436d-ad0d-49579584b59e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:11:59.818729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:59.877251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:59.880255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Allocated IP 172.20.0.7 (aeb576ca-23a4-4f01-8746-09a22baff84a/cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d/74c59c5f-2265-4166-8c34-c05a3c6a7857) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:11:59.884882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Network aeb576ca-23a4-4f01-8746-09a22baff84a is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:11:59.905688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:11:59.907048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55366) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:11:59.908595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:11:59.919011 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Pushing event updated for resources: {'Port': ['ID=7ea84e71-731e-4ba0-8d65-8a7c06a58dd6,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:00.040281 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:00.040692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.045241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Pushing event updated for resources: {'Port': ['ID=9a4b70bd-f398-49e6-9234-c79d598e3a65,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:00.047565 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Attempting to bind port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:00.048030 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Attempting to bind port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '235dbb41-94ab-49ce-be94-ff55807a3130', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'aeb576ca-23a4-4f01-8746-09a22baff84a'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:00.049577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Attempting to bind port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 on network aeb576ca-23a4-4f01-8746-09a22baff84a {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:00.057722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:00.085409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (f6e7a11b-b7c7-436d-ad0d-49579584b59e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.120585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Network 597625fc-4c02-4901-9b3e-46b781f61da1 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:00.124477 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:00.158378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:00.158819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Checking segment: {'id': '235dbb41-94ab-49ce-be94-ff55807a3130', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'aeb576ca-23a4-4f01-8746-09a22baff84a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:00.159567 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.159567 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Bound using segment: {'id': '235dbb41-94ab-49ce-be94-ff55807a3130', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'aeb576ca-23a4-4f01-8746-09a22baff84a'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:00.164343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Bound port: 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '235dbb41-94ab-49ce-be94-ff55807a3130', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'aeb576ca-23a4-4f01-8746-09a22baff84a'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:00.164343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.168067 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ca0467c4-6475-4fad-8db0-aa8903401504 None None] Current status of the port f46e5e98-2578-4507-9699-7abe2faddbac is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:00.241742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Network 1d54abbd-4eda-40cf-82ef-27bc3e194d08 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:00.253777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:00.271148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:00.272086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:00.272685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.312807 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1030 time: 1.5704968 Mar 24 02:12:00.326237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55370) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:00.376300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f74d8b-421b-42d1-acef-9a40de090144 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event updated for resources: {'Port': ['ID=f6e7a11b-b7c7-436d-ad0d-49579584b59e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:00.462230 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks [] for port (74c59c5f-2265-4166-8c34-c05a3c6a7857), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.540088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (74c59c5f-2265-4166-8c34-c05a3c6a7857), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.543814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] For port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:00.544179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempted to set empty binding levels {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Mar 24 02:12:00.576328 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] For port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:00.601028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2df24922-02f4-41c1-8755-961fe0d967ba None None] Provisioning complete for port 3a5a51e0-3aa4-497c-9582-6700ad4f221e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:00.601222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2df24922-02f4-41c1-8755-961fe0d967ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.626006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] For port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7ea84e71-731e-4ba0-8d65-8a7c06a58dd6,segment=NetworkSegment(235dbb41-94ab-49ce-be94-ff55807a3130),segment_id=235dbb41-94ab-49ce-be94-ff55807a3130)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:00.629228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:00.641367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.659015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6143dcbe-72a7-4c49-af8c-6fe96af98814 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.688688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2df24922-02f4-41c1-8755-961fe0d967ba None None] Port 3a5a51e0-3aa4-497c-9582-6700ad4f221e cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:00.730273 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c12dc98-a6dc-4da1-9815-b86ddaa04d6a None None] Pushing event updated for resources: {'Port': ['ID=7ea84e71-731e-4ba0-8d65-8a7c06a58dd6,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:00.756430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:11:57Z', 'revision_number': 3, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:11:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:00.801315 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks [] for router_gateway (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.830677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Checking router: 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:00.831633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Updating router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c port 4c6d0a24-5d23-4334-adb5-b107b1a904a9 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:12:00.861524 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (829d14fb-ee3c-4acd-b2bc-eddf344e9bfb), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.871881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Network aeb576ca-23a4-4f01-8746-09a22baff84a is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:00.882180 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Router 9c57e851-60dd-408a-bb81-1858bda320e9 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:12:00.890691 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:00.901420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.906233 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:00.910653 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:00.911279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.927585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:00.928209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.963209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event updated for resources: {'Port': ['ID=74c59c5f-2265-4166-8c34-c05a3c6a7857,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:00.972583 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6143dcbe-72a7-4c49-af8c-6fe96af98814 admin admin] Publish callbacks [] for security_group (1d6d385e-0e8e-4572-9b6a-8600779d5881), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:00.988156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6143dcbe-72a7-4c49-af8c-6fe96af98814 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1d6d385e-0e8e-4572-9b6a-8600779d5881), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.081867 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-78757f08-769d-4f80-afe4-97f2e128da9e tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.7566373 Mar 24 02:12:01.093887 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 982 time: 6.5088279 Mar 24 02:12:01.097910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55372) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:01.098241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55374) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:01.099738 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-8de4c1e1-6625-45be-8d90-447fcd222992 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Deleting port f6e7a11b-b7c7-436d-ad0d-49579584b59e {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:01.100076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8de4c1e1-6625-45be-8d90-447fcd222992 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f6e7a11b-b7c7-436d-ad0d-49579584b59e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.126406 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f46e5e98-2578-4507-9699-7abe2faddbac up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:01.132306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.275840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f46e5e98-2578-4507-9699-7abe2faddbac triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:01.276135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.291962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f818bc1b-cd75-4015-8ba7-39655d8f413e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'Port': ['ID=829d14fb-ee3c-4acd-b2bc-eddf344e9bfb,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:01.326591 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6143dcbe-72a7-4c49-af8c-6fe96af98814 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=8dbfcfba51e54e189425205e446d9829&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3737230 Mar 24 02:12:01.328549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55376) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:01.349135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6143dcbe-72a7-4c49-af8c-6fe96af98814 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d6d385e-0e8e-4572-9b6a-8600779d5881,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:01.385622 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks [] for router_gateway (b8943750-d96e-4456-bf7c-26b94213b0de), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.433912 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Publish callbacks [] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.435981 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f46e5e98-2578-4507-9699-7abe2faddbac is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:01.437576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device df5a15e4-1066-41f3-b75b-6ab6d45ff057 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:01.445043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.447516 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.450463 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:01.468762 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-de207ad9-c3fb-472e-a7aa-64ed8612da91 admin admin] 10.222.0.20 "PUT /v2.0/routers/9c57e851-60dd-408a-bb81-1858bda320e9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4543841 Mar 24 02:12:01.470900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.514760 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b641807-17ef-4301-bbea-0812e790bed2 admin admin] Publish callbacks [] for security_group (1d6d385e-0e8e-4572-9b6a-8600779d5881), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.528872 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.530955 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8de4c1e1-6625-45be-8d90-447fcd222992 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f6e7a11b-b7c7-436d-ad0d-49579584b59e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.540163 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb58d3f-b9c3-4ff5-a912-2335d500b545 None None] Pushing event updated for resources: {'Port': ['ID=4c6d0a24-5d23-4334-adb5-b107b1a904a9,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:01.543492 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Attempting to bind port 4c6d0a24-5d23-4334-adb5-b107b1a904a9 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:01.543868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Attempting to bind port 4c6d0a24-5d23-4334-adb5-b107b1a904a9 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:01.544229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Attempting to bind port 4c6d0a24-5d23-4334-adb5-b107b1a904a9 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:01.550762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:01.551140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:01.551540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.551933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:01.552401 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Bound port: 4c6d0a24-5d23-4334-adb5-b107b1a904a9, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:01.552782 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.580992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port df5a15e4-1066-41f3-b75b-6ab6d45ff057 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:01.581366 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.583152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-8de4c1e1-6625-45be-8d90-447fcd222992 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Calling delete_port for f6e7a11b-b7c7-436d-ad0d-49579584b59e owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:01.601035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b641807-17ef-4301-bbea-0812e790bed2 admin admin] Publish callbacks [] for security_group (1d6d385e-0e8e-4572-9b6a-8600779d5881), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.663421 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] For port 4c6d0a24-5d23-4334-adb5-b107b1a904a9, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:01.668042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] For port 4c6d0a24-5d23-4334-adb5-b107b1a904a9, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4c6d0a24-5d23-4334-adb5-b107b1a904a9,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:01.684743 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.818716 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-62aaffc1-259e-4619-8e55-d8fa736462a7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Deleting port 74c59c5f-2265-4166-8c34-c05a3c6a7857 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:01.821165 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62aaffc1-259e-4619-8e55-d8fa736462a7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (74c59c5f-2265-4166-8c34-c05a3c6a7857), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.839708 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb58d3f-b9c3-4ff5-a912-2335d500b545 None None] Pushing event updated for resources: {'Port': ['ID=4c6d0a24-5d23-4334-adb5-b107b1a904a9,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:01.842870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:01.847372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:01.850945 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port df5a15e4-1066-41f3-b75b-6ab6d45ff057 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:01.850945 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.875077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b641807-17ef-4301-bbea-0812e790bed2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1d6d385e-0e8e-4572-9b6a-8600779d5881), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.878012 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b641807-17ef-4301-bbea-0812e790bed2 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:01.879434 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7b641807-17ef-4301-bbea-0812e790bed2 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/1d6d385e-0e8e-4572-9b6a-8600779d5881 HTTP/1.1" status: 204 len: 168 time: 0.5311809 Mar 24 02:12:01.899574 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b641807-17ef-4301-bbea-0812e790bed2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d6d385e-0e8e-4572-9b6a-8600779d5881,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:01.903202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Allocated IP 172.20.0.1 (c5ab8914-a9e8-4c4e-bd5d-f979c05148e6/dfc73b89-587b-4f56-aa2b-706a8f904224/9b446767-9204-4d09-bff9-fa3a72e03482) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:01.947517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-94ecaac7-688a-4444-a231-d8f4c6ff1d0b tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Deleting port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:01.948042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ecaac7-688a-4444-a231-d8f4c6ff1d0b tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (829d14fb-ee3c-4acd-b2bc-eddf344e9bfb), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.038228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port df5a15e4-1066-41f3-b75b-6ab6d45ff057, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=df5a15e4-1066-41f3-b75b-6ab6d45ff057,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:02.064585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.119843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:12:02.200362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:02.204093 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Sync routers for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:02.220475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-94ecaac7-688a-4444-a231-d8f4c6ff1d0b tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] For port 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb, host hv-neutron-8348, got binding levels [] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:02.220957 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ecaac7-688a-4444-a231-d8f4c6ff1d0b tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (829d14fb-ee3c-4acd-b2bc-eddf344e9bfb), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.224847 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:02.225509 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:02.253915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-94ecaac7-688a-4444-a231-d8f4c6ff1d0b tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Calling delete_port for 829d14fb-ee3c-4acd-b2bc-eddf344e9bfb owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:02.282481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks [] for router (b8943750-d96e-4456-bf7c-26b94213b0de), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.328114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62aaffc1-259e-4619-8e55-d8fa736462a7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (74c59c5f-2265-4166-8c34-c05a3c6a7857), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.357854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Publish callbacks [] for port (9b446767-9204-4d09-bff9-fa3a72e03482), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.371198 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83090282-92c6-493b-8daf-3271b70c810d None None] Network aeb576ca-23a4-4f01-8746-09a22baff84a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:02.440534 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-62aaffc1-259e-4619-8e55-d8fa736462a7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Calling delete_port for 74c59c5f-2265-4166-8c34-c05a3c6a7857 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:02.442101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.495299 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:02.520710 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=df5a15e4-1066-41f3-b75b-6ab6d45ff057,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:02.523351 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55394) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:02.543516 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:02.544833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-21e05c05-702e-47fd-a71a-23917f704a8e None None] Provisioning complete for port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:02.545326 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21e05c05-702e-47fd-a71a-23917f704a8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.548836 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Pushing event updated for resources: {'Port': ['ID=9b446767-9204-4d09-bff9-fa3a72e03482,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:02.552317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:02.561863 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:02.562336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.597340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.663773 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8de4c1e1-6625-45be-8d90-447fcd222992 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (f6e7a11b-b7c7-436d-ad0d-49579584b59e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.680827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:02.710249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.711990 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-48fd2884-4e31-4d18-95ee-83854ebb71ff admin admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 918 time: 7.4804208 Mar 24 02:12:02.715836 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55398) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:02.757280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Sync routers for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:02.782812 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c3e8ac2-29d1-49e4-8307-4e4e98c7fc29 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.888301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (b8943750-d96e-4456-bf7c-26b94213b0de), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.897481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de4c1e1-6625-45be-8d90-447fcd222992 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event deleted for resources: {'Port': ['ID=f6e7a11b-b7c7-436d-ad0d-49579584b59e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:02.899980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:02.904042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:02.908669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-21e05c05-702e-47fd-a71a-23917f704a8e None None] Current status of the port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:02.910868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21e05c05-702e-47fd-a71a-23917f704a8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.913353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks [] for router_controller (b8943750-d96e-4456-bf7c-26b94213b0de), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:02.935828 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3a5a51e0-3aa4-497c-9582-6700ad4f221e', 'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'mac_address': 'fa:16:3e:e4:34:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:11:59Z', 'revision_number': 2, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'subnets': [{'id': '56374a24-4e35-434f-b4b8-860ef8289893', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:02.969967 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:02.985329 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Checking router: 9c57e851-60dd-408a-bb81-1858bda320e9 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:02.985927 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Updating router 9c57e851-60dd-408a-bb81-1858bda320e9 port 3a5a51e0-3aa4-497c-9582-6700ad4f221e binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:12:03.031069 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.128002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.229871 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-21e05c05-702e-47fd-a71a-23917f704a8e None None] For port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7ea84e71-731e-4ba0-8d65-8a7c06a58dd6,segment=NetworkSegment(235dbb41-94ab-49ce-be94-ff55807a3130),segment_id=235dbb41-94ab-49ce-be94-ff55807a3130)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:03.258376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21e05c05-702e-47fd-a71a-23917f704a8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.364838 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:03.407964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55400) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:03.419027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8b1aee9d-2a2b-43c6-96d7-cdc1e5c64244 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2142817153', 'description': 'tempest-description--175450728'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:03.437559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c3e8ac2-29d1-49e4-8307-4e4e98c7fc29 admin admin] Publish callbacks [] for security_group (35b0b246-bedb-4f06-8f9e-bf4bb107f2b1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.535485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (b8943750-d96e-4456-bf7c-26b94213b0de), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.535961 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Fanout notify agent at l3_agent the message router_deleted on router b8943750-d96e-4456-bf7c-26b94213b0de {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:12:03.551215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ecaac7-688a-4444-a231-d8f4c6ff1d0b tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (829d14fb-ee3c-4acd-b2bc-eddf344e9bfb), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.564332 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c3e8ac2-29d1-49e4-8307-4e4e98c7fc29 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (35b0b246-bedb-4f06-8f9e-bf4bb107f2b1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.586921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62aaffc1-259e-4619-8e55-d8fa736462a7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (74c59c5f-2265-4166-8c34-c05a3c6a7857), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.601030 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8de4c1e1-6625-45be-8d90-447fcd222992 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.605104 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8de4c1e1-6625-45be-8d90-447fcd222992 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "DELETE /v2.0/ports/f6e7a11b-b7c7-436d-ad0d-49579584b59e HTTP/1.1" status: 204 len: 168 time: 3.2767410 Mar 24 02:12:03.631196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ecaac7-688a-4444-a231-d8f4c6ff1d0b tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.637418 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-94ecaac7-688a-4444-a231-d8f4c6ff1d0b tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "DELETE /v2.0/ports/829d14fb-ee3c-4acd-b2bc-eddf344e9bfb HTTP/1.1" status: 204 len: 168 time: 2.5317023 Mar 24 02:12:03.639822 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9c3e8ac2-29d1-49e4-8307-4e4e98c7fc29 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=5b43564d7d9c43bcbab9581e102e0d3e&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1151326 Mar 24 02:12:03.646907 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Publish callbacks [] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.653944 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55402) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:03.654531 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55404) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:03.655037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55406) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:03.655781 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.664785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:11:57Z', 'revision_number': 3, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:03.675444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08', 'external_fixed_ips': [{'subnet_id': '6723a6f9-b722-45c9-8a12-6ff6721ad967', 'ip_address': '2001:db8::188'}]}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:03.693314 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] create failed (client error): There was a conflict when trying to complete your request. Mar 24 02:12:03.697130 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fb207a68-c27d-46b6-b6f7-b01cf7d5269e tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 5.4250424 Mar 24 02:12:03.697130 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94ecaac7-688a-4444-a231-d8f4c6ff1d0b tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event deleted for resources: {'Port': ['ID=829d14fb-ee3c-4acd-b2bc-eddf344e9bfb,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:03.703765 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8e3a5ea-4fb8-4100-8835-b1c8c2cd58eb None None] Pushing event updated for resources: {'Port': ['ID=3a5a51e0-3aa4-497c-9582-6700ad4f221e,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:03.704649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21e05c05-702e-47fd-a71a-23917f704a8e None None] Pushing event updated for resources: {'Port': ['ID=7ea84e71-731e-4ba0-8d65-8a7c06a58dd6,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:03.716698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e85150f-6f50-43a1-b22f-16965d656df2 None None] The sync data for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv is: [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:11:57Z', 'revision_number': 3, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:03.731485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:03.731928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.736349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55408) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:03.751172 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62aaffc1-259e-4619-8e55-d8fa736462a7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.758096 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-62aaffc1-259e-4619-8e55-d8fa736462a7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] 10.222.0.20 "DELETE /v2.0/ports/74c59c5f-2265-4166-8c34-c05a3c6a7857 HTTP/1.1" status: 204 len: 168 time: 2.6557148 Mar 24 02:12:03.759407 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-d95b6924-8cb2-4c2a-b792-313ed6fd959d tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] GET failed (client error): The resource could not be found. Mar 24 02:12:03.765643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55412) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:03.766202 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62aaffc1-259e-4619-8e55-d8fa736462a7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event deleted for resources: {'Port': ['ID=74c59c5f-2265-4166-8c34-c05a3c6a7857,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:03.766842 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d95b6924-8cb2-4c2a-b792-313ed6fd959d tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "GET /v2.0/ports/829d14fb-ee3c-4acd-b2bc-eddf344e9bfb HTTP/1.1" status: 404 len: 333 time: 0.0876734 Mar 24 02:12:03.777203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55414) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:03.806020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8b1aee9d-2a2b-43c6-96d7-cdc1e5c64244 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.819843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Request body: {'port': {'network_id': '2c18001a-08a3-4102-a103-ee446a81214d', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1712180468'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:03.857499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.878805 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Attempting to bind port 3a5a51e0-3aa4-497c-9582-6700ad4f221e on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:03.879381 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Attempting to bind port 3a5a51e0-3aa4-497c-9582-6700ad4f221e by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:03.879686 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Made reservation on behalf of e504d6bef7c748b89165f581c15466df for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:03.880194 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Attempting to bind port 3a5a51e0-3aa4-497c-9582-6700ad4f221e on network 597625fc-4c02-4901-9b3e-46b781f61da1 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:03.888043 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:03.888655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.888989 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Checking segment: {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:03.889567 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.890224 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Bound using segment: {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:03.891010 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Bound port: 3a5a51e0-3aa4-497c-9582-6700ad4f221e, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:03.891549 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.906568 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7e06e399-1fd9-4838-82ba-e46410c1e62c None None] Provisioning complete for port 9b446767-9204-4d09-bff9-fa3a72e03482 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:03.907116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e06e399-1fd9-4838-82ba-e46410c1e62c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:03.929447 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] device_id is not set on port 96e8ec9b-40ca-456d-a1b7-7ff34486562a yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:03.967156 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:12:03.989161 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] For port 3a5a51e0-3aa4-497c-9582-6700ad4f221e, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:03.995482 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] For port 3a5a51e0-3aa4-497c-9582-6700ad4f221e, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3a5a51e0-3aa4-497c-9582-6700ad4f221e,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:04.005127 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.060828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:00Z', 'revision_number': 3, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:11:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:04.080729 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8e3a5ea-4fb8-4100-8835-b1c8c2cd58eb None None] Pushing event updated for resources: {'Port': ['ID=3a5a51e0-3aa4-497c-9582-6700ad4f221e,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:04.099279 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:04.100144 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:04.163635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7e06e399-1fd9-4838-82ba-e46410c1e62c None None] Port 9b446767-9204-4d09-bff9-fa3a72e03482 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:04.188721 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Checking router: f52240e9-2e82-4113-abe0-f8b0dcb76cb1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:04.189471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Updating router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 port 9a4b70bd-f398-49e6-9234-c79d598e3a65 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:12:04.247420 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:04.257068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:04.264492 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device df5a15e4-1066-41f3-b75b-6ab6d45ff057 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:04.265089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c3e8ac2-29d1-49e4-8307-4e4e98c7fc29 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=35b0b246-bedb-4f06-8f9e-bf4bb107f2b1,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:04.267935 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.272337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.362712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks [] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.363290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_controller (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.429137 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.479735 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ebff4c14-bc8f-4937-abf0-ffc2e5d168fa tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] 10.222.0.20 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4560 time: 0.7010837 Mar 24 02:12:04.480457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55420) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:04.498765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-1670431422'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:04.514782 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Provisioning complete for port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:04.515507 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.549294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.630224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-93b96881-7831-4f88-9028-f88346065cb5 admin admin] Publish callbacks [] for security_group (35b0b246-bedb-4f06-8f9e-bf4bb107f2b1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.646338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Network 2c18001a-08a3-4102-a103-ee446a81214d is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:04.649736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:04.653603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port df5a15e4-1066-41f3-b75b-6ab6d45ff057 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:04.654097 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.667628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:04.677989 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:04.679621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.684181 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Made reservation on behalf of dfa9b9d47860473eaa1279e6fcd94aef for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:04.695066 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3a5a51e0-3aa4-497c-9582-6700ad4f221e', 'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'mac_address': 'fa:16:3e:e4:34:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'subnets': [{'id': '56374a24-4e35-434f-b4b8-860ef8289893', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:04.698187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.704518 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8b1aee9d-2a2b-43c6-96d7-cdc1e5c64244 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group (2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.709894 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Publish callbacks [] for port (9b446767-9204-4d09-bff9-fa3a72e03482), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.743550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'Port': ['ID=96e8ec9b-40ca-456d-a1b7-7ff34486562a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:04.744887 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5617d4aa-71bd-4114-8eaf-1637ee4c6b50 None None] The sync data for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv is: [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3a5a51e0-3aa4-497c-9582-6700ad4f221e', 'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'mac_address': 'fa:16:3e:e4:34:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'subnets': [{'id': '56374a24-4e35-434f-b4b8-860ef8289893', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:04.764880 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.768660 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-77a16e5f-41f2-4de9-abca-880ce7ec0cde tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 0.9813204 Mar 24 02:12:04.776908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55422) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:04.779513 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8b1aee9d-2a2b-43c6-96d7-cdc1e5c64244 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.807238 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:04.818994 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 129} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:04.842156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.842945 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.867580 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Current status of the port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:04.880810 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4d792f92-6c91-4f91-9a53-3e1dd0bd87ed), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.881326 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Added segment 4d792f92-6c91-4f91-9a53-3e1dd0bd87ed of type vlan for network a7bd76b6-fded-467a-a183-2680db04e726 Mar 24 02:12:04.942740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Provisioning complete for port 3a5a51e0-3aa4-497c-9582-6700ad4f221e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:04.943290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.989667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:04.995571 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port df5a15e4-1066-41f3-b75b-6ab6d45ff057 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:04.998362 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (a7bd76b6-fded-467a-a183-2680db04e726), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.000281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.070286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:05.080886 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8b1aee9d-2a2b-43c6-96d7-cdc1e5c64244 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.082141 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8b1aee9d-2a2b-43c6-96d7-cdc1e5c64244 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 1.6705589 Mar 24 02:12:05.085759 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55426) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:05.094295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-69f3ea83-782d-4c66-a56b-dcbf147caf71 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Request body: {'security_group_rule': {'security_group_id': '2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:05.158167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69f3ea83-782d-4c66-a56b-dcbf147caf71 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group_rule (8e0dcb42-665c-44f9-b5a5-0189cf8225da), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.169651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:05.172823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0484a095-04c3-42f1-8847-4f40fe57fe51 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Deleting port 36c21b04-65ce-4317-ac40-8cc25078b4fe {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:05.173159 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0484a095-04c3-42f1-8847-4f40fe57fe51 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (36c21b04-65ce-4317-ac40-8cc25078b4fe), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.214347 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Publish callbacks [] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.229951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Current status of the port 3a5a51e0-3aa4-497c-9582-6700ad4f221e is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:05.230353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.232646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (a7bd76b6-fded-467a-a183-2680db04e726), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.240181 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:05.241250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.245345 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Pushing event updated for resources: {'Port': ['ID=9b446767-9204-4d09-bff9-fa3a72e03482,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:05.257681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.318711 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbaed74a-f560-445c-8771-5c7d1764d4e1 None None] Pushing event updated for resources: {'Port': ['ID=9a4b70bd-f398-49e6-9234-c79d598e3a65,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:05.363927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-93b96881-7831-4f88-9028-f88346065cb5 admin admin] Publish callbacks [] for security_group (35b0b246-bedb-4f06-8f9e-bf4bb107f2b1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.364429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] For port 3a5a51e0-3aa4-497c-9582-6700ad4f221e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3a5a51e0-3aa4-497c-9582-6700ad4f221e,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:05.408217 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Attempting to bind port 9a4b70bd-f398-49e6-9234-c79d598e3a65 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:05.408916 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Attempting to bind port 9a4b70bd-f398-49e6-9234-c79d598e3a65 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:05.410374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Attempting to bind port 9a4b70bd-f398-49e6-9234-c79d598e3a65 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:05.413327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.452510 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Could not find standard attr ID for object 74c59c5f-2265-4166-8c34-c05a3c6a7857. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:12:05.454964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69f3ea83-782d-4c66-a56b-dcbf147caf71 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group_rule (8e0dcb42-665c-44f9-b5a5-0189cf8225da), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.456559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:05.457088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:05.461772 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.464160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event updated for resources: {'Network': ['ID=a7bd76b6-fded-467a-a183-2680db04e726,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:05.464810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:05.465443 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Bound port: 9a4b70bd-f398-49e6-9234-c79d598e3a65, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:05.465996 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.472429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69f3ea83-782d-4c66-a56b-dcbf147caf71 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (8e0dcb42-665c-44f9-b5a5-0189cf8225da), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.476124 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b1aee9d-2a2b-43c6-96d7-cdc1e5c64244 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:05.499625 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-daecdd73-8297-465e-a587-e75741b3ba34 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 1.0165102 Mar 24 02:12:05.501470 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55428) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:05.503691 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f3ea83-782d-4c66-a56b-dcbf147caf71 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e0dcb42-665c-44f9-b5a5-0189cf8225da,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:05.547587 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] For port 9a4b70bd-f398-49e6-9234-c79d598e3a65, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:05.551007 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] For port 9a4b70bd-f398-49e6-9234-c79d598e3a65, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9a4b70bd-f398-49e6-9234-c79d598e3a65,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:05.562216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3a5a51e0-3aa4-497c-9582-6700ad4f221e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:05.591253 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network a7bd76b6-fded-467a-a183-2680db04e726 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:05.600437 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.649149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69f3ea83-782d-4c66-a56b-dcbf147caf71 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.650385 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-69f3ea83-782d-4c66-a56b-dcbf147caf71 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5631557 Mar 24 02:12:05.659870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55430) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:05.670778 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-35ad45ba-ed36-4a10-b0c7-7a3148360517 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Request body: {'security_group_rule': {'security_group_id': '2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:05.693463 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-bfdfc570-7965-45f1-94f5-01ffe861f58a None None] Provisioning complete for port 3a5a51e0-3aa4-497c-9582-6700ad4f221e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:05.693930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bfdfc570-7965-45f1-94f5-01ffe861f58a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.715745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35ad45ba-ed36-4a10-b0c7-7a3148360517 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group_rule (e3ce1102-8c00-47e3-98e1-daab3fd686ea), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.764454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4f44064-277d-4d71-9c49-43ee20a206ad None None] Pushing event updated for resources: {'Port': ['ID=3a5a51e0-3aa4-497c-9582-6700ad4f221e,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:05.785665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:05.786446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:05.789992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3a5a51e0-3aa4-497c-9582-6700ad4f221e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:05.790432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.916366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] device_id is not set on port 96e8ec9b-40ca-456d-a1b7-7ff34486562a yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:05.924227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35ad45ba-ed36-4a10-b0c7-7a3148360517 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group_rule (e3ce1102-8c00-47e3-98e1-daab3fd686ea), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.933320 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-505c4642-10b0-4187-a785-6940dd79fff5 tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] 10.222.0.20 "GET /v2.0/agents/8aeface5-bae1-4042-b03b-b97904f320d4/dhcp-networks HTTP/1.1" status: 200 len: 7257 time: 0.4251635 Mar 24 02:12:05.936678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks [] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.940836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55432) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:05.947452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35ad45ba-ed36-4a10-b0c7-7a3148360517 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (e3ce1102-8c00-47e3-98e1-daab3fd686ea), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.964185 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0484a095-04c3-42f1-8847-4f40fe57fe51 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (36c21b04-65ce-4317-ac40-8cc25078b4fe), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:05.964762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.004799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0484a095-04c3-42f1-8847-4f40fe57fe51 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Calling delete_port for 36c21b04-65ce-4317-ac40-8cc25078b4fe owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:06.021900 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-93b96881-7831-4f88-9028-f88346065cb5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (35b0b246-bedb-4f06-8f9e-bf4bb107f2b1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.025109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-93b96881-7831-4f88-9028-f88346065cb5 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.029027 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-93b96881-7831-4f88-9028-f88346065cb5 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/35b0b246-bedb-4f06-8f9e-bf4bb107f2b1 HTTP/1.1" status: 204 len: 168 time: 2.3055146 Mar 24 02:12:06.029175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ad45ba-ed36-4a10-b0c7-7a3148360517 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e3ce1102-8c00-47e3-98e1-daab3fd686ea,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:06.094764 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'Port': ['ID=96e8ec9b-40ca-456d-a1b7-7ff34486562a,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:06.117153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbaed74a-f560-445c-8771-5c7d1764d4e1 None None] Pushing event updated for resources: {'Port': ['ID=9a4b70bd-f398-49e6-9234-c79d598e3a65,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:06.121977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b96881-7831-4f88-9028-f88346065cb5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35b0b246-bedb-4f06-8f9e-bf4bb107f2b1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:06.127550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-bfdfc570-7965-45f1-94f5-01ffe861f58a None None] Current status of the port 3a5a51e0-3aa4-497c-9582-6700ad4f221e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:06.151474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35ad45ba-ed36-4a10-b0c7-7a3148360517 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.155824 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-35ad45ba-ed36-4a10-b0c7-7a3148360517 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4875205 Mar 24 02:12:06.160627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:12:06.164982 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55440) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:06.184873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:06.212895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Allocated IP 172.20.0.1 (d91de7c3-7e46-4c9d-8b0a-c988de7fd81b/02cc6c6a-e353-4d82-9d85-3973d8220a39/c09745fa-b8dd-44bc-bd26-2ffd00f709e6) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:06.260199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bd084a4-052c-4852-94c7-6c5623756fd4 tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] Network a7bd76b6-fded-467a-a183-2680db04e726 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:12:06.275542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:06.284918 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6bd084a4-052c-4852-94c7-6c5623756fd4 tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] 10.222.0.20 "POST /v2.0/agents/8aeface5-bae1-4042-b03b-b97904f320d4/dhcp-networks HTTP/1.1" status: 201 len: 201 time: 0.3428199 Mar 24 02:12:06.286545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:06.287134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:06.287708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:06.290559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55442) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:06.309908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:06.310651 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:06.314258 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 2 to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a Mar 24 02:12:06.371065 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.395989 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:06.399084 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:06.399520 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:06.424811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:06.425528 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:06.428234 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 3 to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a Mar 24 02:12:06.479601 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:06.480522 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:06.480987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:06.516845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:06.518006 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:06.520574 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 4 to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a Mar 24 02:12:06.525389 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3a5a51e0-3aa4-497c-9582-6700ad4f221e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:06.526542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:06.572726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:06.573158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:06.573581 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:06.582055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b4b2546-3328-43bf-9ca2-44306159d538 None None] Network a7bd76b6-fded-467a-a183-2680db04e726 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:06.591645 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c52f798c-9d9d-4714-affc-634519d12c6a tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] 10.222.0.20 "GET /v2.0/agents/8aeface5-bae1-4042-b03b-b97904f320d4/dhcp-networks HTTP/1.1" status: 200 len: 8027 time: 0.2996335 Mar 24 02:12:06.595802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55450) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:06.597907 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:06.599141 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:06.604914 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 5 to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a Mar 24 02:12:06.620546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:06.620933 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:06.621377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:06.637457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:06.637910 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:06.640876 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 6 to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a Mar 24 02:12:06.707063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-be5c1e69-9b56-4536-b381-8c97f2317fd0 None None] Provisioning complete for port 9b446767-9204-4d09-bff9-fa3a72e03482 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:06.709002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-be5c1e69-9b56-4536-b381-8c97f2317fd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.714619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:06.715013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:06.715411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:06.728220 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4eab1a1a-d0c4-4e80-bf18-cb16acc7c100 tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] 10.222.0.20 "DELETE /v2.0/agents/8aeface5-bae1-4042-b03b-b97904f320d4/dhcp-networks/a7bd76b6-fded-467a-a183-2680db04e726 HTTP/1.1" status: 204 len: 168 time: 0.1306739 Mar 24 02:12:06.729950 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:06.730366 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:06.730841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55456) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:06.731346 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 7 to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a Mar 24 02:12:06.762038 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:06.762361 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:06.762729 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:06.769062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0484a095-04c3-42f1-8847-4f40fe57fe51 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (36c21b04-65ce-4317-ac40-8cc25078b4fe), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.773242 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-be5c1e69-9b56-4536-b381-8c97f2317fd0 None None] Port 9b446767-9204-4d09-bff9-fa3a72e03482 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:06.785637 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.822473 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:06.822810 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:06.824530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:06.825088 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 8 to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a Mar 24 02:12:06.828385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Publish callbacks [] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.849307 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:06.849645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:06.857530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:06.857707 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0484a095-04c3-42f1-8847-4f40fe57fe51 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Pushing event deleted for resources: {'Port': ['ID=36c21b04-65ce-4317-ac40-8cc25078b4fe,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:06.861205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:06.861393 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a7f8a86c-d083-4e94-a770-405fcd8f5d89 admin admin] 10.222.0.20 "PUT /v2.0/routers/2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.0964563 Mar 24 02:12:06.861572 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:06.863370 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 9 to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a Mar 24 02:12:06.882666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:06.883802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.925787 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:06.932656 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bc7d479c-6344-4116-88c1-00c7bb01c701 tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] 10.222.0.20 "GET /v2.0/agents/8aeface5-bae1-4042-b03b-b97904f320d4/dhcp-networks HTTP/1.1" status: 200 len: 7257 time: 0.1974928 Mar 24 02:12:06.933268 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55462) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:06.964681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:06.965331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:06.965681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:06.975055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:00Z', 'revision_number': 3, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:06.990844 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-76d052eb-e2d0-41e3-8b26-18ed57f74a7f tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] 10.222.0.20 "GET /v2.0/networks/aeb576ca-23a4-4f01-8746-09a22baff84a/dhcp-agents HTTP/1.1" status: 200 len: 808 time: 0.0499122 Mar 24 02:12:06.991597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55466) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:06.992229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:06.992563 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:07.014086 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 10 to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a Mar 24 02:12:07.019150 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Sync routers for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:07.030324 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7d33356-2e69-476d-bfe4-4ddae7ba41d1 None None] The sync data for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv is: [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:00Z', 'revision_number': 3, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:07.046502 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:07.047173 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:07.080980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:07.096405 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0484a095-04c3-42f1-8847-4f40fe57fe51 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.105287 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0484a095-04c3-42f1-8847-4f40fe57fe51 tempest-RoutersAdminNegativeTest-1732522106 tempest-RoutersAdminNegativeTest-1732522106-project-admin] 10.222.0.20 "DELETE /v2.0/ports/36c21b04-65ce-4317-ac40-8cc25078b4fe HTTP/1.1" status: 204 len: 168 time: 3.3366396 Mar 24 02:12:07.109102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:07.109920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:07.127313 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d9536b00-80ab-4f60-b951-e5dbb1e04508 tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] 10.222.0.20 "GET /v2.0/networks/aeb576ca-23a4-4f01-8746-09a22baff84a/dhcp-agents HTTP/1.1" status: 200 len: 808 time: 0.1297755 Mar 24 02:12:07.128387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:07.128977 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:07.129168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:07.129614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.130237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4c6d0a24-5d23-4334-adb5-b107b1a904a9 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:07.134120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55476) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:07.267475 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 4c6d0a24-5d23-4334-adb5-b107b1a904a9 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:07.268286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.301219 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.334531 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:07.373738 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] For port 96e8ec9b-40ca-456d-a1b7-7ff34486562a, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:07.374027 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempted to set empty binding levels {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Mar 24 02:12:07.385213 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.399276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Pushing event updated for resources: {'Port': ['ID=c09745fa-b8dd-44bc-bd26-2ffd00f709e6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:07.408056 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.529179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 4c6d0a24-5d23-4334-adb5-b107b1a904a9 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:07.529573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.591403 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 4c6d0a24-5d23-4334-adb5-b107b1a904a9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4c6d0a24-5d23-4334-adb5-b107b1a904a9,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:07.600862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.611093 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Allocated IP 172.26.2.33 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/7530a9ed-de50-4a2c-af9d-42d050ea9a38) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:07.743193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=4c6d0a24-5d23-4334-adb5-b107b1a904a9,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:07.752881 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55482) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:07.753217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55484) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:07.789975 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3edd6070-8def-4150-8098-496d5b71c5fd tempest-DHCPAgentSchedulersTestJSON-790345762 tempest-DHCPAgentSchedulersTestJSON-790345762-project-admin] 10.222.0.20 "GET /v2.0/agents/8aeface5-bae1-4042-b03b-b97904f320d4/dhcp-networks HTTP/1.1" status: 200 len: 7257 time: 0.6525090 Mar 24 02:12:07.805822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55494) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:07.808944 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3a5a51e0-3aa4-497c-9582-6700ad4f221e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:07.817184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] In _notify_port_updated(), no bound segment for port 96e8ec9b-40ca-456d-a1b7-7ff34486562a on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:12:07.818361 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:07.819006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.821769 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "PUT /v2.0/ports/96e8ec9b-40ca-456d-a1b7-7ff34486562a HTTP/1.1" status: 200 len: 977 time: 3.0333400 Mar 24 02:12:07.824717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55496) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:07.933520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3a5a51e0-3aa4-497c-9582-6700ad4f221e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:07.933520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:07.958110 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c8fea9f-f166-4852-8145-cfc697f0be53 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'Port': ['ID=96e8ec9b-40ca-456d-a1b7-7ff34486562a,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:07.981883 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '9b446767-9204-4d09-bff9-fa3a72e03482', 'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'mac_address': 'fa:16:3e:8d:f5:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:01Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 2, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'subnets': [{'id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:07.985033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (a7bd76b6-fded-467a-a183-2680db04e726), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.010928 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairTestJSON-test-network-1986977785'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:08.021560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:08.045123 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:08.065003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:08.065718 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.096996 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Checking router: 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:08.106956 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Updating router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c port 9b446767-9204-4d09-bff9-fa3a72e03482 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:12:08.134484 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Allocated IP 2001:db8::188 (1d54abbd-4eda-40cf-82ef-27bc3e194d08/6723a6f9-b722-45c9-8a12-6ff6721ad967/1cbf65ef-f4a9-41c8-84db-28bd13cf98a4) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:08.167493 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55498) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:08.168158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (a7bd76b6-fded-467a-a183-2680db04e726), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.178911 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.185620 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3a5a51e0-3aa4-497c-9582-6700ad4f221e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:08.190661 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-f56324d9-0fa1-4cea-8d05-1ae42218d20e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Request body: {'security_group': {'name': 'tempest-securitygroup--394094996', 'description': 'tempest-description--363015517'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:08.202541 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > segment before_delete 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.202893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.204041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.204429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > port after_create 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.204761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > port after_delete 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.205103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > port after_update 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.205424 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > segment after_delete 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.205802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > subnet after_create 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.206308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > subnet after_delete 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.206708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > subnet after_update 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.231878 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-baf52f99-7ba6-4119-a437-bb8430ef6425 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.233671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Made reservation on behalf of a3f362c54abc4116a2d8ae1cbdbafe9b for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:08.236993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.472937 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for port (7530a9ed-de50-4a2c-af9d-42d050ea9a38), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.490662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > subnet after_create 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.491031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > subnet after_delete 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.491371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > subnet before_create 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.491698 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Subscribe: > subnet before_update 55550000 {{(pid=104037) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:08.492056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a7bd76b6-fded-467a-a183-2680db04e726']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:08.508532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.512880 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-14956fce-078a-40eb-9082-ca86593839d6 None None] Provisioning complete for port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:08.516995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4d792f92-6c91-4f91-9a53-3e1dd0bd87ed') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:08.517296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4d792f92-6c91-4f91-9a53-3e1dd0bd87ed') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:08.519721 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.520200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.520664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.521121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.521576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.522031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.522609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.522935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-14956fce-078a-40eb-9082-ca86593839d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.523032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.523460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.523911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.524360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.524813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.525260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.525716 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.526169 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:08.528698 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-feb3f42a-22c2-4978-82b7-7744d190288e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 14196 time: 0.6696703 Mar 24 02:12:08.533839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55500) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:08.537277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (4d792f92-6c91-4f91-9a53-3e1dd0bd87ed), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.537546 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f56324d9-0fa1-4cea-8d05-1ae42218d20e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.562888 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Publish callbacks [] for port (9b446767-9204-4d09-bff9-fa3a72e03482), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.568823 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.598491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4d792f92-6c91-4f91-9a53-3e1dd0bd87ed), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.603880 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-14956fce-078a-40eb-9082-ca86593839d6 None None] Port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:08.622608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Releasing vlan 129 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:08.623596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (4d792f92-6c91-4f91-9a53-3e1dd0bd87ed), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: from cryptography.utils import int_from_bytes Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: from cryptography.utils import int_from_bytes Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:08.629061 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:08.645683 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd59ea3d-47b9-4e64-9f5c-4985bc75a279 None None] Pushing event updated for resources: {'Port': ['ID=9b446767-9204-4d09-bff9-fa3a72e03482,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:08.742915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ce203712-6ce1-4722-9095-7f1365440e15 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Deleting port 96e8ec9b-40ca-456d-a1b7-7ff34486562a {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:08.743111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce203712-6ce1-4722-9095-7f1365440e15 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.748953 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Attempting to bind port 9b446767-9204-4d09-bff9-fa3a72e03482 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:08.749713 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Attempting to bind port 9b446767-9204-4d09-bff9-fa3a72e03482 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:08.753103 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Attempting to bind port 9b446767-9204-4d09-bff9-fa3a72e03482 on network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:08.763530 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:08.765095 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Checking segment: {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:08.765783 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.766780 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Bound using segment: {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:08.767547 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Bound port: 9b446767-9204-4d09-bff9-fa3a72e03482, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:08.768190 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.797385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (a7bd76b6-fded-467a-a183-2680db04e726), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.816622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f56324d9-0fa1-4cea-8d05-1ae42218d20e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group (eef280c3-0009-459a-81fe-def34b7b79a0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.822014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (7530a9ed-de50-4a2c-af9d-42d050ea9a38), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.829730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-ce203712-6ce1-4722-9095-7f1365440e15 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] For port 96e8ec9b-40ca-456d-a1b7-7ff34486562a, host hv-neutron-8348, got binding levels [] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:08.830335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce203712-6ce1-4722-9095-7f1365440e15 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.833468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f56324d9-0fa1-4cea-8d05-1ae42218d20e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (eef280c3-0009-459a-81fe-def34b7b79a0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.844365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.850885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ce203712-6ce1-4722-9095-7f1365440e15 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Calling delete_port for 96e8ec9b-40ca-456d-a1b7-7ff34486562a owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:08.868756 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] For port 9b446767-9204-4d09-bff9-fa3a72e03482, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:08.872439 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] For port 9b446767-9204-4d09-bff9-fa3a72e03482, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9b446767-9204-4d09-bff9-fa3a72e03482,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:08.881671 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.882477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event deleted for resources: {'Network': ['ID=a7bd76b6-fded-467a-a183-2680db04e726,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:08.882782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.884879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.891911 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4055a14a-a8a2-419b-bc3e-3129303d7cb9 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] 10.222.0.20 "DELETE /v2.0/networks/a7bd76b6-fded-467a-a183-2680db04e726 HTTP/1.1" status: 204 len: 168 time: 1.0812638 Mar 24 02:12:08.899199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55502) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:08.941348 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-7b0a3b61-714a-4768-965d-bcfc94f7c8f7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] DELETE failed (client error): The resource could not be found. Mar 24 02:12:08.942277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7b0a3b61-714a-4768-965d-bcfc94f7c8f7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:12:08.946942 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7b0a3b61-714a-4768-965d-bcfc94f7c8f7 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] 10.222.0.20 "DELETE /v2.0/ports/74c59c5f-2265-4166-8c34-c05a3c6a7857 HTTP/1.1" status: 404 len: 333 time: 0.0460854 Mar 24 02:12:08.955120 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:08.955791 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:08.966178 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55504) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:08.981760 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:08.994094 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f56324d9-0fa1-4cea-8d05-1ae42218d20e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:08.998044 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f56324d9-0fa1-4cea-8d05-1ae42218d20e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.8197253 Mar 24 02:12:09.002656 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55508) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:09.008369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-80fa8072-d525-47dc-adea-4e585065a673 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Request body: {'security_group_rule': {'security_group_id': 'eef280c3-0009-459a-81fe-def34b7b79a0', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:09.010011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f56324d9-0fa1-4cea-8d05-1ae42218d20e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Pushing event updated for resources: {'SecurityGroup': ['ID=eef280c3-0009-459a-81fe-def34b7b79a0,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:09.012369 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Pushing event updated for resources: {'Port': ['ID=7530a9ed-de50-4a2c-af9d-42d050ea9a38,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:09.014765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:09.063136 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce203712-6ce1-4722-9095-7f1365440e15 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (96e8ec9b-40ca-456d-a1b7-7ff34486562a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.064218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a1b226d0-91ef-4b0c-b3c0-74795271be57 None None] Provisioning complete for port 9b446767-9204-4d09-bff9-fa3a72e03482 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:09.064767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a1b226d0-91ef-4b0c-b3c0-74795271be57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.075440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80fa8072-d525-47dc-adea-4e585065a673 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group_rule (648c76e9-6f43-4dea-b490-eee6b0348ca0), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.136162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce203712-6ce1-4722-9095-7f1365440e15 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event deleted for resources: {'Port': ['ID=96e8ec9b-40ca-456d-a1b7-7ff34486562a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:09.138564 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-d749355f-d2f6-4706-9442-be6ad14bd03f tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Deleting subnet cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:12:09.141042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce203712-6ce1-4722-9095-7f1365440e15 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.150129 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ce203712-6ce1-4722-9095-7f1365440e15 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "DELETE /v2.0/ports/96e8ec9b-40ca-456d-a1b7-7ff34486562a HTTP/1.1" status: 204 len: 168 time: 0.6149309 Mar 24 02:12:09.154640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d749355f-d2f6-4706-9442-be6ad14bd03f tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks [] for subnet (cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.154954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55512) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:09.206817 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-ea0f75b7-749c-4675-8871-511b733bfed0 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] GET failed (client error): The resource could not be found. Mar 24 02:12:09.215149 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a1b226d0-91ef-4b0c-b3c0-74795271be57 None None] Current status of the port 9b446767-9204-4d09-bff9-fa3a72e03482 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:09.216162 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a1b226d0-91ef-4b0c-b3c0-74795271be57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.219048 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ea0f75b7-749c-4675-8871-511b733bfed0 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "GET /v2.0/ports/96e8ec9b-40ca-456d-a1b7-7ff34486562a HTTP/1.1" status: 404 len: 333 time: 0.0629988 Mar 24 02:12:09.224453 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55514) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:09.236325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-236752269', 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:09.246976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:09.271775 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80fa8072-d525-47dc-adea-4e585065a673 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group_rule (648c76e9-6f43-4dea-b490-eee6b0348ca0), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.279073 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80fa8072-d525-47dc-adea-4e585065a673 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (648c76e9-6f43-4dea-b490-eee6b0348ca0), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.282071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a1b226d0-91ef-4b0c-b3c0-74795271be57 None None] For port 9b446767-9204-4d09-bff9-fa3a72e03482, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9b446767-9204-4d09-bff9-fa3a72e03482,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:09.291123 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a1b226d0-91ef-4b0c-b3c0-74795271be57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.297944 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-baf52f99-7ba6-4119-a437-bb8430ef6425 admin admin] Publish callbacks [] for security_group (480a3dd9-a977-41b8-8fd6-273104d143e0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.299325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.342143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80fa8072-d525-47dc-adea-4e585065a673 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=648c76e9-6f43-4dea-b490-eee6b0348ca0,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:09.346922 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd59ea3d-47b9-4e64-9f5c-4985bc75a279 None None] Pushing event updated for resources: {'Port': ['ID=9b446767-9204-4d09-bff9-fa3a72e03482,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:09.359892 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80fa8072-d525-47dc-adea-4e585065a673 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.363142 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-80fa8072-d525-47dc-adea-4e585065a673 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3592131 Mar 24 02:12:09.366230 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55516) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:09.371832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-05fdf8bd-9b15-4745-8256-846f643193d2 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Request body: {'security_group_rule': {'security_group_id': 'eef280c3-0009-459a-81fe-def34b7b79a0', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:09.388153 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:09.415925 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-05fdf8bd-9b15-4745-8256-846f643193d2 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group_rule (f43b9e1f-793c-4127-9f69-072c3239c40e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.419549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for security_group (da312a2a-398a-41dd-9893-fd7e702eed0c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.422758 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b226d0-91ef-4b0c-b3c0-74795271be57 None None] Pushing event updated for resources: {'Port': ['ID=9b446767-9204-4d09-bff9-fa3a72e03482,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:09.444355 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d749355f-d2f6-4706-9442-be6ad14bd03f tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks [] for subnet (cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.447200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2a685b0b-b0d9-4185-ad40-1c2816fd5c89 None None] Provisioning complete for port 9b446767-9204-4d09-bff9-fa3a72e03482 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:09.450419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2a685b0b-b0d9-4185-ad40-1c2816fd5c89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.461843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-baf52f99-7ba6-4119-a437-bb8430ef6425 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (480a3dd9-a977-41b8-8fd6-273104d143e0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.483703 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (da312a2a-398a-41dd-9893-fd7e702eed0c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.520857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-05fdf8bd-9b15-4745-8256-846f643193d2 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group_rule (f43b9e1f-793c-4127-9f69-072c3239c40e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.527705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-05fdf8bd-9b15-4745-8256-846f643193d2 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (f43b9e1f-793c-4127-9f69-072c3239c40e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.549668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05fdf8bd-9b15-4745-8256-846f643193d2 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f43b9e1f-793c-4127-9f69-072c3239c40e,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:09.567935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2a685b0b-b0d9-4185-ad40-1c2816fd5c89 None None] Current status of the port 9b446767-9204-4d09-bff9-fa3a72e03482 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:09.572077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Made reservation on behalf of e504d6bef7c748b89165f581c15466df for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:09.574797 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.578385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-05fdf8bd-9b15-4745-8256-846f643193d2 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.582593 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-05fdf8bd-9b15-4745-8256-846f643193d2 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2123158 Mar 24 02:12:09.582953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55518) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:09.591194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:09.623168 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.646620 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event updated for resources: {'Port': ['ID=1cbf65ef-f4a9-41c8-84db-28bd13cf98a4,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:09.660363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Network 1d54abbd-4eda-40cf-82ef-27bc3e194d08 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:09.665800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 108} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:09.693619 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:09.697211 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-baf52f99-7ba6-4119-a437-bb8430ef6425 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=b0a9ab1fcf834773af20e2cd98cc925b&name=default HTTP/1.1" status: 200 len: 2996 time: 1.9406288 Mar 24 02:12:09.697911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf52f99-7ba6-4119-a437-bb8430ef6425 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=480a3dd9-a977-41b8-8fd6-273104d143e0,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:09.701793 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55520) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:09.703257 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:09.709260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for floatingip (55088382-7ea7-41f1-a0cb-71a22f16598d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.714252 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '9b446767-9204-4d09-bff9-fa3a72e03482', 'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'mac_address': 'fa:16:3e:8d:f5:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:01Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'subnets': [{'id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:09.723679 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (2dcf15f9-148f-4ffe-b942-f75d792de49b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.724016 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Added segment 2dcf15f9-148f-4ffe-b942-f75d792de49b of type vlan for network b57330c4-af00-4735-8aae-7d7d77f8f136 Mar 24 02:12:09.757077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] device_id is not set on port 31c3bb7e-3ec9-409c-a8d0-dba833fb8327 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:09.771906 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4be6d2ac-191a-4660-98b0-1be1c2707302 None None] The sync data for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv is: [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '9b446767-9204-4d09-bff9-fa3a72e03482', 'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'mac_address': 'fa:16:3e:8d:f5:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:01Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'subnets': [{'id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:09.788933 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-814d8440-9844-4d93-8028-e00ecdedf811 admin admin] Publish callbacks [] for security_group (480a3dd9-a977-41b8-8fd6-273104d143e0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.826965 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-814d8440-9844-4d93-8028-e00ecdedf811 admin admin] Publish callbacks [] for security_group (480a3dd9-a977-41b8-8fd6-273104d143e0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.846655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.861054 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d749355f-d2f6-4706-9442-be6ad14bd03f tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:09.957634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9a4b70bd-f398-49e6-9234-c79d598e3a65 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:10.056557 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9a4b70bd-f398-49e6-9234-c79d598e3a65 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:10.057152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.063533 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Publish callbacks [] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.069848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Allocated IP 172.26.2.66 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/5041086b-6410-4304-9895-38505ba6c5d7) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:10.074204 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-814d8440-9844-4d93-8028-e00ecdedf811 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (480a3dd9-a977-41b8-8fd6-273104d143e0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.077682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-814d8440-9844-4d93-8028-e00ecdedf811 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.079053 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-814d8440-9844-4d93-8028-e00ecdedf811 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/480a3dd9-a977-41b8-8fd6-273104d143e0 HTTP/1.1" status: 204 len: 168 time: 0.3720889 Mar 24 02:12:10.094063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-814d8440-9844-4d93-8028-e00ecdedf811 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=480a3dd9-a977-41b8-8fd6-273104d143e0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:10.153210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'SecurityGroup': ['ID=da312a2a-398a-41dd-9893-fd7e702eed0c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:10.220040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9a4b70bd-f398-49e6-9234-c79d598e3a65 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:10.221094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.245791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 9a4b70bd-f398-49e6-9234-c79d598e3a65, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9a4b70bd-f398-49e6-9234-c79d598e3a65,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:10.251048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.252077 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4c6d0a24-5d23-4334-adb5-b107b1a904a9 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:10.265730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for port (5041086b-6410-4304-9895-38505ba6c5d7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.339296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5041086b-6410-4304-9895-38505ba6c5d7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.367244 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=9a4b70bd-f398-49e6-9234-c79d598e3a65,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:10.369635 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7530a9ed-de50-4a2c-af9d-42d050ea9a38), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.400836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:10.401511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 4c6d0a24-5d23-4334-adb5-b107b1a904a9 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:10.401898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.406930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:10.409626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Pushing event updated for resources: {'Port': ['ID=5041086b-6410-4304-9895-38505ba6c5d7,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:10.412421 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:10.510589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.511540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.522003 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 4c6d0a24-5d23-4334-adb5-b107b1a904a9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:10.561368 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (b57330c4-af00-4735-8aae-7d7d77f8f136), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.577718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55526) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:10.586970 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d749355f-d2f6-4706-9442-be6ad14bd03f tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.592541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks [] for port (31c3bb7e-3ec9-409c-a8d0-dba833fb8327), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.613083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for floatingip (a4d631f5-1e36-4cb9-a3b6-9fa1737e7397), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.670157 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8dc0438c-f6ba-4348-91c6-ffa797c52d8a admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=79c9dac944a44ef6a5bad97bf03d9529&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0894635 Mar 24 02:12:10.671499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55528) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:10.684607 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d749355f-d2f6-4706-9442-be6ad14bd03f tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event deleted for resources: {'Subnet': ['ID=cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:10.692013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5041086b-6410-4304-9895-38505ba6c5d7), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.815865 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d232d2eb-dd77-402f-892b-a363bbcb3b04 admin admin] Publish callbacks [] for security_group (d7a785d9-65cd-45a7-8930-3ef0c50a7f5a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.848002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d232d2eb-dd77-402f-892b-a363bbcb3b04 admin admin] Publish callbacks [] for security_group (d7a785d9-65cd-45a7-8930-3ef0c50a7f5a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.874778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f41ecfa-195a-4f79-8719-d3a0ae06e168 None None] Network aeb576ca-23a4-4f01-8746-09a22baff84a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:10.959371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for port (5041086b-6410-4304-9895-38505ba6c5d7), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.965808 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (5041086b-6410-4304-9895-38505ba6c5d7), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.977355 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d749355f-d2f6-4706-9442-be6ad14bd03f tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:10.984622 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d749355f-d2f6-4706-9442-be6ad14bd03f tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] 10.222.0.20 "DELETE /v2.0/subnets/cb42bd9f-40e2-41c1-a7d6-3416ad5bff2d HTTP/1.1" status: 204 len: 168 time: 2.0129182 Mar 24 02:12:10.985711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Pushing event updated for resources: {'Port': ['ID=c09745fa-b8dd-44bc-bd26-2ffd00f709e6,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:11.015557 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55530) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:11.036015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d232d2eb-dd77-402f-892b-a363bbcb3b04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d7a785d9-65cd-45a7-8930-3ef0c50a7f5a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.040501 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d232d2eb-dd77-402f-892b-a363bbcb3b04 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.041900 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d232d2eb-dd77-402f-892b-a363bbcb3b04 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/d7a785d9-65cd-45a7-8930-3ef0c50a7f5a HTTP/1.1" status: 204 len: 168 time: 0.3694985 Mar 24 02:12:11.122472 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:11.129406 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:11.139238 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (b57330c4-af00-4735-8aae-7d7d77f8f136), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.145287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:11.146098 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.152169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Pushing event updated for resources: {'Port': ['ID=5041086b-6410-4304-9895-38505ba6c5d7,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:11.160473 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d232d2eb-dd77-402f-892b-a363bbcb3b04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7a785d9-65cd-45a7-8930-3ef0c50a7f5a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:11.173575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] DHCP port deletion for aeb576ca-23a4-4f01-8746-09a22baff84a request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:12:11.198962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (a4d631f5-1e36-4cb9-a3b6-9fa1737e7397), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.213739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (aeb576ca-23a4-4f01-8746-09a22baff84a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.237290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.239678 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fed833de-d67b-4009-969a-48925dbb1856 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.6553128 Mar 24 02:12:11.334361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] Deleting port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:11.336748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.400332 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Deleting port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:11.400690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.492805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] For port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7ea84e71-731e-4ba0-8d65-8a7c06a58dd6,segment=NetworkSegment(235dbb41-94ab-49ce-be94-ff55807a3130),segment_id=235dbb41-94ab-49ce-be94-ff55807a3130)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:11.493209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.528338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] Calling delete_port for 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:11.547801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] For port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7ea84e71-731e-4ba0-8d65-8a7c06a58dd6,segment=NetworkSegment(235dbb41-94ab-49ce-be94-ff55807a3130),segment_id=235dbb41-94ab-49ce-be94-ff55807a3130)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:11.548165 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.554553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (31c3bb7e-3ec9-409c-a8d0-dba833fb8327), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.583559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Calling delete_port for 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:11.608833 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Network 2c18001a-08a3-4102-a103-ee446a81214d is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:11.625753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:11.641233 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 3.8834481 Mar 24 02:12:11.643272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.652280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:11.653415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:11.654228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.671717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55548) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:11.706950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'subnet': {'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:11.762158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:11.845208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event deleted for resources: {'Port': ['ID=7ea84e71-731e-4ba0-8d65-8a7c06a58dd6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:11.850738 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] No DVR routers for this DVR port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:12:11.914810 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 959 time: 2.6821568 Mar 24 02:12:11.938297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55566) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:11.987401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (aeb576ca-23a4-4f01-8746-09a22baff84a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.011166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aeb576ca-23a4-4f01-8746-09a22baff84a']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:12.025022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '235dbb41-94ab-49ce-be94-ff55807a3130') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:12.026024 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '235dbb41-94ab-49ce-be94-ff55807a3130') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:12.047849 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9a4b70bd-f398-49e6-9234-c79d598e3a65 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:12.050839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:12:12.052304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8888424-4b00-4e1f-bbc7-060e91335a58 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Network': ['ID=b57330c4-af00-4735-8aae-7d7d77f8f136,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:12.056974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (235dbb41-94ab-49ce-be94-ff55807a3130), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.075022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (235dbb41-94ab-49ce-be94-ff55807a3130), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.086989 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Releasing vlan 136 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:12.087181 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc79b4d1-035a-419e-985a-609d185a43ea tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'Port': ['ID=31c3bb7e-3ec9-409c-a8d0-dba833fb8327,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:12.087395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (235dbb41-94ab-49ce-be94-ff55807a3130), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:12.102805 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:12.119006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Made reservation on behalf of a3f362c54abc4116a2d8ae1cbdbafe9b for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:12.125627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.151388 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network b57330c4-af00-4735-8aae-7d7d77f8f136 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:12.169627 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-29bdf204-5cfd-4093-ac67-dc1f36f89d1f None None] Provisioning complete for port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:12.169787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-29bdf204-5cfd-4093-ac67-dc1f36f89d1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.247509 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for port (7530a9ed-de50-4a2c-af9d-42d050ea9a38), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.263723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (aeb576ca-23a4-4f01-8746-09a22baff84a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.276838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.288427 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-29bdf204-5cfd-4093-ac67-dc1f36f89d1f None None] Port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:12.306887 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] 10.222.0.20 "DELETE /v2.0/networks/aeb576ca-23a4-4f01-8746-09a22baff84a HTTP/1.1" status: 204 len: 168 time: 1.2861385 Mar 24 02:12:12.335950 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c25524-53ee-4e7f-8bd4-05f8f5e462f6 tempest-DHCPAgentSchedulersTestJSON-785113930 tempest-DHCPAgentSchedulersTestJSON-785113930-project] Pushing event deleted for resources: {'Network': ['ID=aeb576ca-23a4-4f01-8746-09a22baff84a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:12.391409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55582) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:12.396449 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Mar 24 02:12:12.444921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9a4b70bd-f398-49e6-9234-c79d598e3a65 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:12.446040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.539951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7530a9ed-de50-4a2c-af9d-42d050ea9a38), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.540859 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-d4e0d439-8b76-45d0-a9fe-17ece1e1b722 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-securitygroup--394094996&fields=id&tenant_id=d597f5a6c32e40b9b8f2e09949c6fcfd HTTP/1.1" status: 200 len: 267 time: 0.1472447 Mar 24 02:12:12.583654 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84cb2215-1251-4032-ad8a-bd2c9dfef3b5 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:12.587528 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-84cb2215-1251-4032-ad8a-bd2c9dfef3b5 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "GET /v2.0/ports/31c3bb7e-3ec9-409c-a8d0-dba833fb8327 HTTP/1.1" status: 200 len: 954 time: 0.5002697 Mar 24 02:12:12.589360 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55586) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:12.589817 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (7ea84e71-731e-4ba0-8d65-8a7c06a58dd6), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.602050 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] Network aeb576ca-23a4-4f01-8746-09a22baff84a is not hosted by any dhcp agent {{(pid=104038) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Mar 24 02:12:12.602499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] No DVR routers for this DVR port 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:12:12.706093 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55590) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:12.714111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9a4b70bd-f398-49e6-9234-c79d598e3a65 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:12.718906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9b446767-9204-4d09-bff9-fa3a72e03482 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:12.722238 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97a14785-34b2-4426-8d3b-10d2d53dd204 None None] Pushing event deleted for resources: {'Port': ['ID=7ea84e71-731e-4ba0-8d65-8a7c06a58dd6,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:12.726810 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (55088382-7ea7-41f1-a0cb-71a22f16598d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.734167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55592) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:12.776886 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9b446767-9204-4d09-bff9-fa3a72e03482 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:12.777267 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.874046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (14ee7600-4bf8-4bbb-b8f3-467531787f2d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:12.933112 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Pushing event updated for resources: {'Port': ['ID=7530a9ed-de50-4a2c-af9d-42d050ea9a38,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:12.965423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9b446767-9204-4d09-bff9-fa3a72e03482 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:12.997094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45343fbd-d636-4ee0-9800-098315afc35a req-e2c06361-68ae-4e53-946a-080eff23aca9 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:12.998718 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-e2c06361-68ae-4e53-946a-080eff23aca9 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/networks?id=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 HTTP/1.1" status: 200 len: 811 time: 0.4460068 Mar 24 02:12:13.010677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.012079 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6d7cc51e-18b1-421e-a74b-c53d1b72f526 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 6.8451238 Mar 24 02:12:13.035181 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-36f61953-57da-42e3-9639-12073193e541 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/quotas/d597f5a6c32e40b9b8f2e09949c6fcfd HTTP/1.1" status: 200 len: 375 time: 0.0267584 Mar 24 02:12:13.063124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:12:13.096027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:12:13.096373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7ea84e71-731e-4ba0-8d65-8a7c06a58dd6 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:12:13.173389 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Subnet': ['ID=14ee7600-4bf8-4bbb-b8f3-467531787f2d,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:13.214194 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7ebdd0a3-c9bf-42ea-b65f-2ef83f4a8ab1 tempest-AgentManagementNegativeTest-1539059227 tempest-AgentManagementNegativeTest-1539059227-project] 10.222.0.20 "GET /v2.0/agents HTTP/1.1" status: 200 len: 207 time: 0.5012472 Mar 24 02:12:13.249195 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:13.258407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Sync routers for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:13.270661 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-775c4463-15d3-4349-8162-e42b72d3b8cb admin admin] 10.222.0.20 "PUT /v2.0/routers/f52240e9-2e82-4113-abe0-f8b0dcb76cb1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.5455561 Mar 24 02:12:13.278726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Checking segment: {'id': '2dcf15f9-148f-4ffe-b942-f75d792de49b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:13.279089 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Network hostable DHCP agents. Network: b57330c4-af00-4735-8aae-7d7d77f8f136, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:12:13.293507 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:13.294154 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:13.298170 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-05f20ef1-3869-4374-98e6-8933e0a0dc42 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=dfa9b9d47860473eaa1279e6fcd94aef&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5126276 Mar 24 02:12:13.301550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55610) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:13.348756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.358929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Network b57330c4-af00-4735-8aae-7d7d77f8f136 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:12:13.433749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, b57330c4-af00-4735-8aae-7d7d77f8f136) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:13.485294 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:13.486052 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.502744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-45dfbe50-af08-48d2-8fc7-d421d15bb292 admin admin] Publish callbacks [] for security_group (f711af1f-6157-450a-ae2a-03d41cb95627), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.509662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-19717532-e053-4356-b4d9-e57c4e4f865a tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Deleting port 31c3bb7e-3ec9-409c-a8d0-dba833fb8327 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:13.510003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-19717532-e053-4356-b4d9-e57c4e4f865a tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (31c3bb7e-3ec9-409c-a8d0-dba833fb8327), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.520546 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d79852c6-46f3-4fd2-8f4a-abb1ba49d5bf None None] Network b57330c4-af00-4735-8aae-7d7d77f8f136 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:13.556111 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-36b53b4e-6fe2-4a6e-b1c9-7a85b84e42c6 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8584316 Mar 24 02:12:13.562883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55620) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:13.569481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'port': {'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136', 'name': 'tempest-AllowedAddressPairTestJSON-1036173790'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:13.582112 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-45dfbe50-af08-48d2-8fc7-d421d15bb292 admin admin] Publish callbacks [] for security_group (f711af1f-6157-450a-ae2a-03d41cb95627), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.598174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:13.645754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55622) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:13.718746 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-85b45068-b2dc-4f19-af4a-d6dfc6968f0e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=d597f5a6c32e40b9b8f2e09949c6fcfd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.6707373 Mar 24 02:12:13.758801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-19717532-e053-4356-b4d9-e57c4e4f865a tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (31c3bb7e-3ec9-409c-a8d0-dba833fb8327), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.796361 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-19717532-e053-4356-b4d9-e57c4e4f865a tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Calling delete_port for 31c3bb7e-3ec9-409c-a8d0-dba833fb8327 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:13.807143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Router 2ea4d75d-5a20-4ec8-8848-27c5a94d4754 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:12:13.817766 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-45dfbe50-af08-48d2-8fc7-d421d15bb292 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f711af1f-6157-450a-ae2a-03d41cb95627), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.822942 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-45dfbe50-af08-48d2-8fc7-d421d15bb292 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.824164 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-45dfbe50-af08-48d2-8fc7-d421d15bb292 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/f711af1f-6157-450a-ae2a-03d41cb95627 HTTP/1.1" status: 204 len: 168 time: 0.5216315 Mar 24 02:12:13.869670 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45dfbe50-af08-48d2-8fc7-d421d15bb292 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f711af1f-6157-450a-ae2a-03d41cb95627,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:13.896639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Made reservation on behalf of a3f362c54abc4116a2d8ae1cbdbafe9b for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:13.900612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.913205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-b57330c4-af00-4735-8aae-7d7d77f8f136', 'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136', 'project_id': 'a3f362c54abc4116a2d8ae1cbdbafe9b', 'fixed_ips': [{'subnet_id': '14ee7600-4bf8-4bbb-b8f3-467531787f2d'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:12:13.914968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:13.955939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29694443-2bf1-46ad-8887-04bef85fe914 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.071545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-19717532-e053-4356-b4d9-e57c4e4f865a tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (31c3bb7e-3ec9-409c-a8d0-dba833fb8327), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.126225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-19717532-e053-4356-b4d9-e57c4e4f865a tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.131113 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-19717532-e053-4356-b4d9-e57c4e4f865a tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "DELETE /v2.0/ports/31c3bb7e-3ec9-409c-a8d0-dba833fb8327 HTTP/1.1" status: 204 len: 168 time: 1.5407379 Mar 24 02:12:14.131953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55644) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:14.146356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19717532-e053-4356-b4d9-e57c4e4f865a tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event deleted for resources: {'Port': ['ID=31c3bb7e-3ec9-409c-a8d0-dba833fb8327,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:14.160268 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-65c50ec0-dc10-49a0-83d8-8ade51ef557d service neutron] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:12:14.162331 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-65c50ec0-dc10-49a0-83d8-8ade51ef557d service neutron] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2075984 Mar 24 02:12:14.163003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55646) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:14.172273 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'c09745fa-b8dd-44bc-bd26-2ffd00f709e6', 'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'mac_address': 'fa:16:3e:82:8c:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:05Z', 'updated_at': '2022-03-24T02:12:09Z', 'revision_number': 2, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'subnets': [{'id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:14.212881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Checking router: f52240e9-2e82-4113-abe0-f8b0dcb76cb1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:14.213235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Updating router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:12:14.274878 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29694443-2bf1-46ad-8887-04bef85fe914 admin admin] Publish callbacks [] for security_group (b16dc7f1-f57c-47df-8522-284714ee0ff7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.276661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.280759 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-f3045449-d91c-40df-85cb-d3a4d0e45b5e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] GET failed (client error): The resource could not be found. Mar 24 02:12:14.283022 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f3045449-d91c-40df-85cb-d3a4d0e45b5e tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "GET /v2.0/ports/31c3bb7e-3ec9-409c-a8d0-dba833fb8327 HTTP/1.1" status: 404 len: 333 time: 0.1122489 Mar 24 02:12:14.292591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29694443-2bf1-46ad-8887-04bef85fe914 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b16dc7f1-f57c-47df-8522-284714ee0ff7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.298788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55650) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:14.309772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] device_id is not set on port 656939a5-20bf-4ccc-8416-e508e9b0aa95 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:14.313440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Allocated IP 172.20.0.2 (b57330c4-af00-4735-8aae-7d7d77f8f136/14ee7600-4bf8-4bbb-b8f3-467531787f2d/5c554f4c-8591-4d3e-bc06-bec64a955886) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:14.323903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Request body: {'port': {'network_id': '2c18001a-08a3-4102-a103-ee446a81214d', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1869674349'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:14.405327 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-29694443-2bf1-46ad-8887-04bef85fe914 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=6924b474cec64835ac1b93d84b9407bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7555368 Mar 24 02:12:14.408164 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55652) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:14.409728 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-e33dcca9-668b-4f21-9cfd-316eb61f1dbc tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-securitygroup--2142817153&fields=id&tenant_id=2be0ccfa2a914550be8f84da5cb7afe4 HTTP/1.1" status: 200 len: 267 time: 0.2660484 Mar 24 02:12:14.410423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29694443-2bf1-46ad-8887-04bef85fe914 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b16dc7f1-f57c-47df-8522-284714ee0ff7,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:14.488544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:14.489913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55654) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:14.505730 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da545378-f445-4196-9c11-df434b844015 None None] Sync routers for ids ['2ea4d75d-5a20-4ec8-8848-27c5a94d4754'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:14.519153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-295813bd-968b-4875-a607-08a1accdd29b admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.528965 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da545378-f445-4196-9c11-df434b844015 None None] Routers {'2ea4d75d-5a20-4ec8-8848-27c5a94d4754'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:14.530004 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-da545378-f445-4196-9c11-df434b844015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea4d75d-5a20-4ec8-8848-27c5a94d4754'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:14.537075 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.541237 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-71b45ee1-f84e-421a-96bf-52eeb8f3bbb1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 878 time: 10.8738911 Mar 24 02:12:14.542018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55656) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:14.584309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-656ce1ab-be1b-49b0-9e41-70268f0b0ea1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:14.587010 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-656ce1ab-be1b-49b0-9e41-70268f0b0ea1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/networks?id=597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 200 len: 812 time: 0.1604359 Mar 24 02:12:14.590596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Made reservation on behalf of e504d6bef7c748b89165f581c15466df for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:14.594784 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.615661 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-875b3347-4ee7-48ca-aa2a-27b731d1611c service neutron] 10.222.0.20 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4378970 Mar 24 02:12:14.624643 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-295813bd-968b-4875-a607-08a1accdd29b admin admin] Publish callbacks [] for security_group (cacf7e51-f351-4c6f-9397-2c7cd581b3d1), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.636035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-295813bd-968b-4875-a607-08a1accdd29b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (cacf7e51-f351-4c6f-9397-2c7cd581b3d1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.671414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Publish callbacks [] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.672139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f6677c81-43e6-4ddd-a7aa-9e4f198f4a85 admin admin] Publish callbacks [] for security_group (b16dc7f1-f57c-47df-8522-284714ee0ff7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.682846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.690491 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-da545378-f445-4196-9c11-df434b844015 None None] Set router 2ea4d75d-5a20-4ec8-8848-27c5a94d4754 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:14.717385 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-c4c56a97-d9c3-4fdb-a4f5-28f0c95108a7 service neutron] 10.222.0.20 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0945785 Mar 24 02:12:14.718630 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-804aa790-896a-4163-9f28-53a56e199623 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/quotas/2be0ccfa2a914550be8f84da5cb7afe4 HTTP/1.1" status: 200 len: 375 time: 0.1195493 Mar 24 02:12:14.719755 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] device_id is not set on port f944143d-6415-49c5-9d2a-b8fc3eee094d yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:14.724998 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Network b57330c4-af00-4735-8aae-7d7d77f8f136 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:14.730400 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:14.736876 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:14.822966 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Pushing event updated for resources: {'Port': ['ID=5c554f4c-8591-4d3e-bc06-bec64a955886,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:14.872194 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-e55dfa12-196e-4882-b108-2bef814c1367 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1448970 Mar 24 02:12:14.913692 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f6677c81-43e6-4ddd-a7aa-9e4f198f4a85 admin admin] Publish callbacks [] for security_group (b16dc7f1-f57c-47df-8522-284714ee0ff7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:14.931829 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295813bd-968b-4875-a607-08a1accdd29b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cacf7e51-f351-4c6f-9397-2c7cd581b3d1,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:14.943590 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-295813bd-968b-4875-a607-08a1accdd29b admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=b787085c61844e1f8f29fc8030fdb47c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4486320 Mar 24 02:12:14.954563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55662) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:14.965865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Allocated IP 172.20.0.8 (b57330c4-af00-4735-8aae-7d7d77f8f136/14ee7600-4bf8-4bbb-b8f3-467531787f2d/656939a5-20bf-4ccc-8416-e508e9b0aa95) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:15.064832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.072539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks [] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.082554 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-da545378-f445-4196-9c11-df434b844015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea4d75d-5a20-4ec8-8848-27c5a94d4754', 'name': '', 'tenant_id': 'de44dd991a01489cb0ad2761eac48843', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08', 'external_fixed_ips': [{'subnet_id': '6723a6f9-b722-45c9-8a12-6ff6721ad967', 'ip_address': '2001:db8::188'}], 'enable_snat': True}, 'gw_port_id': '1cbf65ef-f4a9-41c8-84db-28bd13cf98a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:12:04Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 3, 'project_id': 'de44dd991a01489cb0ad2761eac48843', 'gw_port': {'id': '1cbf65ef-f4a9-41c8-84db-28bd13cf98a4', 'name': '', 'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:16:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2ea4d75d-5a20-4ec8-8848-27c5a94d4754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 126, 'fixed_ips': [{'subnet_id': '6723a6f9-b722-45c9-8a12-6ff6721ad967', 'ip_address': '2001:db8::188', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:06Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6723a6f9-b722-45c9-8a12-6ff6721ad967', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:15.166989 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f6677c81-43e6-4ddd-a7aa-9e4f198f4a85 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b16dc7f1-f57c-47df-8522-284714ee0ff7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.169608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f6677c81-43e6-4ddd-a7aa-9e4f198f4a85 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.173021 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f6677c81-43e6-4ddd-a7aa-9e4f198f4a85 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/b16dc7f1-f57c-47df-8522-284714ee0ff7 HTTP/1.1" status: 204 len: 168 time: 0.7515635 Mar 24 02:12:15.176224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Publish callbacks [] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.177050 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da545378-f445-4196-9c11-df434b844015 None None] Checking router: 2ea4d75d-5a20-4ec8-8848-27c5a94d4754 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:15.178085 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da545378-f445-4196-9c11-df434b844015 None None] Updating router 2ea4d75d-5a20-4ec8-8848-27c5a94d4754 port 1cbf65ef-f4a9-41c8-84db-28bd13cf98a4 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:12:15.187122 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Attempting to bind port 5c554f4c-8591-4d3e-bc06-bec64a955886 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:15.187663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Attempting to bind port 5c554f4c-8591-4d3e-bc06-bec64a955886 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '2dcf15f9-148f-4ffe-b942-f75d792de49b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:15.188166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Attempting to bind port 5c554f4c-8591-4d3e-bc06-bec64a955886 on network b57330c4-af00-4735-8aae-7d7d77f8f136 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:15.198645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.203996 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.215858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ae68708-9aa0-4f6b-8641-e98b230264a9 admin admin] Publish callbacks [] for security_group (cacf7e51-f351-4c6f-9397-2c7cd581b3d1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.239230 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-02b01d9d-47e4-457d-9480-b94e62afd3bf service neutron] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:12:15.240448 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-02b01d9d-47e4-457d-9480-b94e62afd3bf service neutron] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1470575 Mar 24 02:12:15.256147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:15.256703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Checking segment: {'id': '2dcf15f9-148f-4ffe-b942-f75d792de49b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:15.257194 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.258387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Bound using segment: {'id': '2dcf15f9-148f-4ffe-b942-f75d792de49b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:15.259005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Bound port: 5c554f4c-8591-4d3e-bc06-bec64a955886, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2dcf15f9-148f-4ffe-b942-f75d792de49b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:15.259620 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.285511 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-da545378-f445-4196-9c11-df434b844015 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.294282 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6677c81-43e6-4ddd-a7aa-9e4f198f4a85 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b16dc7f1-f57c-47df-8522-284714ee0ff7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:15.335077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ae68708-9aa0-4f6b-8641-e98b230264a9 admin admin] Publish callbacks [] for security_group (cacf7e51-f351-4c6f-9397-2c7cd581b3d1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.355996 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] For port 5c554f4c-8591-4d3e-bc06-bec64a955886, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:15.360372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] For port 5c554f4c-8591-4d3e-bc06-bec64a955886, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5c554f4c-8591-4d3e-bc06-bec64a955886,segment=NetworkSegment(2dcf15f9-148f-4ffe-b942-f75d792de49b),segment_id=2dcf15f9-148f-4ffe-b942-f75d792de49b)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:15.420778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.434242 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.473660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.480407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Network 2c18001a-08a3-4102-a103-ee446a81214d is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:15.509885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:15.520378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:15.521318 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:15.521919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.533051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'Port': ['ID=f944143d-6415-49c5-9d2a-b8fc3eee094d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:15.543617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for port (656939a5-20bf-4ccc-8416-e508e9b0aa95), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.548308 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e0d22d6-a532-42db-9c82-6b06ef0cdc7e None None] Pushing event updated for resources: {'Port': ['ID=c09745fa-b8dd-44bc-bd26-2ffd00f709e6,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:15.633318 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e219fffa-2715-4a51-ac73-219d59172e66 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.3317161 Mar 24 02:12:15.636071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55688) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:15.648887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:15.660757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ae68708-9aa0-4f6b-8641-e98b230264a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (cacf7e51-f351-4c6f-9397-2c7cd581b3d1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.680246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ae68708-9aa0-4f6b-8641-e98b230264a9 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.688759 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3ae68708-9aa0-4f6b-8641-e98b230264a9 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/cacf7e51-f351-4c6f-9397-2c7cd581b3d1 HTTP/1.1" status: 204 len: 168 time: 0.7309005 Mar 24 02:12:15.696793 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Attempting to bind port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:15.697351 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Attempting to bind port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:15.697518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Attempting to bind port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 on network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:15.714061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:15.714453 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Checking segment: {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:15.714884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.715279 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Bound using segment: {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:15.729485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Bound port: c09745fa-b8dd-44bc-bd26-2ffd00f709e6, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:15.730015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.755082 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-05d9834a-a927-42ba-a371-12c69b7f8119 service neutron] 10.222.0.20 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4320285 Mar 24 02:12:15.786556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e44c579a-a8d8-4f6d-9fd6-287c5a20765c None None] Pushing event updated for resources: {'Port': ['ID=5c554f4c-8591-4d3e-bc06-bec64a955886,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:15.835237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ae68708-9aa0-4f6b-8641-e98b230264a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cacf7e51-f351-4c6f-9397-2c7cd581b3d1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:15.904795 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Deleting port 1cbf65ef-f4a9-41c8-84db-28bd13cf98a4 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:15.905184 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:15.975737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9abc7429-7f7b-408d-9283-839d6e884bed None None] Provisioning complete for port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:15.988184 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9abc7429-7f7b-408d-9283-839d6e884bed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.028081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.092826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] For port c09745fa-b8dd-44bc-bd26-2ffd00f709e6, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:16.114126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] For port c09745fa-b8dd-44bc-bd26-2ffd00f709e6, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c09745fa-b8dd-44bc-bd26-2ffd00f709e6,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:16.128565 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (656939a5-20bf-4ccc-8416-e508e9b0aa95), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.147426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9abc7429-7f7b-408d-9283-839d6e884bed None None] Port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:16.156736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.181867 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-da545378-f445-4196-9c11-df434b844015 None None] Publish callbacks [] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.197556 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-da545378-f445-4196-9c11-df434b844015 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.248049 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-c227879d-0f5a-4c4d-a03c-a51da24ac2ec service neutron] 10.222.0.20 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4833105 Mar 24 02:12:16.320892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.342003 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:16.344033 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:16.365501 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db0ee935-1ffa-4d52-9321-361cc9661b85 None None] Pushing event updated for resources: {'Port': ['ID=1cbf65ef-f4a9-41c8-84db-28bd13cf98a4,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:16.392691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Calling delete_port for 1cbf65ef-f4a9-41c8-84db-28bd13cf98a4 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:16.459564 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-da545378-f445-4196-9c11-df434b844015 None None] Attempting to bind port 1cbf65ef-f4a9-41c8-84db-28bd13cf98a4 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:16.459935 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-da545378-f445-4196-9c11-df434b844015 None None] Attempting to bind port 1cbf65ef-f4a9-41c8-84db-28bd13cf98a4 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'd4c3dc20-eed8-4be0-b727-dc10bea780c3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:16.460297 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da545378-f445-4196-9c11-df434b844015 None None] Attempting to bind port 1cbf65ef-f4a9-41c8-84db-28bd13cf98a4 on network 1d54abbd-4eda-40cf-82ef-27bc3e194d08 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:16.482630 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da545378-f445-4196-9c11-df434b844015 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:16.482973 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da545378-f445-4196-9c11-df434b844015 None None] Checking segment: {'id': 'd4c3dc20-eed8-4be0-b727-dc10bea780c3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:16.483369 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-da545378-f445-4196-9c11-df434b844015 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.483783 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da545378-f445-4196-9c11-df434b844015 None None] Bound using segment: {'id': 'd4c3dc20-eed8-4be0-b727-dc10bea780c3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:16.484245 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-da545378-f445-4196-9c11-df434b844015 None None] Bound port: 1cbf65ef-f4a9-41c8-84db-28bd13cf98a4, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd4c3dc20-eed8-4be0-b727-dc10bea780c3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '1d54abbd-4eda-40cf-82ef-27bc3e194d08'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:16.488251 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-da545378-f445-4196-9c11-df434b844015 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.610469 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-da545378-f445-4196-9c11-df434b844015 None None] For port 1cbf65ef-f4a9-41c8-84db-28bd13cf98a4, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:16.617908 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-da545378-f445-4196-9c11-df434b844015 None None] For port 1cbf65ef-f4a9-41c8-84db-28bd13cf98a4, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=1cbf65ef-f4a9-41c8-84db-28bd13cf98a4,segment=NetworkSegment(d4c3dc20-eed8-4be0-b727-dc10bea780c3),segment_id=d4c3dc20-eed8-4be0-b727-dc10bea780c3)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:16.620961 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] device_id is not set on port f944143d-6415-49c5-9d2a-b8fc3eee094d yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:16.636944 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-da545378-f445-4196-9c11-df434b844015 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.645134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks [] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.656797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e0d22d6-a532-42db-9c82-6b06ef0cdc7e None None] Pushing event updated for resources: {'Port': ['ID=c09745fa-b8dd-44bc-bd26-2ffd00f709e6,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:16.661183 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.895499 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da545378-f445-4196-9c11-df434b844015 None None] Routers {'2ea4d75d-5a20-4ec8-8848-27c5a94d4754'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:16.897940 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-da545378-f445-4196-9c11-df434b844015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea4d75d-5a20-4ec8-8848-27c5a94d4754'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:16.904603 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55730) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:16.913089 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Network b57330c4-af00-4735-8aae-7d7d77f8f136 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:16.919292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:16.920035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'Port': ['ID=f944143d-6415-49c5-9d2a-b8fc3eee094d,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:16.924040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-685e6c09-2b0e-416b-8aa3-ff107678a414 None None] Provisioning complete for port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:16.924040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-685e6c09-2b0e-416b-8aa3-ff107678a414 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:16.933715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d4705e42-df3d-40b0-aea2-40cbf0ba7b52 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1626599056', 'description': 'tempest-description--310758410'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:16.934915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:16.938846 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:16.939628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:16.948543 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:16.954302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:16.954995 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:16.955611 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 2 to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d Mar 24 02:12:17.021440 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:17.033742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:17.034419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:17.048451 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db0ee935-1ffa-4d52-9321-361cc9661b85 None None] Pushing event updated for resources: {'Port': ['ID=1cbf65ef-f4a9-41c8-84db-28bd13cf98a4,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:17.083293 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Port': ['ID=656939a5-20bf-4ccc-8416-e508e9b0aa95,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:17.213529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4705e42-df3d-40b0-aea2-40cbf0ba7b52 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:17.229589 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-da545378-f445-4196-9c11-df434b844015 None None] Set router 2ea4d75d-5a20-4ec8-8848-27c5a94d4754 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:17.257261 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0be08a01-dcb1-4c0c-8a61-696f63566455 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 3.6929433 Mar 24 02:12:17.258479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:17.265071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55750) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:17.266743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:17.267098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:17.286946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'port': {'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136', 'name': 'tempest-AllowedAddressPairTestJSON-2008665260', 'allowed_address_pairs': [{'ip_address': '172.20.0.8', 'mac_address': 'fa:16:3e:af:63:24'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:17.312965 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:17.313303 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:17.316198 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0cbc76de-eae6-4f39-a5a4-c116373d45ec req-2c7294bf-a564-4eb1-8703-bd95b243d1a9 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 210 time: 0.3185873 Mar 24 02:12:17.366505 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 3 to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d Mar 24 02:12:17.379747 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-685e6c09-2b0e-416b-8aa3-ff107678a414 None None] Current status of the port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:17.380190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-685e6c09-2b0e-416b-8aa3-ff107678a414 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:17.411453 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ed8b02e-bec3-43cd-b8d8-c68f1b915679 req-9f6880d4-9c81-4aa6-acbc-e887a811df5b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 210 time: 0.2713904 Mar 24 02:12:17.469676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:17.475742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:17.476100 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:17.494298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:17.494672 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:17.495134 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 4 to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d Mar 24 02:12:17.497699 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-da545378-f445-4196-9c11-df434b844015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea4d75d-5a20-4ec8-8848-27c5a94d4754', 'name': '', 'tenant_id': 'de44dd991a01489cb0ad2761eac48843', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:12:04Z', 'updated_at': '2022-03-24T02:12:15Z', 'revision_number': 4, 'project_id': 'de44dd991a01489cb0ad2761eac48843', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:17.545010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:17.545353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:17.545701 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:17.567042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55768) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:17.573282 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:17.573282 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:17.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 5 to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d Mar 24 02:12:17.614424 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da545378-f445-4196-9c11-df434b844015 None None] The sync data for ids ['2ea4d75d-5a20-4ec8-8848-27c5a94d4754'] in dv-neutron-834874-3-hyperv is: [{'id': '2ea4d75d-5a20-4ec8-8848-27c5a94d4754', 'name': '', 'tenant_id': 'de44dd991a01489cb0ad2761eac48843', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:12:04Z', 'updated_at': '2022-03-24T02:12:15Z', 'revision_number': 4, 'project_id': 'de44dd991a01489cb0ad2761eac48843', 'gw_port_host': None}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:17.645702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:17.646041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:17.646452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:17.663066 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-603a4376-7aac-4840-9d7e-84d0ab93c040 None None] Network b57330c4-af00-4735-8aae-7d7d77f8f136 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:17.683586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-685e6c09-2b0e-416b-8aa3-ff107678a414 None None] For port c09745fa-b8dd-44bc-bd26-2ffd00f709e6, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c09745fa-b8dd-44bc-bd26-2ffd00f709e6,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:17.691946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:17.692293 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:17.694819 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 6 to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d Mar 24 02:12:17.748603 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:17.748940 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:17.749288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:17.761787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-685e6c09-2b0e-416b-8aa3-ff107678a414 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:17.763789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:17.763789 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:17.765155 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 7 to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d Mar 24 02:12:17.861144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:17.867323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:17.867630 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:17.933529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5c554f4c-8591-4d3e-bc06-bec64a955886 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:17.944279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:17.944605 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:17.948851 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 8 to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d Mar 24 02:12:18.012471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685e6c09-2b0e-416b-8aa3-ff107678a414 None None] Pushing event updated for resources: {'Port': ['ID=c09745fa-b8dd-44bc-bd26-2ffd00f709e6,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:18.047860 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:18.048181 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:18.048545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:18.073251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:18.074132 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:18.075049 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 9 to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d Mar 24 02:12:18.077086 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-74a7dffe-8045-41b7-bd91-03c1bf843413 None None] Provisioning complete for port 5c554f4c-8591-4d3e-bc06-bec64a955886 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:18.077595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-74a7dffe-8045-41b7-bd91-03c1bf843413 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.113020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:18.113598 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:18.114463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:18.137080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:18.137462 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:18.139036 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempt 10 to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d Mar 24 02:12:18.185140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Made reservation on behalf of a3f362c54abc4116a2d8ae1cbdbafe9b for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:18.186345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 5c554f4c-8591-4d3e-bc06-bec64a955886 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:18.187189 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.194051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:18.196022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:18.196391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempting to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:18.206561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:18.206960 dv-neutron-834874-3-hyperv neutron-server[104037]: ERROR neutron.plugins.ml2.managers [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Failed to bind port f944143d-6415-49c5-9d2a-b8fc3eee094d on host hv-neutron-8348 for vnic_type normal using segments [{'id': '5c0034c6-6078-4b89-9711-c262747ced7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '2c18001a-08a3-4102-a103-ee446a81214d'}] Mar 24 02:12:18.210823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.218349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'c09745fa-b8dd-44bc-bd26-2ffd00f709e6', 'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'mac_address': 'fa:16:3e:82:8c:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:05Z', 'updated_at': '2022-03-24T02:12:16Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'subnets': [{'id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:18.268422 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32f8c7a8-d6d7-4dfd-aba6-8721d0c8739c None None] The sync data for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv is: [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'c09745fa-b8dd-44bc-bd26-2ffd00f709e6', 'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'mac_address': 'fa:16:3e:82:8c:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:05Z', 'updated_at': '2022-03-24T02:12:16Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'subnets': [{'id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:18.455856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] For port f944143d-6415-49c5-9d2a-b8fc3eee094d, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:18.461461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attempted to set empty binding levels {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Mar 24 02:12:18.473435 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-74a7dffe-8045-41b7-bd91-03c1bf843413 None None] Current status of the port 5c554f4c-8591-4d3e-bc06-bec64a955886 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:18.473435 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-74a7dffe-8045-41b7-bd91-03c1bf843413 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.509709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4705e42-df3d-40b0-aea2-40cbf0ba7b52 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group (79e8d0c0-2674-47ef-8eea-b630f6955be7), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.512243 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'network': {'name': 'tempest-NetworksTestDHCPv6-test-network-212325497'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:18.573343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4705e42-df3d-40b0-aea2-40cbf0ba7b52 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (79e8d0c0-2674-47ef-8eea-b630f6955be7), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.599610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.635046 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:18.638299 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.688723 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-74a7dffe-8045-41b7-bd91-03c1bf843413 None None] For port 5c554f4c-8591-4d3e-bc06-bec64a955886, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5c554f4c-8591-4d3e-bc06-bec64a955886,segment=NetworkSegment(2dcf15f9-148f-4ffe-b942-f75d792de49b),segment_id=2dcf15f9-148f-4ffe-b942-f75d792de49b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:18.690051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5c554f4c-8591-4d3e-bc06-bec64a955886 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:18.690441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.713053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4705e42-df3d-40b0-aea2-40cbf0ba7b52 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Pushing event updated for resources: {'SecurityGroup': ['ID=79e8d0c0-2674-47ef-8eea-b630f6955be7,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:18.716096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-74a7dffe-8045-41b7-bd91-03c1bf843413 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.720360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4705e42-df3d-40b0-aea2-40cbf0ba7b52 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.724379 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d4705e42-df3d-40b0-aea2-40cbf0ba7b52 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 1.8100379 Mar 24 02:12:18.732635 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (1cbf65ef-f4a9-41c8-84db-28bd13cf98a4), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.768304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55804) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:18.820642 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2fc18397-00de-40a0-8658-ed7f1e8584f4 req-d5849359-114d-4745-87ff-c1f46e188b9c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 210 time: 0.2336602 Mar 24 02:12:18.821791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] In _notify_port_updated(), no bound segment for port f944143d-6415-49c5-9d2a-b8fc3eee094d on network 2c18001a-08a3-4102-a103-ee446a81214d {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:12:18.826299 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:18.828450 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.830127 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "PUT /v2.0/ports/f944143d-6415-49c5-9d2a-b8fc3eee094d HTTP/1.1" status: 200 len: 977 time: 3.1909781 Mar 24 02:12:18.866965 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55808) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:18.882052 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3660467e-928b-482e-a444-678a56bff3c5 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Request body: {'security_group_rule': {'security_group_id': '79e8d0c0-2674-47ef-8eea-b630f6955be7', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:18.893740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:18.921550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event deleted for resources: {'Port': ['ID=1cbf65ef-f4a9-41c8-84db-28bd13cf98a4,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:18.977748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.043761 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74a7dffe-8045-41b7-bd91-03c1bf843413 None None] Pushing event updated for resources: {'Port': ['ID=5c554f4c-8591-4d3e-bc06-bec64a955886,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:19.082834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:12:19.084239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:12:19.088171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1894fb11-3408-4021-9747-511eaff6a3f8 None None] Provisioning complete for port 5c554f4c-8591-4d3e-bc06-bec64a955886 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:19.088332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1894fb11-3408-4021-9747-511eaff6a3f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.111347 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bf323bd8-46ea-4bf1-812f-97de50cb68cd req-373e450c-da80-4813-9e34-bb4944edb466 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 210 time: 0.2453349 Mar 24 02:12:19.199750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55812) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:19.209307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.232830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9858b74-e4ef-4e8d-bf3f-9a666b87d0d6 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event updated for resources: {'Port': ['ID=f944143d-6415-49c5-9d2a-b8fc3eee094d,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:19.238720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1894fb11-3408-4021-9747-511eaff6a3f8 None None] Current status of the port 5c554f4c-8591-4d3e-bc06-bec64a955886 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:19.253426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1894fb11-3408-4021-9747-511eaff6a3f8 None None] Provisioning complete for port 656939a5-20bf-4ccc-8416-e508e9b0aa95 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:19.253794 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1894fb11-3408-4021-9747-511eaff6a3f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (656939a5-20bf-4ccc-8416-e508e9b0aa95), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.295712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for security_group (05660306-331a-4737-9a34-3ad56cbd2a03), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.307162 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1894fb11-3408-4021-9747-511eaff6a3f8 None None] Port 656939a5-20bf-4ccc-8416-e508e9b0aa95 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:19.307957 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (05660306-331a-4737-9a34-3ad56cbd2a03), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.354414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 130} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:19.359323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-327fdba3-c25f-45d8-bf4b-22ba80817e30 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Deleting port f944143d-6415-49c5-9d2a-b8fc3eee094d {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:19.359872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-327fdba3-c25f-45d8-bf4b-22ba80817e30 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.418324 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'SecurityGroup': ['ID=05660306-331a-4737-9a34-3ad56cbd2a03,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:19.433132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (10c9520a-ce90-4c32-a99e-00890d4b2069), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.433630 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Added segment 10c9520a-ce90-4c32-a99e-00890d4b2069 of type vlan for network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 Mar 24 02:12:19.464789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-681b5047-3a1d-4ccb-bc92-7976bdb301c8 None None] Provisioning complete for port 656939a5-20bf-4ccc-8416-e508e9b0aa95 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:19.465235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-681b5047-3a1d-4ccb-bc92-7976bdb301c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (656939a5-20bf-4ccc-8416-e508e9b0aa95), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.482337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.30', 58669) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:19.509091 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3660467e-928b-482e-a444-678a56bff3c5 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group_rule (718c0c14-2d25-4dd0-aeca-0f5c81138df0), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.520457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-681b5047-3a1d-4ccb-bc92-7976bdb301c8 None None] Port 656939a5-20bf-4ccc-8416-e508e9b0aa95 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:19.520990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.529573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_controller (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.531788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] device_id is not set on port c99483c0-463d-40f7-9f78-73c1fdd72703 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:19.572228 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-327fdba3-c25f-45d8-bf4b-22ba80817e30 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] For port f944143d-6415-49c5-9d2a-b8fc3eee094d, host hv-neutron-8348, got binding levels [] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:19.572591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-327fdba3-c25f-45d8-bf4b-22ba80817e30 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.578988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (6f3080fc-791f-4748-a0a2-9eff6ea2a609), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.599589 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-327fdba3-c25f-45d8-bf4b-22ba80817e30 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Calling delete_port for f944143d-6415-49c5-9d2a-b8fc3eee094d owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:19.671636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45343fbd-d636-4ee0-9800-098315afc35a req-2ed1a189-ff2e-491c-acf3-74f94b61f17d tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:19.673148 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-2ed1a189-ff2e-491c-acf3-74f94b61f17d tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.30 "GET /v2.0/networks?id=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 HTTP/1.1" status: 200 len: 811 time: 0.1882429 Mar 24 02:12:19.696799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (2ea4d75d-5a20-4ec8-8848-27c5a94d4754), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.697574 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 2ea4d75d-5a20-4ec8-8848-27c5a94d4754 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:12:19.706326 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5c554f4c-8591-4d3e-bc06-bec64a955886 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:19.751852 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.30', 58670) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:19.763813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.764986 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1e03bcf9-54ac-4456-80df-1c74d1d08747 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "DELETE /v2.0/routers/2ea4d75d-5a20-4ec8-8848-27c5a94d4754 HTTP/1.1" status: 204 len: 168 time: 5.1390772 Mar 24 02:12:19.772983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55818) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:19.812791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (6f3080fc-791f-4748-a0a2-9eff6ea2a609), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:19.818749 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:19.819882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.000725 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Request body: {'network': {'name': 'tempest-ExternalNetworksTestJSON-test-network-1804776399'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:20.020165 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3660467e-928b-482e-a444-678a56bff3c5 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group_rule (718c0c14-2d25-4dd0-aeca-0f5c81138df0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.025768 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 2.4535499 Mar 24 02:12:20.034006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c09745fa-b8dd-44bc-bd26-2ffd00f709e6 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:20.049368 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55824) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:20.065323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:20.158359 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c7e05d-d9d0-4149-84b4-0c6813a0869f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Network': ['ID=6f3080fc-791f-4748-a0a2-9eff6ea2a609,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:20.165059 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:20.165059 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.176928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:20.203166 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e3baee04-f6af-46b7-a089-faeff201ee21 req-8640db7a-f112-4516-9531-ea84c6a1c7dd tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 210 time: 0.0766511 Mar 24 02:12:20.209762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3660467e-928b-482e-a444-678a56bff3c5 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (718c0c14-2d25-4dd0-aeca-0f5c81138df0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.216623 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-fea23250-326f-42e8-b4fc-82f12caaa2c2 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d597f5a6c32e40b9b8f2e09949c6fcfd HTTP/1.1" status: 200 len: 379 time: 0.4802105 Mar 24 02:12:20.222550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-327fdba3-c25f-45d8-bf4b-22ba80817e30 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (f944143d-6415-49c5-9d2a-b8fc3eee094d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.249802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-c161cba1-290e-4880-8cd0-451166287a7a tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:20.256975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:20.260741 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.261393 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-c161cba1-290e-4880-8cd0-451166287a7a tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.30 "GET /v2.0/networks?id=597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 200 len: 812 time: 0.5084383 Mar 24 02:12:20.267308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Request body: {'port': {'device_id': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'admin_state_up': True, 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'security_groups': ['eef280c3-0009-459a-81fe-def34b7b79a0']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:20.281393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-327fdba3-c25f-45d8-bf4b-22ba80817e30 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.285867 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-327fdba3-c25f-45d8-bf4b-22ba80817e30 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "DELETE /v2.0/ports/f944143d-6415-49c5-9d2a-b8fc3eee094d HTTP/1.1" status: 204 len: 168 time: 1.4173958 Mar 24 02:12:20.302219 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55844) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:20.337774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-2183df88-8d05-486b-8e95-92bf177c292f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Deleting subnet 6723a6f9-b722-45c9-8a12-6ff6721ad967 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:12:20.356313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327fdba3-c25f-45d8-bf4b-22ba80817e30 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] Pushing event deleted for resources: {'Port': ['ID=f944143d-6415-49c5-9d2a-b8fc3eee094d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:20.389394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3660467e-928b-482e-a444-678a56bff3c5 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=718c0c14-2d25-4dd0-aeca-0f5c81138df0,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:20.391662 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-671d9a10-1f96-45fe-8438-b686cad82828 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] GET failed (client error): The resource could not be found. Mar 24 02:12:20.394001 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-671d9a10-1f96-45fe-8438-b686cad82828 tempest-PortsAdminExtendedAttrsTestJSON-1498238447 tempest-PortsAdminExtendedAttrsTestJSON-1498238447-project-admin] 10.222.0.20 "GET /v2.0/ports/f944143d-6415-49c5-9d2a-b8fc3eee094d HTTP/1.1" status: 404 len: 333 time: 0.0529280 Mar 24 02:12:20.395379 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Made reservation on behalf of 737a577a40a54fa7965a296b4d18cbb4 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:20.402272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.419975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2183df88-8d05-486b-8e95-92bf177c292f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for subnet (6723a6f9-b722-45c9-8a12-6ff6721ad967), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.425108 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55846) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:20.426765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Allocated IP 172.20.0.10 (b57330c4-af00-4735-8aae-7d7d77f8f136/14ee7600-4bf8-4bbb-b8f3-467531787f2d/c99483c0-463d-40f7-9f78-73c1fdd72703) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:20.430107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.507227 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3660467e-928b-482e-a444-678a56bff3c5 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.509317 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3660467e-928b-482e-a444-678a56bff3c5 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.7120018 Mar 24 02:12:20.537824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55852) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:20.566213 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:20.567093 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5c554f4c-8591-4d3e-bc06-bec64a955886 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:20.578855 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-96019df5-6322-45e4-bade-97769a3796e4 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Request body: {'security_group_rule': {'security_group_id': '79e8d0c0-2674-47ef-8eea-b630f6955be7', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:20.620753 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 5c554f4c-8591-4d3e-bc06-bec64a955886 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:20.620955 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.634481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2183df88-8d05-486b-8e95-92bf177c292f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for subnet (6723a6f9-b722-45c9-8a12-6ff6721ad967), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.661297 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d699e8af-a958-4016-87d5-db45dfd6b9a5 req-c6f5ab03-5a64-4108-8206-3ac0091bbf42 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 210 time: 0.3528442 Mar 24 02:12:20.682092 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2183df88-8d05-486b-8e95-92bf177c292f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (6723a6f9-b722-45c9-8a12-6ff6721ad967), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.739579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5c554f4c-8591-4d3e-bc06-bec64a955886 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:20.746035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Made reservation on behalf of d597f5a6c32e40b9b8f2e09949c6fcfd for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:20.749442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.766800 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1ef9b2ad-f77c-4f54-b53c-f54a2cace659 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2be0ccfa2a914550be8f84da5cb7afe4 HTTP/1.1" status: 200 len: 380 time: 0.5044575 Mar 24 02:12:20.776103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Request body: {'port': {'device_id': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'admin_state_up': True, 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'security_groups': ['2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:20.801952 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (2c18001a-08a3-4102-a103-ee446a81214d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.803691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96019df5-6322-45e4-bade-97769a3796e4 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group_rule (02b356b2-18c0-4d44-bd04-a6d891982be0), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:20.979911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Allocated IP 172.20.0.12 (c5ab8914-a9e8-4c4e-bd5d-f979c05148e6/dfc73b89-587b-4f56-aa2b-706a8f904224/dba04693-4495-4586-b5e4-7de9e3b2abd3) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:20.989666 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Made reservation on behalf of 2be0ccfa2a914550be8f84da5cb7afe4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:20.994893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.050556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2183df88-8d05-486b-8e95-92bf177c292f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (6723a6f9-b722-45c9-8a12-6ff6721ad967), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.176376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96019df5-6322-45e4-bade-97769a3796e4 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group_rule (02b356b2-18c0-4d44-bd04-a6d891982be0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.178545 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks [] for security_group (e937d7e3-3394-4d82-b956-dd0eab941b42), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.197704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2183df88-8d05-486b-8e95-92bf177c292f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=6723a6f9-b722-45c9-8a12-6ff6721ad967,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:21.207337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2183df88-8d05-486b-8e95-92bf177c292f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.213778 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2183df88-8d05-486b-8e95-92bf177c292f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "DELETE /v2.0/subnets/6723a6f9-b722-45c9-8a12-6ff6721ad967 HTTP/1.1" status: 204 len: 168 time: 1.4397323 Mar 24 02:12:21.217272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e937d7e3-3394-4d82-b956-dd0eab941b42), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.220915 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96019df5-6322-45e4-bade-97769a3796e4 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (02b356b2-18c0-4d44-bd04-a6d891982be0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.227448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55864) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:21.240577 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (2c18001a-08a3-4102-a103-ee446a81214d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.275774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for subnet (c8d15af7-f453-4e4c-8e4a-4d846de18e0c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.359321 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 113} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:21.397682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.397920 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for port (c99483c0-463d-40f7-9f78-73c1fdd72703), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.409961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96019df5-6322-45e4-bade-97769a3796e4 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=02b356b2-18c0-4d44-bd04-a6d891982be0,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:21.432493 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > segment before_delete 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.433142 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.434087 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.434658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > port after_create 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.435147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > port after_delete 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.435884 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > port after_update 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.436426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > segment after_delete 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.437157 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > subnet after_create 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.437656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > subnet after_delete 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.438153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > subnet after_update 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.485767 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-89350264-e427-48af-a0bf-082d5ace076c req-4d133f63-adc4-48ac-bfb2-52a24e7bd28c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 210 time: 0.0632608 Mar 24 02:12:21.555684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Allocated IP 172.20.0.10 (597625fc-4c02-4901-9b3e-46b781f61da1/56374a24-4e35-434f-b4b8-860ef8289893/23c422ed-55e0-408f-95ff-bc9d2619a936) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:21.606808 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.653274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > subnet after_create 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.653890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > subnet after_delete 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.653991 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > subnet before_create 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.654254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Subscribe: > subnet before_update 55550000 {{(pid=104036) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Mar 24 02:12:21.654674 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2c18001a-08a3-4102-a103-ee446a81214d']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:21.666614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96019df5-6322-45e4-bade-97769a3796e4 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.671154 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-96019df5-6322-45e4-bade-97769a3796e4 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0987713 Mar 24 02:12:21.676559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55868) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:21.692814 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (440766f6-54ce-473b-b088-46ad02b345f5), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.694820 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Added segment 440766f6-54ce-473b-b088-46ad02b345f5 of type vlan for network e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc Mar 24 02:12:21.702874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e937d7e3-3394-4d82-b956-dd0eab941b42,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:21.724082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c0034c6-6078-4b89-9711-c262747ced7f') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:21.724460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c0034c6-6078-4b89-9711-c262747ced7f') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:21.765297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (5c0034c6-6078-4b89-9711-c262747ced7f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.802676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:21.810647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:21.812675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=c8d15af7-f453-4e4c-8e4a-4d846de18e0c,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:21.816682 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (1d54abbd-4eda-40cf-82ef-27bc3e194d08), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.834984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Pushing event updated for resources: {'Port': ['ID=dba04693-4495-4586-b5e4-7de9e3b2abd3,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:21.841823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (5c0034c6-6078-4b89-9711-c262747ced7f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.850442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:21.864803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.871184 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Releasing vlan 122 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:21.871578 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (5c0034c6-6078-4b89-9711-c262747ced7f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: from cryptography.utils import int_from_bytes Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: from cryptography.utils import int_from_bytes Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_agent failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: warnings.warn(msg) Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: items = [ Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:21.876982 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:21.914270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:21.972077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:21.972442 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network hostable DHCP agents. Network: 6f3080fc-791f-4748-a0a2-9eff6ea2a609, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:12:22.013312 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c99483c0-463d-40f7-9f78-73c1fdd72703), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.045835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.063965 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.079046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:22.079607 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.109251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ed20e5-68de-4aeb-b924-cabab212d96f req-f2d2626a-a078-46be-b0dd-bd72cfffc4f1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:22.114022 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f5ed20e5-68de-4aeb-b924-cabab212d96f req-f2d2626a-a078-46be-b0dd-bd72cfffc4f1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 932 time: 0.2954121 Mar 24 02:12:22.121314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (2c18001a-08a3-4102-a103-ee446a81214d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.158914 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:22.159780 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.172493 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Network b57330c4-af00-4735-8aae-7d7d77f8f136 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:22.221432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.242408 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-3360cee6-c9ff-4506-a166-cafc82d2622b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.0034349 Mar 24 02:12:22.292403 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f5ed20e5-68de-4aeb-b924-cabab212d96f req-fa5f8258-5023-46c1-97f0-153632e72f7d tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1293659 Mar 24 02:12:22.293289 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3dcf4e7f-1178-4e08-95f3-eb29d993b43d None None] Provisioning complete for port dba04693-4495-4586-b5e4-7de9e3b2abd3 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:22.293785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3dcf4e7f-1178-4e08-95f3-eb29d993b43d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.328003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-459dc02e-e6c1-4f52-a023-43ed421b810c tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:12:22.340815 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-459dc02e-e6c1-4f52-a023-43ed421b810c tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0294628 Mar 24 02:12:22.373270 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3dcf4e7f-1178-4e08-95f3-eb29d993b43d None None] Port dba04693-4495-4586-b5e4-7de9e3b2abd3 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:22.390040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.468262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Network 597625fc-4c02-4901-9b3e-46b781f61da1 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:22.472369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:22.493960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:22.542668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Pushing event updated for resources: {'Port': ['ID=23c422ed-55e0-408f-95ff-bc9d2619a936,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:22.543932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (1d54abbd-4eda-40cf-82ef-27bc3e194d08), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.557432 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:22.594341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:22.595190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.603709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.653020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:22.685443 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.696944 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-1faba8d9-1f37-4ab5-9a95-3feda2a907f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.9248459 Mar 24 02:12:22.714287 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] 10.222.0.20 "DELETE /v2.0/networks/2c18001a-08a3-4102-a103-ee446a81214d HTTP/1.1" status: 204 len: 168 time: 2.2814250 Mar 24 02:12:22.781468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3f403a-6978-4e2e-9da6-6cfa8672ffe6 req-628e9ec9-b36f-4033-b1dd-00ef0cc666af tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:22.783034 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bc3f403a-6978-4e2e-9da6-6cfa8672ffe6 req-628e9ec9-b36f-4033-b1dd-00ef0cc666af tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 932 time: 0.0949812 Mar 24 02:12:22.861961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:12:22.890779 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bc3f403a-6978-4e2e-9da6-6cfa8672ffe6 req-17f0ccea-5bbd-46d3-8ba1-90c33f084ff4 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0772104 Mar 24 02:12:22.922740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1d54abbd-4eda-40cf-82ef-27bc3e194d08']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:22.940125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Allocated IP 172.26.2.120 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/71b554a6-8cdd-48b9-9b30-c2360b15257b) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:22.944665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-85a58d98-de03-4b87-85ce-01f7e87f22fd None None] Provisioning complete for port 23c422ed-55e0-408f-95ff-bc9d2619a936 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:22.945389 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-85a58d98-de03-4b87-85ce-01f7e87f22fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:22.958077 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 792 time: 3.7524729 Mar 24 02:12:22.965790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55876) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:22.991978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Port': ['ID=c99483c0-463d-40f7-9f78-73c1fdd72703,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:23.000740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4c3dc20-eed8-4be0-b727-dc10bea780c3') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:23.001037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4c3dc20-eed8-4be0-b727-dc10bea780c3') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:23.004753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af068749-fa6e-4258-8872-6f9eeee99780 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Pushing event updated for resources: {'Network': ['ID=e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:23.009162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 6f3080fc-791f-4748-a0a2-9eff6ea2a609) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:23.035915 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:23.036570 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.041923 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (d4c3dc20-eed8-4be0-b727-dc10bea780c3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.051088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-85a58d98-de03-4b87-85ce-01f7e87f22fd None None] Port 23c422ed-55e0-408f-95ff-bc9d2619a936 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:23.057836 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:23.067141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e434ffa7-bea5-4d5e-9dc9-b094df4dcc4e tempest-PortsAdminExtendedAttrsTestJSON-1133007148 tempest-PortsAdminExtendedAttrsTestJSON-1133007148-project] Pushing event deleted for resources: {'Network': ['ID=2c18001a-08a3-4102-a103-ee446a81214d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:23.078186 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:23.078876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.086999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d4c3dc20-eed8-4be0-b727-dc10bea780c3), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.120852 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1eb6fa17-c378-428a-9ade-06075e2c1503 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 3.0674236 Mar 24 02:12:23.120852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Releasing vlan 143 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:23.120852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (d4c3dc20-eed8-4be0-b727-dc10bea780c3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:23.124594 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:23.149055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55880) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:23.154336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'name': 'tempest-NetworksTestDHCPv6-1123890571'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:23.170240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-55285716-3d9d-4001-b3f9-44d9196b8fc1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:12:23.171561 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-55285716-3d9d-4001-b3f9-44d9196b8fc1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0307646 Mar 24 02:12:23.171652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f9f25e5-512d-4e84-adac-b16be3fd7dad None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:23.180723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Request body: {'network': {'name': 'tempest-network--811759702', 'router:external': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:23.241638 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ad9e06e4-41b1-4192-9f27-2bbeb2beefc0 None None] Provisioning complete for port c99483c0-463d-40f7-9f78-73c1fdd72703 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:23.242131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ad9e06e4-41b1-4192-9f27-2bbeb2beefc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c99483c0-463d-40f7-9f78-73c1fdd72703), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.248551 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b1ed6f4a-4b12-4ca7-a1fb-3afacc517724 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 999 time: 5.9787967 Mar 24 02:12:23.250132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55884) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:23.282653 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ad9e06e4-41b1-4192-9f27-2bbeb2beefc0 None None] Port c99483c0-463d-40f7-9f78-73c1fdd72703 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:23.366694 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': 'c8d15af7-f453-4e4c-8e4a-4d846de18e0c'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:12:23.368511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.438859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55888) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:23.468682 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (1d54abbd-4eda-40cf-82ef-27bc3e194d08), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.499010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 1d54abbd-4eda-40cf-82ef-27bc3e194d08 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Mar 24 02:12:23.504664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.513245 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "DELETE /v2.0/networks/1d54abbd-4eda-40cf-82ef-27bc3e194d08 HTTP/1.1" status: 204 len: 168 time: 2.2776875 Mar 24 02:12:23.531001 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3311ae20-3d8e-4376-89a1-2ebca2ea8ad9 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event deleted for resources: {'Network': ['ID=1d54abbd-4eda-40cf-82ef-27bc3e194d08,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:23.537910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Made reservation on behalf of b1bf23b03a854c86ad22a24cf8348ef2 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:23.540288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.568954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.594813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:23.598323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.625922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for port (71b554a6-8cdd-48b9-9b30-c2360b15257b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:23.630681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/c8d15af7-f453-4e4c-8e4a-4d846de18e0c/b4933efe-9e0f-45f4-92b6-ba88769e3e05) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:23.638466 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53162852-6654-45ba-8824-bf64d7950024 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:23.646805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53162852-6654-45ba-8824-bf64d7950024 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:23.650820 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53162852-6654-45ba-8824-bf64d7950024 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:23.655683 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-53162852-6654-45ba-8824-bf64d7950024 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2467 time: 0.3989160 Mar 24 02:12:23.658436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55902) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:23.660561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Request body: {'port': {'device_id': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:23.662164 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port fcda2b67-af67-4b8b-9561-7ab5a45396d6 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:23.704006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Request body: {'port': {'device_id': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:23.764846 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-527e31df-45f1-4a51-bd0a-358be7ee4c46 req-37218428-8a87-46fe-b84e-0ed064fa6e12 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:23.771877 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-527e31df-45f1-4a51-bd0a-358be7ee4c46 req-37218428-8a87-46fe-b84e-0ed064fa6e12 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 932 time: 0.3309031 Mar 24 02:12:24.048372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Publish callbacks [] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.060335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.106769 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.125603 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (71b554a6-8cdd-48b9-9b30-c2360b15257b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.169340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:24.169999 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-69b46993-8575-4803-a44d-cd8568bd3f1e admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=c354b13cd84e43e7ae53c1614f8efe57&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7248979 Mar 24 02:12:24.172757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55914) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:24.181102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:24.187101 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:24.191127 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-527e31df-45f1-4a51-bd0a-358be7ee4c46 req-5db31cb5-6396-49ac-b01d-be4bec3db5ac tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4182856 Mar 24 02:12:24.241394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.247392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55916) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:24.255290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Pushing event updated for resources: {'Port': ['ID=b4933efe-9e0f-45f4-92b6-ba88769e3e05,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:24.261454 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-840456fb-262b-4ea3-89d8-e019cef37f1d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'router': {'name': 'tempest-router--160397129', 'project_id': '764254e1224d42288978a79a9afe720e'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:24.349803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Attempting to bind port b4933efe-9e0f-45f4-92b6-ba88769e3e05 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:24.350174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Attempting to bind port b4933efe-9e0f-45f4-92b6-ba88769e3e05 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:24.350734 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Attempting to bind port b4933efe-9e0f-45f4-92b6-ba88769e3e05 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:24.358300 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:24.359005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:24.359644 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.360204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:24.361406 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Bound port: b4933efe-9e0f-45f4-92b6-ba88769e3e05, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:24.361543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.417775 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Pushing event updated for resources: {'Port': ['ID=71b554a6-8cdd-48b9-9b30-c2360b15257b,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:24.428575 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::1cb (6f3080fc-791f-4748-a0a2-9eff6ea2a609/c8d15af7-f453-4e4c-8e4a-4d846de18e0c/fcda2b67-af67-4b8b-9561-7ab5a45396d6) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:24.448790 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-76160118-76e7-4346-a95d-84e5404d54af tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Deleting port c99483c0-463d-40f7-9f78-73c1fdd72703 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:24.449518 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76160118-76e7-4346-a95d-84e5404d54af tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c99483c0-463d-40f7-9f78-73c1fdd72703), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.449758 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] For port b4933efe-9e0f-45f4-92b6-ba88769e3e05, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:24.454783 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] For port b4933efe-9e0f-45f4-92b6-ba88769e3e05, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b4933efe-9e0f-45f4-92b6-ba88769e3e05,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:24.468187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.564284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8645d883-cd93-46e8-bbc6-bd5f07e5f535 admin admin] Publish callbacks [] for security_group (e59a89ce-c6a5-42cb-a8d6-f2562253a6b5), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.611670 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d323814c-b197-41f5-83bd-b18b9ce68f7e None None] Pushing event updated for resources: {'Port': ['ID=b4933efe-9e0f-45f4-92b6-ba88769e3e05,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:24.657025 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8645d883-cd93-46e8-bbc6-bd5f07e5f535 admin admin] Publish callbacks [] for security_group (e59a89ce-c6a5-42cb-a8d6-f2562253a6b5), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.794482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76160118-76e7-4346-a95d-84e5404d54af tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c99483c0-463d-40f7-9f78-73c1fdd72703), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.841602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-76160118-76e7-4346-a95d-84e5404d54af tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Calling delete_port for c99483c0-463d-40f7-9f78-73c1fdd72703 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:24.972020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8645d883-cd93-46e8-bbc6-bd5f07e5f535 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e59a89ce-c6a5-42cb-a8d6-f2562253a6b5), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.974931 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8645d883-cd93-46e8-bbc6-bd5f07e5f535 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:24.979786 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8645d883-cd93-46e8-bbc6-bd5f07e5f535 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/e59a89ce-c6a5-42cb-a8d6-f2562253a6b5 HTTP/1.1" status: 204 len: 168 time: 0.7273729 Mar 24 02:12:25.005106 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (fcda2b67-af67-4b8b-9561-7ab5a45396d6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.063715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8645d883-cd93-46e8-bbc6-bd5f07e5f535 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e59a89ce-c6a5-42cb-a8d6-f2562253a6b5,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:25.144719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:25.153524 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:25.161806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks [] for security_group (a2e3681c-a454-4d41-bd49-4104ddf71985), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.174341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:25.215294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a2e3681c-a454-4d41-bd49-4104ddf71985), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.227836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 126} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:25.238232 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (5470f875-0d98-42d5-a4fa-b8bc73adfa01), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.238421 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Added segment 5470f875-0d98-42d5-a4fa-b8bc73adfa01 of type vlan for network 58edf94e-c2f9-408c-80bc-44595128bf78 Mar 24 02:12:25.295674 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (fcda2b67-af67-4b8b-9561-7ab5a45396d6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.317604 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76160118-76e7-4346-a95d-84e5404d54af tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c99483c0-463d-40f7-9f78-73c1fdd72703), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.335377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (58edf94e-c2f9-408c-80bc-44595128bf78), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.355642 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:25.369136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:25.380982 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:25.388021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:25.388883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.431417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=fcda2b67-af67-4b8b-9561-7ab5a45396d6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:25.529041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76160118-76e7-4346-a95d-84e5404d54af tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event deleted for resources: {'Port': ['ID=c99483c0-463d-40f7-9f78-73c1fdd72703,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:25.555936 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3dabe73f-ef81-46e8-998f-d99ab825aeeb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 2.4056985 Mar 24 02:12:25.571757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55924) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:25.624939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (58edf94e-c2f9-408c-80bc-44595128bf78), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.625832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:25.626615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.824838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55926) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:25.846046 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 2.8752141 Mar 24 02:12:25.850770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55930) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:25.871251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-840456fb-262b-4ea3-89d8-e019cef37f1d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (0b191317-3969-4f57-941c-9a826dbac819), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.872425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-840456fb-262b-4ea3-89d8-e019cef37f1d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (0b191317-3969-4f57-941c-9a826dbac819), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.948126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b4933efe-9e0f-45f4-92b6-ba88769e3e05 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:25.959182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-840456fb-262b-4ea3-89d8-e019cef37f1d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_controller (0b191317-3969-4f57-941c-9a826dbac819), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:25.996945 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cf8b92bf-2133-45a4-a297-77636476901f admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=e504d6bef7c748b89165f581c15466df&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1682093 Mar 24 02:12:26.001807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55932) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:26.006722 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7058147-1f54-4a2a-8f38-ed023aae4c66 req-936a3b65-458c-43eb-80a1-e63d49122f4d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:26.008998 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d7058147-1f54-4a2a-8f38-ed023aae4c66 req-936a3b65-458c-43eb-80a1-e63d49122f4d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 932 time: 1.9456303 Mar 24 02:12:26.019371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-840456fb-262b-4ea3-89d8-e019cef37f1d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (0b191317-3969-4f57-941c-9a826dbac819), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.021576 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'Network': ['ID=58edf94e-c2f9-408c-80bc-44595128bf78,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:26.041587 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 58edf94e-c2f9-408c-80bc-44595128bf78 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:26.059447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd2a08b5-87b9-4119-a9bf-c64690b572f8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:26.068244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd2a08b5-87b9-4119-a9bf-c64690b572f8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:26.075193 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dd2a08b5-87b9-4119-a9bf-c64690b572f8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1669 time: 0.4898870 Mar 24 02:12:26.078304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55934) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:26.220101 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4bd0828-dcf2-401d-b384-7b4f4ed78a7f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2e3681c-a454-4d41-bd49-4104ddf71985,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:26.262292 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-840456fb-262b-4ea3-89d8-e019cef37f1d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.263645 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-840456fb-262b-4ea3-89d8-e019cef37f1d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 2.0136890 Mar 24 02:12:26.279481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 55936) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:26.321678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76160118-76e7-4346-a95d-84e5404d54af tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.330059 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-76160118-76e7-4346-a95d-84e5404d54af tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "DELETE /v2.0/ports/c99483c0-463d-40f7-9f78-73c1fdd72703 HTTP/1.1" status: 204 len: 168 time: 2.6667395 Mar 24 02:12:26.332765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55938) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:26.339094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for floatingip (68838617-65cc-46a4-a440-36592cc8777d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.388028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port b4933efe-9e0f-45f4-92b6-ba88769e3e05 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:26.388644 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.412962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b9f4db8f-e482-4e56-a174-7af45e0cc502 admin admin] Publish callbacks [] for security_group (39b9b171-812e-4a01-a7ec-867a839de331), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.439096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e1514b5-fda7-479c-87d6-aee7d110c3c2 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:26.455298 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d7058147-1f54-4a2a-8f38-ed023aae4c66 req-a3b31051-9e5c-4035-a078-6a7195f29b05 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4032071 Mar 24 02:12:26.472293 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b9f4db8f-e482-4e56-a174-7af45e0cc502 admin admin] Publish callbacks [] for security_group (39b9b171-812e-4a01-a7ec-867a839de331), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.504174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (58edf94e-c2f9-408c-80bc-44595128bf78), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.512992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 23c422ed-55e0-408f-95ff-bc9d2619a936 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:12:26.517496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (71b554a6-8cdd-48b9-9b30-c2360b15257b), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.527823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8b88a8db-2604-40e8-8001-3dc3e2067a1d None None] Provisioning complete for port b4933efe-9e0f-45f4-92b6-ba88769e3e05 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:26.528239 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e992ef3a-5fc9-4a08-a2b8-df24e9de1f6c req-3cb75cbe-3235-44b2-87be-b97f5a276514 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:26.528754 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8b88a8db-2604-40e8-8001-3dc3e2067a1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.530155 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e992ef3a-5fc9-4a08-a2b8-df24e9de1f6c req-3cb75cbe-3235-44b2-87be-b97f5a276514 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 932 time: 0.9065173 Mar 24 02:12:26.550727 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-1ad05870-f9e4-4864-9768-488693503cb4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] GET failed (client error): The resource could not be found. Mar 24 02:12:26.556036 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1ad05870-f9e4-4864-9768-488693503cb4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "GET /v2.0/ports/c99483c0-463d-40f7-9f78-73c1fdd72703 HTTP/1.1" status: 404 len: 333 time: 0.2174802 Mar 24 02:12:26.556278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b9f4db8f-e482-4e56-a174-7af45e0cc502 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (39b9b171-812e-4a01-a7ec-867a839de331), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.559754 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b9f4db8f-e482-4e56-a174-7af45e0cc502 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.563603 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b9f4db8f-e482-4e56-a174-7af45e0cc502 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/39b9b171-812e-4a01-a7ec-867a839de331 HTTP/1.1" status: 204 len: 168 time: 0.5570283 Mar 24 02:12:26.563603 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55940) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:26.571504 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'port': {'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136', 'name': 'tempest-AllowedAddressPairTestJSON-1593036427'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:26.574152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Publish callbacks [] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.589572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd6faccf-f40d-4625-9573-0ce2f462ea94 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (0b191317-3969-4f57-941c-9a826dbac819), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.600306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f4db8f-e482-4e56-a174-7af45e0cc502 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39b9b171-812e-4a01-a7ec-867a839de331,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:26.743345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port b4933efe-9e0f-45f4-92b6-ba88769e3e05 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:26.743793 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.806922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Transition to ACTIVE for port object 23c422ed-55e0-408f-95ff-bc9d2619a936 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:12:26.823950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8b88a8db-2604-40e8-8001-3dc3e2067a1d None None] Current status of the port b4933efe-9e0f-45f4-92b6-ba88769e3e05 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:26.824974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8b88a8db-2604-40e8-8001-3dc3e2067a1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.871548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port b4933efe-9e0f-45f4-92b6-ba88769e3e05, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b4933efe-9e0f-45f4-92b6-ba88769e3e05,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:26.892110 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:26.919377 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.012460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Pushing event updated for resources: {'Port': ['ID=23c422ed-55e0-408f-95ff-bc9d2619a936,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:27.148888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-39d28b40-f114-404f-96d3-d97746491f1f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port fcda2b67-af67-4b8b-9561-7ab5a45396d6 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:27.149225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39d28b40-f114-404f-96d3-d97746491f1f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fcda2b67-af67-4b8b-9561-7ab5a45396d6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.210208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd6faccf-f40d-4625-9573-0ce2f462ea94 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (0b191317-3969-4f57-941c-9a826dbac819), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.216138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd6faccf-f40d-4625-9573-0ce2f462ea94 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_controller (0b191317-3969-4f57-941c-9a826dbac819), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.361534 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e992ef3a-5fc9-4a08-a2b8-df24e9de1f6c req-d14d7345-7ffd-4d0c-8cf1-faec98bd1364 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7882054 Mar 24 02:12:27.366771 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=b4933efe-9e0f-45f4-92b6-ba88769e3e05,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:27.384623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (58edf94e-c2f9-408c-80bc-44595128bf78), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.394296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39d28b40-f114-404f-96d3-d97746491f1f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fcda2b67-af67-4b8b-9561-7ab5a45396d6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.414291 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-39d28b40-f114-404f-96d3-d97746491f1f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for fcda2b67-af67-4b8b-9561-7ab5a45396d6 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:27.417710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['58edf94e-c2f9-408c-80bc-44595128bf78']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:27.433874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-8b88a8db-2604-40e8-8001-3dc3e2067a1d None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:12:27.434225 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-8b88a8db-2604-40e8-8001-3dc3e2067a1d None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:12:27.436533 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5470f875-0d98-42d5-a4fa-b8bc73adfa01') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:27.437474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5470f875-0d98-42d5-a4fa-b8bc73adfa01') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:27.438811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-98afe121-524a-4a97-84ca-028faef49675 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.491590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dba04693-4495-4586-b5e4-7de9e3b2abd3 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:12:27.500534 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Publish callbacks [] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.514724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Transition to ACTIVE for port object dba04693-4495-4586-b5e4-7de9e3b2abd3 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:12:27.527687 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd6faccf-f40d-4625-9573-0ce2f462ea94 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (0b191317-3969-4f57-941c-9a826dbac819), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.528588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd6faccf-f40d-4625-9573-0ce2f462ea94 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 0b191317-3969-4f57-941c-9a826dbac819 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:12:27.543686 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.591246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (5470f875-0d98-42d5-a4fa-b8bc73adfa01), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.602708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd6faccf-f40d-4625-9573-0ce2f462ea94 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.604230 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cd6faccf-f40d-4625-9573-0ce2f462ea94 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "DELETE /v2.0/routers/0b191317-3969-4f57-941c-9a826dbac819 HTTP/1.1" status: 204 len: 168 time: 1.3023455 Mar 24 02:12:27.715529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39d28b40-f114-404f-96d3-d97746491f1f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (fcda2b67-af67-4b8b-9561-7ab5a45396d6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.760260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39d28b40-f114-404f-96d3-d97746491f1f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=fcda2b67-af67-4b8b-9561-7ab5a45396d6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:27.923700 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b4933efe-9e0f-45f4-92b6-ba88769e3e05 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:27.928955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39d28b40-f114-404f-96d3-d97746491f1f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:27.949635 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-39d28b40-f114-404f-96d3-d97746491f1f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/fcda2b67-af67-4b8b-9561-7ab5a45396d6 HTTP/1.1" status: 204 len: 168 time: 1.8669653 Mar 24 02:12:27.950446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55960) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:27.950851 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55962) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:28.065726 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8b88a8db-2604-40e8-8001-3dc3e2067a1d None None] Current status of the port b4933efe-9e0f-45f4-92b6-ba88769e3e05 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:28.091872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port b4933efe-9e0f-45f4-92b6-ba88769e3e05 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:28.096680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.260199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Made reservation on behalf of a3f362c54abc4116a2d8ae1cbdbafe9b for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:28.285567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.317669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-dcdd9d99-21cf-4845-b695-9873d705c7f5 None None] Provisioning complete for port b4933efe-9e0f-45f4-92b6-ba88769e3e05 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:28.322921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dcdd9d99-21cf-4845-b695-9873d705c7f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.370016 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1740883390', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:28.471136 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for port (71b554a6-8cdd-48b9-9b30-c2360b15257b), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.485511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (b5ea29cc-f908-4e06-9b0e-23b705106b0f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.489608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (5470f875-0d98-42d5-a4fa-b8bc73adfa01), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.493084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (b5ea29cc-f908-4e06-9b0e-23b705106b0f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.506337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (71b554a6-8cdd-48b9-9b30-c2360b15257b), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.685160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Releasing vlan 126 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:28.685600 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (5470f875-0d98-42d5-a4fa-b8bc73adfa01), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:28.687920 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:28.740062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (b5ea29cc-f908-4e06-9b0e-23b705106b0f), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:28.766622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-372e6c2e-0d3b-4d5c-ae52-52feb690dafe tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:28.768154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-372e6c2e-0d3b-4d5c-ae52-52feb690dafe tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:28.778096 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-372e6c2e-0d3b-4d5c-ae52-52feb690dafe tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.8098984 Mar 24 02:12:28.778831 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55976) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:28.829571 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-dcdd9d99-21cf-4845-b695-9873d705c7f5 None None] Current status of the port b4933efe-9e0f-45f4-92b6-ba88769e3e05 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:28.848072 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-dcdd9d99-21cf-4845-b695-9873d705c7f5 None None] Could not find standard attr ID for object fcda2b67-af67-4b8b-9561-7ab5a45396d6. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:12:28.858271 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port b4933efe-9e0f-45f4-92b6-ba88769e3e05 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:28.924447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e5cb022-9fce-4c5e-a4a2-7d9ce3f9c1ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet c8d15af7-f453-4e4c-8e4a-4d846de18e0c {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:12:28.997219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-837df9bd-7b45-4308-9820-69acee15bb27 None None] Could not find standard attr ID for object fcda2b67-af67-4b8b-9561-7ab5a45396d6. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:12:29.041655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e5cb022-9fce-4c5e-a4a2-7d9ce3f9c1ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (c8d15af7-f453-4e4c-8e4a-4d846de18e0c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.053458 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] device_id is not set on port 91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:29.077444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Pushing event updated for resources: {'Port': ['ID=dba04693-4495-4586-b5e4-7de9e3b2abd3,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:29.203742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (58edf94e-c2f9-408c-80bc-44595128bf78), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.223547 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 58edf94e-c2f9-408c-80bc-44595128bf78 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Mar 24 02:12:29.227567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.242580 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "DELETE /v2.0/networks/58edf94e-c2f9-408c-80bc-44595128bf78 HTTP/1.1" status: 204 len: 168 time: 3.2801938 Mar 24 02:12:29.248857 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 55980) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:29.306500 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Request body: {'network': {'router:external': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:29.315449 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Pushing event updated for resources: {'Port': ['ID=71b554a6-8cdd-48b9-9b30-c2360b15257b,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:29.410419 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5110367-47b8-4c44-81ae-1cdbacde9549 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event deleted for resources: {'Network': ['ID=58edf94e-c2f9-408c-80bc-44595128bf78,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:29.437498 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e5cb022-9fce-4c5e-a4a2-7d9ce3f9c1ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (c8d15af7-f453-4e4c-8e4a-4d846de18e0c), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.515696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Made reservation on behalf of b1bf23b03a854c86ad22a24cf8348ef2 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:29.532001 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.541687 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Attempting to bind port 23c422ed-55e0-408f-95ff-bc9d2619a936 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:29.547151 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Attempting to bind port 23c422ed-55e0-408f-95ff-bc9d2619a936 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:29.547766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Attempting to bind port 23c422ed-55e0-408f-95ff-bc9d2619a936 on network 597625fc-4c02-4901-9b3e-46b781f61da1 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:29.611812 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e95283-34d0-498a-96ee-58087a88d9f8 req-2ddd8108-9dde-475d-b085-6c1fb9c5bac2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:29.628057 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-23e95283-34d0-498a-96ee-58087a88d9f8 req-2ddd8108-9dde-475d-b085-6c1fb9c5bac2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 944 time: 2.0033057 Mar 24 02:12:29.668320 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (68838617-65cc-46a4-a440-36592cc8777d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.671898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (b5ea29cc-f908-4e06-9b0e-23b705106b0f), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.688075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Port 23c422ed-55e0-408f-95ff-bc9d2619a936 on network 597625fc-4c02-4901-9b3e-46b781f61da1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:29.688075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Attempting to bind port 23c422ed-55e0-408f-95ff-bc9d2619a936 on network 597625fc-4c02-4901-9b3e-46b781f61da1 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:29.715590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 139} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:29.843720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.859376 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b1120d35-4307-4c73-b1a8-73af863a256b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 8.1228826 Mar 24 02:12:29.876672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:29.876672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Checking segment: {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:29.876672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Bound using segment: {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:29.876672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Bound port: 23c422ed-55e0-408f-95ff-bc9d2619a936, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3634fb13-0e49-49bf-a115-a9f2198a6323', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:29.877176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.898499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Attempting to bind port dba04693-4495-4586-b5e4-7de9e3b2abd3 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:29.898499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Attempting to bind port dba04693-4495-4586-b5e4-7de9e3b2abd3 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:29.898499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Attempting to bind port dba04693-4495-4586-b5e4-7de9e3b2abd3 on network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:29.917451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (dd8f5a5b-407d-4b19-8f0b-75d27c7a3d5a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:29.917885 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Added segment dd8f5a5b-407d-4b19-8f0b-75d27c7a3d5a of type vlan for network c3edf343-f305-42d5-bf02-59a961b01eed Mar 24 02:12:29.925478 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Port dba04693-4495-4586-b5e4-7de9e3b2abd3 on network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:29.926002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Attempting to bind port dba04693-4495-4586-b5e4-7de9e3b2abd3 on network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:29.978494 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:29.978923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Checking segment: {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:29.979349 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Bound using segment: {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:29.979809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Bound port: dba04693-4495-4586-b5e4-7de9e3b2abd3, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0315a2ce-6d94-400b-b5e9-b545de04ccbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:29.980218 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.034351 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f730a8-0427-4ebf-bd07-80638ee88998 req-7b4ad5ea-82ec-41fd-86d4-0bedc0f30a39 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:30.036284 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46f730a8-0427-4ebf-bd07-80638ee88998 req-7b4ad5ea-82ec-41fd-86d4-0bedc0f30a39 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 944 time: 0.8242466 Mar 24 02:12:30.076910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Allocated IP 172.20.0.12 (b57330c4-af00-4735-8aae-7d7d77f8f136/14ee7600-4bf8-4bbb-b8f3-467531787f2d/91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:30.115299 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-23e95283-34d0-498a-96ee-58087a88d9f8 req-55d4e6df-3cf8-4b31-bcf4-47e54efb8bd2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4860115 Mar 24 02:12:30.227113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (c3edf343-f305-42d5-bf02-59a961b01eed), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.254919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e5cb022-9fce-4c5e-a4a2-7d9ce3f9c1ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (c8d15af7-f453-4e4c-8e4a-4d846de18e0c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.335461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56010) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:30.358283 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] For port 23c422ed-55e0-408f-95ff-bc9d2619a936, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:30.475788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] For port dba04693-4495-4586-b5e4-7de9e3b2abd3, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:30.480002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] For port dba04693-4495-4586-b5e4-7de9e3b2abd3, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dba04693-4495-4586-b5e4-7de9e3b2abd3,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:30.498954 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7da005fd-4250-4ce2-9258-02395a7d5fc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.501571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (c3edf343-f305-42d5-bf02-59a961b01eed), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.502983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:30.503735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.531186 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46f730a8-0427-4ebf-bd07-80638ee88998 req-9ef35f47-b2e5-4954-b9df-6c8d526f1b38 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4144428 Mar 24 02:12:30.540246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.544534 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e5cb022-9fce-4c5e-a4a2-7d9ce3f9c1ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (c8d15af7-f453-4e4c-8e4a-4d846de18e0c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.549731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] For port 23c422ed-55e0-408f-95ff-bc9d2619a936, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=23c422ed-55e0-408f-95ff-bc9d2619a936,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:30.652485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc4de057-b5ce-4316-a83d-0dc64db847b0 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:30.656273 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e5cb022-9fce-4c5e-a4a2-7d9ce3f9c1ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=c8d15af7-f453-4e4c-8e4a-4d846de18e0c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:30.659757 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.667475 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a841eee8-8d54-4441-914a-94a7311bf3a8 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Request body: {'quota': {'network': 0, 'port': 0}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:30.747837 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:30.748449 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.749887 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] 10.222.0.30 "PUT /v2.0/ports/dba04693-4495-4586-b5e4-7de9e3b2abd3 HTTP/1.1" status: 200 len: 1094 time: 7.3080077 Mar 24 02:12:30.755174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'tag': 'dba04693-4495-4586-b5e4-7de9e3b2abd3'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:12:30.784120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.785470 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-c7eab09f-343d-48d3-aa2e-d90f1b252768 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-securitygroup--1626599056&fields=id&tenant_id=70b00ff8787a4049967d01e358be86c2 HTTP/1.1" status: 200 len: 267 time: 0.4746158 Mar 24 02:12:30.814121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e5cb022-9fce-4c5e-a4a2-7d9ce3f9c1ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.817595 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7e5cb022-9fce-4c5e-a4a2-7d9ce3f9c1ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/c8d15af7-f453-4e4c-8e4a-4d846de18e0c HTTP/1.1" status: 204 len: 168 time: 2.0346041 Mar 24 02:12:30.817740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:30.826350 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 836 time: 1.5247598 Mar 24 02:12:30.833347 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56018) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:30.833837 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56020) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:30.849354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.855481 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] 10.222.0.30 "PUT /v2.0/ports/23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 200 len: 1094 time: 7.4143996 Mar 24 02:12:30.865038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Request body: {'subnet': {'network_id': 'c3edf343-f305-42d5-bf02-59a961b01eed', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:30.880179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:30.962836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97348c46-9bf2-4483-b777-fa31bae08b9e service neutron] Pushing event updated for resources: {'Port': ['ID=dba04693-4495-4586-b5e4-7de9e3b2abd3,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:31.028379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8d2c006-b102-457d-82a0-c727613b8590 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:12:31.115393 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-da1818d2-6257-4832-b29a-91808028ca62 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.2711811 Mar 24 02:12:31.116436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-126b1cc9-20e4-44bd-9bb6-f76670578563 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'Network': ['ID=c3edf343-f305-42d5-bf02-59a961b01eed,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:31.139621 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56022) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:31.151960 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network c3edf343-f305-42d5-bf02-59a961b01eed details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:31.153792 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2" -d '{"events": [{"name": "network-changed", "server_uuid": "bb0721bf-38c2-46f0-8650-43fce951aa0f", "tag": "dba04693-4495-4586-b5e4-7de9e3b2abd3"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:12:31.227639 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45343fbd-d636-4ee0-9800-098315afc35a req-0928a5ee-30d1-4018-967c-694ffdf9c3de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:31.229184 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-0928a5ee-30d1-4018-967c-694ffdf9c3de service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d597f5a6c32e40b9b8f2e09949c6fcfd&device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 1128 time: 0.3506773 Mar 24 02:12:31.243066 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c8d2c006-b102-457d-82a0-c727613b8590 None None] Deleting port b4933efe-9e0f-45f4-92b6-ba88769e3e05 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:31.243325 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c8d2c006-b102-457d-82a0-c727613b8590 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:31.317799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b81010-2445-42b0-8c25-2cb533db5760 service neutron] Pushing event updated for resources: {'Port': ['ID=23c422ed-55e0-408f-95ff-bc9d2619a936,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:31.340881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c8d2c006-b102-457d-82a0-c727613b8590 None None] For port b4933efe-9e0f-45f4-92b6-ba88769e3e05, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b4933efe-9e0f-45f4-92b6-ba88769e3e05,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:31.341500 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c8d2c006-b102-457d-82a0-c727613b8590 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:31.356803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c8d2c006-b102-457d-82a0-c727613b8590 None None] Calling delete_port for b4933efe-9e0f-45f4-92b6-ba88769e3e05 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:31.373039 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-e89394d7-0443-4359-9f94-c639f885b6e3 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=dba04693-4495-4586-b5e4-7de9e3b2abd3 HTTP/1.1" status: 200 len: 217 time: 0.1138406 Mar 24 02:12:31.384630 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b13d6fc7-2d13-4c41-a285-fc853bea219a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:31.386225 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-b13d6fc7-2d13-4c41-a285-fc853bea219a service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 1128 time: 0.4269722 Mar 24 02:12:31.392228 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-4138a2bf-fabc-4f6d-a679-61bd602d1c76 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:31.393651 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-4138a2bf-fabc-4f6d-a679-61bd602d1c76 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/networks?id=d91de7c3-7e46-4c9d-8b0a-c988de7fd81b HTTP/1.1" status: 200 len: 806 time: 0.5361898 Mar 24 02:12:31.415315 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-8e673de7-42be-45d4-9825-bdc9cc0057d2 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/quotas/70b00ff8787a4049967d01e358be86c2 HTTP/1.1" status: 200 len: 375 time: 0.0146911 Mar 24 02:12:31.422751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:31.427543 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c93c74-f947-458b-bc58-91bdf060b275 req-be1606ae-df50-4a59-a60c-766bb02d1211 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:31.437091 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-35c93c74-f947-458b-bc58-91bdf060b275 req-be1606ae-df50-4a59-a60c-766bb02d1211 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 944 time: 0.1975267 Mar 24 02:12:31.457141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c8d2c006-b102-457d-82a0-c727613b8590 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (b4933efe-9e0f-45f4-92b6-ba88769e3e05), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:31.489620 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d2c006-b102-457d-82a0-c727613b8590 None None] Pushing event deleted for resources: {'Port': ['ID=b4933efe-9e0f-45f4-92b6-ba88769e3e05,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:31.492613 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:31.493758 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8d2c006-b102-457d-82a0-c727613b8590 None None] No DVR routers for this DVR port b4933efe-9e0f-45f4-92b6-ba88769e3e05 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:12:31.496071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Made reservation on behalf of b1bf23b03a854c86ad22a24cf8348ef2 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:31.498492 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:31.527102 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-35c93c74-f947-458b-bc58-91bdf060b275 req-35fcc1ba-c9bf-49da-b6ed-021200d29e15 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0890617 Mar 24 02:12:31.534710 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-526fdb7b-62db-4ba5-aa58-5c3135635acd tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=70b00ff8787a4049967d01e358be86c2&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0955529 Mar 24 02:12:31.572261 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a841eee8-8d54-4441-914a-94a7311bf3a8 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] 10.222.0.20 "PUT /v2.0/quotas/c230494aaa844b889ebae0750228eb5a HTTP/1.1" status: 200 len: 366 time: 1.2260950 Mar 24 02:12:31.601629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56032) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:31.606395 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (b5ea29cc-f908-4e06-9b0e-23b705106b0f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:31.620907 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4aac1f1d-c815-4371-85aa-ab02371b6428 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] 10.222.0.20 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 468 time: 0.0184863 Mar 24 02:12:31.623323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56034) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:31.648881 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a9bae54f-e1e1-4ebd-a297-aecb6f6320f1 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] 10.222.0.20 "GET /v2.0/quotas/c230494aaa844b889ebae0750228eb5a HTTP/1.1" status: 200 len: 366 time: 0.0235848 Mar 24 02:12:31.650822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:31.651383 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56036) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:31.658539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Network b57330c4-af00-4735-8aae-7d7d77f8f136 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:31.679005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:31.684467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:12:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bb626cf-191d-4cc0-83e0-a7b61404095c x-openstack-request-id: req-0bb626cf-191d-4cc0-83e0-a7b61404095c {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:12:31.684932 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bb0721bf-38c2-46f0-8650-43fce951aa0f", "tag": "dba04693-4495-4586-b5e4-7de9e3b2abd3", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:12:31.685496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-0bb626cf-191d-4cc0-83e0-a7b61404095c {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:12:31.686618 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0bb626cf-191d-4cc0-83e0-a7b61404095c'] response: {'name': 'network-changed', 'server_uuid': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'tag': 'dba04693-4495-4586-b5e4-7de9e3b2abd3', 'status': 'completed', 'code': 200} Mar 24 02:12:31.687343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:31.690925 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Port': ['ID=91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:31.710556 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7abd21d4-9c7f-4fc5-a793-f81b6efefd64 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] 10.222.0.20 "DELETE /v2.0/quotas/c230494aaa844b889ebae0750228eb5a HTTP/1.1" status: 204 len: 168 time: 0.0567131 Mar 24 02:12:31.712188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56040) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:31.725450 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-03e06dc0-fe68-434f-9194-75edbe9779dd tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] 10.222.0.20 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 207 time: 0.0100188 Mar 24 02:12:31.725772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56042) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:31.738556 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-e26dca71-f3fe-470a-af6a-cb626bfd8985 service neutron] 10.222.0.20 "GET /v2.0/networks/d91de7c3-7e46-4c9d-8b0a-c988de7fd81b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1865747 Mar 24 02:12:31.753074 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-95e833b4-cbd7-4ea8-96ec-56918759f844 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] 10.222.0.20 "GET /v2.0/quotas/c230494aaa844b889ebae0750228eb5a HTTP/1.1" status: 200 len: 370 time: 0.0260127 Mar 24 02:12:31.762298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56044) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:31.772464 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-97b7dc4c-00b0-4b89-bbba-a64c99175e3f tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] 10.222.0.20 "GET /v2.0/quotas/c230494aaa844b889ebae0750228eb5a/default HTTP/1.1" status: 200 len: 370 time: 0.0053337 Mar 24 02:12:31.781908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56046) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:31.809305 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:31.813237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:31.816687 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-b7d5c6b4-2701-45c0-a68e-cc0ccfd33b4b tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] delete failed (client error): The resource could not be found. Mar 24 02:12:31.821013 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b7d5c6b4-2701-45c0-a68e-cc0ccfd33b4b tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] 10.222.0.20 "DELETE /v2.0/quotas/c230494aaa844b889ebae0750228eb5a HTTP/1.1" status: 404 len: 348 time: 0.0349925 Mar 24 02:12:31.850135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b4933efe-9e0f-45f4-92b6-ba88769e3e05 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:12:31.879713 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: b4933efe-9e0f-45f4-92b6-ba88769e3e05 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:12:31.880060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b4933efe-9e0f-45f4-92b6-ba88769e3e05 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:12:31.937523 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03fc3ac-90b1-4d5d-9b49-282dca112fd8 req-7e06bc2d-7b1b-4e3b-b0b0-23b78baaacea tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:31.939089 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d03fc3ac-90b1-4d5d-9b49-282dca112fd8 req-7e06bc2d-7b1b-4e3b-b0b0-23b78baaacea tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 944 time: 0.1202729 Mar 24 02:12:31.941132 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-4bc2ff54-80d6-464b-acf2-78f7b701025c service neutron] 10.222.0.20 "GET /v2.0/networks/d91de7c3-7e46-4c9d-8b0a-c988de7fd81b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1908932 Mar 24 02:12:31.975692 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:31.976671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.006187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56050) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:32.015444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-881d948b-2bc2-40b1-80d5-c615024f68fc None None] Provisioning complete for port 91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:32.015810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-881d948b-2bc2-40b1-80d5-c615024f68fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.028178 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fb5c41d9-acc0-41e5-a794-996286b96994 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 5.4610736 Mar 24 02:12:32.031185 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56052) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:32.039864 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d03fc3ac-90b1-4d5d-9b49-282dca112fd8 req-807f1596-8e8a-41e4-9a5b-b7089dca5f3b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0882640 Mar 24 02:12:32.046414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-aecf9c0e-1af7-4fbf-b50d-d0047330909c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.8', 'mac_address': 'fa:16:3e:af:63:24'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:32.056498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Usage tracker for resource:network and project:03f48ae797de48cd87cf35f37c5657ba is out of sync, need to count used quota {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Mar 24 02:12:32.060254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Mar 24 02:12:32.067210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Usage tracker for resource:subnet and project:03f48ae797de48cd87cf35f37c5657ba is out of sync, need to count used quota {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Mar 24 02:12:32.071830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Mar 24 02:12:32.074041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-881d948b-2bc2-40b1-80d5-c615024f68fc None None] Port 91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:32.078335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Usage tracker for resource:subnetpool and project:03f48ae797de48cd87cf35f37c5657ba is out of sync, need to count used quota {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Mar 24 02:12:32.083839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Quota usage for subnetpool was recalculated. Used quota:0. {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Mar 24 02:12:32.085434 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Allocated IP 172.26.2.145 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/21d54e60-84e3-4fbc-ba71-cf6b236a83bf) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:32.091281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Usage tracker for resource:port and project:03f48ae797de48cd87cf35f37c5657ba is out of sync, need to count used quota {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Mar 24 02:12:32.094555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Mar 24 02:12:32.102433 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Usage tracker for resource:router and project:03f48ae797de48cd87cf35f37c5657ba is out of sync, need to count used quota {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Mar 24 02:12:32.105654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Mar 24 02:12:32.111562 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Usage tracker for resource:floatingip and project:03f48ae797de48cd87cf35f37c5657ba is out of sync, need to count used quota {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Mar 24 02:12:32.114926 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Mar 24 02:12:32.155642 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Usage tracker for resource:security_group and project:03f48ae797de48cd87cf35f37c5657ba is out of sync, need to count used quota {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Mar 24 02:12:32.162148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Mar 24 02:12:32.181975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Usage tracker for resource:security_group_rule and project:03f48ae797de48cd87cf35f37c5657ba is out of sync, need to count used quota {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Mar 24 02:12:32.186342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.quota.resource [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=104037) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Mar 24 02:12:32.203412 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46bf01f5-7837-4287-adec-e8ef86937149 req-979e21dd-3972-4214-b241-2103a9630b4d tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 210 time: 0.0310400 Mar 24 02:12:32.209916 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a459130c-5c85-4419-a7f1-b3e27b606632 tempest-QuotasTest-394381417 tempest-QuotasTest-394381417-project-admin] 10.222.0.20 "GET /v2.0/quotas/03f48ae797de48cd87cf35f37c5657ba/details.json HTTP/1.1" status: 200 len: 703 time: 0.1998055 Mar 24 02:12:32.373277 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.502896 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for port (21d54e60-84e3-4fbc-ba71-cf6b236a83bf), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.527614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (14372524-5236-4550-9b88-28763fa41de8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.550301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56068) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:32.568640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aecf9c0e-1af7-4fbf-b50d-d0047330909c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.609765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:32.622470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:32.630811 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:32.631667 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.634978 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3474b6c-0035-4327-b1fe-dc91d45ec3c2 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:32.636410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=14372524-5236-4550-9b88-28763fa41de8,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:32.700879 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (21d54e60-84e3-4fbc-ba71-cf6b236a83bf), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.706874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:12:32.707411 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (7c18d7b4-93ce-40af-a916-9f24179812df), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.715130 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3574fa03-180e-4b15-a6b6-b0ca839f6e15 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.754392 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e72b4845-88f3-427d-85bc-3d7bb2394366 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.3741920 Mar 24 02:12:32.755252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56074) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:32.762015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'name': 'tempest-NetworksTestDHCPv6-1239632084'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:32.776845 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '14372524-5236-4550-9b88-28763fa41de8'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:12:32.778382 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.848953 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:32.873488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:32.879849 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:32.887076 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event updated for resources: {'Port': ['ID=21d54e60-84e3-4fbc-ba71-cf6b236a83bf,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:32.893803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'Subnet': ['ID=7c18d7b4-93ce-40af-a916-9f24179812df,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:32.932119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/14372524-5236-4550-9b88-28763fa41de8/263cc31f-9e56-4e9f-9934-09ba56916bde) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:32.965930 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Checking segment: {'id': 'dd8f5a5b-407d-4b19-8f0b-75d27c7a3d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'c3edf343-f305-42d5-bf02-59a961b01eed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:32.966361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Network hostable DHCP agents. Network: c3edf343-f305-42d5-bf02-59a961b01eed, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:12:32.968194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90fdf9db-e377-4487-bc9e-8d249f371185 req-bd776f45-59aa-4b04-8ae1-733212def99d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:32.969695 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-90fdf9db-e377-4487-bc9e-8d249f371185 req-bd776f45-59aa-4b04-8ae1-733212def99d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 944 time: 0.1816571 Mar 24 02:12:32.976881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3574fa03-180e-4b15-a6b6-b0ca839f6e15 admin admin] Publish callbacks [] for security_group (cbfe026d-6869-403f-9b4e-f90f2e5b29b3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:32.994900 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3574fa03-180e-4b15-a6b6-b0ca839f6e15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (cbfe026d-6869-403f-9b4e-f90f2e5b29b3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.096238 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Network c3edf343-f305-42d5-bf02-59a961b01eed is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:12:33.103851 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aecf9c0e-1af7-4fbf-b50d-d0047330909c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.114936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aecf9c0e-1af7-4fbf-b50d-d0047330909c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.134106 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, c3edf343-f305-42d5-bf02-59a961b01eed) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:33.142965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Publish callbacks [] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.149792 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a011f89-2890-4919-8438-f581e9c7f23e None None] Network c3edf343-f305-42d5-bf02-59a961b01eed requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:33.160390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:33.161071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.195762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.333035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:33.352707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:33.373636 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:33.390141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Pushing event updated for resources: {'Port': ['ID=263cc31f-9e56-4e9f-9934-09ba56916bde,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:33.448956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-777fc666-eaca-4980-bfc7-6095f2ec97b9 None None] Network c3edf343-f305-42d5-bf02-59a961b01eed requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:33.473957 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45343fbd-d636-4ee0-9800-098315afc35a req-cf643ee3-dcc1-4f2c-b5bd-8b94a47284e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:33.475529 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-cf643ee3-dcc1-4f2c-b5bd-8b94a47284e8 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dfc73b89-587b-4f56-aa2b-706a8f904224 HTTP/1.1" status: 200 len: 850 time: 0.4669676 Mar 24 02:12:33.488113 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-9dd0bbef-551f-4082-b168-e1afcfa70ab2 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 200 len: 217 time: 0.4896541 Mar 24 02:12:33.515615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Attempting to bind port 263cc31f-9e56-4e9f-9934-09ba56916bde on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:33.515983 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Attempting to bind port 263cc31f-9e56-4e9f-9934-09ba56916bde by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:33.516330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Attempting to bind port 263cc31f-9e56-4e9f-9934-09ba56916bde on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:33.518617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:33.522419 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.531143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:33.531540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:33.531908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.532297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:33.532769 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Bound port: 263cc31f-9e56-4e9f-9934-09ba56916bde, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:33.533609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.545418 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-848ae69c-d5be-4f95-a0f9-b6e44449a11a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.6887913 Mar 24 02:12:33.546560 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fda5d8d1-dca7-4e98-85f1-801c451de0fb None None] Provisioning complete for port 91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:33.549202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fda5d8d1-dca7-4e98-85f1-801c451de0fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.553815 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aecf9c0e-1af7-4fbf-b50d-d0047330909c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Port': ['ID=91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:33.564768 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56080) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:33.568959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Request body: {'floatingip': {'floating_network_id': 'c3edf343-f305-42d5-bf02-59a961b01eed'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:33.607921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks [] for floatingip (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.618918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fda5d8d1-dca7-4e98-85f1-801c451de0fb None None] Port 91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:33.663438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-85e89140-b9e8-4524-86a0-6977de9bb86e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:33.665683 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-85e89140-b9e8-4524-86a0-6977de9bb86e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=56374a24-4e35-434f-b4b8-860ef8289893 HTTP/1.1" status: 200 len: 851 time: 0.1480150 Mar 24 02:12:33.668672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] For port 263cc31f-9e56-4e9f-9934-09ba56916bde, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:33.673881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] For port 263cc31f-9e56-4e9f-9934-09ba56916bde, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=263cc31f-9e56-4e9f-9934-09ba56916bde,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:33.676758 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3574fa03-180e-4b15-a6b6-b0ca839f6e15 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=3a0c042351f74a69bc6c88f14470b73d&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1251700 Mar 24 02:12:33.681435 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3574fa03-180e-4b15-a6b6-b0ca839f6e15 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cbfe026d-6869-403f-9b4e-f90f2e5b29b3,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:33.682327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56082) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:33.689989 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-aecf9c0e-1af7-4fbf-b50d-d0047330909c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] In _notify_port_updated(), no bound segment for port 91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 on network b57330c4-af00-4735-8aae-7d7d77f8f136 {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:12:33.695374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aecf9c0e-1af7-4fbf-b50d-d0047330909c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:33.696005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aecf9c0e-1af7-4fbf-b50d-d0047330909c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.697308 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-aecf9c0e-1af7-4fbf-b50d-d0047330909c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "PUT /v2.0/ports/91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 HTTP/1.1" status: 200 len: 994 time: 1.6616147 Mar 24 02:12:33.702320 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.705062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port a637b4a0-dbbc-433e-a7fc-981fa5888420 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:33.709431 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56084) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:33.709580 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'tag': '23c422ed-55e0-408f-95ff-bc9d2619a936'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:12:33.713009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36919898-17aa-43b9-87b3-35349098743f" -d '{"events": [{"name": "network-changed", "server_uuid": "0a447b1e-7d9a-43d6-8a64-8ff70a04f466", "tag": "23c422ed-55e0-408f-95ff-bc9d2619a936"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:12:33.740966 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-90fdf9db-e377-4487-bc9e-8d249f371185 req-e41f8634-bb35-4262-9ec6-4fda29bab63b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7569005 Mar 24 02:12:33.744220 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.30', 58679) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:33.809706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3669377b-1152-4851-9e3c-9318f0b21ee0 None None] Pushing event updated for resources: {'Port': ['ID=263cc31f-9e56-4e9f-9934-09ba56916bde,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:33.824338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:33.899829 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45343fbd-d636-4ee0-9800-098315afc35a req-c8da2c4b-e47c-4881-9088-cf212a9b5080 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:33.901325 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-c8da2c4b-e47c-4881-9088-cf212a9b5080 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.4094779 Mar 24 02:12:33.927685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3384c3e-f4f6-4b8f-aca6-9bbdc148b38e req-118d317d-a9e1-4a05-a91b-228fa79bfa1e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:33.928983 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b3384c3e-f4f6-4b8f-aca6-9bbdc148b38e req-118d317d-a9e1-4a05-a91b-228fa79bfa1e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 944 time: 0.4496429 Mar 24 02:12:33.930845 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-622af223-5064-4dec-bf74-bc1c876e17fd req-31edf2d3-2096-4907-b97c-1e8221ea2c3b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 210 time: 0.0653737 Mar 24 02:12:33.943373 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (b5ea29cc-f908-4e06-9b0e-23b705106b0f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.055266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-44a8658b-34c9-41e7-8856-b71cb9e34758 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:34.056837 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-44a8658b-34c9-41e7-8856-b71cb9e34758 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=597625fc-4c02-4901-9b3e-46b781f61da1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.3779442 Mar 24 02:12:34.095870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:12:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6e81b188-b4e4-4b68-9f2c-5286194b47c6 x-openstack-request-id: req-6e81b188-b4e4-4b68-9f2c-5286194b47c6 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:12:34.096167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0a447b1e-7d9a-43d6-8a64-8ff70a04f466", "tag": "23c422ed-55e0-408f-95ff-bc9d2619a936", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:12:34.096423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-6e81b188-b4e4-4b68-9f2c-5286194b47c6 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:12:34.096826 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-6e81b188-b4e4-4b68-9f2c-5286194b47c6'] response: {'name': 'network-changed', 'server_uuid': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'tag': '23c422ed-55e0-408f-95ff-bc9d2619a936', 'status': 'completed', 'code': 200} Mar 24 02:12:34.210406 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b3384c3e-f4f6-4b8f-aca6-9bbdc148b38e req-57c124ff-d350-4e93-8e30-14d18dc6e359 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2600467 Mar 24 02:12:34.216897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::86 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/14372524-5236-4550-9b88-28763fa41de8/a637b4a0-dbbc-433e-a7fc-981fa5888420) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:34.243694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-65bd27fe-c73f-495a-8a62-e487968295cd admin admin] Publish callbacks [] for security_group (cbfe026d-6869-403f-9b4e-f90f2e5b29b3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.264585 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-7d85c79f-32c5-4636-b932-efdd04a9f743 service neutron] 10.222.0.30 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3234482 Mar 24 02:12:34.271696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-887c1ce9-7bf5-450e-bd6c-547eb52b7e1b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:34.272786 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-887c1ce9-7bf5-450e-bd6c-547eb52b7e1b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.30 "GET /v2.0/networks?id=d91de7c3-7e46-4c9d-8b0a-c988de7fd81b HTTP/1.1" status: 200 len: 806 time: 0.5169771 Mar 24 02:12:34.321318 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-65bd27fe-c73f-495a-8a62-e487968295cd admin admin] Publish callbacks [] for security_group (cbfe026d-6869-403f-9b4e-f90f2e5b29b3), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.346689 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-4ed093c0-fe17-4c9d-872c-db301e06b503 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Deleting port 91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:34.347027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ed093c0-fe17-4c9d-872c-db301e06b503 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.360985 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-7da0a735-a999-48b3-8ada-2e499741cba1 service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2872069 Mar 24 02:12:34.485777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.505364 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-45343fbd-d636-4ee0-9800-098315afc35a req-e93448d2-3961-4c2b-8166-55f4b1b1d4fa service neutron] 10.222.0.30 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2332423 Mar 24 02:12:34.559690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (a637b4a0-dbbc-433e-a7fc-981fa5888420), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.562863 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e7c443ba-4fbb-40f9-be83-ce4c2fe42af4 req-bc90002c-ebff-495a-91f1-946494788d44 service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1826332 Mar 24 02:12:34.572722 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-f670d1ea-0f56-4874-a6a2-7f302cd6f616 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=70b00ff8787a4049967d01e358be86c2 HTTP/1.1" status: 200 len: 380 time: 0.2880380 Mar 24 02:12:34.618999 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a637b4a0-dbbc-433e-a7fc-981fa5888420), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.619626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Request body: {'port': {'device_id': '65964499-8a52-4d24-90bb-505fb03cb88a', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'admin_state_up': True, 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'security_groups': ['79e8d0c0-2674-47ef-8eea-b630f6955be7']}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:34.713219 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-65bd27fe-c73f-495a-8a62-e487968295cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (cbfe026d-6869-403f-9b4e-f90f2e5b29b3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.715884 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-65bd27fe-c73f-495a-8a62-e487968295cd admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.719349 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-65bd27fe-c73f-495a-8a62-e487968295cd admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/cbfe026d-6869-403f-9b4e-f90f2e5b29b3 HTTP/1.1" status: 204 len: 168 time: 1.0302491 Mar 24 02:12:34.721011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ed093c0-fe17-4c9d-872c-db301e06b503 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.727666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (b5ea29cc-f908-4e06-9b0e-23b705106b0f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.750463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:34.757045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:34.757268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-4ed093c0-fe17-4c9d-872c-db301e06b503 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Calling delete_port for 91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:34.760010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:34.761657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65bd27fe-c73f-495a-8a62-e487968295cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cbfe026d-6869-403f-9b4e-f90f2e5b29b3,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:34.795458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:34.796140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:34.825356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=a637b4a0-dbbc-433e-a7fc-981fa5888420,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:34.926867 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e0767517-c20d-4742-994d-81d3038ca36d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.1704228 Mar 24 02:12:34.930148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-9e43179e-80d1-4c87-b852-1ef440859160 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:34.931638 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-9e43179e-80d1-4c87-b852-1ef440859160 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d597f5a6c32e40b9b8f2e09949c6fcfd&device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 1128 time: 0.2781124 Mar 24 02:12:34.933087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56100) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:34.945729 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919898-17aa-43b9-87b3-35349098743f req-2aaaa947-075b-40ec-a0ee-80cddec9d74d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:34.947413 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36919898-17aa-43b9-87b3-35349098743f req-2aaaa947-075b-40ec-a0ee-80cddec9d74d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 1128 time: 0.2898421 Mar 24 02:12:34.951477 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Allocated IP 172.20.0.3 (c3edf343-f305-42d5-bf02-59a961b01eed/7c18d7b4-93ce-40af-a916-9f24179812df/c5c42e79-c5c6-42c8-b284-d7d811d8686b) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:35.113077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56104) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:35.124264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Made reservation on behalf of 70b00ff8787a4049967d01e358be86c2 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:35.127644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.129176 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-80aafffe-0c08-4691-a424-2d29b6c9e130 req-8aac35d8-d691-426f-8f99-6315f7ddc12b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 210 time: 0.0710001 Mar 24 02:12:35.158173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dac20917-7a10-4be9-9eb5-1dac30cdd9ce req-a31f0519-1703-403e-b4a6-c30ae66159c0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:35.162611 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dac20917-7a10-4be9-9eb5-1dac30cdd9ce req-a31f0519-1703-403e-b4a6-c30ae66159c0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 944 time: 0.3047509 Mar 24 02:12:35.175733 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7e9de26f-02b3-4d0e-8bbe-3c8ecf53095d None None] Provisioning complete for port 263cc31f-9e56-4e9f-9934-09ba56916bde triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:35.176834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e9de26f-02b3-4d0e-8bbe-3c8ecf53095d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.231050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35623b94-53a8-4b36-9891-9af51f96a3e8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:35.237576 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35623b94-53a8-4b36-9891-9af51f96a3e8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:35.239259 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-35623b94-53a8-4b36-9891-9af51f96a3e8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1668 time: 0.3035958 Mar 24 02:12:35.242418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56108) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:35.288589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7e9de26f-02b3-4d0e-8bbe-3c8ecf53095d None None] Current status of the port 263cc31f-9e56-4e9f-9934-09ba56916bde is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:35.289600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e9de26f-02b3-4d0e-8bbe-3c8ecf53095d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.294874 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-ddebaa14-ab5c-41a5-9b80-0ff871400d97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:35.296360 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-ddebaa14-ab5c-41a5-9b80-0ff871400d97 service neutron] 10.222.0.30 "GET /v2.0/networks?id=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 HTTP/1.1" status: 200 len: 912 time: 0.3474188 Mar 24 02:12:35.337485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7e9de26f-02b3-4d0e-8bbe-3c8ecf53095d None None] For port 263cc31f-9e56-4e9f-9934-09ba56916bde, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=263cc31f-9e56-4e9f-9934-09ba56916bde,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:35.338677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919898-17aa-43b9-87b3-35349098743f req-7eea177a-ab64-4a25-b3fd-a7afb7e1b40d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:35.340284 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36919898-17aa-43b9-87b3-35349098743f req-7eea177a-ab64-4a25-b3fd-a7afb7e1b40d service neutron] 10.222.0.30 "GET /v2.0/networks?id=597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 200 len: 913 time: 0.3263080 Mar 24 02:12:35.346116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e9de26f-02b3-4d0e-8bbe-3c8ecf53095d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.400334 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e9de26f-02b3-4d0e-8bbe-3c8ecf53095d None None] Pushing event updated for resources: {'Port': ['ID=263cc31f-9e56-4e9f-9934-09ba56916bde,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:35.400629 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-c3452225-80fe-4a84-a67e-cf428c4d0d4b service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=dba04693-4495-4586-b5e4-7de9e3b2abd3 HTTP/1.1" status: 200 len: 217 time: 0.0855746 Mar 24 02:12:35.405067 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dac20917-7a10-4be9-9eb5-1dac30cdd9ce req-ba757e4e-4331-47bb-8688-ab1f4d100dc1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2351949 Mar 24 02:12:35.408565 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be541ef8-c932-472b-927b-d75e68582fc4 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.470041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6b4f69c5-e368-450c-99d2-ff88e082f172 None None] Provisioning complete for port a637b4a0-dbbc-433e-a7fc-981fa5888420 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:35.470613 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6b4f69c5-e368-450c-99d2-ff88e082f172 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a637b4a0-dbbc-433e-a7fc-981fa5888420), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.512166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6b4f69c5-e368-450c-99d2-ff88e082f172 None None] Port a637b4a0-dbbc-433e-a7fc-981fa5888420 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:35.633584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks [] for port (c5c42e79-c5c6-42c8-b284-d7d811d8686b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.674265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ed093c0-fe17-4c9d-872c-db301e06b503 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.699305 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36919898-17aa-43b9-87b3-35349098743f req-308dd0bb-3dcf-4de9-9f99-bb6b7b362a27 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 200 len: 217 time: 0.3205636 Mar 24 02:12:35.717899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Router b5ea29cc-f908-4e06-9b0e-23b705106b0f is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:12:35.733826 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed093c0-fe17-4c9d-872c-db301e06b503 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event deleted for resources: {'Port': ['ID=91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:35.803797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-245da65e-a219-4b26-8083-3b9213f625c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:35.808525 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-245da65e-a219-4b26-8083-3b9213f625c5 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dfc73b89-587b-4f56-aa2b-706a8f904224 HTTP/1.1" status: 200 len: 850 time: 0.3661668 Mar 24 02:12:35.808699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be541ef8-c932-472b-927b-d75e68582fc4 admin admin] Publish callbacks [] for security_group (0783dd99-d0c2-4f11-9852-79aa193f2836), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.819437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Allocated IP 172.20.0.6 (d91de7c3-7e46-4c9d-8b0a-c988de7fd81b/02cc6c6a-e353-4d82-9d85-3973d8220a39/3f03ca03-be93-4662-af2b-73bbfc93a9da) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:35.819734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b1f9eb-1544-450e-86d4-57bce4362eaf req-a33df5fd-e96d-45cf-b54e-4721a87ab727 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:35.821195 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b1f9eb-1544-450e-86d4-57bce4362eaf req-a33df5fd-e96d-45cf-b54e-4721a87ab727 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 944 time: 0.4918613 Mar 24 02:12:35.825173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919898-17aa-43b9-87b3-35349098743f req-b223a7b9-139a-445f-a948-3e84726a2b3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:35.826724 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36919898-17aa-43b9-87b3-35349098743f req-b223a7b9-139a-445f-a948-3e84726a2b3a service neutron] 10.222.0.30 "GET /v2.0/subnets?id=56374a24-4e35-434f-b4b8-860ef8289893 HTTP/1.1" status: 200 len: 851 time: 0.1075506 Mar 24 02:12:35.867382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be541ef8-c932-472b-927b-d75e68582fc4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0783dd99-d0c2-4f11-9852-79aa193f2836), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.887862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 263cc31f-9e56-4e9f-9934-09ba56916bde up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:35.908312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f7ce6237-17e9-47fd-b11c-e11e848ae983 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port a637b4a0-dbbc-433e-a7fc-981fa5888420 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:35.908648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7ce6237-17e9-47fd-b11c-e11e848ae983 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a637b4a0-dbbc-433e-a7fc-981fa5888420), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.962730 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 263cc31f-9e56-4e9f-9934-09ba56916bde triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:35.963103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:35.969438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c5c42e79-c5c6-42c8-b284-d7d811d8686b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.000968 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-be541ef8-c932-472b-927b-d75e68582fc4 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=03f48ae797de48cd87cf35f37c5657ba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8865139 Mar 24 02:12:36.009195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56110) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:36.021121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be541ef8-c932-472b-927b-d75e68582fc4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0783dd99-d0c2-4f11-9852-79aa193f2836,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:36.021531 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b1f9eb-1544-450e-86d4-57bce4362eaf req-6879bc64-78cc-45d1-a141-24f58a3bef1f tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1811976 Mar 24 02:12:36.033577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-364062e0-c082-4ffb-afa0-d08f6b71d515 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:36.035089 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-364062e0-c082-4ffb-afa0-d08f6b71d515 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.2121859 Mar 24 02:12:36.071315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919898-17aa-43b9-87b3-35349098743f req-01081b4d-4ed3-4555-86b9-a7a442cfe2d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:36.073276 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36919898-17aa-43b9-87b3-35349098743f req-01081b4d-4ed3-4555-86b9-a7a442cfe2d6 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=597625fc-4c02-4901-9b3e-46b781f61da1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.2348557 Mar 24 02:12:36.090943 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 263cc31f-9e56-4e9f-9934-09ba56916bde is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:36.105885 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Network c3edf343-f305-42d5-bf02-59a961b01eed is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:36.171726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:36.182942 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:36.185688 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7ce6237-17e9-47fd-b11c-e11e848ae983 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a637b4a0-dbbc-433e-a7fc-981fa5888420), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.192370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:36.208757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baa5895b-8bb6-47fc-bd07-ba98a47ce43b None None] Sync routers for ids ['b5ea29cc-f908-4e06-9b0e-23b705106b0f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:36.215194 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'Port': ['ID=c5c42e79-c5c6-42c8-b284-d7d811d8686b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:36.220487 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baa5895b-8bb6-47fc-bd07-ba98a47ce43b None None] Routers {'b5ea29cc-f908-4e06-9b0e-23b705106b0f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:36.221829 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-baa5895b-8bb6-47fc-bd07-ba98a47ce43b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b5ea29cc-f908-4e06-9b0e-23b705106b0f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:36.226182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f7ce6237-17e9-47fd-b11c-e11e848ae983 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for a637b4a0-dbbc-433e-a7fc-981fa5888420 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:36.258912 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-baa5895b-8bb6-47fc-bd07-ba98a47ce43b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:36.267151 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ed093c0-fe17-4c9d-872c-db301e06b503 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.268441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baa5895b-8bb6-47fc-bd07-ba98a47ce43b None None] Routers {'b5ea29cc-f908-4e06-9b0e-23b705106b0f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:36.269044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-baa5895b-8bb6-47fc-bd07-ba98a47ce43b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b5ea29cc-f908-4e06-9b0e-23b705106b0f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:36.272940 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4ed093c0-fe17-4c9d-872c-db301e06b503 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "DELETE /v2.0/ports/91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 HTTP/1.1" status: 204 len: 168 time: 2.5582979 Mar 24 02:12:36.277639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56114) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:36.280250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.283955 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-00a1cb0c-394a-4b6f-88b4-c2f58370049f tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 889 time: 8.3239040 Mar 24 02:12:36.295947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56116) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:36.326589 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-005db48c-38a6-4ad7-b2dd-7e753b1f8cdb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] GET failed (client error): The resource could not be found. Mar 24 02:12:36.331593 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-005db48c-38a6-4ad7-b2dd-7e753b1f8cdb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "GET /v2.0/ports/91fb5e5b-f8a4-49dd-bd09-dc1acdeeca22 HTTP/1.1" status: 404 len: 333 time: 0.0456657 Mar 24 02:12:36.336632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56118) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:36.365239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'port': {'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136', 'name': 'tempest-AllowedAddressPairTestJSON-1219154859'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:36.374561 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.421510 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-baa5895b-8bb6-47fc-bd07-ba98a47ce43b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:36.422152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baa5895b-8bb6-47fc-bd07-ba98a47ce43b None None] The sync data for ids ['b5ea29cc-f908-4e06-9b0e-23b705106b0f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:36.434915 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-73b34a60-84bc-4a3c-8ed1-72047120ddf5 req-982dd810-f92b-43b1-9fd7-f8ea8841f1e1 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 210 time: 0.1364250 Mar 24 02:12:36.435529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d0a03c33-383d-403c-8113-f2c506779954 admin admin] Publish callbacks [] for security_group (0783dd99-d0c2-4f11-9852-79aa193f2836), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.455589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks [] for floatingip (ec3c7555-6f82-45fc-98f2-f7809d809d17), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.458597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d0a03c33-383d-403c-8113-f2c506779954 admin admin] Publish callbacks [] for security_group (0783dd99-d0c2-4f11-9852-79aa193f2836), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.533143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.547130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c5c42e79-c5c6-42c8-b284-d7d811d8686b), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.573844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d0a03c33-383d-403c-8113-f2c506779954 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0783dd99-d0c2-4f11-9852-79aa193f2836), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.576441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d0a03c33-383d-403c-8113-f2c506779954 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.577593 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d0a03c33-383d-403c-8113-f2c506779954 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/0783dd99-d0c2-4f11-9852-79aa193f2836 HTTP/1.1" status: 204 len: 168 time: 0.5674548 Mar 24 02:12:36.599819 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-405076d1-bd1c-4537-af92-ba934de331cf service neutron] 10.222.0.30 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5465257 Mar 24 02:12:36.613846 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36919898-17aa-43b9-87b3-35349098743f req-66f1d63f-f865-4a39-a1ed-0b12ecc6f6ab service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5251486 Mar 24 02:12:36.622388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:36.624333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a03c33-383d-403c-8113-f2c506779954 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0783dd99-d0c2-4f11-9852-79aa193f2836,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:36.627230 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Made reservation on behalf of a3f362c54abc4116a2d8ae1cbdbafe9b for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:36.631742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.650267 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:36.659941 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Pushing event updated for resources: {'Port': ['ID=3f03ca03-be93-4662-af2b-73bbfc93a9da,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:36.666874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:36.766250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] device_id is not set on port e58c33b1-ed53-4ec5-bda2-6db4af383f7c yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:36.796510 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d2fbb433-b720-4bdd-a568-8dfa9d36feda tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/routers/b5ea29cc-f908-4e06-9b0e-23b705106b0f HTTP/1.1" status: 200 len: 925 time: 0.4846663 Mar 24 02:12:36.806427 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55421c2-c789-473e-92b8-7cabbff63aa7 req-fbd35312-c5b9-43ac-b620-e7b3fa502994 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:36.807994 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e55421c2-c789-473e-92b8-7cabbff63aa7 req-fbd35312-c5b9-43ac-b620-e7b3fa502994 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 944 time: 0.2959900 Mar 24 02:12:36.812092 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56124) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:36.885010 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a0327553-cc99-4c95-8f3f-9def4a753c78 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=b5ea29cc-f908-4e06-9b0e-23b705106b0f HTTP/1.1" status: 200 len: 205 time: 0.0698397 Mar 24 02:12:36.888464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56128) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:36.933729 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a76eaed-b1f0-4dbb-9c3a-6b67665229c2 req-1448d54e-0edc-4ab6-b8e7-8184b7d826ed service neutron] 10.222.0.30 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3223183 Mar 24 02:12:36.937489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7ce6237-17e9-47fd-b11c-e11e848ae983 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a637b4a0-dbbc-433e-a7fc-981fa5888420), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.951818 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4dffd7de-8f0c-4356-a9bf-cd4f121dd551 None None] Provisioning complete for port 3f03ca03-be93-4662-af2b-73bbfc93a9da triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:36.952434 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4dffd7de-8f0c-4356-a9bf-cd4f121dd551 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:36.981168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Allocated IP 172.20.0.11 (b57330c4-af00-4735-8aae-7d7d77f8f136/14ee7600-4bf8-4bbb-b8f3-467531787f2d/e58c33b1-ed53-4ec5-bda2-6db4af383f7c) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:36.985268 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36919898-17aa-43b9-87b3-35349098743f req-f3d61ab3-83d7-479a-a4ea-7b0d820ab9e6 service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3588750 Mar 24 02:12:36.997382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ce6237-17e9-47fd-b11c-e11e848ae983 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=a637b4a0-dbbc-433e-a7fc-981fa5888420,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:37.015087 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e55421c2-c789-473e-92b8-7cabbff63aa7 req-481fcd69-e087-4a44-a191-95fe865e4854 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1778419 Mar 24 02:12:37.046633 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:37.047418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7ce6237-17e9-47fd-b11c-e11e848ae983 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.047610 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.053825 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f7ce6237-17e9-47fd-b11c-e11e848ae983 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/a637b4a0-dbbc-433e-a7fc-981fa5888420 HTTP/1.1" status: 204 len: 168 time: 1.8056931 Mar 24 02:12:37.055044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56138) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:37.063318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4dffd7de-8f0c-4356-a9bf-cd4f121dd551 None None] Port 3f03ca03-be93-4662-af2b-73bbfc93a9da cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:37.141952 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6c4452a0-354a-46c1-80f3-a71d7560091f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.5313132 Mar 24 02:12:37.169137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Request body: {'port': {'device_id': '65964499-8a52-4d24-90bb-505fb03cb88a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:37.221669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f7cefc2-92af-48ef-b560-d83051d576e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:37.223566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f7cefc2-92af-48ef-b560-d83051d576e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:37.225816 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6f7cefc2-92af-48ef-b560-d83051d576e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1687756 Mar 24 02:12:37.230236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56142) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:37.267639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (b5ea29cc-f908-4e06-9b0e-23b705106b0f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.289922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6180fc30-8192-448e-bd86-54e1e7f463f6 req-ed15e408-1d20-436f-8757-8bda542ecfb0 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:37.292158 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6180fc30-8192-448e-bd86-54e1e7f463f6 req-ed15e408-1d20-436f-8757-8bda542ecfb0 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 944 time: 0.1489377 Mar 24 02:12:37.333664 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-8e4b3cc0-8db3-43e1-ad40-4571aa7e8460 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 14372524-5236-4550-9b88-28763fa41de8 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:12:37.345111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8e4b3cc0-8db3-43e1-ad40-4571aa7e8460 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (14372524-5236-4550-9b88-28763fa41de8), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.385667 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6180fc30-8192-448e-bd86-54e1e7f463f6 req-e67b5676-0cac-4bee-98fc-96ffafeda15e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0867326 Mar 24 02:12:37.399430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8e4b3cc0-8db3-43e1-ad40-4571aa7e8460 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (14372524-5236-4550-9b88-28763fa41de8), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.428798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks [] for port (c5c42e79-c5c6-42c8-b284-d7d811d8686b), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.450167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (c5c42e79-c5c6-42c8-b284-d7d811d8686b), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.458156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.529015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56154) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:37.551020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8e4b3cc0-8db3-43e1-ad40-4571aa7e8460 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (14372524-5236-4550-9b88-28763fa41de8), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.592803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.621572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'Port': ['ID=c5c42e79-c5c6-42c8-b284-d7d811d8686b,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:37.633643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1736c686-8d0a-46ef-97a7-1708796b9c8a req-c5036cb2-04b0-48af-a2b2-a22acc372c3b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:37.635182 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1736c686-8d0a-46ef-97a7-1708796b9c8a req-c5036cb2-04b0-48af-a2b2-a22acc372c3b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 931 time: 0.0986776 Mar 24 02:12:37.652842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (ec3c7555-6f82-45fc-98f2-f7809d809d17), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.656322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-test-network-607037669'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:37.661566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8e4b3cc0-8db3-43e1-ad40-4571aa7e8460 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (14372524-5236-4550-9b88-28763fa41de8), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.928279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e4b3cc0-8db3-43e1-ad40-4571aa7e8460 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=14372524-5236-4550-9b88-28763fa41de8,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:37.932895 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8e4b3cc0-8db3-43e1-ad40-4571aa7e8460 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.935952 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8e4b3cc0-8db3-43e1-ad40-4571aa7e8460 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/14372524-5236-4550-9b88-28763fa41de8 HTTP/1.1" status: 204 len: 168 time: 0.7028675 Mar 24 02:12:37.938444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fd03c8c-1d04-4268-9420-e91e14c4155a None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:37.939212 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56158) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:37.956875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Made reservation on behalf of 9caabc535d3b4f50bb25aa525e01dd5f for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:37.960933 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.965213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (b5ea29cc-f908-4e06-9b0e-23b705106b0f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.973174 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1736c686-8d0a-46ef-97a7-1708796b9c8a req-7ba6776f-db8c-42e5-af76-f8005967f493 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3268895 Mar 24 02:12:37.973854 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:37.995695 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.041801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.045479 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-184a4e90-f275-4d10-8979-37fad87974d8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 4.4774604 Mar 24 02:12:38.047258 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56162) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:38.059547 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks [] for security_group (633900fc-c0b1-46fe-b128-c6e70eca4ff9), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.059720 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-06cf6274-f1b6-4016-af32-eb50ee07799d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0951686 Mar 24 02:12:38.062004 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56164) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:38.068149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:38.074238 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (633900fc-c0b1-46fe-b128-c6e70eca4ff9), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.153699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1209bbaa-26dc-46b5-a4ba-4ff365069ed6 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:12:38.158721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 131} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:38.196286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event updated for resources: {'SecurityGroup': ['ID=633900fc-c0b1-46fe-b128-c6e70eca4ff9,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:38.207207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.207562 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Added segment ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e of type vlan for network 0c679173-666f-45c2-9af4-7ceb8205d217 Mar 24 02:12:38.239471 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-27f5b159-682c-4feb-8355-a60612a5a65a tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "GET /v2.0/floatingips?floating_network_id=c3edf343-f305-42d5-bf02-59a961b01eed HTTP/1.1" status: 200 len: 689 time: 0.1825395 Mar 24 02:12:38.244203 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1209bbaa-26dc-46b5-a4ba-4ff365069ed6 None None] Deleting port 263cc31f-9e56-4e9f-9934-09ba56916bde {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:38.244770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1209bbaa-26dc-46b5-a4ba-4ff365069ed6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.245474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Network b57330c4-af00-4735-8aae-7d7d77f8f136 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:38.250770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56166) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:38.266841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:38.268713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (0c679173-666f-45c2-9af4-7ceb8205d217), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.282709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:38.286421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Port': ['ID=e58c33b1-ed53-4ec5-bda2-6db4af383f7c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:38.297784 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c657bf4-dc47-4515-ae93-a5cdeb2895f5 req-c34a90ca-33b5-4a25-a6b7-620d9e73b5f4 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:38.299302 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4c657bf4-dc47-4515-ae93-a5cdeb2895f5 req-c34a90ca-33b5-4a25-a6b7-620d9e73b5f4 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 944 time: 0.1992292 Mar 24 02:12:38.305127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:38.308434 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.326673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1209bbaa-26dc-46b5-a4ba-4ff365069ed6 None None] For port 263cc31f-9e56-4e9f-9934-09ba56916bde, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=263cc31f-9e56-4e9f-9934-09ba56916bde,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:38.327348 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1209bbaa-26dc-46b5-a4ba-4ff365069ed6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.348029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1209bbaa-26dc-46b5-a4ba-4ff365069ed6 None None] Calling delete_port for 263cc31f-9e56-4e9f-9934-09ba56916bde owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:38.408751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (0c679173-666f-45c2-9af4-7ceb8205d217), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.431469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:38.433457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.435232 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:38.435877 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.454098 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1209bbaa-26dc-46b5-a4ba-4ff365069ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (263cc31f-9e56-4e9f-9934-09ba56916bde), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.468533 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (c3edf343-f305-42d5-bf02-59a961b01eed), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.473061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Deleting port 21d54e60-84e3-4fbc-ba71-cf6b236a83bf {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:38.473408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (21d54e60-84e3-4fbc-ba71-cf6b236a83bf), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.483369 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8b0141f5-a3d1-4370-b961-0e41375ae128 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.1456523 Mar 24 02:12:38.490691 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1209bbaa-26dc-46b5-a4ba-4ff365069ed6 None None] Pushing event deleted for resources: {'Port': ['ID=263cc31f-9e56-4e9f-9934-09ba56916bde,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:38.492793 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56170) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:38.495464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1209bbaa-26dc-46b5-a4ba-4ff365069ed6 None None] No DVR routers for this DVR port 263cc31f-9e56-4e9f-9934-09ba56916bde on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:12:38.514207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d136c1d6-a89f-4ed8-a253-bc4e0f896179 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:af:63:24'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:38.541334 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 1.0112803 Mar 24 02:12:38.584803 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56172) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:38.596588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Request body: {'subnet': {'network_id': '0c679173-666f-45c2-9af4-7ceb8205d217', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:38.634440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9c6fc27a-2667-4850-a8e3-b057bc3a191e None None] Provisioning complete for port e58c33b1-ed53-4ec5-bda2-6db4af383f7c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:38.634872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9c6fc27a-2667-4850-a8e3-b057bc3a191e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.670619 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9c6fc27a-2667-4850-a8e3-b057bc3a191e None None] Port e58c33b1-ed53-4ec5-bda2-6db4af383f7c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:38.676191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3f03ca03-be93-4662-af2b-73bbfc93a9da {{(pid=104036) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:12:38.688067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Publish callbacks [] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.722106 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.provisioning_blocks [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Transition to ACTIVE for port object 3f03ca03-be93-4662-af2b-73bbfc93a9da will not be triggered until provisioned by entity L2. {{(pid=104036) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:12:38.726952 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (21d54e60-84e3-4fbc-ba71-cf6b236a83bf), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.735792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.749696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Calling delete_port for 21d54e60-84e3-4fbc-ba71-cf6b236a83bf owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:38.790107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Deleting port c5c42e79-c5c6-42c8-b284-d7d811d8686b {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:38.790450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c5c42e79-c5c6-42c8-b284-d7d811d8686b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.798896 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4c657bf4-dc47-4515-ae93-a5cdeb2895f5 req-00cd2e4c-f4b4-4e9e-997c-121cc901b31a tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4846618 Mar 24 02:12:38.799725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-599747f4-d9ac-423e-80e5-b54093260db0 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event updated for resources: {'Network': ['ID=0c679173-666f-45c2-9af4-7ceb8205d217,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:38.823063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 0c679173-666f-45c2-9af4-7ceb8205d217 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:38.884569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Pushing event updated for resources: {'Port': ['ID=3f03ca03-be93-4662-af2b-73bbfc93a9da,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:38.933684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Made reservation on behalf of 9caabc535d3b4f50bb25aa525e01dd5f for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:38.937378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:38.954359 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab20a831-8d75-4b69-b045-7772d225575e req-bf58abdb-82a3-4b62-ab6b-dbe1663e2d07 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:38.956575 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ab20a831-8d75-4b69-b045-7772d225575e req-bf58abdb-82a3-4b62-ab6b-dbe1663e2d07 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 944 time: 0.4012976 Mar 24 02:12:39.016672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c5c42e79-c5c6-42c8-b284-d7d811d8686b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.017246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks [] for floatingip (c5c42e79-c5c6-42c8-b284-d7d811d8686b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.047608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Calling delete_port for c5c42e79-c5c6-42c8-b284-d7d811d8686b owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:39.072496 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Attempting to bind port 3f03ca03-be93-4662-af2b-73bbfc93a9da on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:39.072810 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Attempting to bind port 3f03ca03-be93-4662-af2b-73bbfc93a9da by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:39.073696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Attempting to bind port 3f03ca03-be93-4662-af2b-73bbfc93a9da on network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:39.083808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Port 3f03ca03-be93-4662-af2b-73bbfc93a9da on network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:12:39.084127 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Attempting to bind port 3f03ca03-be93-4662-af2b-73bbfc93a9da on network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:39.151543 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:39.151911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Checking segment: {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:39.152444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Bound using segment: {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'} {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:39.152902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Bound port: 3f03ca03-be93-4662-af2b-73bbfc93a9da, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fadaf792-3bdd-4a39-9224-2e6bc940be47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b'}}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:39.153252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.171768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d136c1d6-a89f-4ed8-a253-bc4e0f896179 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.176217 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ab20a831-8d75-4b69-b045-7772d225575e req-1d972d28-0b4a-4534-b0e8-19cfda51ab25 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1749516 Mar 24 02:12:39.217426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (21d54e60-84e3-4fbc-ba71-cf6b236a83bf), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.225023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (aadc9290-5a16-421d-8b48-b81f496a068f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.257712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event deleted for resources: {'Port': ['ID=21d54e60-84e3-4fbc-ba71-cf6b236a83bf,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:39.312491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] For port 3f03ca03-be93-4662-af2b-73bbfc93a9da, host hv-neutron-8348, cleared binding levels {{(pid=104036) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:39.324672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7412dca2-5f90-4845-baf1-479fc941bbe7 req-8e97af8a-7fb9-4010-877e-932ea5e5c336 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:39.326143 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7412dca2-5f90-4845-baf1-479fc941bbe7 req-8e97af8a-7fb9-4010-877e-932ea5e5c336 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 943 time: 0.2521427 Mar 24 02:12:39.345354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:39.371019 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:39.372274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] For port 3f03ca03-be93-4662-af2b-73bbfc93a9da, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=3f03ca03-be93-4662-af2b-73bbfc93a9da,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104036) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:39.380603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device dba04693-4495-4586-b5e4-7de9e3b2abd3 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:12:39.383074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:39.383651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.389356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.400416 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=aadc9290-5a16-421d-8b48-b81f496a068f,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:39.427562 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (b5ea29cc-f908-4e06-9b0e-23b705106b0f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.453101 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-928b9f9e-9011-4440-acf1-70892ca285e3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.3893716 Mar 24 02:12:39.461893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56176) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:39.505245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'name': 'tempest-NetworksTestDHCPv6-1699717407'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:39.511958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port dba04693-4495-4586-b5e4-7de9e3b2abd3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dba04693-4495-4586-b5e4-7de9e3b2abd3,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:39.527770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': 'dba04693-4495-4586-b5e4-7de9e3b2abd3', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'port_id': 'dba04693-4495-4586-b5e4-7de9e3b2abd3', 'mac_address': 'fa:16:3e:ad:26:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:12:39.530206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (b5ea29cc-f908-4e06-9b0e-23b705106b0f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.531968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44341d8f-a091-4f91-ae5b-dc9b4f2ec884 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:39.532866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (b5ea29cc-f908-4e06-9b0e-23b705106b0f), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.570352 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7412dca2-5f90-4845-baf1-479fc941bbe7 req-c09c1344-a8ef-4dd7-a22f-b276141581ba tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2319605 Mar 24 02:12:39.580792 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (272c6bcc-dfd7-4e88-bc00-f1d036de9e54), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.581119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c5c42e79-c5c6-42c8-b284-d7d811d8686b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.596304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:39.598414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.600073 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] 10.222.0.30 "PUT /v2.0/ports/3f03ca03-be93-4662-af2b-73bbfc93a9da HTTP/1.1" status: 200 len: 1093 time: 2.4352472 Mar 24 02:12:39.600957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (b5ea29cc-f908-4e06-9b0e-23b705106b0f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.601717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Fanout notify agent at l3_agent the message router_deleted on router b5ea29cc-f908-4e06-9b0e-23b705106b0f {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:12:39.603791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '65964499-8a52-4d24-90bb-505fb03cb88a', 'tag': '3f03ca03-be93-4662-af2b-73bbfc93a9da'}] {{(pid=104036) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:12:39.627416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.632994 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1bf82818-6c0c-4b41-b423-731d72e1367d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/b5ea29cc-f908-4e06-9b0e-23b705106b0f HTTP/1.1" status: 204 len: 168 time: 2.7344303 Mar 24 02:12:39.634677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56180) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:39.649326 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede5e4f9-2cd9-465f-96d8-9cd299ed7ed0 service neutron] Pushing event updated for resources: {'Port': ['ID=3f03ca03-be93-4662-af2b-73bbfc93a9da,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:39.658753 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'router': {'name': 'tempest-snat-router-229558191', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': False}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:39.668770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port dba04693-4495-4586-b5e4-7de9e3b2abd3 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:39.669171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.718689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dba04693-4495-4586-b5e4-7de9e3b2abd3 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:12:39.778151 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event updated for resources: {'Subnet': ['ID=272c6bcc-dfd7-4e88-bc00-f1d036de9e54,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:39.799902 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (6734957d-912d-40f2-aecb-59fbd65994f8), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.804123 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (6734957d-912d-40f2-aecb-59fbd65994f8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.815414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port dba04693-4495-4586-b5e4-7de9e3b2abd3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dba04693-4495-4586-b5e4-7de9e3b2abd3,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:39.827322 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.828080 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 23c422ed-55e0-408f-95ff-bc9d2619a936 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:12:39.845076 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': 'aadc9290-5a16-421d-8b48-b81f496a068f'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:12:39.845992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.857724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 263cc31f-9e56-4e9f-9934-09ba56916bde no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:12:39.870693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:39.875150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.888507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Checking segment: {'id': 'ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '0c679173-666f-45c2-9af4-7ceb8205d217'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:39.888868 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Network hostable DHCP agents. Network: 0c679173-666f-45c2-9af4-7ceb8205d217, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:12:39.942684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 263cc31f-9e56-4e9f-9934-09ba56916bde {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:12:39.942684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 263cc31f-9e56-4e9f-9934-09ba56916bde not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:12:39.987333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 1a3ac717-ddb0-4aa9-8a94-58851a486f53 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:39.992870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_controller (6734957d-912d-40f2-aecb-59fbd65994f8), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.997382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d136c1d6-a89f-4ed8-a253-bc4e0f896179 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:39.998924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Network 0c679173-666f-45c2-9af4-7ceb8205d217 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:12:40.043435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d6177697792ca3fff01bbfc58b3e16cb8a22905a2f74e66d9151ebb6b50c8f9c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-70e1e758-1efc-4df6-9517-53c7e4814088" -d '{"events": [{"name": "network-changed", "server_uuid": "65964499-8a52-4d24-90bb-505fb03cb88a", "tag": "3f03ca03-be93-4662-af2b-73bbfc93a9da"}]}' {{(pid=104036) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:12:40.043981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d136c1d6-a89f-4ed8-a253-bc4e0f896179 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.070896 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event deleted for resources: {'Port': ['ID=c5c42e79-c5c6-42c8-b284-d7d811d8686b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:40.087300 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=dba04693-4495-4586-b5e4-7de9e3b2abd3,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:40.144290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 0c679173-666f-45c2-9af4-7ceb8205d217) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:40.152733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks [] for floatingip (ec3c7555-6f82-45fc-98f2-f7809d809d17), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.157662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:40.158267 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.159903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-026265b2-36a2-4f13-ab16-642eb5eb1173 None None] Network 0c679173-666f-45c2-9af4-7ceb8205d217 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:40.167462 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-a797bbca-4d71-4857-a4e0-c2082bde86a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:40.168736 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-a797bbca-4d71-4857-a4e0-c2082bde86a5 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=70b00ff8787a4049967d01e358be86c2&device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 1127 time: 0.4997733 Mar 24 02:12:40.221028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:12:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-772ca137-3564-4203-aa7b-c690232725a0 x-openstack-request-id: req-772ca137-3564-4203-aa7b-c690232725a0 {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:12:40.226572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "65964499-8a52-4d24-90bb-505fb03cb88a", "tag": "3f03ca03-be93-4662-af2b-73bbfc93a9da", "status": "completed", "code": 200}]} {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:12:40.227001 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-772ca137-3564-4203-aa7b-c690232725a0 {{(pid=104036) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:12:40.227641 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.notifiers.nova [-] Nova event matching ['req-772ca137-3564-4203-aa7b-c690232725a0'] response: {'name': 'network-changed', 'server_uuid': '65964499-8a52-4d24-90bb-505fb03cb88a', 'tag': '3f03ca03-be93-4662-af2b-73bbfc93a9da', 'status': 'completed', 'code': 200} Mar 24 02:12:40.231356 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 23c422ed-55e0-408f-95ff-bc9d2619a936, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=23c422ed-55e0-408f-95ff-bc9d2619a936,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:40.254615 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b767292e-403b-4d74-85d7-84da7e573def tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6634173 Mar 24 02:12:40.254910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56192) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:40.261692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '23c422ed-55e0-408f-95ff-bc9d2619a936', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'port_id': '23c422ed-55e0-408f-95ff-bc9d2619a936', 'mac_address': 'fa:16:3e:4e:5e:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 147, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:12:40.265605 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/aadc9290-5a16-421d-8b48-b81f496a068f/7cfaa63a-538d-427b-abe2-334429d28a57) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:40.273366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Request body: {'port': {'network_id': '0c679173-666f-45c2-9af4-7ceb8205d217', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-1582645171'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:40.293430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d45f865-a9b4-41bb-8033-f8e7cc6268f8 req-b333102b-3b86-4328-b37e-0b0e21059f5d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:40.295068 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4d45f865-a9b4-41bb-8033-f8e7cc6268f8 req-b333102b-3b86-4328-b37e-0b0e21059f5d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 944 time: 0.3938363 Mar 24 02:12:40.327824 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-2c658406-e0ec-4732-aa03-a47a9282c522 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3f03ca03-be93-4662-af2b-73bbfc93a9da HTTP/1.1" status: 200 len: 217 time: 0.0992794 Mar 24 02:12:40.371029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d136c1d6-a89f-4ed8-a253-bc4e0f896179 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Port': ['ID=e58c33b1-ed53-4ec5-bda2-6db4af383f7c,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:40.399651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (7c18d7b4-93ce-40af-a916-9f24179812df), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.424211 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 23c422ed-55e0-408f-95ff-bc9d2619a936 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:40.424807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.427857 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6b815943-ddb4-44ec-a315-ec8f210fb4f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:40.430444 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-6b815943-ddb4-44ec-a315-ec8f210fb4f8 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=02cc6c6a-e353-4d82-9d85-3973d8220a39 HTTP/1.1" status: 200 len: 845 time: 0.0952339 Mar 24 02:12:40.442374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-0c679173-666f-45c2-9af4-7ceb8205d217', 'network_id': '0c679173-666f-45c2-9af4-7ceb8205d217', 'project_id': '9caabc535d3b4f50bb25aa525e01dd5f', 'fixed_ips': [{'subnet_id': '272c6bcc-dfd7-4e88-bc00-f1d036de9e54'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:12:40.443264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.463989 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 23c422ed-55e0-408f-95ff-bc9d2619a936 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:12:40.512138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 23c422ed-55e0-408f-95ff-bc9d2619a936, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=23c422ed-55e0-408f-95ff-bc9d2619a936,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:40.558358 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-f5e52ca2-0376-47ff-b3fc-f96cf4e79e6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:40.560314 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-f5e52ca2-0376-47ff-b3fc-f96cf4e79e6b service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=d91de7c3-7e46-4c9d-8b0a-c988de7fd81b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.1224120 Mar 24 02:12:40.562245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (7c18d7b4-93ce-40af-a916-9f24179812df), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.585684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.629370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=7c18d7b4-93ce-40af-a916-9f24179812df,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:40.697302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (c3edf343-f305-42d5-bf02-59a961b01eed), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.699302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-85edb046-b3b4-4cfb-87c1-cd1cb58c9c7a None None] Provisioning complete for port e58c33b1-ed53-4ec5-bda2-6db4af383f7c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:40.699675 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-85edb046-b3b4-4cfb-87c1-cd1cb58c9c7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.717091 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Publish callbacks [] for port (7cfaa63a-538d-427b-abe2-334429d28a57), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.720823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (6734957d-912d-40f2-aecb-59fbd65994f8), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.724418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d136c1d6-a89f-4ed8-a253-bc4e0f896179 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] In _notify_port_updated(), no bound segment for port e58c33b1-ed53-4ec5-bda2-6db4af383f7c on network b57330c4-af00-4735-8aae-7d7d77f8f136 {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:12:40.730837 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d136c1d6-a89f-4ed8-a253-bc4e0f896179 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:40.731361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3edf343-f305-42d5-bf02-59a961b01eed']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:40.731481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d136c1d6-a89f-4ed8-a253-bc4e0f896179 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.736002 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d136c1d6-a89f-4ed8-a253-bc4e0f896179 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "PUT /v2.0/ports/e58c33b1-ed53-4ec5-bda2-6db4af383f7c HTTP/1.1" status: 200 len: 997 time: 2.2260823 Mar 24 02:12:40.741343 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56196) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:40.747153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=23c422ed-55e0-408f-95ff-bc9d2619a936,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:40.749445 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dd8f5a5b-407d-4b19-8f0b-75d27c7a3d5a') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:40.749814 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dd8f5a5b-407d-4b19-8f0b-75d27c7a3d5a') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:40.753221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.760776 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-3cb41885-3179-432a-a065-dbd7bb3603c0 service neutron] 10.222.0.30 "GET /v2.0/networks/d91de7c3-7e46-4c9d-8b0a-c988de7fd81b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1898148 Mar 24 02:12:40.765383 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (dd8f5a5b-407d-4b19-8f0b-75d27c7a3d5a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.797103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Allocated IP 2001:db8::2 (0c679173-666f-45c2-9af4-7ceb8205d217/272c6bcc-dfd7-4e88-bc00-f1d036de9e54/d3c95218-5c0f-456d-87a4-8e30632ecd58) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:40.817486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-85edb046-b3b4-4cfb-87c1-cd1cb58c9c7a None None] Port e58c33b1-ed53-4ec5-bda2-6db4af383f7c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:40.822105 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:40.825158 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (dd8f5a5b-407d-4b19-8f0b-75d27c7a3d5a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.832557 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:40.835473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:40.836530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (dd8f5a5b-407d-4b19-8f0b-75d27c7a3d5a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: /opt/stack/neutron/neutron/extensions/quotasv2.py:141: UserWarning: Neutron quota engine will require "--force" parameter to set a quota limit without checking the resource usage. Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: warnings.warn('Neutron quota engine will require "--force" ' Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:40.838581 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:40.841609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:40.908925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Pushing event updated for resources: {'Port': ['ID=7cfaa63a-538d-427b-abe2-334429d28a57,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:40.917640 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-489c7bb5-f3df-46aa-a95e-9ab8071e8771 req-f5b03828-1d1b-4770-bec3-8ac54b4c9edb service neutron] 10.222.0.30 "GET /v2.0/networks/d91de7c3-7e46-4c9d-8b0a-c988de7fd81b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1495347 Mar 24 02:12:40.922158 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (c3edf343-f305-42d5-bf02-59a961b01eed), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.937404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network c3edf343-f305-42d5-bf02-59a961b01eed {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Mar 24 02:12:40.972537 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:12:40.973160 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4d45f865-a9b4-41bb-8033-f8e7cc6268f8 req-ea38ddff-c39b-4a48-88bb-6e2942584d68 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6029346 Mar 24 02:12:40.983382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:40.991590 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "DELETE /v2.0/networks/c3edf343-f305-42d5-bf02-59a961b01eed HTTP/1.1" status: 204 len: 168 time: 2.7370915 Mar 24 02:12:41.006602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda6b8df-a15d-48b1-9e44-ea72bb7cb715 req-2b954da8-8675-43bc-8310-d7eb3a0e7395 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.008210 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dda6b8df-a15d-48b1-9e44-ea72bb7cb715 req-2b954da8-8675-43bc-8310-d7eb3a0e7395 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 945 time: 0.6418786 Mar 24 02:12:41.013383 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56198) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:41.020625 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf4e1b4-1517-4fb7-92b8-b7b4e44f67f4 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event deleted for resources: {'Network': ['ID=c3edf343-f305-42d5-bf02-59a961b01eed,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:41.084085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-6f5dcb1a-a3ff-4289-bc1b-5a17aaf44a28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.086204 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-6f5dcb1a-a3ff-4289-bc1b-5a17aaf44a28 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=70b00ff8787a4049967d01e358be86c2&device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 1127 time: 0.0907204 Mar 24 02:12:41.143376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Attempting to bind port 7cfaa63a-538d-427b-abe2-334429d28a57 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:41.143756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Attempting to bind port 7cfaa63a-538d-427b-abe2-334429d28a57 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:41.144122 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Attempting to bind port 7cfaa63a-538d-427b-abe2-334429d28a57 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:41.157615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:41.157999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:41.158408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.159495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:41.165716 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Bound port: 7cfaa63a-538d-427b-abe2-334429d28a57, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:41.166130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.207610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::5c (6f3080fc-791f-4748-a0a2-9eff6ea2a609/aadc9290-5a16-421d-8b48-b81f496a068f/1a3ac717-ddb0-4aa9-8a94-58851a486f53) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:41.219887 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['dba04693-4495-4586-b5e4-7de9e3b2abd3'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:12:41.264830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-684460e9-b877-4848-916b-3b1d5e3c32c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.266732 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-684460e9-b877-4848-916b-3b1d5e3c32c1 service neutron] 10.222.0.30 "GET /v2.0/networks?id=d91de7c3-7e46-4c9d-8b0a-c988de7fd81b HTTP/1.1" status: 200 len: 907 time: 0.1744537 Mar 24 02:12:41.279981 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['23c422ed-55e0-408f-95ff-bc9d2619a936'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:12:41.307369 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a673a66e-27f9-4346-8791-ce94b2f74f95 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 1650 time: 0.2922153 Mar 24 02:12:41.313376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56200) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:41.331863 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-64e93183-5f3f-463c-80da-4637b5921772 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3f03ca03-be93-4662-af2b-73bbfc93a9da HTTP/1.1" status: 200 len: 217 time: 0.0578527 Mar 24 02:12:41.357607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Made reservation on behalf of 9caabc535d3b4f50bb25aa525e01dd5f for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:41.362829 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.381456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Publish callbacks [] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.411777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] device_id is not set on port 0dbdbe56-6b76-4f74-82b2-e218ac01200d yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:41.418412 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.464440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] For port 7cfaa63a-538d-427b-abe2-334429d28a57, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:41.470585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-e1e2dc1a-4ff0-4cb6-813c-2a08da749eec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.472699 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-e1e2dc1a-4ff0-4cb6-813c-2a08da749eec service neutron] 10.222.0.30 "GET /v2.0/subnets?id=02cc6c6a-e353-4d82-9d85-3973d8220a39 HTTP/1.1" status: 200 len: 845 time: 0.1187904 Mar 24 02:12:41.479484 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.479484 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.480135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.480681 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.481230 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.481955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.482458 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.483321 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.483582 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.485523 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5737e719-aae3-46e8-a719-7278c37251fb tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 5844 time: 0.1710608 Mar 24 02:12:41.495446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56202) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:41.506847 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Network 0c679173-666f-45c2-9af4-7ceb8205d217 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:41.512678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] For port 7cfaa63a-538d-427b-abe2-334429d28a57, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7cfaa63a-538d-427b-abe2-334429d28a57,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:41.532549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:41.558070 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-3b62be8e-4c8f-48a0-b0b2-957b54a8d495 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] delete failed (client error): The resource could not be found. Mar 24 02:12:41.559669 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3b62be8e-4c8f-48a0-b0b2-957b54a8d495 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "DELETE /v2.0/floatingips/ec3c7555-6f82-45fc-98f2-f7809d809d17 HTTP/1.1" status: 404 len: 345 time: 0.0620396 Mar 24 02:12:41.563031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56204) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:41.573321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Pushing event updated for resources: {'Port': ['ID=d3c95218-5c0f-456d-87a4-8e30632ecd58,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:41.594724 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-4d2503ad-7a7c-4b7c-8458-904f0910b05d tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] DELETE failed (client error): The resource could not be found. Mar 24 02:12:41.595422 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4d2503ad-7a7c-4b7c-8458-904f0910b05d tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:12:41.598819 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4d2503ad-7a7c-4b7c-8458-904f0910b05d tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "DELETE /v2.0/networks/c3edf343-f305-42d5-bf02-59a961b01eed HTTP/1.1" status: 404 len: 339 time: 0.0336845 Mar 24 02:12:41.603497 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56206) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:41.608933 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Request body: {'network': {'name': 'tempest-network--1362740054', 'router:external': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:41.613571 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:41.616641 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.628543 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43167227-7e30-4574-817a-f429668f6a57 req-3b3a6df3-f2d0-480d-8980-28f3577f8d18 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.629661 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-0c1ca9ae-b9bc-428e-be49-bda292187471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.630077 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-43167227-7e30-4574-817a-f429668f6a57 req-3b3a6df3-f2d0-480d-8980-28f3577f8d18 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 943 time: 0.5508199 Mar 24 02:12:41.631308 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-0c1ca9ae-b9bc-428e-be49-bda292187471 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=d91de7c3-7e46-4c9d-8b0a-c988de7fd81b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.1445961 Mar 24 02:12:41.632610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-166e410c-dc4d-4eac-8251-962595926e56 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Deleting port e58c33b1-ed53-4ec5-bda2-6db4af383f7c {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:41.632843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-166e410c-dc4d-4eac-8251-962595926e56 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.646260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Made reservation on behalf of b1bf23b03a854c86ad22a24cf8348ef2 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:41.648973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.719714 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 107} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:41.730182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Allocated IP 2001:db8::1b6 (0c679173-666f-45c2-9af4-7ceb8205d217/272c6bcc-dfd7-4e88-bc00-f1d036de9e54/0dbdbe56-6b76-4f74-82b2-e218ac01200d) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:41.741141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (33d1238f-b85d-474e-8949-5a8684bd1eb8), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.741663 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Added segment 33d1238f-b85d-474e-8949-5a8684bd1eb8 of type vlan for network 2dfef7df-ff0c-4202-919b-9195722c7a0c Mar 24 02:12:41.752486 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dda6b8df-a15d-48b1-9e44-ea72bb7cb715 req-e7972964-4000-4f7a-be14-755b75805775 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7338915 Mar 24 02:12:41.799821 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-c2b89aab-3809-4592-bfca-39346f83f924 service neutron] 10.222.0.30 "GET /v2.0/networks/d91de7c3-7e46-4c9d-8b0a-c988de7fd81b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1621497 Mar 24 02:12:41.822460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (2dfef7df-ff0c-4202-919b-9195722c7a0c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.860957 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bb39e75-e2b8-4597-9493-78de10eb7f73 None None] Pushing event updated for resources: {'Port': ['ID=7cfaa63a-538d-427b-abe2-334429d28a57,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:41.879494 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-43167227-7e30-4574-817a-f429668f6a57 req-bea8c254-eaf3-44cd-953b-76418b374e29 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2435057 Mar 24 02:12:41.908243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Attempting to bind port d3c95218-5c0f-456d-87a4-8e30632ecd58 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:41.908243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Attempting to bind port d3c95218-5c0f-456d-87a4-8e30632ecd58 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '0c679173-666f-45c2-9af4-7ceb8205d217'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:41.908243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Attempting to bind port d3c95218-5c0f-456d-87a4-8e30632ecd58 on network 0c679173-666f-45c2-9af4-7ceb8205d217 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:41.927958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (2dfef7df-ff0c-4202-919b-9195722c7a0c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.929053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:41.930304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.934209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:41.934795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Checking segment: {'id': 'ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '0c679173-666f-45c2-9af4-7ceb8205d217'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:41.935203 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.935714 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Bound using segment: {'id': 'ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '0c679173-666f-45c2-9af4-7ceb8205d217'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:41.940705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Bound port: d3c95218-5c0f-456d-87a4-8e30632ecd58, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '0c679173-666f-45c2-9af4-7ceb8205d217'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:41.941576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.948863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-166e410c-dc4d-4eac-8251-962595926e56 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:41.955520 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (1a3ac717-ddb0-4aa9-8a94-58851a486f53), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.019740 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.4128842 Mar 24 02:12:42.020767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56210) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:42.028442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-166e410c-dc4d-4eac-8251-962595926e56 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Calling delete_port for e58c33b1-ed53-4ec5-bda2-6db4af383f7c owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:42.045368 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-70e1e758-1efc-4df6-9517-53c7e4814088 req-ca762957-2384-469c-b7b7-44e245c2102e service neutron] 10.222.0.30 "GET /v2.0/networks/d91de7c3-7e46-4c9d-8b0a-c988de7fd81b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2394910 Mar 24 02:12:42.074981 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-894ef898-0225-4e0f-aed8-77c4a51faf60 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'Network': ['ID=2dfef7df-ff0c-4202-919b-9195722c7a0c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:42.092024 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 2dfef7df-ff0c-4202-919b-9195722c7a0c details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:42.151244 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] For port d3c95218-5c0f-456d-87a4-8e30632ecd58, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:42.169366 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] For port d3c95218-5c0f-456d-87a4-8e30632ecd58, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3c95218-5c0f-456d-87a4-8e30632ecd58,segment=NetworkSegment(ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e),segment_id=ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:42.182770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.249549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7831a8a2-fef3-47f0-87f2-9d94a84748a8 None None] Pushing event updated for resources: {'Port': ['ID=d3c95218-5c0f-456d-87a4-8e30632ecd58,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:42.464608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks [] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.492625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (1a3ac717-ddb0-4aa9-8a94-58851a486f53), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.557968 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (6734957d-912d-40f2-aecb-59fbd65994f8), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.627565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80d30429-b1b3-49db-8636-8f72b396845a tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:42.636131 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80d30429-b1b3-49db-8636-8f72b396845a tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:42.643752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80d30429-b1b3-49db-8636-8f72b396845a tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:42.649070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80d30429-b1b3-49db-8636-8f72b396845a tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:42.650829 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-80d30429-b1b3-49db-8636-8f72b396845a tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2454 time: 0.6237152 Mar 24 02:12:42.653785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56212) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:42.658061 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9a31453-f05f-4a47-80fb-ac26b2396e99 req-cea964ea-e292-4a08-a622-fe37649c4e8d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:42.659571 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a9a31453-f05f-4a47-80fb-ac26b2396e99 req-cea964ea-e292-4a08-a622-fe37649c4e8d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 945 time: 0.4891050 Mar 24 02:12:42.670159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.706218 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:42.730400 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (2dfef7df-ff0c-4202-919b-9195722c7a0c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.730649 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:42.777919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=1a3ac717-ddb0-4aa9-8a94-58851a486f53,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:42.791848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:42.796898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:42.797536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.836931 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (2dfef7df-ff0c-4202-919b-9195722c7a0c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.861854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2dfef7df-ff0c-4202-919b-9195722c7a0c']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:42.872979 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '33d1238f-b85d-474e-8949-5a8684bd1eb8') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:42.873279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '33d1238f-b85d-474e-8949-5a8684bd1eb8') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:42.875186 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-166e410c-dc4d-4eac-8251-962595926e56 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (e58c33b1-ed53-4ec5-bda2-6db4af383f7c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.877939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.884510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (33d1238f-b85d-474e-8949-5a8684bd1eb8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.898533 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (33d1238f-b85d-474e-8949-5a8684bd1eb8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.906997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Releasing vlan 107 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:42.907592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (33d1238f-b85d-474e-8949-5a8684bd1eb8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:42.911844 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:42.968580 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0c48313c-b3b0-4c0a-b200-fe190fa946d0 None None] Provisioning complete for port 7cfaa63a-538d-427b-abe2-334429d28a57 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:42.969629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0c48313c-b3b0-4c0a-b200-fe190fa946d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.005636 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (2dfef7df-ff0c-4202-919b-9195722c7a0c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.011805 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 2dfef7df-ff0c-4202-919b-9195722c7a0c {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Mar 24 02:12:43.027340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.039192 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "DELETE /v2.0/networks/2dfef7df-ff0c-4202-919b-9195722c7a0c HTTP/1.1" status: 204 len: 168 time: 0.3803599 Mar 24 02:12:43.056124 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56218) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:43.069205 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Request body: {'network': {'name': 'tempest-network--1231580526', 'router:external': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:43.078259 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c1c428-cbd4-45a5-b290-fa833dbbb9f8 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event deleted for resources: {'Network': ['ID=2dfef7df-ff0c-4202-919b-9195722c7a0c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:43.089129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0c48313c-b3b0-4c0a-b200-fe190fa946d0 None None] Current status of the port 7cfaa63a-538d-427b-abe2-334429d28a57 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:43.089647 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0c48313c-b3b0-4c0a-b200-fe190fa946d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.120673 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Made reservation on behalf of b1bf23b03a854c86ad22a24cf8348ef2 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:43.123140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.141887 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-0c48313c-b3b0-4c0a-b200-fe190fa946d0 None None] For port 7cfaa63a-538d-427b-abe2-334429d28a57, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7cfaa63a-538d-427b-abe2-334429d28a57,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:43.148635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0c48313c-b3b0-4c0a-b200-fe190fa946d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.174572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 149} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:43.197650 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (04ed54ee-d363-4aee-976e-ef047ddd3e33), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.197999 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Added segment 04ed54ee-d363-4aee-976e-ef047ddd3e33 of type vlan for network e81b4a9f-e0bc-424f-9f53-05abe8dce35f Mar 24 02:12:43.225730 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c48313c-b3b0-4c0a-b200-fe190fa946d0 None None] Pushing event updated for resources: {'Port': ['ID=7cfaa63a-538d-427b-abe2-334429d28a57,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:43.268435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (e81b4a9f-e0bc-424f-9f53-05abe8dce35f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.298279 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a9a31453-f05f-4a47-80fb-ac26b2396e99 req-14ee1966-bcd3-46fb-91c6-aeed9236b69b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6259251 Mar 24 02:12:43.308340 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7125b8e1-8fbf-4046-9ef9-cd2d534a1639 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 3.8328738 Mar 24 02:12:43.311309 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56220) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:43.335900 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Network 0c679173-666f-45c2-9af4-7ceb8205d217 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:43.343913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:43.347222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:43.353845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:43.354477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.362460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (e81b4a9f-e0bc-424f-9f53-05abe8dce35f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.363426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:43.368479 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.371140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device dba04693-4495-4586-b5e4-7de9e3b2abd3 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:43.385118 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56222) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:43.385398 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 942 time: 3.1215320 Mar 24 02:12:43.488072 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51cf68ed-5dbd-4350-87be-ae2e1f5d8d6f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event updated for resources: {'Port': ['ID=0dbdbe56-6b76-4f74-82b2-e218ac01200d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:43.499659 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-03569f13-ea6a-4497-911f-2a727370fd87 None None] Provisioning complete for port 1a3ac717-ddb0-4aa9-8a94-58851a486f53 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:43.501032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-03569f13-ea6a-4497-911f-2a727370fd87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (1a3ac717-ddb0-4aa9-8a94-58851a486f53), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.522617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Allocated IP 172.26.2.79 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/9f435316-c418-499d-93c6-e251f5c7ae65) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:43.554751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba209dfd-b295-4feb-8315-64b4dcb19a08 req-ec84655c-4faf-4740-884b-bed33ac30a53 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:43.562429 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ba209dfd-b295-4feb-8315-64b4dcb19a08 req-ec84655c-4faf-4740-884b-bed33ac30a53 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 945 time: 0.7170348 Mar 24 02:12:43.562862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port dba04693-4495-4586-b5e4-7de9e3b2abd3 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:12:43.592033 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port dba04693-4495-4586-b5e4-7de9e3b2abd3 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:43.592730 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.640747 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c203dd6-9fb3-4b3d-8245-0a080aef5720 None None] Network 0c679173-666f-45c2-9af4-7ceb8205d217 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:43.646921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-03569f13-ea6a-4497-911f-2a727370fd87 None None] Port 1a3ac717-ddb0-4aa9-8a94-58851a486f53 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:43.664236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-166e410c-dc4d-4eac-8251-962595926e56 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event deleted for resources: {'Port': ['ID=e58c33b1-ed53-4ec5-bda2-6db4af383f7c,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:43.755326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-166e410c-dc4d-4eac-8251-962595926e56 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.761389 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-166e410c-dc4d-4eac-8251-962595926e56 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "DELETE /v2.0/ports/e58c33b1-ed53-4ec5-bda2-6db4af383f7c HTTP/1.1" status: 204 len: 168 time: 3.0161486 Mar 24 02:12:43.768605 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56224) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:43.824364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad49ed25-0008-425f-abbd-fa71e74663f7 req-69e15309-dd8f-437e-aa7c-c3ffea4e6ab7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:43.825534 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ad49ed25-0008-425f-abbd-fa71e74663f7 req-69e15309-dd8f-437e-aa7c-c3ffea4e6ab7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 943 time: 0.3200588 Mar 24 02:12:43.828784 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-c1f4ec9f-f6e1-4e84-8c09-0908b9c115f8 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] GET failed (client error): The resource could not be found. Mar 24 02:12:43.829966 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c1f4ec9f-f6e1-4e84-8c09-0908b9c115f8 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "GET /v2.0/ports/e58c33b1-ed53-4ec5-bda2-6db4af383f7c HTTP/1.1" status: 404 len: 333 time: 0.0576556 Mar 24 02:12:43.840904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port dba04693-4495-4586-b5e4-7de9e3b2abd3 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:43.840904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.844472 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ba209dfd-b295-4feb-8315-64b4dcb19a08 req-53daedd9-629b-408f-8581-eed3d94f488c tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2787538 Mar 24 02:12:43.844991 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56226) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:43.852079 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-da9a6432-e194-425d-84a4-bbe692a4faa0 None None] Provisioning complete for port d3c95218-5c0f-456d-87a4-8e30632ecd58 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:43.852431 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-da9a6432-e194-425d-84a4-bbe692a4faa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:43.859246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'port': {'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136', 'name': 'tempest-AllowedAddressPairTestJSON-1084754747'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:43.862720 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Request body: {'port': {'network_id': '0c679173-666f-45c2-9af4-7ceb8205d217', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-1848378681', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:43.863372 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.api.validators [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] bootfile-name is not in valid_values {{(pid=104036) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:12:43.864356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.api.validators [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] tftp-server is not in valid_values {{(pid=104036) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:12:43.864356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.api.validators [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] server-ip-address is not in valid_values {{(pid=104036) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:12:43.870704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'Network': ['ID=e81b4a9f-e0bc-424f-9f53-05abe8dce35f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:43.892855 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ec9516e8-694b-4daf-9e35-7ffcff17465e tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.8356237 Mar 24 02:12:43.893626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56228) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:43.907539 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network e81b4a9f-e0bc-424f-9f53-05abe8dce35f details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:43.936214 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dba04693-4495-4586-b5e4-7de9e3b2abd3'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:12:44.004103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e67c10f2-ee2a-48b2-acb6-e08779fd5bed tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:44.010698 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e67c10f2-ee2a-48b2-acb6-e08779fd5bed tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:44.012352 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e67c10f2-ee2a-48b2-acb6-e08779fd5bed tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1670 time: 0.6995134 Mar 24 02:12:44.022164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56232) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:44.035237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3c95218-5c0f-456d-87a4-8e30632ecd58 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:44.038895 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for port (9f435316-c418-499d-93c6-e251f5c7ae65), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.062069 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ad49ed25-0008-425f-abbd-fa71e74663f7 req-0d9b5028-8151-435d-a1af-9e4ace973eb0 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2158117 Mar 24 02:12:44.074672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5f92c2e-fa92-4d4a-bff6-623b24b858ee tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:44.078773 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a5f92c2e-fa92-4d4a-bff6-623b24b858ee tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] 10.222.0.20 "GET /v2.0/networks/e81b4a9f-e0bc-424f-9f53-05abe8dce35f HTTP/1.1" status: 200 len: 757 time: 0.1723287 Mar 24 02:12:44.079471 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56236) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:44.087509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port dba04693-4495-4586-b5e4-7de9e3b2abd3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dba04693-4495-4586-b5e4-7de9e3b2abd3,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:44.105478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.106252 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 23c422ed-55e0-408f-95ff-bc9d2619a936 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:44.169021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fee9742a-5004-4dfe-b837-fc3eaecde877" -d '{"events": [{"server_uuid": "bb0721bf-38c2-46f0-8650-43fce951aa0f", "name": "network-vif-plugged", "status": "completed", "tag": "dba04693-4495-4586-b5e4-7de9e3b2abd3"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:12:44.211077 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.226776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Made reservation on behalf of a3f362c54abc4116a2d8ae1cbdbafe9b for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:44.235640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.242777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-271ce138-206a-4d1d-8f0d-1fa0dfa439ea tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:44.244476 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-271ce138-206a-4d1d-8f0d-1fa0dfa439ea tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] 10.222.0.20 "GET /v2.0/networks/e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc HTTP/1.1" status: 200 len: 768 time: 0.1331317 Mar 24 02:12:44.247681 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56242) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:44.251807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Made reservation on behalf of 9caabc535d3b4f50bb25aa525e01dd5f for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:44.265370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.291632 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=dba04693-4495-4586-b5e4-7de9e3b2abd3,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:44.344555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] device_id is not set on port 909bbf58-63e1-4dc6-b04f-12cd843c91c2 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:44.385014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (e81b4a9f-e0bc-424f-9f53-05abe8dce35f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.397919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] device_id is not set on port 85a550ea-974f-4fe1-81df-a64c8a033d54 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:44.465756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:12:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5a8d0fd-db8d-4cbb-b5a3-b4ce4268874f x-openstack-request-id: req-b5a8d0fd-db8d-4cbb-b5a3-b4ce4268874f {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:12:44.466085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bb0721bf-38c2-46f0-8650-43fce951aa0f", "name": "network-vif-plugged", "status": "completed", "tag": "dba04693-4495-4586-b5e4-7de9e3b2abd3", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:12:44.466682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-b5a8d0fd-db8d-4cbb-b5a3-b4ce4268874f {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:12:44.467311 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b5a8d0fd-db8d-4cbb-b5a3-b4ce4268874f'] response: {'server_uuid': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dba04693-4495-4586-b5e4-7de9e3b2abd3', 'code': 200} Mar 24 02:12:44.470974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d3c95218-5c0f-456d-87a4-8e30632ecd58 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:44.471378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.473935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-da9a6432-e194-425d-84a4-bbe692a4faa0 None None] Current status of the port d3c95218-5c0f-456d-87a4-8e30632ecd58 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:44.474478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-da9a6432-e194-425d-84a4-bbe692a4faa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.511796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Allocated IP 172.20.0.10 (b57330c4-af00-4735-8aae-7d7d77f8f136/14ee7600-4bf8-4bbb-b8f3-467531787f2d/909bbf58-63e1-4dc6-b04f-12cd843c91c2) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:44.518846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 23c422ed-55e0-408f-95ff-bc9d2619a936 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:12:44.526647 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 23c422ed-55e0-408f-95ff-bc9d2619a936 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:44.527112 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.574830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:44.590052 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-da9a6432-e194-425d-84a4-bbe692a4faa0 None None] For port d3c95218-5c0f-456d-87a4-8e30632ecd58, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3c95218-5c0f-456d-87a4-8e30632ecd58,segment=NetworkSegment(ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e),segment_id=ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:44.591078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:44.597752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event updated for resources: {'Port': ['ID=9f435316-c418-499d-93c6-e251f5c7ae65,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:44.606357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:44.630642 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-da9a6432-e194-425d-84a4-bbe692a4faa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.642856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-52cc267a-7b07-4a14-9cfe-4ced724f8c10 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 1a3ac717-ddb0-4aa9-8a94-58851a486f53 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:44.643341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52cc267a-7b07-4a14-9cfe-4ced724f8c10 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1a3ac717-ddb0-4aa9-8a94-58851a486f53), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.651418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (e81b4a9f-e0bc-424f-9f53-05abe8dce35f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.723698 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e81b4a9f-e0bc-424f-9f53-05abe8dce35f']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:44.723914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da9a6432-e194-425d-84a4-bbe692a4faa0 None None] Pushing event updated for resources: {'Port': ['ID=d3c95218-5c0f-456d-87a4-8e30632ecd58,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:44.737983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09471df4-8ef4-4b6a-9ff6-fca304320e76 req-065c95a1-8ec6-4840-9fee-1aa44706e4e5 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:44.739466 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-09471df4-8ef4-4b6a-9ff6-fca304320e76 req-065c95a1-8ec6-4840-9fee-1aa44706e4e5 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 945 time: 0.2948258 Mar 24 02:12:44.752958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde5e4f5-69fc-4522-9139-1d3ecdde2178 req-83eef16c-6e64-41dc-a8f4-fcdbb1cb6e7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:44.758303 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-cde5e4f5-69fc-4522-9139-1d3ecdde2178 req-83eef16c-6e64-41dc-a8f4-fcdbb1cb6e7b service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 1130 time: 0.2360272 Mar 24 02:12:44.771055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 23c422ed-55e0-408f-95ff-bc9d2619a936 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:44.771450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.776937 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '04ed54ee-d363-4aee-976e-ef047ddd3e33') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:44.777342 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '04ed54ee-d363-4aee-976e-ef047ddd3e33') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:44.796919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-cde5e4f5-69fc-4522-9139-1d3ecdde2178 req-86397d2e-96ac-4ea7-b52d-828ed973f2b2 service neutron] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.800672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (04ed54ee-d363-4aee-976e-ef047ddd3e33), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.804957 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-610becbd-12df-4c55-8680-26a81bd79edd None None] Provisioning complete for port 0dbdbe56-6b76-4f74-82b2-e218ac01200d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:44.805147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-610becbd-12df-4c55-8680-26a81bd79edd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.806909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d3c95218-5c0f-456d-87a4-8e30632ecd58 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:44.807961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7cfaa63a-538d-427b-abe2-334429d28a57 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:44.827272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Allocated IP 2001:db8::23c (0c679173-666f-45c2-9af4-7ceb8205d217/272c6bcc-dfd7-4e88-bc00-f1d036de9e54/85a550ea-974f-4fe1-81df-a64c8a033d54) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:44.842465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (04ed54ee-d363-4aee-976e-ef047ddd3e33), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.856787 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Releasing vlan 149 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:44.857370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (04ed54ee-d363-4aee-976e-ef047ddd3e33), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:44.870927 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:44.890668 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 23c422ed-55e0-408f-95ff-bc9d2619a936, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=23c422ed-55e0-408f-95ff-bc9d2619a936,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:44.911133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.917767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.941371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-610becbd-12df-4c55-8680-26a81bd79edd None None] Port 0dbdbe56-6b76-4f74-82b2-e218ac01200d cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:44.983877 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-610becbd-12df-4c55-8680-26a81bd79edd None None] Provisioning complete for port d3c95218-5c0f-456d-87a4-8e30632ecd58 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:44.984243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-610becbd-12df-4c55-8680-26a81bd79edd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.986240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 7cfaa63a-538d-427b-abe2-334429d28a57 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:44.986750 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:44.989062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=23c422ed-55e0-408f-95ff-bc9d2619a936,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:44.991062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (e81b4a9f-e0bc-424f-9f53-05abe8dce35f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.005990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network e81b4a9f-e0bc-424f-9f53-05abe8dce35f {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Mar 24 02:12:45.056367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52cc267a-7b07-4a14-9cfe-4ced724f8c10 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1a3ac717-ddb0-4aa9-8a94-58851a486f53), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.062170 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-09471df4-8ef4-4b6a-9ff6-fca304320e76 req-8da4f827-2810-429d-b785-d776bad277c3 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3110499 Mar 24 02:12:45.088299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.089766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-52cc267a-7b07-4a14-9cfe-4ced724f8c10 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 1a3ac717-ddb0-4aa9-8a94-58851a486f53 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:45.103970 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "DELETE /v2.0/networks/e81b4a9f-e0bc-424f-9f53-05abe8dce35f HTTP/1.1" status: 204 len: 168 time: 0.8551245 Mar 24 02:12:45.124110 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56250) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:45.138602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Request body: {'network': {'name': 'tempest-network--1672607405'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:45.144921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a603ef-64d3-4f2c-8b3c-53fa93768543 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event deleted for resources: {'Network': ['ID=e81b4a9f-e0bc-424f-9f53-05abe8dce35f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:45.174115 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-610becbd-12df-4c55-8680-26a81bd79edd None None] Current status of the port d3c95218-5c0f-456d-87a4-8e30632ecd58 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:45.191736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 7cfaa63a-538d-427b-abe2-334429d28a57 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:45.227906 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for port (909bbf58-63e1-4dc6-b04f-12cd843c91c2), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.257820 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-cde5e4f5-69fc-4522-9139-1d3ecdde2178 req-86397d2e-96ac-4ea7-b52d-828ed973f2b2 service neutron] Publish callbacks [] for security_group (d5c1db5d-e524-4072-92f0-b0db601a5cf6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.269053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-cde5e4f5-69fc-4522-9139-1d3ecdde2178 req-86397d2e-96ac-4ea7-b52d-828ed973f2b2 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d5c1db5d-e524-4072-92f0-b0db601a5cf6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.293007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cd484c0-6452-459d-9655-b36ac88dec22 req-38153109-28f8-4ec3-b585-b3b60906b5bc tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:45.294540 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4cd484c0-6452-459d-9655-b36ac88dec22 req-38153109-28f8-4ec3-b585-b3b60906b5bc tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 946 time: 0.3553529 Mar 24 02:12:45.304343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6e23fab9-a903-4cdc-9743-5693f9a94812 None None] Provisioning complete for port 0dbdbe56-6b76-4f74-82b2-e218ac01200d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:45.305075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6e23fab9-a903-4cdc-9743-5693f9a94812 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.334082 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-cde5e4f5-69fc-4522-9139-1d3ecdde2178 req-86397d2e-96ac-4ea7-b52d-828ed973f2b2 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5698221 Mar 24 02:12:45.339228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86397d2e-96ac-4ea7-b52d-828ed973f2b2 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=d5c1db5d-e524-4072-92f0-b0db601a5cf6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:45.361979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Made reservation on behalf of b1bf23b03a854c86ad22a24cf8348ef2 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:45.366277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.367442 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks [] for port (85a550ea-974f-4fe1-81df-a64c8a033d54), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.381801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 3f03ca03-be93-4662-af2b-73bbfc93a9da details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:12:45.385703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6e23fab9-a903-4cdc-9743-5693f9a94812 None None] Port 0dbdbe56-6b76-4f74-82b2-e218ac01200d cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:45.407281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (85a550ea-974f-4fe1-81df-a64c8a033d54), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.475060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Network 0c679173-666f-45c2-9af4-7ceb8205d217 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:45.476130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event updated for resources: {'Port': ['ID=85a550ea-974f-4fe1-81df-a64c8a033d54,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:45.480083 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:45.483447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:45.488343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:45.489029 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.496480 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4cd484c0-6452-459d-9655-b36ac88dec22 req-94d51b53-1429-4b16-9fcc-d3bb2167f7c1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1653917 Mar 24 02:12:45.498611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 133} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:45.515533 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-707a98ef-7c7d-48fe-b4e6-8f56a0fbecf9 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1150 time: 2.1000209 Mar 24 02:12:45.517914 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56252) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:45.546469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (909bbf58-63e1-4dc6-b04f-12cd843c91c2), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.559217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c881240a-42fc-4178-9565-cab2ff9ce21f req-a360a729-7fc2-43ed-9822-0148d86e7cea tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:45.560741 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c881240a-42fc-4178-9565-cab2ff9ce21f req-a360a729-7fc2-43ed-9822-0148d86e7cea tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 943 time: 0.3618045 Mar 24 02:12:45.567817 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (813470c2-6933-4c39-9700-24883eee38ac), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.568162 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Added segment 813470c2-6933-4c39-9700-24883eee38ac of type vlan for network 2cb5c952-8eb5-474f-a335-ed5b19e4630d Mar 24 02:12:45.569329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (6734957d-912d-40f2-aecb-59fbd65994f8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.613379 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65154ac6-f00b-4042-aeed-16953383d0c8 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:45.618455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65154ac6-f00b-4042-aeed-16953383d0c8 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:45.624369 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65154ac6-f00b-4042-aeed-16953383d0c8 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:45.624939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 3f03ca03-be93-4662-af2b-73bbfc93a9da, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=3f03ca03-be93-4662-af2b-73bbfc93a9da,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:45.626107 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-65154ac6-f00b-4042-aeed-16953383d0c8 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2624 time: 0.0985928 Mar 24 02:12:45.628905 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56254) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:45.643668 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '3f03ca03-be93-4662-af2b-73bbfc93a9da', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'port_id': '3f03ca03-be93-4662-af2b-73bbfc93a9da', 'mac_address': 'fa:16:3e:8e:7b:45', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:12:45.685725 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 3f03ca03-be93-4662-af2b-73bbfc93a9da is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:45.686125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.703037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3f03ca03-be93-4662-af2b-73bbfc93a9da {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:12:45.725020 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 3f03ca03-be93-4662-af2b-73bbfc93a9da, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=3f03ca03-be93-4662-af2b-73bbfc93a9da,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:45.730383 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.749597 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-513d6599-52ea-4a45-a8d3-0098ced2014f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Deleting port 85a550ea-974f-4fe1-81df-a64c8a033d54 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:45.750032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-513d6599-52ea-4a45-a8d3-0098ced2014f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (85a550ea-974f-4fe1-81df-a64c8a033d54), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.792132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=3f03ca03-be93-4662-af2b-73bbfc93a9da,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:45.809005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (2cb5c952-8eb5-474f-a335-ed5b19e4630d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.831434 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Port': ['ID=909bbf58-63e1-4dc6-b04f-12cd843c91c2,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:45.856717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Network b57330c4-af00-4735-8aae-7d7d77f8f136 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:45.858351 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3c95218-5c0f-456d-87a4-8e30632ecd58 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:45.863559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-143f2b42-47bb-4a18-a0a9-c031f1241cb7 None None] Provisioning complete for port 85a550ea-974f-4fe1-81df-a64c8a033d54 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:45.863934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-143f2b42-47bb-4a18-a0a9-c031f1241cb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (85a550ea-974f-4fe1-81df-a64c8a033d54), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.875823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:45.885494 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-513d6599-52ea-4a45-a8d3-0098ced2014f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (85a550ea-974f-4fe1-81df-a64c8a033d54), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.888818 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:45.902005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-513d6599-52ea-4a45-a8d3-0098ced2014f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Calling delete_port for 85a550ea-974f-4fe1-81df-a64c8a033d54 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:45.921797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52cc267a-7b07-4a14-9cfe-4ced724f8c10 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (1a3ac717-ddb0-4aa9-8a94-58851a486f53), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:45.946654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-143f2b42-47bb-4a18-a0a9-c031f1241cb7 None None] Port 85a550ea-974f-4fe1-81df-a64c8a033d54 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:45.960182 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c881240a-42fc-4178-9565-cab2ff9ce21f req-008a3b28-5afe-4f2b-8082-442c99f6d28a tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3447559 Mar 24 02:12:45.965465 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d3c95218-5c0f-456d-87a4-8e30632ecd58 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:45.965956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.023068 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (2cb5c952-8eb5-474f-a335-ed5b19e4630d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.023937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.024518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.056933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d3c95218-5c0f-456d-87a4-8e30632ecd58 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:46.072708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-513d6599-52ea-4a45-a8d3-0098ced2014f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (85a550ea-974f-4fe1-81df-a64c8a033d54), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.125810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['3f03ca03-be93-4662-af2b-73bbfc93a9da'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:12:46.147205 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-513d6599-52ea-4a45-a8d3-0098ced2014f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.156265 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-513d6599-52ea-4a45-a8d3-0098ced2014f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "DELETE /v2.0/ports/85a550ea-974f-4fe1-81df-a64c8a033d54 HTTP/1.1" status: 204 len: 168 time: 0.5214388 Mar 24 02:12:46.156265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-513d6599-52ea-4a45-a8d3-0098ced2014f tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event deleted for resources: {'Port': ['ID=85a550ea-974f-4fe1-81df-a64c8a033d54,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:46.156265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56258) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:46.160852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Request body: {'port': {'name': 'tempest-new-port-name-305169643', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:46.161284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.api.validators [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] bootfile-name is not in valid_values {{(pid=104036) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:12:46.161625 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.api.validators [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] tftp-server is not in valid_values {{(pid=104036) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:12:46.161974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.api.validators [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] server-ip-address is not in valid_values {{(pid=104036) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:12:46.248078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.309749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0a208509-2926-4132-880d-1ffa2603ee6b None None] Provisioning complete for port 909bbf58-63e1-4dc6-b04f-12cd843c91c2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:46.310316 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0a208509-2926-4132-880d-1ffa2603ee6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (909bbf58-63e1-4dc6-b04f-12cd843c91c2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.343783 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52cc267a-7b07-4a14-9cfe-4ced724f8c10 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=1a3ac717-ddb0-4aa9-8a94-58851a486f53,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:46.361340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0a208509-2926-4132-880d-1ffa2603ee6b None None] Port 909bbf58-63e1-4dc6-b04f-12cd843c91c2 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:46.456340 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.456956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.469278 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '23c422ed-55e0-408f-95ff-bc9d2619a936'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:12:46.471254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52cc267a-7b07-4a14-9cfe-4ced724f8c10 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.471693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-05a56e8e-c8e2-493f-bd4b-2e7dab957919" -d '{"events": [{"server_uuid": "0a447b1e-7d9a-43d6-8a64-8ff70a04f466", "name": "network-vif-plugged", "status": "completed", "tag": "23c422ed-55e0-408f-95ff-bc9d2619a936"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:12:46.475210 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-52cc267a-7b07-4a14-9cfe-4ced724f8c10 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/1a3ac717-ddb0-4aa9-8a94-58851a486f53 HTTP/1.1" status: 204 len: 168 time: 2.4504898 Mar 24 02:12:46.478781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56262) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:46.497035 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 864 time: 1.3677940 Mar 24 02:12:46.506103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56264) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:46.516122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-68a362aa-b467-4038-ba91-3e6f312b4745 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Request body: {'network': {'router:external': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:46.519910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:12:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76377cad-612e-439c-a7c3-7c499e91a940 x-openstack-request-id: req-76377cad-612e-439c-a7c3-7c499e91a940 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:12:46.520520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0a447b1e-7d9a-43d6-8a64-8ff70a04f466", "name": "network-vif-plugged", "status": "completed", "tag": "23c422ed-55e0-408f-95ff-bc9d2619a936", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:12:46.521256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-76377cad-612e-439c-a7c3-7c499e91a940 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:12:46.521888 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-76377cad-612e-439c-a7c3-7c499e91a940'] response: {'server_uuid': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '23c422ed-55e0-408f-95ff-bc9d2619a936', 'code': 200} Mar 24 02:12:46.568699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8387371-6459-4a2b-a392-33c1c4e44147 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.570135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8387371-6459-4a2b-a392-33c1c4e44147 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.574147 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f8387371-6459-4a2b-a392-33c1c4e44147 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0920928 Mar 24 02:12:46.574676 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56268) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:46.586133 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks [] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.592965 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e3de2e04-1c33-4018-886c-aeaa8deefc2c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.7355886 Mar 24 02:12:46.617551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56270) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:46.625149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'port': {'network_id': 'b57330c4-af00-4735-8aae-7d7d77f8f136', 'name': 'tempest-AllowedAddressPairTestJSON-976578289'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:46.628657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.644010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac1261d-10d3-483d-a63d-46edf238b91f tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'Network': ['ID=2cb5c952-8eb5-474f-a335-ed5b19e4630d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:46.656106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 2cb5c952-8eb5-474f-a335-ed5b19e4630d details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:46.675948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] In _notify_port_updated(), no bound segment for port 0dbdbe56-6b76-4f74-82b2-e218ac01200d on network 0c679173-666f-45c2-9af4-7ceb8205d217 {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:12:46.682059 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.682722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.690010 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "PUT /v2.0/ports/0dbdbe56-6b76-4f74-82b2-e218ac01200d HTTP/1.1" status: 200 len: 1129 time: 0.5317605 Mar 24 02:12:46.691682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56272) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:46.770712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-473550ce-9047-4e45-8573-f7779a54ebc8 req-5efb14ba-d09b-472d-89bb-e3a28ccd9a2f tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.772291 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-473550ce-9047-4e45-8573-f7779a54ebc8 req-5efb14ba-d09b-472d-89bb-e3a28ccd9a2f tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.4252284 Mar 24 02:12:46.779866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (6734957d-912d-40f2-aecb-59fbd65994f8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.807845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-beb262c6-711b-4e92-b2b8-54af6d3ad1f2 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.809286 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-beb262c6-711b-4e92-b2b8-54af6d3ad1f2 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "GET /v2.0/ports/0dbdbe56-6b76-4f74-82b2-e218ac01200d HTTP/1.1" status: 200 len: 1129 time: 0.1159101 Mar 24 02:12:46.818163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56274) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:46.828365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-ebd6528c-dbc4-4f8b-ac08-19b48a7dcb22 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet aadc9290-5a16-421d-8b48-b81f496a068f {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:12:46.832798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebd6528c-dbc4-4f8b-ac08-19b48a7dcb22 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (aadc9290-5a16-421d-8b48-b81f496a068f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.871121 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-68a362aa-b467-4038-ba91-3e6f312b4745 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (2cb5c952-8eb5-474f-a335-ed5b19e4630d), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.906713 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c74c4b50-bd4c-4094-92d8-c4c706db61d5 None None] Provisioning complete for port 0dbdbe56-6b76-4f74-82b2-e218ac01200d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:46.907173 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c74c4b50-bd4c-4094-92d8-c4c706db61d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.921230 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbc7bef0-5705-42c1-892a-1e6966dc502c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event updated for resources: {'Port': ['ID=0dbdbe56-6b76-4f74-82b2-e218ac01200d,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:46.935707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e60a6ec-7c22-488e-8d7e-782d220b24a7 req-c2f2c58d-ec18-4ed9-8558-fed572420091 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.937432 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0e60a6ec-7c22-488e-8d7e-782d220b24a7 req-c2f2c58d-ec18-4ed9-8558-fed572420091 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 946 time: 0.2944775 Mar 24 02:12:46.947265 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c74c4b50-bd4c-4094-92d8-c4c706db61d5 None None] Port 0dbdbe56-6b76-4f74-82b2-e218ac01200d cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:46.953034 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-68a362aa-b467-4038-ba91-3e6f312b4745 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (2cb5c952-8eb5-474f-a335-ed5b19e4630d), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.962300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebd6528c-dbc4-4f8b-ac08-19b48a7dcb22 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (aadc9290-5a16-421d-8b48-b81f496a068f), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.992660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87e817ec-e138-4d41-bad6-b6aac6c3499f req-f8907ef0-721b-4edb-a83f-ce6a81050df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.993158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-68a362aa-b467-4038-ba91-3e6f312b4745 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Network 2cb5c952-8eb5-474f-a335-ed5b19e4630d is not hosted by any dhcp agent {{(pid=104037) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Mar 24 02:12:46.994002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68a362aa-b467-4038-ba91-3e6f312b4745 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:46.994627 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-68a362aa-b467-4038-ba91-3e6f312b4745 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:46.995668 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-87e817ec-e138-4d41-bad6-b6aac6c3499f req-f8907ef0-721b-4edb-a83f-ce6a81050df6 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 1130 time: 0.2920167 Mar 24 02:12:46.995889 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-68a362aa-b467-4038-ba91-3e6f312b4745 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "PUT /v2.0/networks/2cb5c952-8eb5-474f-a335-ed5b19e4630d HTTP/1.1" status: 200 len: 858 time: 0.4859269 Mar 24 02:12:47.022240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56278) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:47.027925 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-473550ce-9047-4e45-8573-f7779a54ebc8 req-46527d3e-5ee8-468e-ad24-037fad7310a7 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2446518 Mar 24 02:12:47.077683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a362aa-b467-4038-ba91-3e6f312b4745 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event updated for resources: {'Network': ['ID=2cb5c952-8eb5-474f-a335-ed5b19e4630d,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:47.085731 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0e60a6ec-7c22-488e-8d7e-782d220b24a7 req-21cd2b1b-ecee-4ada-a584-0f8d88039131 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1389446 Mar 24 02:12:47.164441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98ca0d9b-e7ed-4688-a7e1-ef139fd5e0e2 req-7aa7e768-79d9-4133-8f7a-a80557064171 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:47.166017 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-98ca0d9b-e7ed-4688-a7e1-ef139fd5e0e2 req-7aa7e768-79d9-4133-8f7a-a80557064171 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 944 time: 0.0771253 Mar 24 02:12:47.167212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Router 6734957d-912d-40f2-aecb-59fbd65994f8 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:12:47.296791 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-98ca0d9b-e7ed-4688-a7e1-ef139fd5e0e2 req-ea7afc20-e232-4df5-b1b7-86b83713dfd3 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1241097 Mar 24 02:12:47.329029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:47.343326 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Sync routers for ids ['6734957d-912d-40f2-aecb-59fbd65994f8'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:47.356170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.357360 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Routers {'6734957d-912d-40f2-aecb-59fbd65994f8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:47.357807 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8d2dfc92-5cee-4159-a4b6-e642a976a7fe tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 7.7184873 Mar 24 02:12:47.358283 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['6734957d-912d-40f2-aecb-59fbd65994f8'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:47.361822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56280) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:47.381033 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Made reservation on behalf of a3f362c54abc4116a2d8ae1cbdbafe9b for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:47.384997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.401566 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 3f03ca03-be93-4662-af2b-73bbfc93a9da up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:47.442979 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (2cb5c952-8eb5-474f-a335-ed5b19e4630d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.459179 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-87e817ec-e138-4d41-bad6-b6aac6c3499f req-732b9c1f-af98-4207-8735-b34f7629efef service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4385605 Mar 24 02:12:47.472339 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] device_id is not set on port 6a530a05-1b64-47c0-9390-431917e2d4f0 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:47.478139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebd6528c-dbc4-4f8b-ac08-19b48a7dcb22 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (aadc9290-5a16-421d-8b48-b81f496a068f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.482867 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-663a47bd-0ba0-453b-900b-9b5c617b75c3 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Deleting port 0dbdbe56-6b76-4f74-82b2-e218ac01200d {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:47.483203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-663a47bd-0ba0-453b-900b-9b5c617b75c3 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.489983 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 3f03ca03-be93-4662-af2b-73bbfc93a9da completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:12:47.495434 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 3f03ca03-be93-4662-af2b-73bbfc93a9da triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:47.496701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.497593 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ae78a5b2-8148-459a-a866-2fef8204f01e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/routers/6734957d-912d-40f2-aecb-59fbd65994f8 HTTP/1.1" status: 200 len: 907 time: 0.1355379 Mar 24 02:12:47.498244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56282) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:47.503282 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'router': {'name': 'tempest-snat-router-229558191', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': True}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:47.529399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (170decdb-939c-4bfe-a485-601df982102c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.531578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (170decdb-939c-4bfe-a485-601df982102c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.594652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 3f03ca03-be93-4662-af2b-73bbfc93a9da is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:47.594652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.600717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_controller (170decdb-939c-4bfe-a485-601df982102c), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.605873 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Set router 6734957d-912d-40f2-aecb-59fbd65994f8 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:47.635081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 3f03ca03-be93-4662-af2b-73bbfc93a9da, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=3f03ca03-be93-4662-af2b-73bbfc93a9da,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:47.640775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.712336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=3f03ca03-be93-4662-af2b-73bbfc93a9da,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:47.744603 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (2cb5c952-8eb5-474f-a335-ed5b19e4630d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.769141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebd6528c-dbc4-4f8b-ac08-19b48a7dcb22 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (aadc9290-5a16-421d-8b48-b81f496a068f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.787079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (170decdb-939c-4bfe-a485-601df982102c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.792532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-663a47bd-0ba0-453b-900b-9b5c617b75c3 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.808082 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6734957d-912d-40f2-aecb-59fbd65994f8', 'name': 'tempest-snat-router-229558191', 'tenant_id': 'de44dd991a01489cb0ad2761eac48843', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.79'}], 'enable_snat': False}, 'gw_port_id': '9f435316-c418-499d-93c6-e251f5c7ae65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:12:39Z', 'updated_at': '2022-03-24T02:12:45Z', 'revision_number': 3, 'project_id': 'de44dd991a01489cb0ad2761eac48843', 'gw_port': {'id': '9f435316-c418-499d-93c6-e251f5c7ae65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:03:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6734957d-912d-40f2-aecb-59fbd65994f8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 237, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:42Z', 'updated_at': '2022-03-24T02:12:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:47.820539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2cb5c952-8eb5-474f-a335-ed5b19e4630d']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:47.834847 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebd6528c-dbc4-4f8b-ac08-19b48a7dcb22 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=aadc9290-5a16-421d-8b48-b81f496a068f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:47.835967 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Checking router: 6734957d-912d-40f2-aecb-59fbd65994f8 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:47.836649 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Updating router 6734957d-912d-40f2-aecb-59fbd65994f8 port 9f435316-c418-499d-93c6-e251f5c7ae65 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:12:47.843178 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d84b2093-96cd-4e1d-9e44-8fe38af8e88b None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:47.845414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebd6528c-dbc4-4f8b-ac08-19b48a7dcb22 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.848623 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ebd6528c-dbc4-4f8b-ac08-19b48a7dcb22 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/aadc9290-5a16-421d-8b48-b81f496a068f HTTP/1.1" status: 204 len: 168 time: 1.2729070 Mar 24 02:12:47.849845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Allocated IP 172.20.0.13 (b57330c4-af00-4735-8aae-7d7d77f8f136/14ee7600-4bf8-4bbb-b8f3-467531787f2d/6a530a05-1b64-47c0-9390-431917e2d4f0) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:47.852764 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-663a47bd-0ba0-453b-900b-9b5c617b75c3 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Calling delete_port for 0dbdbe56-6b76-4f74-82b2-e218ac01200d owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:47.855601 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '813470c2-6933-4c39-9700-24883eee38ac') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:47.855906 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '813470c2-6933-4c39-9700-24883eee38ac') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:47.859573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56284) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:47.874756 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.916208 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (813470c2-6933-4c39-9700-24883eee38ac), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.923530 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7a43e0f4-5f2c-444c-8fc3-d56447f2a7c8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0600486 Mar 24 02:12:47.926889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56286) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:47.968231 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (813470c2-6933-4c39-9700-24883eee38ac), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.983773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Releasing vlan 133 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:47.986559 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (813470c2-6933-4c39-9700-24883eee38ac), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:47.994617 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:48.040454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-634509c1-298e-4a45-9734-8c8e5fd597d1 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:12:48.101328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52a65f9f-8532-459d-9c82-df6c8d9188f5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:48.105106 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-52a65f9f-8532-459d-9c82-df6c8d9188f5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1725059 Mar 24 02:12:48.105347 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56290) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:48.128711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (2cb5c952-8eb5-474f-a335-ed5b19e4630d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.142413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-634509c1-298e-4a45-9734-8c8e5fd597d1 None None] Deleting port 7cfaa63a-538d-427b-abe2-334429d28a57 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:48.144084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-634509c1-298e-4a45-9734-8c8e5fd597d1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.158898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (170decdb-939c-4bfe-a485-601df982102c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.161803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 2cb5c952-8eb5-474f-a335-ed5b19e4630d {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Mar 24 02:12:48.196239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Pushing event deleted for resources: {'Network': ['ID=2cb5c952-8eb5-474f-a335-ed5b19e4630d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:48.219727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.222959 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d5e7460f-e2b2-4a19-8579-73d4e6d83cd2 tempest-ExternalNetworksTestJSON-2144746605 tempest-ExternalNetworksTestJSON-2144746605-project-admin] 10.222.0.20 "DELETE /v2.0/networks/2cb5c952-8eb5-474f-a335-ed5b19e4630d HTTP/1.1" status: 204 len: 168 time: 1.1989269 Mar 24 02:12:48.229828 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.232253 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56294) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:48.239369 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Publish callbacks [] for port (9f435316-c418-499d-93c6-e251f5c7ae65), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.242845 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-634509c1-298e-4a45-9734-8c8e5fd597d1 None None] For port 7cfaa63a-538d-427b-abe2-334429d28a57, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7cfaa63a-538d-427b-abe2-334429d28a57,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:48.243415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-634509c1-298e-4a45-9734-8c8e5fd597d1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.253775 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.262645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-634509c1-298e-4a45-9734-8c8e5fd597d1 None None] Calling delete_port for 7cfaa63a-538d-427b-abe2-334429d28a57 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:48.284984 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Attempting to bind port 9f435316-c418-499d-93c6-e251f5c7ae65 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:48.285352 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Attempting to bind port 9f435316-c418-499d-93c6-e251f5c7ae65 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:48.286216 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Attempting to bind port 9f435316-c418-499d-93c6-e251f5c7ae65 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:48.315516 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:48.315982 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:48.316299 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.316690 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:48.317174 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Bound port: 9f435316-c418-499d-93c6-e251f5c7ae65, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:48.317558 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.393034 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] For port 9f435316-c418-499d-93c6-e251f5c7ae65, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:48.408303 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] For port 9f435316-c418-499d-93c6-e251f5c7ae65, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f435316-c418-499d-93c6-e251f5c7ae65,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:48.427085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.428698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-634509c1-298e-4a45-9734-8c8e5fd597d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (7cfaa63a-538d-427b-abe2-334429d28a57), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.431484 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.447002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-634509c1-298e-4a45-9734-8c8e5fd597d1 None None] No DVR routers for this DVR port 7cfaa63a-538d-427b-abe2-334429d28a57 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:12:48.453301 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0409295-3e71-41ed-b2be-ebb221e4478c None None] Pushing event updated for resources: {'Port': ['ID=9f435316-c418-499d-93c6-e251f5c7ae65,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:48.463456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-663a47bd-0ba0-453b-900b-9b5c617b75c3 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0dbdbe56-6b76-4f74-82b2-e218ac01200d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.472146 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634509c1-298e-4a45-9734-8c8e5fd597d1 None None] Pushing event deleted for resources: {'Port': ['ID=7cfaa63a-538d-427b-abe2-334429d28a57,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:48.514250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663a47bd-0ba0-453b-900b-9b5c617b75c3 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event deleted for resources: {'Port': ['ID=0dbdbe56-6b76-4f74-82b2-e218ac01200d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:48.523553 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65964499-8a52-4d24-90bb-505fb03cb88a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f03ca03-be93-4662-af2b-73bbfc93a9da'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:12:48.530413 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0409295-3e71-41ed-b2be-ebb221e4478c None None] Pushing event updated for resources: {'Port': ['ID=9f435316-c418-499d-93c6-e251f5c7ae65,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:48.531335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29a51c58-43d2-4dab-a48a-dd947cee877e" -d '{"events": [{"server_uuid": "65964499-8a52-4d24-90bb-505fb03cb88a", "name": "network-vif-plugged", "status": "completed", "tag": "3f03ca03-be93-4662-af2b-73bbfc93a9da"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:12:48.538200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-663a47bd-0ba0-453b-900b-9b5c617b75c3 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.541784 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-663a47bd-0ba0-453b-900b-9b5c617b75c3 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "DELETE /v2.0/ports/0dbdbe56-6b76-4f74-82b2-e218ac01200d HTTP/1.1" status: 204 len: 168 time: 1.7225692 Mar 24 02:12:48.546804 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56300) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:48.547219 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87efbe9e-83fb-47b4-90a8-27957df2d9ff tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:48.550939 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-87efbe9e-83fb-47b4-90a8-27957df2d9ff tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.4424202 Mar 24 02:12:48.552711 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Routers {'6734957d-912d-40f2-aecb-59fbd65994f8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:48.553327 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['6734957d-912d-40f2-aecb-59fbd65994f8'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:48.555472 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Allocated IP 172.26.2.217 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/0355a4df-7c69-4b51-93f0-1a3e44aa4a20) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:48.555689 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56302) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:48.589216 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-d2ec80ad-5b25-4c88-a61b-b89a4b8fb3bf tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] DELETE failed (client error): The resource could not be found. Mar 24 02:12:48.590026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d2ec80ad-5b25-4c88-a61b-b89a4b8fb3bf tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:12:48.597307 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d2ec80ad-5b25-4c88-a61b-b89a4b8fb3bf tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] 10.222.0.20 "DELETE /v2.0/subnets/7c18d7b4-93ce-40af-a916-9f24179812df HTTP/1.1" status: 404 len: 337 time: 0.3610649 Mar 24 02:12:48.599730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56304) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:48.659027 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a71f0bdf-3c1a-445f-8128-6e70dfd135a4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0969019 Mar 24 02:12:48.660368 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56306) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:48.668807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:48.678286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.716538 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Network b57330c4-af00-4735-8aae-7d7d77f8f136 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:48.740503 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] Set router 6734957d-912d-40f2-aecb-59fbd65994f8 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:48.744349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:48.746397 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:48.791668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-df36ae96-4fd7-49fe-9aa1-461f94fb7e8c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Deleting subnet 272c6bcc-dfd7-4e88-bc00-f1d036de9e54 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:12:48.855839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-df36ae96-4fd7-49fe-9aa1-461f94fb7e8c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks [] for subnet (272c6bcc-dfd7-4e88-bc00-f1d036de9e54), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.871748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:48.872415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:48.962345 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.3437028 Mar 24 02:12:48.970847 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56308) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:48.986733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ca5487b0-1174-467c-bae1-dad7b54cd9eb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.8', 'mac_address': 'fa:16:3e:af:63:24'}, {'ip_address': '172.20.0.10', 'mac_address': 'fa:16:3e:fd:74:e3'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:49.028467 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d0b365c-e07b-464a-a117-eb48a81c8946 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Port': ['ID=6a530a05-1b64-47c0-9390-431917e2d4f0,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:49.046686 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6734957d-912d-40f2-aecb-59fbd65994f8', 'name': 'tempest-snat-router-229558191', 'tenant_id': 'de44dd991a01489cb0ad2761eac48843', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.79'}], 'enable_snat': False}, 'gw_port_id': '9f435316-c418-499d-93c6-e251f5c7ae65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:12:39Z', 'updated_at': '2022-03-24T02:12:45Z', 'revision_number': 3, 'project_id': 'de44dd991a01489cb0ad2761eac48843', 'gw_port': {'id': '9f435316-c418-499d-93c6-e251f5c7ae65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:03:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6734957d-912d-40f2-aecb-59fbd65994f8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 237, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:42Z', 'updated_at': '2022-03-24T02:12:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:49.047555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-df36ae96-4fd7-49fe-9aa1-461f94fb7e8c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (272c6bcc-dfd7-4e88-bc00-f1d036de9e54), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.081403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a7865b6-a2a6-405c-aa9c-6c0eed8ef520 req-d2c93cdf-85c1-4096-a92a-eb75b6766d93 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:49.081798 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5abfb9f9-ccaa-4619-ba63-5bf2e75d8a45 None None] The sync data for ids ['6734957d-912d-40f2-aecb-59fbd65994f8'] in dv-neutron-834874-3-hyperv is: [{'id': '6734957d-912d-40f2-aecb-59fbd65994f8', 'name': 'tempest-snat-router-229558191', 'tenant_id': 'de44dd991a01489cb0ad2761eac48843', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.79'}], 'enable_snat': False}, 'gw_port_id': '9f435316-c418-499d-93c6-e251f5c7ae65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:12:39Z', 'updated_at': '2022-03-24T02:12:45Z', 'revision_number': 3, 'project_id': 'de44dd991a01489cb0ad2761eac48843', 'gw_port': {'id': '9f435316-c418-499d-93c6-e251f5c7ae65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:03:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6734957d-912d-40f2-aecb-59fbd65994f8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 237, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:42Z', 'updated_at': '2022-03-24T02:12:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:49.082929 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2a7865b6-a2a6-405c-aa9c-6c0eed8ef520 req-d2c93cdf-85c1-4096-a92a-eb75b6766d93 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.9649038 Mar 24 02:12:49.109327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-db1d6b02-f179-409b-adc6-9f5c61d0cf9b None None] Provisioning complete for port 6a530a05-1b64-47c0-9390-431917e2d4f0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:49.109688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-db1d6b02-f179-409b-adc6-9f5c61d0cf9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.129973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18fa9acf-22ff-4f97-b8a6-bb09025d9b90 req-6e4c6335-b137-44fa-b33c-f4fcaa969683 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:49.131565 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-18fa9acf-22ff-4f97-b8a6-bb09025d9b90 req-6e4c6335-b137-44fa-b33c-f4fcaa969683 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 946 time: 0.8984337 Mar 24 02:12:49.145255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:49.149319 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.158929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-db1d6b02-f179-409b-adc6-9f5c61d0cf9b None None] Port 6a530a05-1b64-47c0-9390-431917e2d4f0 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:49.159381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.245461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.254271 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2a7865b6-a2a6-405c-aa9c-6c0eed8ef520 req-4ae09899-c190-4036-b5d9-985fbb89a5cf tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1647418 Mar 24 02:12:49.334347 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ca5487b0-1174-467c-bae1-dad7b54cd9eb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.342142 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-18fa9acf-22ff-4f97-b8a6-bb09025d9b90 req-196b450d-e438-4e3c-92d7-4487e6bf7078 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1927989 Mar 24 02:12:49.357537 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-df36ae96-4fd7-49fe-9aa1-461f94fb7e8c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (272c6bcc-dfd7-4e88-bc00-f1d036de9e54), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.439622 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:12:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90e8001a-dbb4-4f1a-a8a8-d9c0a0a4ad42 x-openstack-request-id: req-90e8001a-dbb4-4f1a-a8a8-d9c0a0a4ad42 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:12:49.440118 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "65964499-8a52-4d24-90bb-505fb03cb88a", "name": "network-vif-plugged", "status": "completed", "tag": "3f03ca03-be93-4662-af2b-73bbfc93a9da", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:12:49.440611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-90e8001a-dbb4-4f1a-a8a8-d9c0a0a4ad42 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:12:49.441112 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-90e8001a-dbb4-4f1a-a8a8-d9c0a0a4ad42'] response: {'server_uuid': '65964499-8a52-4d24-90bb-505fb03cb88a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f03ca03-be93-4662-af2b-73bbfc93a9da', 'code': 200} Mar 24 02:12:49.443046 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.497505 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:49.518591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aba1382-b265-4654-a24e-39faec3e4831 req-8ce0fd60-35ca-4b94-a3ba-67b1ddf631b2 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:49.520563 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8aba1382-b265-4654-a24e-39faec3e4831 req-8ce0fd60-35ca-4b94-a3ba-67b1ddf631b2 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 945 time: 0.1836865 Mar 24 02:12:49.524096 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.529107 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '440766f6-54ce-473b-b088-46ad02b345f5') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:49.529601 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '440766f6-54ce-473b-b088-46ad02b345f5') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:49.552468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (440766f6-54ce-473b-b088-46ad02b345f5), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.582147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-df36ae96-4fd7-49fe-9aa1-461f94fb7e8c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (272c6bcc-dfd7-4e88-bc00-f1d036de9e54), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.643011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df36ae96-4fd7-49fe-9aa1-461f94fb7e8c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event deleted for resources: {'Subnet': ['ID=272c6bcc-dfd7-4e88-bc00-f1d036de9e54,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:49.656018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-df36ae96-4fd7-49fe-9aa1-461f94fb7e8c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.662259 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-df36ae96-4fd7-49fe-9aa1-461f94fb7e8c tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "DELETE /v2.0/subnets/272c6bcc-dfd7-4e88-bc00-f1d036de9e54 HTTP/1.1" status: 204 len: 168 time: 1.1123464 Mar 24 02:12:49.664775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aaaa6615-5780-4fd8-95dd-09f82515bd37 None None] Network 0c679173-666f-45c2-9af4-7ceb8205d217 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:49.667009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (92009ae8-4e82-4a33-9746-06bbf72cb55c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.669827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56312) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:49.676226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:49.677270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (440766f6-54ce-473b-b088-46ad02b345f5), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.697826 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:49.700572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:49.709984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Releasing vlan 113 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:49.710432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (440766f6-54ce-473b-b088-46ad02b345f5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:49.713650 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:49.749173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event updated for resources: {'Port': ['ID=0355a4df-7c69-4b51-93f0-1a3e44aa4a20,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:49.818607 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8aba1382-b265-4654-a24e-39faec3e4831 req-de884f92-cd6e-4f5a-9f23-3574c86b183e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2917602 Mar 24 02:12:49.864363 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df0ca72a-e651-40dc-a5fd-ee3732892275 None None] DHCP port deletion for 0c679173-666f-45c2-9af4-7ceb8205d217 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:12:49.923655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:49.946004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-df0ca72a-e651-40dc-a5fd-ee3732892275 None None] Deleting port d3c95218-5c0f-456d-87a4-8e30632ecd58 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:49.946919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-df0ca72a-e651-40dc-a5fd-ee3732892275 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.948926 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:49.954300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=92009ae8-4e82-4a33-9746-06bbf72cb55c,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:49.964829 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:49.965649 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:49.996642 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (0c679173-666f-45c2-9af4-7ceb8205d217), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.018345 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cd75174a-648a-41fe-be32-a58db388b131 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.3537738 Mar 24 02:12:50.019985 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9766f906-38c9-4da0-a906-c622f2e1c735 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:50.021746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56314) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:50.023377 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f435316-c418-499d-93c6-e251f5c7ae65 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:50.025531 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.029632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae16cbb-e345-40f5-a2f4-fb378f8324a9 req-5082dd7d-ca40-4d9a-abea-e0ae448808e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:50.029632 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-bae16cbb-e345-40f5-a2f4-fb378f8324a9 req-5082dd7d-ca40-4d9a-abea-e0ae448808e8 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 1129 time: 0.2980525 Mar 24 02:12:50.032316 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': '92009ae8-4e82-4a33-9746-06bbf72cb55c', 'ip_address': '2001:db8::41ff:58a3:8674:8dab'}], 'name': 'tempest-NetworksTestDHCPv6-318502893'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:50.043345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbd139c-6111-404a-8552-69b2e6776738 req-51107d39-1442-418d-a4ab-ddabbd5f6b78 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:50.045108 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ecbd139c-6111-404a-8552-69b2e6776738 req-51107d39-1442-418d-a4ab-ddabbd5f6b78 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 946 time: 0.4656982 Mar 24 02:12:50.070831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56316) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:50.071919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.077442 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] 10.222.0.20 "DELETE /v2.0/networks/e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc HTTP/1.1" status: 204 len: 168 time: 1.4618688 Mar 24 02:12:50.087124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e12eb8-941f-45e6-8ec6-e4260a631601 tempest-ExternalNetworksTestJSON-84002073 tempest-ExternalNetworksTestJSON-84002073-project] Pushing event deleted for resources: {'Network': ['ID=e7dbbfb4-14f5-48c8-a145-25c3ec2a19cc,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:50.107251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ca5487b0-1174-467c-bae1-dad7b54cd9eb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.127241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Request body: {'floatingip': {'port_id': 'dba04693-4495-4586-b5e4-7de9e3b2abd3'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:50.143865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ca5487b0-1174-467c-bae1-dad7b54cd9eb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.217535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for floatingip (a4d631f5-1e36-4cb9-a3b6-9fa1737e7397), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.217758 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca5487b0-1174-467c-bae1-dad7b54cd9eb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event updated for resources: {'Port': ['ID=6a530a05-1b64-47c0-9390-431917e2d4f0,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:50.271575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-df0ca72a-e651-40dc-a5fd-ee3732892275 None None] For port d3c95218-5c0f-456d-87a4-8e30632ecd58, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3c95218-5c0f-456d-87a4-8e30632ecd58,segment=NetworkSegment(ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e),segment_id=ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:50.272352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-df0ca72a-e651-40dc-a5fd-ee3732892275 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.313028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-df0ca72a-e651-40dc-a5fd-ee3732892275 None None] Calling delete_port for d3c95218-5c0f-456d-87a4-8e30632ecd58 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:50.374243 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-bae16cbb-e345-40f5-a2f4-fb378f8324a9 req-e952bca4-0692-4938-90b1-5c4035e08763 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2627277 Mar 24 02:12:50.400854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-ca5487b0-1174-467c-bae1-dad7b54cd9eb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] In _notify_port_updated(), no bound segment for port 6a530a05-1b64-47c0-9390-431917e2d4f0 on network b57330c4-af00-4735-8aae-7d7d77f8f136 {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:12:50.407523 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca5487b0-1174-467c-bae1-dad7b54cd9eb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:50.408307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ca5487b0-1174-467c-bae1-dad7b54cd9eb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.409756 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ca5487b0-1174-467c-bae1-dad7b54cd9eb tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "PUT /v2.0/ports/6a530a05-1b64-47c0-9390-431917e2d4f0 HTTP/1.1" status: 200 len: 1056 time: 1.4355886 Mar 24 02:12:50.414956 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56322) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:50.425126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9f435316-c418-499d-93c6-e251f5c7ae65 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:50.425497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.518095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Deleting port d3c95218-5c0f-456d-87a4-8e30632ecd58 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:50.518439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.521323 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '92009ae8-4e82-4a33-9746-06bbf72cb55c'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:12:50.522362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.645358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56326) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:50.674799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] For port d3c95218-5c0f-456d-87a4-8e30632ecd58, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3c95218-5c0f-456d-87a4-8e30632ecd58,segment=NetworkSegment(ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e),segment_id=ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:50.675167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.683907 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-df0ca72a-e651-40dc-a5fd-ee3732892275 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.689972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9f435316-c418-499d-93c6-e251f5c7ae65 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:50.692121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Calling delete_port for d3c95218-5c0f-456d-87a4-8e30632ecd58 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:50.698920 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.759670 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17220c59-e099-4f38-9395-ce45c9ec1ce4 req-2bd88311-3498-4e00-b481-0c1f1a45b675 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:50.767066 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-17220c59-e099-4f38-9395-ce45c9ec1ce4 req-2bd88311-3498-4e00-b481-0c1f1a45b675 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3973598 Mar 24 02:12:50.770467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df0ca72a-e651-40dc-a5fd-ee3732892275 None None] No DVR routers for this DVR port d3c95218-5c0f-456d-87a4-8e30632ecd58 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:12:50.775580 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df0ca72a-e651-40dc-a5fd-ee3732892275 None None] Pushing event deleted for resources: {'Port': ['ID=d3c95218-5c0f-456d-87a4-8e30632ecd58,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:50.799655 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b77318b6-3ba8-4b95-a6c4-3aef66a02691 None None] Provisioning complete for port 6a530a05-1b64-47c0-9390-431917e2d4f0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:50.800128 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b77318b6-3ba8-4b95-a6c4-3aef66a02691 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.801221 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (170decdb-939c-4bfe-a485-601df982102c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.805038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-ee40cbce-e05f-4e3b-bb8b-88b84cabcfc0 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Deleting port 6a530a05-1b64-47c0-9390-431917e2d4f0 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:50.805428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ee40cbce-e05f-4e3b-bb8b-88b84cabcfc0 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.838541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 9f435316-c418-499d-93c6-e251f5c7ae65, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f435316-c418-499d-93c6-e251f5c7ae65,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:50.863581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.901806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:50.923698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b77318b6-3ba8-4b95-a6c4-3aef66a02691 None None] Port 6a530a05-1b64-47c0-9390-431917e2d4f0 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:50.956057 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/92009ae8-4e82-4a33-9746-06bbf72cb55c/74ec5634-7068-4e1a-87ac-541b7983e145) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:50.960454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7cfaa63a-538d-427b-abe2-334429d28a57 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:12:50.976540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ee40cbce-e05f-4e3b-bb8b-88b84cabcfc0 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.980620 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d3c95218-5c0f-456d-87a4-8e30632ecd58), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:50.994895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=9f435316-c418-499d-93c6-e251f5c7ae65,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:50.999001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 7cfaa63a-538d-427b-abe2-334429d28a57 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:12:50.999289 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7cfaa63a-538d-427b-abe2-334429d28a57 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:12:51.022988 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-ee40cbce-e05f-4e3b-bb8b-88b84cabcfc0 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Calling delete_port for 6a530a05-1b64-47c0-9390-431917e2d4f0 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:51.029187 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event deleted for resources: {'Port': ['ID=d3c95218-5c0f-456d-87a4-8e30632ecd58,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:51.037801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] No DVR routers for this DVR port d3c95218-5c0f-456d-87a4-8e30632ecd58 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:12:51.181885 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Publish callbacks [] for port (74ec5634-7068-4e1a-87ac-541b7983e145), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.192503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.207591 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (0c679173-666f-45c2-9af4-7ceb8205d217), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.238097 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:51.242290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:51.242927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0c679173-666f-45c2-9af4-7ceb8205d217']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:51.245724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:51.256553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:51.257024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:51.272588 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.308569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Pushing event updated for resources: {'Port': ['ID=74ec5634-7068-4e1a-87ac-541b7983e145,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:51.314036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.325888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Releasing vlan 131 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:12:51.326258 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (ea6fbbb0-c65e-4793-bcf7-78b98aa2b08e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:12:51.329350 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:12:51.336795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Attempting to bind port 74ec5634-7068-4e1a-87ac-541b7983e145 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:51.337287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Attempting to bind port 74ec5634-7068-4e1a-87ac-541b7983e145 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:51.337756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Attempting to bind port 74ec5634-7068-4e1a-87ac-541b7983e145 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:51.343490 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:51.343854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:51.344360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.344852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:51.345415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Bound port: 74ec5634-7068-4e1a-87ac-541b7983e145, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:51.345909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.356404 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.385087 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ee40cbce-e05f-4e3b-bb8b-88b84cabcfc0 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6a530a05-1b64-47c0-9390-431917e2d4f0), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.421466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee40cbce-e05f-4e3b-bb8b-88b84cabcfc0 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event deleted for resources: {'Port': ['ID=6a530a05-1b64-47c0-9390-431917e2d4f0,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:51.423278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (0c679173-666f-45c2-9af4-7ceb8205d217), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.430844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.433855 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] 10.222.0.20 "DELETE /v2.0/networks/0c679173-666f-45c2-9af4-7ceb8205d217 HTTP/1.1" status: 204 len: 168 time: 1.6913812 Mar 24 02:12:51.464683 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6510e1de-fb83-449b-b925-d50bbf1be363 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364 tempest-ExtraDHCPOptionsIpV6TestJSON-570362364-project] Pushing event deleted for resources: {'Network': ['ID=0c679173-666f-45c2-9af4-7ceb8205d217,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:51.469333 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-17220c59-e099-4f38-9395-ce45c9ec1ce4 req-b16d9db6-d4d4-4205-80c1-8f6109745747 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7014081 Mar 24 02:12:51.470384 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] For port 74ec5634-7068-4e1a-87ac-541b7983e145, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:51.474929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] For port 74ec5634-7068-4e1a-87ac-541b7983e145, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=74ec5634-7068-4e1a-87ac-541b7983e145,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:51.489033 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.555845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port bb524409-2554-4e0a-b0d7-5a59a769634f yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:12:51.616674 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d4c0ba4-5bba-4a55-9d55-bc4e7ef5610f None None] Pushing event updated for resources: {'Port': ['ID=74ec5634-7068-4e1a-87ac-541b7983e145,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:51.848040 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ee40cbce-e05f-4e3b-bb8b-88b84cabcfc0 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:51.858828 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ee40cbce-e05f-4e3b-bb8b-88b84cabcfc0 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "DELETE /v2.0/ports/6a530a05-1b64-47c0-9390-431917e2d4f0 HTTP/1.1" status: 204 len: 168 time: 1.4421058 Mar 24 02:12:51.861390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56338) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:51.870048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56340) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:51.923431 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-5d91d12d-e195-45a9-92dc-106c3d36720e tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] GET failed (client error): The resource could not be found. Mar 24 02:12:51.927311 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5d91d12d-e195-45a9-92dc-106c3d36720e tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "GET /v2.0/ports/6a530a05-1b64-47c0-9390-431917e2d4f0 HTTP/1.1" status: 404 len: 333 time: 0.0625422 Mar 24 02:12:51.929252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56344) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:51.941123 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-80e85235-77d6-4bed-818c-e83b30e19f9d admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=737a577a40a54fa7965a296b4d18cbb4&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2902534 Mar 24 02:12:51.950348 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f435316-c418-499d-93c6-e251f5c7ae65 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:51.975450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56346) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:52.018038 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9f435316-c418-499d-93c6-e251f5c7ae65 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:52.018583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.116140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1c9c95-c56b-4619-a343-aba8b82e9dba req-c6e806cb-3d4c-4316-9df5-03348cc1e3c6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:52.124336 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dc1c9c95-c56b-4619-a343-aba8b82e9dba req-c6e806cb-3d4c-4316-9df5-03348cc1e3c6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 945 time: 1.1534443 Mar 24 02:12:52.141482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9f435316-c418-499d-93c6-e251f5c7ae65 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:52.145689 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-de7ea76c-4cf9-4d53-8814-aaf405507fd4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Deleting port 909bbf58-63e1-4dc6-b04f-12cd843c91c2 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:52.146211 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de7ea76c-4cf9-4d53-8814-aaf405507fd4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (909bbf58-63e1-4dc6-b04f-12cd843c91c2), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.149372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (170decdb-939c-4bfe-a485-601df982102c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.153947 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Publish callbacks [] for security_group (e937d7e3-3394-4d82-b956-dd0eab941b42), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.202632 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-234d72fa-16aa-4060-a41c-61273c8fffdf admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=9caabc535d3b4f50bb25aa525e01dd5f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3219647 Mar 24 02:12:52.204032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3c95218-5c0f-456d-87a4-8e30632ecd58 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:12:52.213036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56348) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:52.229160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d3c95218-5c0f-456d-87a4-8e30632ecd58 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:12:52.229854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3c95218-5c0f-456d-87a4-8e30632ecd58 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:12:52.260804 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Publish callbacks [] for security_group (e937d7e3-3394-4d82-b956-dd0eab941b42), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.321712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de7ea76c-4cf9-4d53-8814-aaf405507fd4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (909bbf58-63e1-4dc6-b04f-12cd843c91c2), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.338219 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-de7ea76c-4cf9-4d53-8814-aaf405507fd4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Calling delete_port for 909bbf58-63e1-4dc6-b04f-12cd843c91c2 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:52.359229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f43d79-86c6-4ff9-8381-d2141459304f req-0f24c09b-20aa-4446-9d34-ceb51669b339 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:52.361028 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-44f43d79-86c6-4ff9-8381-d2141459304f req-0f24c09b-20aa-4446-9d34-ceb51669b339 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.6325006 Mar 24 02:12:52.361609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6af58f2f-9a5e-4c51-8f13-9ffb7015e34f admin admin] Publish callbacks [] for security_group (633900fc-c0b1-46fe-b128-c6e70eca4ff9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.371443 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56350) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:52.391226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::41ff:58a3:8674:8dab (6f3080fc-791f-4748-a0a2-9eff6ea2a609/92009ae8-4e82-4a33-9746-06bbf72cb55c/bb524409-2554-4e0a-b0d7-5a59a769634f) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:12:52.406337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-aa6b9891-ba83-4651-bc71-7929cb4c2ebe tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Request body: {'floatingip': {'port_id': '23c422ed-55e0-408f-95ff-bc9d2619a936'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:52.409450 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dc1c9c95-c56b-4619-a343-aba8b82e9dba req-78360348-34cb-4a54-86f3-b274cce412dd tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2840545 Mar 24 02:12:52.428083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.db.resource_extend [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Mar 24 02:12:52.560762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.582678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (a4d631f5-1e36-4cb9-a3b6-9fa1737e7397), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.713817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e937d7e3-3394-4d82-b956-dd0eab941b42), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.716336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.717483 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/e937d7e3-3394-4d82-b956-dd0eab941b42 HTTP/1.1" status: 204 len: 168 time: 0.7407787 Mar 24 02:12:52.742265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6af58f2f-9a5e-4c51-8f13-9ffb7015e34f admin admin] Publish callbacks [] for security_group (633900fc-c0b1-46fe-b128-c6e70eca4ff9), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.749204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa6b9891-ba83-4651-bc71-7929cb4c2ebe tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for floatingip (55088382-7ea7-41f1-a0cb-71a22f16598d), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.762153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e937d7e3-3394-4d82-b956-dd0eab941b42,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:52.766149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Router 170decdb-939c-4bfe-a485-601df982102c is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:12:52.784532 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (bb524409-2554-4e0a-b0d7-5a59a769634f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.793190 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Floating IP a4d631f5-1e36-4cb9-a3b6-9fa1737e7397 associated. External IP: 172.26.2.66, port: dba04693-4495-4586-b5e4-7de9e3b2abd3. Mar 24 02:12:52.855966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.856348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.856684 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.857133 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.857507 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.858049 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.858846 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.858846 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.859339 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.859453 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.859751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.860073 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.860391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.860709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.861022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b21e269-810b-43c8-a9f7-41295f0f09eb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:52.922338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Provisioning complete for port 74ec5634-7068-4e1a-87ac-541b7983e145 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:52.923422 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.940041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6af58f2f-9a5e-4c51-8f13-9ffb7015e34f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (633900fc-c0b1-46fe-b128-c6e70eca4ff9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.944028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6af58f2f-9a5e-4c51-8f13-9ffb7015e34f admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:52.946397 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6af58f2f-9a5e-4c51-8f13-9ffb7015e34f admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/633900fc-c0b1-46fe-b128-c6e70eca4ff9 HTTP/1.1" status: 204 len: 168 time: 0.7324240 Mar 24 02:12:52.961953 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6af58f2f-9a5e-4c51-8f13-9ffb7015e34f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=633900fc-c0b1-46fe-b128-c6e70eca4ff9,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:53.105455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Current status of the port 74ec5634-7068-4e1a-87ac-541b7983e145 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:53.106546 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:53.138674 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de7ea76c-4cf9-4d53-8814-aaf405507fd4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (909bbf58-63e1-4dc6-b04f-12cd843c91c2), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:53.195568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56358) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:53.204711 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] For port 74ec5634-7068-4e1a-87ac-541b7983e145, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=74ec5634-7068-4e1a-87ac-541b7983e145,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:53.213332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:53.228283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de7ea76c-4cf9-4d53-8814-aaf405507fd4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event deleted for resources: {'Port': ['ID=909bbf58-63e1-4dc6-b04f-12cd843c91c2,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:53.296835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Pushing event updated for resources: {'Port': ['ID=74ec5634-7068-4e1a-87ac-541b7983e145,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:53.303286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (bb524409-2554-4e0a-b0d7-5a59a769634f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:53.320196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.320692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.321064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.321408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.321806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.322141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.322490 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.324591 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.324943 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.325282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.325671 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.326009 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.326334 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.326681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.327003 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-003878ed-e363-47b2-84ae-f51505d7af2c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.379883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:53.383828 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:53.393570 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Sync routers for ids ['170decdb-939c-4bfe-a485-601df982102c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:53.395242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:53.416420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Routers {'170decdb-939c-4bfe-a485-601df982102c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:53.419283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['170decdb-939c-4bfe-a485-601df982102c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:53.438624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:12:53.444461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:53.445335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:53.517037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=bb524409-2554-4e0a-b0d7-5a59a769634f,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:53.557837 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de7ea76c-4cf9-4d53-8814-aaf405507fd4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:53.562341 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-de7ea76c-4cf9-4d53-8814-aaf405507fd4 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "DELETE /v2.0/ports/909bbf58-63e1-4dc6-b04f-12cd843c91c2 HTTP/1.1" status: 204 len: 168 time: 1.6318171 Mar 24 02:12:53.570785 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.571143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.571491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.571833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.572169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.578542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.579135 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.579602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56368) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:53.580102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.581338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.581846 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.590327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.590831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.591184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.591524 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.591859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:12:53.601407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:53.605132 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dd2525a8-130d-45c8-b2cf-0c2eecedce80 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 6.1058648 Mar 24 02:12:53.624919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56372) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:53.656618 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-6668765d-45d6-4577-a970-97a1f2e6470c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] GET failed (client error): The resource could not be found. Mar 24 02:12:53.661320 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6668765d-45d6-4577-a970-97a1f2e6470c tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "GET /v2.0/ports/909bbf58-63e1-4dc6-b04f-12cd843c91c2 HTTP/1.1" status: 404 len: 333 time: 0.0774989 Mar 24 02:12:53.667557 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Set router 170decdb-939c-4bfe-a485-601df982102c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:53.670284 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2a5acb12-3da5-4242-a97a-8d6db8ccac86 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=b1bf23b03a854c86ad22a24cf8348ef2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4526334 Mar 24 02:12:53.672861 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56374) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:53.676086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56376) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:53.680684 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-51223be0-0542-4ce3-96ae-4e35c5cef6a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 3.6539822 Mar 24 02:12:53.719787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56378) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:53.926939 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-666cbe4e-774d-46c6-a34e-101ce9501c2d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/routers/170decdb-939c-4bfe-a485-601df982102c HTTP/1.1" status: 200 len: 907 time: 0.3003225 Mar 24 02:12:53.938561 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56384) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:53.938892 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d91aebc-4b7d-41f6-ba02-bdcba5ecea69 req-e791b423-68e4-490b-8457-baa54de3cdcf tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:53.946232 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2d91aebc-4b7d-41f6-ba02-bdcba5ecea69 req-e791b423-68e4-490b-8457-baa54de3cdcf tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 945 time: 0.3879204 Mar 24 02:12:53.950598 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:12:53.959034 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aecc55b4-31ed-409f-b8ab-44868783eed5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:53.965881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aecc55b4-31ed-409f-b8ab-44868783eed5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:53.969888 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-aecc55b4-31ed-409f-b8ab-44868783eed5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1686 time: 0.2468579 Mar 24 02:12:53.975558 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 74ec5634-7068-4e1a-87ac-541b7983e145 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:53.988981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56388) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:54.009070 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-66695b13-4382-4332-bfc4-07c1c89e78d7 None None] Provisioning complete for port bb524409-2554-4e0a-b0d7-5a59a769634f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:54.009450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-66695b13-4382-4332-bfc4-07c1c89e78d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (bb524409-2554-4e0a-b0d7-5a59a769634f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.073105 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '170decdb-939c-4bfe-a485-601df982102c', 'name': 'tempest-snat-router-229558191', 'tenant_id': 'de44dd991a01489cb0ad2761eac48843', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.217'}], 'enable_snat': True}, 'gw_port_id': '0355a4df-7c69-4b51-93f0-1a3e44aa4a20', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:12:47Z', 'updated_at': '2022-03-24T02:12:50Z', 'revision_number': 3, 'project_id': 'de44dd991a01489cb0ad2761eac48843', 'gw_port': {'id': '0355a4df-7c69-4b51-93f0-1a3e44aa4a20', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:73:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '170decdb-939c-4bfe-a485-601df982102c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:48Z', 'updated_at': '2022-03-24T02:12:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:54.080748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-66695b13-4382-4332-bfc4-07c1c89e78d7 None None] Port bb524409-2554-4e0a-b0d7-5a59a769634f cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:12:54.103428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa6b9891-ba83-4651-bc71-7929cb4c2ebe tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.118629 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa6b9891-ba83-4651-bc71-7929cb4c2ebe tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (55088382-7ea7-41f1-a0cb-71a22f16598d), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.136764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Checking router: 170decdb-939c-4bfe-a485-601df982102c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:54.137508 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Updating router 170decdb-939c-4bfe-a485-601df982102c port 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:12:54.171554 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2d91aebc-4b7d-41f6-ba02-bdcba5ecea69 req-d2a57506-f9bc-46d7-9d9c-85b62a4845dc tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2241817 Mar 24 02:12:54.185306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 74ec5634-7068-4e1a-87ac-541b7983e145 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:12:54.185689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.214051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.228460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (170decdb-939c-4bfe-a485-601df982102c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.246189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-1e85f2aa-874f-431c-a062-d3022b12cd3c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port bb524409-2554-4e0a-b0d7-5a59a769634f {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:54.246434 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1e85f2aa-874f-431c-a062-d3022b12cd3c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (bb524409-2554-4e0a-b0d7-5a59a769634f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.264777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56396) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:54.301814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:54.311117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.316840 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] Sync routers for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:54.333006 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:54.339690 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:54.403084 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0a9ae2b2-6bf0-422d-a66e-27de37ed4776 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "PUT /v2.0/floatingips/a4d631f5-1e36-4cb9-a3b6-9fa1737e7397 HTTP/1.1" status: 200 len: 991 time: 4.3136084 Mar 24 02:12:54.406857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'tag': 'dba04693-4495-4586-b5e4-7de9e3b2abd3'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:12:54.409355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13d9fd5a-7d79-4892-a68a-995b84c088ad" -d '{"events": [{"name": "network-changed", "server_uuid": "bb0721bf-38c2-46f0-8650-43fce951aa0f", "tag": "dba04693-4495-4586-b5e4-7de9e3b2abd3"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:12:54.429137 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 74ec5634-7068-4e1a-87ac-541b7983e145 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:12:54.437218 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1e85f2aa-874f-431c-a062-d3022b12cd3c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (bb524409-2554-4e0a-b0d7-5a59a769634f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.458195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f91996d1-778b-4e7b-b468-ea5f80897d36 req-c794b69a-ad39-437d-ab74-d53c4f8c963f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:54.460917 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f91996d1-778b-4e7b-b468-ea5f80897d36 req-c794b69a-ad39-437d-ab74-d53c4f8c963f tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 945 time: 0.1634550 Mar 24 02:12:54.476467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56404) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:54.494771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ac7197a7-6457-4921-b0b5-ada5ef396df7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Request body: {'floatingip': {'port_id': '3f03ca03-be93-4662-af2b-73bbfc93a9da'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:54.509026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1618076898'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:54.538726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-1e85f2aa-874f-431c-a062-d3022b12cd3c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for bb524409-2554-4e0a-b0d7-5a59a769634f owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:54.547722 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:12:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49b4ea0f-5f54-4180-8747-dc51e037fa33 x-openstack-request-id: req-49b4ea0f-5f54-4180-8747-dc51e037fa33 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:12:54.548007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bb0721bf-38c2-46f0-8650-43fce951aa0f", "tag": "dba04693-4495-4586-b5e4-7de9e3b2abd3", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:12:54.548263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-49b4ea0f-5f54-4180-8747-dc51e037fa33 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:12:54.548663 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-49b4ea0f-5f54-4180-8747-dc51e037fa33'] response: {'name': 'network-changed', 'server_uuid': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'tag': 'dba04693-4495-4586-b5e4-7de9e3b2abd3', 'status': 'completed', 'code': 200} Mar 24 02:12:54.550447 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:54.561598 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Publish callbacks [] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.570543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.588884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac7197a7-6457-4921-b0b5-ada5ef396df7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for floatingip (68838617-65cc-46a4-a440-36592cc8777d), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.629811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-882fcc17-1be7-4e2e-b78d-5aaabd824727 None None] Pushing event updated for resources: {'Port': ['ID=0355a4df-7c69-4b51-93f0-1a3e44aa4a20,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:54.666010 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Attempting to bind port 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:12:54.667196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Attempting to bind port 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:12:54.667562 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Attempting to bind port 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:12:54.682151 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:12:54.683157 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:12:54.683903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.684572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:12:54.685286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Bound port: 0355a4df-7c69-4b51-93f0-1a3e44aa4a20, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:12:54.685888 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.700600 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:54.703971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.709781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b7b69463-fd5b-4a83-a984-734bcd4546bb admin admin] Publish callbacks [] for security_group (a2e3681c-a454-4d41-bd49-4104ddf71985), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.729550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.732469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b7b69463-fd5b-4a83-a984-734bcd4546bb admin admin] Publish callbacks [] for security_group (a2e3681c-a454-4d41-bd49-4104ddf71985), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.755633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] For port 0355a4df-7c69-4b51-93f0-1a3e44aa4a20, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:12:54.759879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] For port 0355a4df-7c69-4b51-93f0-1a3e44aa4a20, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0355a4df-7c69-4b51-93f0-1a3e44aa4a20,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:12:54.769307 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.803593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5baf9d1b-1f33-410c-80e7-c677dff7a07c req-13d9eb50-2ab0-43ca-9b67-39c451fb4ee4 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:54.810653 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5baf9d1b-1f33-410c-80e7-c677dff7a07c req-13d9eb50-2ab0-43ca-9b67-39c451fb4ee4 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 946 time: 0.2699802 Mar 24 02:12:54.836605 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7b4eebf6-34bd-42f0-ae21-bc11f3ae69f2 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Deleting port 656939a5-20bf-4ccc-8416-e508e9b0aa95 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:54.837260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b4eebf6-34bd-42f0-ae21-bc11f3ae69f2 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (656939a5-20bf-4ccc-8416-e508e9b0aa95), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.840853 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-882fcc17-1be7-4e2e-b78d-5aaabd824727 None None] Pushing event updated for resources: {'Port': ['ID=0355a4df-7c69-4b51-93f0-1a3e44aa4a20,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:54.869896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Routers {'170decdb-939c-4bfe-a485-601df982102c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:54.875202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['170decdb-939c-4bfe-a485-601df982102c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:54.946120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-cf6e31b3-7767-49a1-a7a8-641ac54b8a61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:54.947947 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-cf6e31b3-7767-49a1-a7a8-641ac54b8a61 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d597f5a6c32e40b9b8f2e09949c6fcfd&device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 1130 time: 0.1819375 Mar 24 02:12:54.959754 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b7b69463-fd5b-4a83-a984-734bcd4546bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a2e3681c-a454-4d41-bd49-4104ddf71985), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.963223 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b7b69463-fd5b-4a83-a984-734bcd4546bb admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:54.965020 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b7b69463-fd5b-4a83-a984-734bcd4546bb admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/a2e3681c-a454-4d41-bd49-4104ddf71985 HTTP/1.1" status: 204 len: 168 time: 1.1886005 Mar 24 02:12:54.972191 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'a4d631f5-1e36-4cb9-a3b6-9fa1737e7397', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'floating_ip_address': '172.26.2.66', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'port_id': 'dba04693-4495-4586-b5e4-7de9e3b2abd3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 148, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'mac_address': 'fa:16:3e:ad:26:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:12:10Z', 'updated_at': '2022-03-24T02:12:52Z', 'revision_number': 1, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b446767-9204-4d09-bff9-fa3a72e03482', 'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'mac_address': 'fa:16:3e:8d:f5:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:01Z', 'updated_at': '2022-03-24T02:12:09Z', 'revision_number': 5, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'subnets': [{'id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:55.010714 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] Checking router: 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:55.010927 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5baf9d1b-1f33-410c-80e7-c677dff7a07c req-35f3a6e8-8ea0-4232-8bad-29c318d4d1cd tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1993127 Mar 24 02:12:55.035687 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:55.035687 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:55.119568 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-aa6b9891-ba83-4651-bc71-7929cb4c2ebe tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Floating IP 55088382-7ea7-41f1-a0cb-71a22f16598d associated. External IP: 172.26.2.33, port: 23c422ed-55e0-408f-95ff-bc9d2619a936. Mar 24 02:12:55.127354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for security_group (1e9612c6-d218-462e-9785-b176d6768c13), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.128339 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1e85f2aa-874f-431c-a062-d3022b12cd3c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (bb524409-2554-4e0a-b0d7-5a59a769634f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.153266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1e9612c6-d218-462e-9785-b176d6768c13), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.277453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e85f2aa-874f-431c-a062-d3022b12cd3c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=bb524409-2554-4e0a-b0d7-5a59a769634f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:55.313992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] Set router 170decdb-939c-4bfe-a485-601df982102c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:55.324687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b69463-fd5b-4a83-a984-734bcd4546bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2e3681c-a454-4d41-bd49-4104ddf71985,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:55.359385 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:55.386700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 136} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:12:55.396278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1e85f2aa-874f-431c-a062-d3022b12cd3c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.402574 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1e85f2aa-874f-431c-a062-d3022b12cd3c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/bb524409-2554-4e0a-b0d7-5a59a769634f HTTP/1.1" status: 204 len: 168 time: 1.4111834 Mar 24 02:12:55.404267 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56414) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:55.439170 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (170decdb-939c-4bfe-a485-601df982102c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.494185 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b4eebf6-34bd-42f0-ae21-bc11f3ae69f2 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (656939a5-20bf-4ccc-8416-e508e9b0aa95), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.509816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1e9612c6-d218-462e-9785-b176d6768c13,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:55.544893 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7b4eebf6-34bd-42f0-ae21-bc11f3ae69f2 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Calling delete_port for 656939a5-20bf-4ccc-8416-e508e9b0aa95 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:55.575911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.576254 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Added segment 41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe of type vlan for network e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 Mar 24 02:12:55.679543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '170decdb-939c-4bfe-a485-601df982102c', 'name': 'tempest-snat-router-229558191', 'tenant_id': 'de44dd991a01489cb0ad2761eac48843', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.217'}], 'enable_snat': True}, 'gw_port_id': '0355a4df-7c69-4b51-93f0-1a3e44aa4a20', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:12:47Z', 'updated_at': '2022-03-24T02:12:50Z', 'revision_number': 3, 'project_id': 'de44dd991a01489cb0ad2761eac48843', 'gw_port': {'id': '0355a4df-7c69-4b51-93f0-1a3e44aa4a20', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:73:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '170decdb-939c-4bfe-a485-601df982102c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:48Z', 'updated_at': '2022-03-24T02:12:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:55.688990 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09afec95-ca82-4225-8d48-fa4401159456 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:55.690321 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09afec95-ca82-4225-8d48-fa4401159456 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:55.695190 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-09afec95-ca82-4225-8d48-fa4401159456 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.2795882 Mar 24 02:12:55.697071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.705613 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56424) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:55.712090 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204ae966-05cf-4b47-aa93-5c15bb1add35 None None] The sync data for ids ['170decdb-939c-4bfe-a485-601df982102c'] in dv-neutron-834874-3-hyperv is: [{'id': '170decdb-939c-4bfe-a485-601df982102c', 'name': 'tempest-snat-router-229558191', 'tenant_id': 'de44dd991a01489cb0ad2761eac48843', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.217'}], 'enable_snat': True}, 'gw_port_id': '0355a4df-7c69-4b51-93f0-1a3e44aa4a20', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:12:47Z', 'updated_at': '2022-03-24T02:12:50Z', 'revision_number': 3, 'project_id': 'de44dd991a01489cb0ad2761eac48843', 'gw_port': {'id': '0355a4df-7c69-4b51-93f0-1a3e44aa4a20', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:73:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '170decdb-939c-4bfe-a485-601df982102c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:48Z', 'updated_at': '2022-03-24T02:12:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:55.712926 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-ae1685cb-689f-4234-b97b-11e8a03785c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:55.714427 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-ae1685cb-689f-4234-b97b-11e8a03785c5 service neutron] 10.222.0.30 "GET /v2.0/networks?id=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 HTTP/1.1" status: 200 len: 912 time: 0.7557759 Mar 24 02:12:55.795254 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'a4d631f5-1e36-4cb9-a3b6-9fa1737e7397', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'floating_ip_address': '172.26.2.66', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'port_id': 'dba04693-4495-4586-b5e4-7de9e3b2abd3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 148, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'mac_address': 'fa:16:3e:ad:26:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:12:10Z', 'updated_at': '2022-03-24T02:12:52Z', 'revision_number': 1, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b446767-9204-4d09-bff9-fa3a72e03482', 'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'mac_address': 'fa:16:3e:8d:f5:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:01Z', 'updated_at': '2022-03-24T02:12:09Z', 'revision_number': 5, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'subnets': [{'id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:55.824677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.830860 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:55.831473 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.863792 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-584857c6-9faa-431e-9d73-db7aada1ffe1 None None] The sync data for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv is: [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'a4d631f5-1e36-4cb9-a3b6-9fa1737e7397', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'floating_ip_address': '172.26.2.66', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'port_id': 'dba04693-4495-4586-b5e4-7de9e3b2abd3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 148, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'mac_address': 'fa:16:3e:ad:26:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:12:10Z', 'updated_at': '2022-03-24T02:12:52Z', 'revision_number': 1, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b446767-9204-4d09-bff9-fa3a72e03482', 'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'mac_address': 'fa:16:3e:8d:f5:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:01Z', 'updated_at': '2022-03-24T02:12:09Z', 'revision_number': 5, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'subnets': [{'id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:55.875300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-560310fb-71b3-411b-87d0-723277ce5592 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 92009ae8-4e82-4a33-9746-06bbf72cb55c {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:12:55.906634 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa6b9891-ba83-4651-bc71-7929cb4c2ebe tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Router 9c57e851-60dd-408a-bb81-1858bda320e9 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:12:55.911183 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.6436789 Mar 24 02:12:55.914468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-560310fb-71b3-411b-87d0-723277ce5592 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (92009ae8-4e82-4a33-9746-06bbf72cb55c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.971241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac7197a7-6457-4921-b0b5-ada5ef396df7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.972098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ccf947-44eb-46bf-99b6-8b24c58327c0 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Network': ['ID=e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:55.988345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac7197a7-6457-4921-b0b5-ada5ef396df7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (68838617-65cc-46a4-a440-36592cc8777d), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:55.992069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:12:56.019951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Deleting port 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:56.020230 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:56.134835 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-14433fa4-2794-4fb8-969a-dcc6f8620bea service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=dba04693-4495-4586-b5e4-7de9e3b2abd3 HTTP/1.1" status: 200 len: 999 time: 0.3762963 Mar 24 02:12:56.213815 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-ac7197a7-6457-4921-b0b5-ada5ef396df7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Floating IP 68838617-65cc-46a4-a440-36592cc8777d associated. External IP: 172.26.2.120, port: 3f03ca03-be93-4662-af2b-73bbfc93a9da. Mar 24 02:12:56.265409 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-560310fb-71b3-411b-87d0-723277ce5592 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (92009ae8-4e82-4a33-9746-06bbf72cb55c), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:56.438011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-ba81eb7c-a9e9-4641-8663-017ee754ebc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:56.439640 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-ba81eb7c-a9e9-4641-8663-017ee754ebc3 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dfc73b89-587b-4f56-aa2b-706a8f904224 HTTP/1.1" status: 200 len: 850 time: 0.2948544 Mar 24 02:12:56.492138 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] For port 0355a4df-7c69-4b51-93f0-1a3e44aa4a20, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0355a4df-7c69-4b51-93f0-1a3e44aa4a20,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:56.492491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:56.508985 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Calling delete_port for 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:56.535160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b24427e5-bfd5-49ca-9a90-fd32d9cff43f None None] New status for floating IP a4d631f5-1e36-4cb9-a3b6-9fa1737e7397: ACTIVE {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:12:56.680411 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa6b9891-ba83-4651-bc71-7929cb4c2ebe tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:56.692683 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] Sync routers for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:56.693257 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa6b9891-ba83-4651-bc71-7929cb4c2ebe tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:56.728842 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:56.731758 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:56.754051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ac7197a7-6457-4921-b0b5-ada5ef396df7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:12:56.791023 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-aa6b9891-ba83-4651-bc71-7929cb4c2ebe tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "PUT /v2.0/floatingips/55088382-7ea7-41f1-a0cb-71a22f16598d HTTP/1.1" status: 200 len: 991 time: 4.3786275 Mar 24 02:12:56.993034 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:57.076439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-560310fb-71b3-411b-87d0-723277ce5592 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (92009ae8-4e82-4a33-9746-06bbf72cb55c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:57.173003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'tag': '23c422ed-55e0-408f-95ff-bc9d2619a936'}] {{(pid=104036) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:12:57.178495 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d6177697792ca3fff01bbfc58b3e16cb8a22905a2f74e66d9151ebb6b50c8f9c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4da7cda-6427-464d-a5ea-59f0e3832a4e" -d '{"events": [{"name": "network-changed", "server_uuid": "0a447b1e-7d9a-43d6-8a64-8ff70a04f466", "tag": "23c422ed-55e0-408f-95ff-bc9d2619a936"}]}' {{(pid=104036) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:12:57.248666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-560310fb-71b3-411b-87d0-723277ce5592 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (92009ae8-4e82-4a33-9746-06bbf72cb55c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:57.253168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b4eebf6-34bd-42f0-ae21-bc11f3ae69f2 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (656939a5-20bf-4ccc-8416-e508e9b0aa95), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:57.360630 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ba6fad5e-e854-40f2-97fb-f7e6124a5bab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:57.520558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:12:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb6c9b0e-f6e4-4825-943c-d9a66fee5afc x-openstack-request-id: req-fb6c9b0e-f6e4-4825-943c-d9a66fee5afc {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:12:57.523875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0a447b1e-7d9a-43d6-8a64-8ff70a04f466", "tag": "23c422ed-55e0-408f-95ff-bc9d2619a936", "status": "completed", "code": 200}]} {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:12:57.524866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-fb6c9b0e-f6e4-4825-943c-d9a66fee5afc {{(pid=104036) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:12:57.526228 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fb6c9b0e-f6e4-4825-943c-d9a66fee5afc'] response: {'name': 'network-changed', 'server_uuid': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'tag': '23c422ed-55e0-408f-95ff-bc9d2619a936', 'status': 'completed', 'code': 200} Mar 24 02:12:57.528717 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '55088382-7ea7-41f1-a0cb-71a22f16598d', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'floating_ip_address': '172.26.2.33', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'port_id': '23c422ed-55e0-408f-95ff-bc9d2619a936', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 142, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'mac_address': 'fa:16:3e:4e:5e:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:12:09Z', 'updated_at': '2022-03-24T02:12:53Z', 'revision_number': 1, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a5a51e0-3aa4-497c-9582-6700ad4f221e', 'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'mac_address': 'fa:16:3e:e4:34:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:05Z', 'revision_number': 5, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'subnets': [{'id': '56374a24-4e35-434f-b4b8-860ef8289893', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:57.533680 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b4eebf6-34bd-42f0-ae21-bc11f3ae69f2 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event deleted for resources: {'Port': ['ID=656939a5-20bf-4ccc-8416-e508e9b0aa95,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:57.562317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-560310fb-71b3-411b-87d0-723277ce5592 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=92009ae8-4e82-4a33-9746-06bbf72cb55c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:57.591607 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-560310fb-71b3-411b-87d0-723277ce5592 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:57.601392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc6b705b-4b0b-468e-9741-a9d4f8cd70b9 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:57.604610 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-560310fb-71b3-411b-87d0-723277ce5592 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/92009ae8-4e82-4a33-9746-06bbf72cb55c HTTP/1.1" status: 204 len: 168 time: 1.8890083 Mar 24 02:12:57.608946 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] Checking router: 9c57e851-60dd-408a-bb81-1858bda320e9 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:57.614200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56452) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:57.629635 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:57.631500 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:57.720107 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b9a8e3-e698-4b05-83dc-1542e1a6545b req-f876cf46-5a86-47f9-ad15-b300b2a0e3d1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:57.720762 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-77b9a8e3-e698-4b05-83dc-1542e1a6545b req-f876cf46-5a86-47f9-ad15-b300b2a0e3d1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1225929 Mar 24 02:12:57.805170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56454) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:57.892359 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-da93773e-8b3a-4187-a78c-0ec3b6831625 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.2661161 Mar 24 02:12:57.906209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56458) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:57.921852 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-4096eee2-e6eb-46e3-973c-c0bac5af1a5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:57.927973 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-4096eee2-e6eb-46e3-973c-c0bac5af1a5e service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 1130 time: 0.2970512 Mar 24 02:12:57.936471 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:57.950042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:57.951724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0355a4df-7c69-4b51-93f0-1a3e44aa4a20), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:58.024853 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:12:58.088586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:12:58.089130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Mar 24 02:12:58.091117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c550a55a-1343-4838-8725-944ee55299b1 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:12:58.091293 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b4eebf6-34bd-42f0-ae21-bc11f3ae69f2 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:58.105302 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7b4eebf6-34bd-42f0-ae21-bc11f3ae69f2 tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "DELETE /v2.0/ports/656939a5-20bf-4ccc-8416-e508e9b0aa95 HTTP/1.1" status: 204 len: 168 time: 4.3277731 Mar 24 02:12:58.109624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-da594c81-eca4-465e-a7cf-4b3348af30cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:58.114480 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-da594c81-eca4-465e-a7cf-4b3348af30cb service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 1.4301770 Mar 24 02:12:58.115718 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56460) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:58.124809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event deleted for resources: {'Port': ['ID=0355a4df-7c69-4b51-93f0-1a3e44aa4a20,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:58.165229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Port 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 not found, will not notify nova. {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Mar 24 02:12:58.219221 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-77b9a8e3-e698-4b05-83dc-1542e1a6545b req-dca53b00-715d-4b92-aa33-3fac3cd39ed5 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4848635 Mar 24 02:12:58.220410 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac7197a7-6457-4921-b0b5-ada5ef396df7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:12:58.256444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] Sync routers for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:12:58.268901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac7197a7-6457-4921-b0b5-ada5ef396df7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:58.282240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:58.283034 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:58.287023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:58.408224 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-5990fc7d-d294-47c8-a570-7be6daef4f61 service neutron] 10.222.0.30 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2631898 Mar 24 02:12:58.417763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:58.514794 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '55088382-7ea7-41f1-a0cb-71a22f16598d', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'floating_ip_address': '172.26.2.33', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'port_id': '23c422ed-55e0-408f-95ff-bc9d2619a936', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 142, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'mac_address': 'fa:16:3e:4e:5e:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:12:09Z', 'updated_at': '2022-03-24T02:12:53Z', 'revision_number': 1, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a5a51e0-3aa4-497c-9582-6700ad4f221e', 'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'mac_address': 'fa:16:3e:e4:34:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:05Z', 'revision_number': 5, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'subnets': [{'id': '56374a24-4e35-434f-b4b8-860ef8289893', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:58.538710 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-9089e828-9e6c-4eff-99ad-fcd4417381ae tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Deleting subnet 14ee7600-4bf8-4bbb-b8f3-467531787f2d {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:12:58.553803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9089e828-9e6c-4eff-99ad-fcd4417381ae tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks [] for subnet (14ee7600-4bf8-4bbb-b8f3-467531787f2d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:58.599419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (170decdb-939c-4bfe-a485-601df982102c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:58.604271 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ac7197a7-6457-4921-b0b5-ada5ef396df7 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "PUT /v2.0/floatingips/68838617-65cc-46a4-a440-36592cc8777d HTTP/1.1" status: 200 len: 991 time: 4.1187263 Mar 24 02:12:58.605144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:58.606188 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-457b5ff6-5b12-40da-8e9f-5f20caf6d63d None None] The sync data for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv is: [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '55088382-7ea7-41f1-a0cb-71a22f16598d', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'floating_ip_address': '172.26.2.33', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'port_id': '23c422ed-55e0-408f-95ff-bc9d2619a936', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 142, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'mac_address': 'fa:16:3e:4e:5e:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:12:09Z', 'updated_at': '2022-03-24T02:12:53Z', 'revision_number': 1, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a5a51e0-3aa4-497c-9582-6700ad4f221e', 'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'mac_address': 'fa:16:3e:e4:34:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:05Z', 'revision_number': 5, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'subnets': [{'id': '56374a24-4e35-434f-b4b8-860ef8289893', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:12:58.624192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '65964499-8a52-4d24-90bb-505fb03cb88a', 'tag': '3f03ca03-be93-4662-af2b-73bbfc93a9da'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:12:58.640072 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f314f89c-9857-445d-9bf3-aec9a69116f0" -d '{"events": [{"name": "network-changed", "server_uuid": "65964499-8a52-4d24-90bb-505fb03cb88a", "tag": "3f03ca03-be93-4662-af2b-73bbfc93a9da"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:12:58.766883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:58.770502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:58.854012 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c550a55a-1343-4838-8725-944ee55299b1 None None] Deleting port 74ec5634-7068-4e1a-87ac-541b7983e145 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:12:58.854928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c550a55a-1343-4838-8725-944ee55299b1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:58.917857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-8b078096-96ca-40e9-b418-6f526fbd2eff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:58.924643 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-8b078096-96ca-40e9-b418-6f526fbd2eff service neutron] 10.222.0.30 "GET /v2.0/networks?id=597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 200 len: 913 time: 0.7287328 Mar 24 02:12:58.933848 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '68838617-65cc-46a4-a440-36592cc8777d', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'floating_ip_address': '172.26.2.120', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'port_id': '3f03ca03-be93-4662-af2b-73bbfc93a9da', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 196, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'mac_address': 'fa:16:3e:8e:7b:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65964499-8a52-4d24-90bb-505fb03cb88a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:12:25Z', 'updated_at': '2022-03-24T02:12:55Z', 'revision_number': 1, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c09745fa-b8dd-44bc-bd26-2ffd00f709e6', 'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'mac_address': 'fa:16:3e:82:8c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:05Z', 'updated_at': '2022-03-24T02:12:17Z', 'revision_number': 5, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'subnets': [{'id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:58.952882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d299925b-1bc7-4a52-8bf0-a5c7638aa4b0 req-f2f55976-fd0c-4721-8f15-3214cb3d660e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:58.964848 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d299925b-1bc7-4a52-8bf0-a5c7638aa4b0 req-f2f55976-fd0c-4721-8f15-3214cb3d660e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.5387049 Mar 24 02:12:58.968237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] Checking router: f52240e9-2e82-4113-abe0-f8b0dcb76cb1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:12:58.989138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:12:58.989918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:12:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:12:59.016685 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88c39828-ff6a-47a7-ac03-82b828bf41e8 None None] New status for floating IP 55088382-7ea7-41f1-a0cb-71a22f16598d: ACTIVE {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:12:59.175935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5611218-009e-4b1b-832d-59a4b39ef7a9 req-0cc3ed71-2e0e-4560-983f-b2e417d844d8 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:59.177531 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5611218-009e-4b1b-832d-59a4b39ef7a9 req-0cc3ed71-2e0e-4560-983f-b2e417d844d8 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 945 time: 0.4139147 Mar 24 02:12:59.188112 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-a0b50923-0516-4da1-aa8b-c5563e331e3f service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 200 len: 999 time: 0.2445323 Mar 24 02:12:59.256112 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56468) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:59.261809 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d299925b-1bc7-4a52-8bf0-a5c7638aa4b0 req-5d130233-6f86-4160-8471-2f3db56c1dd4 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2825871 Mar 24 02:12:59.286302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'subnet': {'network_id': 'e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:59.303361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9089e828-9e6c-4eff-99ad-fcd4417381ae tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (14ee7600-4bf8-4bbb-b8f3-467531787f2d), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.346804 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-7396f5aa-410d-49a0-b81c-878876555972 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:59.348409 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-7396f5aa-410d-49a0-b81c-878876555972 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=56374a24-4e35-434f-b4b8-860ef8289893 HTTP/1.1" status: 200 len: 851 time: 0.1484561 Mar 24 02:12:59.358995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:12:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-02e3a698-7daa-46f5-b9a8-d897136f28a7 x-openstack-request-id: req-02e3a698-7daa-46f5-b9a8-d897136f28a7 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:12:59.359488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "65964499-8a52-4d24-90bb-505fb03cb88a", "tag": "3f03ca03-be93-4662-af2b-73bbfc93a9da", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:12:59.359882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-02e3a698-7daa-46f5-b9a8-d897136f28a7 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:12:59.360425 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-02e3a698-7daa-46f5-b9a8-d897136f28a7'] response: {'name': 'network-changed', 'server_uuid': '65964499-8a52-4d24-90bb-505fb03cb88a', 'tag': '3f03ca03-be93-4662-af2b-73bbfc93a9da', 'status': 'completed', 'code': 200} Mar 24 02:12:59.369600 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5611218-009e-4b1b-832d-59a4b39ef7a9 req-1f129f84-5c5b-4929-b711-fdca58240306 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1792948 Mar 24 02:12:59.396353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c550a55a-1343-4838-8725-944ee55299b1 None None] For port 74ec5634-7068-4e1a-87ac-541b7983e145, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=74ec5634-7068-4e1a-87ac-541b7983e145,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:12:59.396461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (170decdb-939c-4bfe-a485-601df982102c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.396570 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c550a55a-1343-4838-8725-944ee55299b1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.400110 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_controller (170decdb-939c-4bfe-a485-601df982102c), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.410121 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c550a55a-1343-4838-8725-944ee55299b1 None None] Calling delete_port for 74ec5634-7068-4e1a-87ac-541b7983e145 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:12:59.506763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.519814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (b5f08dee-8285-4a00-baae-d1c98849f262), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.532567 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:12:59.551645 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9089e828-9e6c-4eff-99ad-fcd4417381ae tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (14ee7600-4bf8-4bbb-b8f3-467531787f2d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.560387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c550a55a-1343-4838-8725-944ee55299b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (74ec5634-7068-4e1a-87ac-541b7983e145), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.590722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c550a55a-1343-4838-8725-944ee55299b1 None None] Pushing event deleted for resources: {'Port': ['ID=74ec5634-7068-4e1a-87ac-541b7983e145,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:59.599192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c550a55a-1343-4838-8725-944ee55299b1 None None] No DVR routers for this DVR port 74ec5634-7068-4e1a-87ac-541b7983e145 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:12:59.616998 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-70ef377d-8f05-424a-aad5-c8de4624d7a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:59.619383 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-70ef377d-8f05-424a-aad5-c8de4624d7a9 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=597625fc-4c02-4901-9b3e-46b781f61da1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.2524781 Mar 24 02:12:59.630142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:12:59.645996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-0a0b0b31-efe5-41a1-ae42-8273c17eebda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:59.646941 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-0a0b0b31-efe5-41a1-ae42-8273c17eebda service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=70b00ff8787a4049967d01e358be86c2&device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 1129 time: 0.2214203 Mar 24 02:12:59.653073 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:12:59.667631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ceb051f8-e1de-470f-a2dc-e30d3d72defd None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:12:59.688961 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-13d9fd5a-7d79-4892-a68a-995b84c088ad req-6ca8751d-1ea0-479b-8341-8f0216b95b2b service neutron] 10.222.0.30 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.2425747 Mar 24 02:12:59.698357 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:12:59.702199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.708250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (170decdb-939c-4bfe-a485-601df982102c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.708751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 170decdb-939c-4bfe-a485-601df982102c {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:12:59.730591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:12:59.731262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.733703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=b5f08dee-8285-4a00-baae-d1c98849f262,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:59.767491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.768624 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-58c97400-d2e1-46b5-bd70-6dd380746282 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "DELETE /v2.0/routers/170decdb-939c-4bfe-a485-601df982102c HTTP/1.1" status: 204 len: 168 time: 5.8282692 Mar 24 02:12:59.776992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9089e828-9e6c-4eff-99ad-fcd4417381ae tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (14ee7600-4bf8-4bbb-b8f3-467531787f2d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.778236 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56474) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:59.840808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9089e828-9e6c-4eff-99ad-fcd4417381ae tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event deleted for resources: {'Subnet': ['ID=14ee7600-4bf8-4bbb-b8f3-467531787f2d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:12:59.899604 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b5b5d413-d7fa-4b05-83b6-b8754bc452b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.9661419 Mar 24 02:12:59.906157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56476) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:59.921292 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': 'b5f08dee-8285-4a00-baae-d1c98849f262', 'ip_address': '2001:db8::e69b:63ce:56e:5ef3'}], 'name': 'tempest-NetworksTestDHCPv6-530433575'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:12:59.943666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9089e828-9e6c-4eff-99ad-fcd4417381ae tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.946865 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9089e828-9e6c-4eff-99ad-fcd4417381ae tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "DELETE /v2.0/subnets/14ee7600-4bf8-4bbb-b8f3-467531787f2d HTTP/1.1" status: 204 len: 168 time: 1.8293645 Mar 24 02:12:59.951235 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56478) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:12:59.955482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': 'b5f08dee-8285-4a00-baae-d1c98849f262'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:12:59.956658 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:12:59.965695 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8fa270f-e61d-4a6f-a34c-d89509a2df45 None None] Network b57330c4-af00-4735-8aae-7d7d77f8f136 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:00.010746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (6734957d-912d-40f2-aecb-59fbd65994f8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.021148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Allocated IP 172.26.2.26 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/549c3fcd-27af-43b5-8d1b-bae79b616201) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:00.037635 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-ee9a9f03-833e-41cc-a955-cbbca7b4a9bd service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4063649 Mar 24 02:13:00.098632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-7a9c81fb-8cd5-485b-b00f-ad146ec4de56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:00.099889 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-7a9c81fb-8cd5-485b-b00f-ad146ec4de56 service neutron] 10.222.0.30 "GET /v2.0/networks?id=d91de7c3-7e46-4c9d-8b0a-c988de7fd81b HTTP/1.1" status: 200 len: 907 time: 0.4324090 Mar 24 02:13:00.180597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '68838617-65cc-46a4-a440-36592cc8777d', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'floating_ip_address': '172.26.2.120', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'port_id': '3f03ca03-be93-4662-af2b-73bbfc93a9da', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 196, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'mac_address': 'fa:16:3e:8e:7b:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65964499-8a52-4d24-90bb-505fb03cb88a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:12:25Z', 'updated_at': '2022-03-24T02:12:55Z', 'revision_number': 1, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c09745fa-b8dd-44bc-bd26-2ffd00f709e6', 'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'mac_address': 'fa:16:3e:82:8c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:05Z', 'updated_at': '2022-03-24T02:12:17Z', 'revision_number': 5, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'subnets': [{'id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:00.194999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (b57330c4-af00-4735-8aae-7d7d77f8f136), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.233834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c0255f3-c8b2-4b67-b935-1435fb8d360a None None] The sync data for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv is: [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '68838617-65cc-46a4-a440-36592cc8777d', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'floating_ip_address': '172.26.2.120', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'port_id': '3f03ca03-be93-4662-af2b-73bbfc93a9da', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 196, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'mac_address': 'fa:16:3e:8e:7b:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65964499-8a52-4d24-90bb-505fb03cb88a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:12:25Z', 'updated_at': '2022-03-24T02:12:55Z', 'revision_number': 1, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c09745fa-b8dd-44bc-bd26-2ffd00f709e6', 'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'mac_address': 'fa:16:3e:82:8c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:05Z', 'updated_at': '2022-03-24T02:12:17Z', 'revision_number': 5, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'subnets': [{'id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:00.264492 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-34f182b0-b694-4714-b797-ae9afa2d6446 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3f03ca03-be93-4662-af2b-73bbfc93a9da HTTP/1.1" status: 200 len: 999 time: 0.1584017 Mar 24 02:13:00.282831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/b5f08dee-8285-4a00-baae-d1c98849f262/2913c88a-402b-4514-9681-a637d61013dc) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:00.355989 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-4290cd65-81d0-4b81-adc1-af584e3c9ba2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:00.367491 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-4290cd65-81d0-4b81-adc1-af584e3c9ba2 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=02cc6c6a-e353-4d82-9d85-3973d8220a39 HTTP/1.1" status: 200 len: 845 time: 0.0910470 Mar 24 02:13:00.380703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1eecd7b-0104-41b3-b5dc-805f438329e5 None None] DHCP port deletion for b57330c4-af00-4735-8aae-7d7d77f8f136 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:00.383170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 74ec5634-7068-4e1a-87ac-541b7983e145 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:00.402091 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (6734957d-912d-40f2-aecb-59fbd65994f8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.420376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 74ec5634-7068-4e1a-87ac-541b7983e145 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:00.420376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 74ec5634-7068-4e1a-87ac-541b7983e145 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:00.478108 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Deleting port 5c554f4c-8591-4d3e-bc06-bec64a955886 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:00.478446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.480910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.501175 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e7e396c1-5eb0-46cc-8f0c-b259086f1c6f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.507742 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4da7cda-6427-464d-a5ea-59f0e3832a4e req-d54c71ff-e12c-4f70-a031-5d7380df519e service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4585521 Mar 24 02:13:00.518676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:00.568643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a1eecd7b-0104-41b3-b5dc-805f438329e5 None None] Deleting port 5c554f4c-8591-4d3e-bc06-bec64a955886 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:00.569905 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a1eecd7b-0104-41b3-b5dc-805f438329e5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.589176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks [] for port (549c3fcd-27af-43b5-8d1b-bae79b616201), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.628085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Subnet': ['ID=fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:00.636057 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Publish callbacks [] for port (2913c88a-402b-4514-9681-a637d61013dc), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.654982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (2913c88a-402b-4514-9681-a637d61013dc), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.656495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-df320e08-0c2c-4810-8e94-05ec888a9357 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:00.658124 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-df320e08-0c2c-4810-8e94-05ec888a9357 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=d91de7c3-7e46-4c9d-8b0a-c988de7fd81b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.2786055 Mar 24 02:13:00.677147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6503f087-d868-41f1-99fc-c6761cb3d6d0 req-4540b216-9b3a-47fc-94f3-9b52363c2d99 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:00.679409 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6503f087-d868-41f1-99fc-c6761cb3d6d0 req-4540b216-9b3a-47fc-94f3-9b52363c2d99 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2554948 Mar 24 02:13:00.681267 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Deleting port 9f435316-c418-499d-93c6-e251f5c7ae65 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:00.681891 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.699165 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] For port 5c554f4c-8591-4d3e-bc06-bec64a955886, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5c554f4c-8591-4d3e-bc06-bec64a955886,segment=NetworkSegment(2dcf15f9-148f-4ffe-b942-f75d792de49b),segment_id=2dcf15f9-148f-4ffe-b942-f75d792de49b)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:00.699530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.730187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Pushing event updated for resources: {'Port': ['ID=2913c88a-402b-4514-9681-a637d61013dc,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:00.743738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:00.744148 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Checking segment: {'id': '41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:00.744507 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network hostable DHCP agents. Network: e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:00.749455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:00.754229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f9c56dc-39e8-4e38-b049-b45315af4c13 None None] New status for floating IP 68838617-65cc-46a4-a440-36592cc8777d: ACTIVE {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:13:00.757512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Calling delete_port for 5c554f4c-8591-4d3e-bc06-bec64a955886 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:00.758163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.769402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:00.778142 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a1eecd7b-0104-41b3-b5dc-805f438329e5 None None] For port 5c554f4c-8591-4d3e-bc06-bec64a955886, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5c554f4c-8591-4d3e-bc06-bec64a955886,segment=NetworkSegment(2dcf15f9-148f-4ffe-b942-f75d792de49b),segment_id=2dcf15f9-148f-4ffe-b942-f75d792de49b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:00.778142 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a1eecd7b-0104-41b3-b5dc-805f438329e5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.844788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (549c3fcd-27af-43b5-8d1b-bae79b616201), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.851678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:00.853960 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a1eecd7b-0104-41b3-b5dc-805f438329e5 None None] Calling delete_port for 5c554f4c-8591-4d3e-bc06-bec64a955886 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:00.867763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 02521872-da9a-4dc8-beff-07719679c5df yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:00.885550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.892679 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] For port 9f435316-c418-499d-93c6-e251f5c7ae65, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f435316-c418-499d-93c6-e251f5c7ae65,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:00.893032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.895470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:00.900565 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:00.900899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:00.910573 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-89687aa3-d286-4844-a99c-db2570a8fab4 service neutron] 10.222.0.30 "GET /v2.0/networks/d91de7c3-7e46-4c9d-8b0a-c988de7fd81b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2288837 Mar 24 02:13:00.914756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97c18d16-c7a6-40b4-9d3d-43a74abc8eaa None None] Network e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:00.925682 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7231050c-9a39-46ce-998a-2b1414b8ce87 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.6655078 Mar 24 02:13:00.931785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56482) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:00.933868 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Calling delete_port for 9f435316-c418-499d-93c6-e251f5c7ae65 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:00.939858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-641548483'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:00.978934 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6503f087-d868-41f1-99fc-c6761cb3d6d0 req-7ff71fd6-4316-45da-8ec7-7d17ececb2ca tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2703195 Mar 24 02:13:00.980588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:01.006992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.014067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:01.017348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.021779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:01.034208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:01.050818 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Attempting to bind port 2913c88a-402b-4514-9681-a637d61013dc on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:01.051408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Attempting to bind port 2913c88a-402b-4514-9681-a637d61013dc by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:01.051408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Attempting to bind port 2913c88a-402b-4514-9681-a637d61013dc on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:01.057441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event deleted for resources: {'Port': ['ID=5c554f4c-8591-4d3e-bc06-bec64a955886,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:01.061702 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] No DVR routers for this DVR port 5c554f4c-8591-4d3e-bc06-bec64a955886 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:01.065907 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Pushing event updated for resources: {'Port': ['ID=549c3fcd-27af-43b5-8d1b-bae79b616201,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:01.074825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:01.075208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:01.075600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.075987 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:01.076468 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Bound port: 2913c88a-402b-4514-9681-a637d61013dc, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:01.076848 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2913c88a-402b-4514-9681-a637d61013dc), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.145798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 101} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:01.214090 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (b57330c4-af00-4735-8aae-7d7d77f8f136), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.217322 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (c74b6e6a-8270-4d17-bc9f-5ebaa34fca20), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.217660 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Added segment c74b6e6a-8270-4d17-bc9f-5ebaa34fca20 of type vlan for network 85ea4ade-99a4-4f64-93f5-a2a5102bff1f Mar 24 02:13:01.289931 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b57330c4-af00-4735-8aae-7d7d77f8f136']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:01.304295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (85ea4ade-99a4-4f64-93f5-a2a5102bff1f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.332869 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2dcf15f9-148f-4ffe-b942-f75d792de49b') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:01.333264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2dcf15f9-148f-4ffe-b942-f75d792de49b') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:01.352890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (2dcf15f9-148f-4ffe-b942-f75d792de49b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.375806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a1eecd7b-0104-41b3-b5dc-805f438329e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (5c554f4c-8591-4d3e-bc06-bec64a955886), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.383978 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418', 'network_id': 'e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418', 'project_id': '0a478f43194148c295b3c5808a7fb554', 'fixed_ips': [{'subnet_id': 'fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:01.386391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.389731 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (2dcf15f9-148f-4ffe-b942-f75d792de49b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.402770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (85ea4ade-99a4-4f64-93f5-a2a5102bff1f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.409166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:01.409846 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.422946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (9f435316-c418-499d-93c6-e251f5c7ae65), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.425181 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Releasing vlan 108 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:01.425568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (2dcf15f9-148f-4ffe-b942-f75d792de49b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.427508 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] For port 2913c88a-402b-4514-9681-a637d61013dc, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:01.430165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1eecd7b-0104-41b3-b5dc-805f438329e5 None None] Pushing event deleted for resources: {'Port': ['ID=5c554f4c-8591-4d3e-bc06-bec64a955886,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:01.442984 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:01.445241 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1eecd7b-0104-41b3-b5dc-805f438329e5 None None] No DVR routers for this DVR port 5c554f4c-8591-4d3e-bc06-bec64a955886 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:01.452150 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] For port 2913c88a-402b-4514-9681-a637d61013dc, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2913c88a-402b-4514-9681-a637d61013dc,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:01.469447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2913c88a-402b-4514-9681-a637d61013dc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.480286 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f314f89c-9857-445d-9bf3-aec9a69116f0 req-9e06a0a5-ccd0-4f87-a406-f8f528d6cf6a service neutron] 10.222.0.30 "GET /v2.0/networks/d91de7c3-7e46-4c9d-8b0a-c988de7fd81b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5305791 Mar 24 02:13:01.515865 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::e69b:63ce:56e:5ef3 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/b5f08dee-8285-4a00-baae-d1c98849f262/02521872-da9a-4dc8-beff-07719679c5df) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:01.521648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks [] for floatingip (0643b8b7-348f-4260-8475-30d8644a9e6b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.590203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (549c3fcd-27af-43b5-8d1b-bae79b616201), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.599462 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.6666124 Mar 24 02:13:01.600358 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event deleted for resources: {'Port': ['ID=9f435316-c418-499d-93c6-e251f5c7ae65,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:01.602068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56484) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:01.626342 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'subnet': {'network_id': '85ea4ade-99a4-4f64-93f5-a2a5102bff1f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:01.652334 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af75083-04ec-4c87-9854-73d8f674d040 None None] Pushing event updated for resources: {'Port': ['ID=2913c88a-402b-4514-9681-a637d61013dc,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:01.693360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Allocated IP 2001:db8:0:ffff::2 (e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418/fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d/3cbcc90c-9b98-40db-bfa7-656d69fa744d) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:01.743995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60621c0c-24b9-4550-94aa-638bb424da81 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Network': ['ID=85ea4ade-99a4-4f64-93f5-a2a5102bff1f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:01.758218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (b57330c4-af00-4735-8aae-7d7d77f8f136), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.778751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.781975 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] 10.222.0.20 "DELETE /v2.0/networks/b57330c4-af00-4735-8aae-7d7d77f8f136 HTTP/1.1" status: 204 len: 168 time: 1.8284304 Mar 24 02:13:01.799643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 85ea4ade-99a4-4f64-93f5-a2a5102bff1f details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:01.835866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c2bac3-38d7-40cd-ac12-9824d080f37a tempest-AllowedAddressPairTestJSON-1905637747 tempest-AllowedAddressPairTestJSON-1905637747-project] Pushing event deleted for resources: {'Network': ['ID=b57330c4-af00-4735-8aae-7d7d77f8f136,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:01.841662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (02521872-da9a-4dc8-beff-07719679c5df), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.851385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (6734957d-912d-40f2-aecb-59fbd65994f8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.985152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks [] for port (549c3fcd-27af-43b5-8d1b-bae79b616201), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:01.993291 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (549c3fcd-27af-43b5-8d1b-bae79b616201), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.052050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:02.052050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.065224 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (02521872-da9a-4dc8-beff-07719679c5df), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.098644 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Publish callbacks [] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.108473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (6734957d-912d-40f2-aecb-59fbd65994f8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.110141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:02.111145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_controller (6734957d-912d-40f2-aecb-59fbd65994f8), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.118456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.147262 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:02.147892 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0355a4df-7c69-4b51-93f0-1a3e44aa4a20 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:02.149596 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5c554f4c-8591-4d3e-bc06-bec64a955886 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:02.150197 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:02.154199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Pushing event updated for resources: {'Port': ['ID=549c3fcd-27af-43b5-8d1b-bae79b616201,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:02.187917 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:02.191064 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:02.198238 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:02.199038 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.204468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (6734957d-912d-40f2-aecb-59fbd65994f8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.205328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 6734957d-912d-40f2-aecb-59fbd65994f8 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:02.216890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Network e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:02.220720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:02.222908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 5c554f4c-8591-4d3e-bc06-bec64a955886 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:02.223407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5c554f4c-8591-4d3e-bc06-bec64a955886 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:02.231896 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 946 time: 2.3225415 Mar 24 02:13:02.239449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:02.254578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56492) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:02.258359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.263624 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a1413ecb-76f6-4683-9a14-00c18174b689 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "DELETE /v2.0/routers/6734957d-912d-40f2-aecb-59fbd65994f8 HTTP/1.1" status: 204 len: 168 time: 2.4316802 Mar 24 02:13:02.273869 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56496) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:02.276816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (0643b8b7-348f-4260-8475-30d8644a9e6b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.278811 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-288139074', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:02.310654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Pushing event updated for resources: {'Port': ['ID=3cbcc90c-9b98-40db-bfa7-656d69fa744d,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:02.343326 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (5ae6b345-443c-4040-84bd-8c9058264436), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.344315 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (5ae6b345-443c-4040-84bd-8c9058264436), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.348078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c47adf8e-f797-4f8b-8322-18563c568e53 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=02521872-da9a-4dc8-beff-07719679c5df,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:02.349868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Attempting to bind port 3cbcc90c-9b98-40db-bfa7-656d69fa744d on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:02.350659 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Attempting to bind port 3cbcc90c-9b98-40db-bfa7-656d69fa744d by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:02.351190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Attempting to bind port 3cbcc90c-9b98-40db-bfa7-656d69fa744d on network e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:02.366446 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.371732 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9f008812-7f71-45c4-b1fa-646e15ef3de4 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.5542638 Mar 24 02:13:02.371931 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56498) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:02.385938 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Request body: {'port': {'name': 'tempest-ExternalNetworksAdminNegativeTestJSON-620571682', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'fixed_ips': [{'ip_address': '172.26.2.26'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:02.387624 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:02.387965 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02cd16d7-5e3f-4500-b480-ec11b9fb5af9 req-616d7ce0-2d47-4625-ac21-a08d84a8c3fd tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:02.388519 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Checking segment: {'id': '41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:02.389336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.389720 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-02cd16d7-5e3f-4500-b480-ec11b9fb5af9 req-616d7ce0-2d47-4625-ac21-a08d84a8c3fd tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2569282 Mar 24 02:13:02.396846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Bound using segment: {'id': '41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:02.398832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Bound port: 3cbcc90c-9b98-40db-bfa7-656d69fa744d, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:02.399548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.410254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49976384-980e-4207-be99-9d38dcd886ff tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:02.410604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.416496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49976384-980e-4207-be99-9d38dcd886ff tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:02.420583 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-49976384-980e-4207-be99-9d38dcd886ff tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1683 time: 0.1607308 Mar 24 02:13:02.426414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56500) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:02.465080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56502) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:02.477337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] For port 3cbcc90c-9b98-40db-bfa7-656d69fa744d, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:02.478641 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-02cd16d7-5e3f-4500-b480-ec11b9fb5af9 req-c51328da-08b5-4f20-814a-188251872e2c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0809169 Mar 24 02:13:02.493527 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] For port 3cbcc90c-9b98-40db-bfa7-656d69fa744d, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3cbcc90c-9b98-40db-bfa7-656d69fa744d,segment=NetworkSegment(41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe),segment_id=41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:02.502350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.534757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (5ae6b345-443c-4040-84bd-8c9058264436), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.583196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37f97b48-35bb-4e3e-b37d-f56281935930 None None] Pushing event updated for resources: {'Port': ['ID=3cbcc90c-9b98-40db-bfa7-656d69fa744d,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:02.660111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b265137-e918-4107-b905-a3439e55e646 req-d488d686-2413-4e8e-bb3a-437d18dd5c64 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:02.668621 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6b265137-e918-4107-b905-a3439e55e646 req-d488d686-2413-4e8e-bb3a-437d18dd5c64 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1048362 Mar 24 02:13:02.758584 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6b265137-e918-4107-b905-a3439e55e646 req-c6a70957-c2bd-477e-94d8-30d344e04d1a tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0798063 Mar 24 02:13:02.758584 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2b6e124a-a978-44c1-adb2-dc769c26de56 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=a3f362c54abc4116a2d8ae1cbdbafe9b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2916746 Mar 24 02:13:02.762951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56508) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:02.839117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b860f26b-04cb-4458-96d5-aa11bd723319 admin admin] Publish callbacks [] for security_group (da312a2a-398a-41dd-9893-fd7e702eed0c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.876481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b860f26b-04cb-4458-96d5-aa11bd723319 admin admin] Publish callbacks [] for security_group (da312a2a-398a-41dd-9893-fd7e702eed0c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.945862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b860f26b-04cb-4458-96d5-aa11bd723319 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (da312a2a-398a-41dd-9893-fd7e702eed0c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.949992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b860f26b-04cb-4458-96d5-aa11bd723319 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:02.953637 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b860f26b-04cb-4458-96d5-aa11bd723319 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/da312a2a-398a-41dd-9893-fd7e702eed0c HTTP/1.1" status: 204 len: 168 time: 0.1871581 Mar 24 02:13:02.967372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b860f26b-04cb-4458-96d5-aa11bd723319 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da312a2a-398a-41dd-9893-fd7e702eed0c,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:03.007911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Made reservation on behalf of 6c227ff3ce184b0b8246e0685b879cb0 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:03.021291 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.063084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.166262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-643f1050-a05b-45dd-aa68-e46505eaa3a4 req-486fb2f2-0aa0-4f3d-9c06-fb4ecbbf3eda tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:03.167960 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-643f1050-a05b-45dd-aa68-e46505eaa3a4 req-486fb2f2-0aa0-4f3d-9c06-fb4ecbbf3eda tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.0975239 Mar 24 02:13:03.232531 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (5ae6b345-443c-4040-84bd-8c9058264436), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.237032 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-643f1050-a05b-45dd-aa68-e46505eaa3a4 req-86d51508-9c05-443b-9b11-8526be19707c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0605381 Mar 24 02:13:03.312306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0d302499-b307-4c11-9b91-1f9fbc987085 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 02521872-da9a-4dc8-beff-07719679c5df {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:03.312625 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d302499-b307-4c11-9b91-1f9fbc987085 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (02521872-da9a-4dc8-beff-07719679c5df), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.442286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-50863149-3ff9-490f-ba21-78c14e0fa440 None None] Provisioning complete for port 2913c88a-402b-4514-9681-a637d61013dc triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:03.443495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-50863149-3ff9-490f-ba21-78c14e0fa440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2913c88a-402b-4514-9681-a637d61013dc), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.501034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:13:03.502465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (b95f1f2f-b31b-4f68-b502-9909e35405ba), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.563593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-50863149-3ff9-490f-ba21-78c14e0fa440 None None] Current status of the port 2913c88a-402b-4514-9681-a637d61013dc is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:03.564233 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-50863149-3ff9-490f-ba21-78c14e0fa440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2913c88a-402b-4514-9681-a637d61013dc), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.625971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks [] for security_group (5c41f506-36a5-4e66-868b-b670ea1b20f5), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.636975 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-50863149-3ff9-490f-ba21-78c14e0fa440 None None] For port 2913c88a-402b-4514-9681-a637d61013dc, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2913c88a-402b-4514-9681-a637d61013dc,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:03.646373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-50863149-3ff9-490f-ba21-78c14e0fa440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2913c88a-402b-4514-9681-a637d61013dc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.666622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d302499-b307-4c11-9b91-1f9fbc987085 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (02521872-da9a-4dc8-beff-07719679c5df), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.691270 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0d302499-b307-4c11-9b91-1f9fbc987085 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 02521872-da9a-4dc8-beff-07719679c5df owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:03.701229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Subnet': ['ID=b95f1f2f-b31b-4f68-b502-9909e35405ba,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:03.719964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (5c41f506-36a5-4e66-868b-b670ea1b20f5), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.723715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] device_id is not set on port b37fed17-450e-45d4-bed3-36a5cfed9f84 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:03.751991 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.800122 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50863149-3ff9-490f-ba21-78c14e0fa440 None None] Pushing event updated for resources: {'Port': ['ID=2913c88a-402b-4514-9681-a637d61013dc,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:03.815725 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-78d4f112-5d73-4d3d-9016-8dc0b893a200 None None] Provisioning complete for port 02521872-da9a-4dc8-beff-07719679c5df triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:03.816269 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-78d4f112-5d73-4d3d-9016-8dc0b893a200 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (02521872-da9a-4dc8-beff-07719679c5df), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:03.902294 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-78d4f112-5d73-4d3d-9016-8dc0b893a200 None None] Port 02521872-da9a-4dc8-beff-07719679c5df cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:03.990461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e06b3a5-31e5-44b3-91a3-4cbb1fa703d5 req-4fe15f98-307b-48b1-b971-ec36d8fcf88b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:03.992989 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6e06b3a5-31e5-44b3-91a3-4cbb1fa703d5 req-4fe15f98-307b-48b1-b971-ec36d8fcf88b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1388988 Mar 24 02:13:04.016622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Checking segment: {'id': 'c74b6e6a-8270-4d17-bc9f-5ebaa34fca20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '85ea4ade-99a4-4f64-93f5-a2a5102bff1f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:04.017206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network hostable DHCP agents. Network: 85ea4ade-99a4-4f64-93f5-a2a5102bff1f, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:04.030843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c41f506-36a5-4e66-868b-b670ea1b20f5,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:04.039831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3cbcc90c-9b98-40db-bfa7-656d69fa744d up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:04.093663 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6e06b3a5-31e5-44b3-91a3-4cbb1fa703d5 req-7f423976-ccdd-41cc-8c7b-4e7d187736cd tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0772786 Mar 24 02:13:04.094137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56542) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:04.109787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3cbcc90c-9b98-40db-bfa7-656d69fa744d triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:04.110220 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.148584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network 85ea4ade-99a4-4f64-93f5-a2a5102bff1f is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:04.189233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 85ea4ade-99a4-4f64-93f5-a2a5102bff1f) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:04.203859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:04.204462 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.208512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e7555bb-ceae-4160-849e-5cd4ed119da3 None None] Network e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:04.211786 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14c7f346-a9b8-4829-be33-7ab0db789ee0 None None] Network 85ea4ade-99a4-4f64-93f5-a2a5102bff1f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:04.230718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsTestJSON-test-network-1958091320'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:04.251509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Made reservation on behalf of cdbae0c829f34ceb835da84afcf97d40 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:04.255462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.265267 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.318699 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4ce589d8-97f7-4ef4-8a34-4804a65645f5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.6962752 Mar 24 02:13:04.321735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56546) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:04.330799 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3cbcc90c-9b98-40db-bfa7-656d69fa744d is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:04.331024 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Mar 24 02:13:04.331505 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:04.331654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.335327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'port': {'network_id': '85ea4ade-99a4-4f64-93f5-a2a5102bff1f', 'name': 'tempest-NetworksIpV6TestAttrs-1295795130'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:04.362691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (5ae6b345-443c-4040-84bd-8c9058264436), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.367276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d302499-b307-4c11-9b91-1f9fbc987085 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (02521872-da9a-4dc8-beff-07719679c5df), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.370388 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-51cc464e-63cf-4717-88e8-621527e2896a None None] Provisioning complete for port 3cbcc90c-9b98-40db-bfa7-656d69fa744d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:04.370907 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-51cc464e-63cf-4717-88e8-621527e2896a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.394382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.399144 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2a805486-de60-46af-a514-fc72434ec5d3 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 409 len: 371 time: 2.0250468 Mar 24 02:13:04.403115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56548) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:04.429155 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d302499-b307-4c11-9b91-1f9fbc987085 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=02521872-da9a-4dc8-beff-07719679c5df,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:04.473969 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 3cbcc90c-9b98-40db-bfa7-656d69fa744d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3cbcc90c-9b98-40db-bfa7-656d69fa744d,segment=NetworkSegment(41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe),segment_id=41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:04.485126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.486116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2913c88a-402b-4514-9681-a637d61013dc up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:04.491521 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d302499-b307-4c11-9b91-1f9fbc987085 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.495169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks [] for security_group (97b45e55-3a9b-4cd0-aa81-6b6d35e64c8a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.499640 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0d302499-b307-4c11-9b91-1f9fbc987085 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/02521872-da9a-4dc8-beff-07719679c5df HTTP/1.1" status: 204 len: 168 time: 2.0411010 Mar 24 02:13:04.502403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56550) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:04.521352 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (97b45e55-3a9b-4cd0-aa81-6b6d35e64c8a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.521601 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-85ea4ade-99a4-4f64-93f5-a2a5102bff1f', 'network_id': '85ea4ade-99a4-4f64-93f5-a2a5102bff1f', 'project_id': '0a478f43194148c295b3c5808a7fb554', 'fixed_ips': [{'subnet_id': 'b95f1f2f-b31b-4f68-b502-9909e35405ba'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:04.523308 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.587412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Allocated IP 172.26.2.112 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/7b3e5137-1d6f-4ae1-a63b-deb71df2469e) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:04.641861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=3cbcc90c-9b98-40db-bfa7-656d69fa744d,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:04.661155 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event updated for resources: {'SecurityGroup': ['ID=97b45e55-3a9b-4cd0-aa81-6b6d35e64c8a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:04.719637 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for port (7b3e5137-1d6f-4ae1-a63b-deb71df2469e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.722419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-51cc464e-63cf-4717-88e8-621527e2896a None None] Current status of the port 3cbcc90c-9b98-40db-bfa7-656d69fa744d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:04.748436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 104} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:04.776313 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (7b3e5137-1d6f-4ae1-a63b-deb71df2469e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.782551 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3854d77-b980-44c3-b99b-aa06e25febea tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:04.783908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3854d77-b980-44c3-b99b-aa06e25febea tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:04.790591 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b3854d77-b980-44c3-b99b-aa06e25febea tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2869854 Mar 24 02:13:04.793216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56552) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:04.794491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b7f27dc5-bad5-4e56-8046-14e2dd220868), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.794917 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Added segment b7f27dc5-bad5-4e56-8046-14e2dd220868 of type vlan for network d7f5822e-534f-40d8-be30-994a25f1a852 Mar 24 02:13:04.820275 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:04.823321 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:04.823808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 2913c88a-402b-4514-9681-a637d61013dc triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:04.824185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2913c88a-402b-4514-9681-a637d61013dc), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.830351 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:04.843517 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event updated for resources: {'Port': ['ID=7b3e5137-1d6f-4ae1-a63b-deb71df2469e,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:04.888807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Allocated IP 2001:db8::f816:3eff:fe8e:5f0a (85ea4ade-99a4-4f64-93f5-a2a5102bff1f/b95f1f2f-b31b-4f68-b502-9909e35405ba/ed530a58-9ca5-4e5c-be94-feaeea0ec606) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:04.891978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:04.895518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.952012 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (d7f5822e-534f-40d8-be30-994a25f1a852), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.973945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Deleting port 549c3fcd-27af-43b5-8d1b-bae79b616201 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:04.974286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (549c3fcd-27af-43b5-8d1b-bae79b616201), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:04.976588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] device_id is not set on port 1fd3bc66-3bb4-4226-9b33-72d945904603 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:04.987758 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-55ebc7b6-711f-49b0-a74a-0ac87adc5090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet b5f08dee-8285-4a00-baae-d1c98849f262 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:05.031702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55ebc7b6-711f-49b0-a74a-0ac87adc5090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (b5f08dee-8285-4a00-baae-d1c98849f262), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.114112 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (d7f5822e-534f-40d8-be30-994a25f1a852), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.125118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:05.125772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.166381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2913c88a-402b-4514-9681-a637d61013dc is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:05.174819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-26fc92d6-3185-4cbc-b387-af1b810d95b8 None None] Provisioning complete for port 3cbcc90c-9b98-40db-bfa7-656d69fa744d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:05.175188 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-26fc92d6-3185-4cbc-b387-af1b810d95b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.190915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (549c3fcd-27af-43b5-8d1b-bae79b616201), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.191271 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks [] for floatingip (549c3fcd-27af-43b5-8d1b-bae79b616201), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.205796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f435316-c418-499d-93c6-e251f5c7ae65 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:05.207320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (5ae6b345-443c-4040-84bd-8c9058264436), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.211931 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 792 time: 1.1132700 Mar 24 02:13:05.240652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 9f435316-c418-499d-93c6-e251f5c7ae65 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:05.240882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f435316-c418-499d-93c6-e251f5c7ae65 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:05.246053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56556) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:05.264770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Request body: {'subnet': {'network_id': 'd7f5822e-534f-40d8-be30-994a25f1a852', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:05.277996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55ebc7b6-711f-49b0-a74a-0ac87adc5090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (b5f08dee-8285-4a00-baae-d1c98849f262), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.319568 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Calling delete_port for 549c3fcd-27af-43b5-8d1b-bae79b616201 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:05.333796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Publish callbacks [] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.341651 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-26fc92d6-3185-4cbc-b387-af1b810d95b8 None None] Current status of the port 3cbcc90c-9b98-40db-bfa7-656d69fa744d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:05.348493 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.390237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Network 85ea4ade-99a4-4f64-93f5-a2a5102bff1f is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:05.396034 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:05.401534 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:05.404853 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Pushing event updated for resources: {'Port': ['ID=ed530a58-9ca5-4e5c-be94-feaeea0ec606,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:05.425873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bc33da5-9ecf-4fd9-9ebc-c3853573cf40 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event updated for resources: {'Network': ['ID=d7f5822e-534f-40d8-be30-994a25f1a852,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:05.450064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network d7f5822e-534f-40d8-be30-994a25f1a852 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:05.467946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (5ae6b345-443c-4040-84bd-8c9058264436), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.508518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Attempting to bind port ed530a58-9ca5-4e5c-be94-feaeea0ec606 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:05.508518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Attempting to bind port ed530a58-9ca5-4e5c-be94-feaeea0ec606 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'c74b6e6a-8270-4d17-bc9f-5ebaa34fca20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '85ea4ade-99a4-4f64-93f5-a2a5102bff1f'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:05.508518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Attempting to bind port ed530a58-9ca5-4e5c-be94-feaeea0ec606 on network 85ea4ade-99a4-4f64-93f5-a2a5102bff1f {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:05.517047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:05.517426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Checking segment: {'id': 'c74b6e6a-8270-4d17-bc9f-5ebaa34fca20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '85ea4ade-99a4-4f64-93f5-a2a5102bff1f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:05.517826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.518212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Bound using segment: {'id': 'c74b6e6a-8270-4d17-bc9f-5ebaa34fca20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '85ea4ade-99a4-4f64-93f5-a2a5102bff1f'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:05.518697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Bound port: ed530a58-9ca5-4e5c-be94-feaeea0ec606, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c74b6e6a-8270-4d17-bc9f-5ebaa34fca20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '85ea4ade-99a4-4f64-93f5-a2a5102bff1f'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:05.519153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.547250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Allocated IP 2001:db8::f816:3eff:fe2f:b80b (85ea4ade-99a4-4f64-93f5-a2a5102bff1f/b95f1f2f-b31b-4f68-b502-9909e35405ba/1fd3bc66-3bb4-4226-9b33-72d945904603) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:05.579571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b917b992-d30f-4534-a236-8c981b42e522 req-1804070f-c88a-44c3-848f-081877d889c9 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:05.580831 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b917b992-d30f-4534-a236-8c981b42e522 req-1804070f-c88a-44c3-848f-081877d889c9 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3937464 Mar 24 02:13:05.618119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] For port ed530a58-9ca5-4e5c-be94-feaeea0ec606, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:05.621867 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] For port ed530a58-9ca5-4e5c-be94-feaeea0ec606, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ed530a58-9ca5-4e5c-be94-feaeea0ec606,segment=NetworkSegment(c74b6e6a-8270-4d17-bc9f-5ebaa34fca20),segment_id=c74b6e6a-8270-4d17-bc9f-5ebaa34fca20)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:05.628613 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.629912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55ebc7b6-711f-49b0-a74a-0ac87adc5090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (b5f08dee-8285-4a00-baae-d1c98849f262), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.634483 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Made reservation on behalf of cdbae0c829f34ceb835da84afcf97d40 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:05.636067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Router 5ae6b345-443c-4040-84bd-8c9058264436 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:05.637750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.689325 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9fed6bb-9864-44ff-a0da-3bcfd6f49798 None None] Pushing event updated for resources: {'Port': ['ID=ed530a58-9ca5-4e5c-be94-feaeea0ec606,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:05.754427 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:05.776786 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d4cdb63-16b5-40d5-ab56-af84d87f15a2 None None] Sync routers for ids ['5ae6b345-443c-4040-84bd-8c9058264436'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:05.780946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:05.783136 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ec9ff6c9-403a-4c58-8954-026c75a259eb tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 3.5081110 Mar 24 02:13:05.785126 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56558) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:05.789857 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d4cdb63-16b5-40d5-ab56-af84d87f15a2 None None] Routers {'5ae6b345-443c-4040-84bd-8c9058264436'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:05.791278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5a733fc4-faea-40d2-8210-f7804fa1170d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': False}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:05.791855 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9d4cdb63-16b5-40d5-ab56-af84d87f15a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['5ae6b345-443c-4040-84bd-8c9058264436'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:05.844626 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9d4cdb63-16b5-40d5-ab56-af84d87f15a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:05.855800 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d4cdb63-16b5-40d5-ab56-af84d87f15a2 None None] Routers {'5ae6b345-443c-4040-84bd-8c9058264436'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:05.859790 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9d4cdb63-16b5-40d5-ab56-af84d87f15a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['5ae6b345-443c-4040-84bd-8c9058264436'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:05.949752 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3cbcc90c-9b98-40db-bfa7-656d69fa744d up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:05.965660 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b917b992-d30f-4534-a236-8c981b42e522 req-dbacfd1d-101e-4eab-b4d7-6be63cbe6a6c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3699787 Mar 24 02:13:05.966557 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9d4cdb63-16b5-40d5-ab56-af84d87f15a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:05.968199 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d4cdb63-16b5-40d5-ab56-af84d87f15a2 None None] The sync data for ids ['5ae6b345-443c-4040-84bd-8c9058264436'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:06.019199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55ebc7b6-711f-49b0-a74a-0ac87adc5090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (b5f08dee-8285-4a00-baae-d1c98849f262), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.044145 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55ebc7b6-711f-49b0-a74a-0ac87adc5090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.051398 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56560) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:06.052292 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-55ebc7b6-711f-49b0-a74a-0ac87adc5090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/b5f08dee-8285-4a00-baae-d1c98849f262 HTTP/1.1" status: 204 len: 168 time: 1.2538970 Mar 24 02:13:06.052604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e742e91d-5962-486d-a00e-9008c9283d6d None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:06.093148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ebc7b6-711f-49b0-a74a-0ac87adc5090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=b5f08dee-8285-4a00-baae-d1c98849f262,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:06.111568 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3cbcc90c-9b98-40db-bfa7-656d69fa744d triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:06.111993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.122342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (549c3fcd-27af-43b5-8d1b-bae79b616201), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.161078 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-17566821-19c1-4a87-9238-1aada52c2b0a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1084087 Mar 24 02:13:06.161813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56562) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:06.197041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:06.248206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3cbcc90c-9b98-40db-bfa7-656d69fa744d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:06.249413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2913c88a-402b-4514-9681-a637d61013dc up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:06.308862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 2913c88a-402b-4514-9681-a637d61013dc triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:06.309252 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2913c88a-402b-4514-9681-a637d61013dc), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.362948 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1a8a22c-8bed-41be-9856-71f3930d3c3b None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:06.437239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2913c88a-402b-4514-9681-a637d61013dc is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:06.453932 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b1a8a22c-8bed-41be-9856-71f3930d3c3b None None] Deleting port 2913c88a-402b-4514-9681-a637d61013dc {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:06.454304 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b1a8a22c-8bed-41be-9856-71f3930d3c3b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2913c88a-402b-4514-9681-a637d61013dc), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.513479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Pushing event deleted for resources: {'Port': ['ID=549c3fcd-27af-43b5-8d1b-bae79b616201,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:06.521000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b1a8a22c-8bed-41be-9856-71f3930d3c3b None None] For port 2913c88a-402b-4514-9681-a637d61013dc, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2913c88a-402b-4514-9681-a637d61013dc,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:06.521576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b1a8a22c-8bed-41be-9856-71f3930d3c3b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2913c88a-402b-4514-9681-a637d61013dc), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.525893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for port (1fd3bc66-3bb4-4226-9b33-72d945904603), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.539321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b1a8a22c-8bed-41be-9856-71f3930d3c3b None None] Calling delete_port for 2913c88a-402b-4514-9681-a637d61013dc owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:06.611508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5a733fc4-faea-40d2-8210-f7804fa1170d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (5ae6b345-443c-4040-84bd-8c9058264436), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.623582 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:06.627895 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks [] for floatingip (0643b8b7-348f-4260-8475-30d8644a9e6b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.628210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.630910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.632678 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-442fa2c8-627a-4a54-ad8a-07437ff7bf8a tempest-ExternalNetworksAdminNegativeTestJSON-2079365196 tempest-ExternalNetworksAdminNegativeTestJSON-2079365196-project-admin] 10.222.0.20 "DELETE /v2.0/floatingips/0643b8b7-348f-4260-8475-30d8644a9e6b HTTP/1.1" status: 204 len: 168 time: 2.2283683 Mar 24 02:13:06.670065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b1a8a22c-8bed-41be-9856-71f3930d3c3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (2913c88a-402b-4514-9681-a637d61013dc), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.682176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (858e8e5b-7f72-41ba-9520-39c18f731457), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.708143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a8a22c-8bed-41be-9856-71f3930d3c3b None None] Pushing event deleted for resources: {'Port': ['ID=2913c88a-402b-4514-9681-a637d61013dc,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:06.716329 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1a8a22c-8bed-41be-9856-71f3930d3c3b None None] No DVR routers for this DVR port 2913c88a-402b-4514-9681-a637d61013dc on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:06.731980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (1fd3bc66-3bb4-4226-9b33-72d945904603), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.808889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event updated for resources: {'Subnet': ['ID=858e8e5b-7f72-41ba-9520-39c18f731457,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:06.831466 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network 85ea4ade-99a4-4f64-93f5-a2a5102bff1f is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:06.837836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:06.844949 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:06.851396 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:06.851779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.865535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Port': ['ID=1fd3bc66-3bb4-4226-9b33-72d945904603,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:06.871560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Checking segment: {'id': 'b7f27dc5-bad5-4e56-8046-14e2dd220868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'd7f5822e-534f-40d8-be30-994a25f1a852'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:06.871923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Network hostable DHCP agents. Network: d7f5822e-534f-40d8-be30-994a25f1a852, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:06.892573 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-889fba16-a807-4018-9d2f-4dbb002ee4fc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 951 time: 2.5655615 Mar 24 02:13:06.893272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56568) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:06.923013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Network d7f5822e-534f-40d8-be30-994a25f1a852 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:06.940677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (1bb4f5b0-a007-4763-bc4d-79c61bcc0a53), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.945697 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, d7f5822e-534f-40d8-be30-994a25f1a852) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:06.953206 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:06.953799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.957450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15daf23b-b9a5-4946-ba16-b097f531eb0f None None] Network d7f5822e-534f-40d8-be30-994a25f1a852 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:06.969367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-dae5b79c-196b-45ee-a34d-9087efead336 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Deleting subnet b95f1f2f-b31b-4f68-b502-9909e35405ba {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:06.973104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dae5b79c-196b-45ee-a34d-9087efead336 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for subnet (b95f1f2f-b31b-4f68-b502-9909e35405ba), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:06.977426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:06.995934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:06.999363 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7b772859-bb4f-4033-b0d9-df3be66f2f94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7392259 Mar 24 02:13:07.001772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56572) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:07.003717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:07.005524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.006947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Request body: {'port': {'network_id': 'd7f5822e-534f-40d8-be30-994a25f1a852', 'name': 'tempest-ExtraDHCPOptionsTestJSON-788105995'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:07.055107 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa477af6-1009-4e00-8252-d47a61a089c4 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:07.144094 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.9479425 Mar 24 02:13:07.146349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c4af142-05db-4ce0-af2f-6351306512cd None None] Network 85ea4ade-99a4-4f64-93f5-a2a5102bff1f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:07.147987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56576) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:07.154560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': '1bb4f5b0-a007-4763-bc4d-79c61bcc0a53', 'ip_address': '2001:db8::3482:53ec:db8b:3a27'}], 'name': 'tempest-NetworksTestDHCPv6-1762480064'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:07.155995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dae5b79c-196b-45ee-a34d-9087efead336 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (b95f1f2f-b31b-4f68-b502-9909e35405ba), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.157740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56578) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:07.192235 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd66beb5-1527-46b8-b6ff-7eb6da272271 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=1bb4f5b0-a007-4763-bc4d-79c61bcc0a53,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:07.278808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-d7f5822e-534f-40d8-be30-994a25f1a852', 'network_id': 'd7f5822e-534f-40d8-be30-994a25f1a852', 'project_id': 'cdbae0c829f34ceb835da84afcf97d40', 'fixed_ips': [{'subnet_id': '858e8e5b-7f72-41ba-9520-39c18f731457'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:07.279706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.282108 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47107628-d9aa-4b43-9ea1-cf1ac00d0c8a req-4e312a11-1b9a-4ad7-9b15-7d96af7e3edf tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:07.290394 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-47107628-d9aa-4b43-9ea1-cf1ac00d0c8a req-4e312a11-1b9a-4ad7-9b15-7d96af7e3edf tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1775172 Mar 24 02:13:07.293189 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Provisioning complete for port ed530a58-9ca5-4e5c-be94-feaeea0ec606 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:07.293572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.342806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '1bb4f5b0-a007-4763-bc4d-79c61bcc0a53'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:07.343779 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.389953 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6347cd3-7a89-4dd7-8313-4dd422d0ccd1 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.393447 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Made reservation on behalf of cdbae0c829f34ceb835da84afcf97d40 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:07.396768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.410338 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-47107628-d9aa-4b43-9ea1-cf1ac00d0c8a req-ba4af098-29fd-4d2f-931b-7fef2808a375 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1190798 Mar 24 02:13:07.436796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] device_id is not set on port ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:07.468959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:07.507998 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dae5b79c-196b-45ee-a34d-9087efead336 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (b95f1f2f-b31b-4f68-b502-9909e35405ba), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.579793 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dae5b79c-196b-45ee-a34d-9087efead336 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (b95f1f2f-b31b-4f68-b502-9909e35405ba), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.610755 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae5b79c-196b-45ee-a34d-9087efead336 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Subnet': ['ID=b95f1f2f-b31b-4f68-b502-9909e35405ba,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:07.624158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dae5b79c-196b-45ee-a34d-9087efead336 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.624616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Allocated IP 172.20.0.2 (d7f5822e-534f-40d8-be30-994a25f1a852/858e8e5b-7f72-41ba-9520-39c18f731457/14392940-0f97-466b-8ec5-9cec4f7bf990) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:07.630139 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dae5b79c-196b-45ee-a34d-9087efead336 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/subnets/b95f1f2f-b31b-4f68-b502-9909e35405ba HTTP/1.1" status: 204 len: 168 time: 0.7341824 Mar 24 02:13:07.633089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56582) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:07.637450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Current status of the port ed530a58-9ca5-4e5c-be94-feaeea0ec606 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:07.637770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.668858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6347cd3-7a89-4dd7-8313-4dd422d0ccd1 admin admin] Publish callbacks [] for security_group (17ffed1d-39c2-44c3-b40d-d176f85bd6a0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.680113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5a733fc4-faea-40d2-8210-f7804fa1170d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (5ae6b345-443c-4040-84bd-8c9058264436), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.684516 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.686292 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6347cd3-7a89-4dd7-8313-4dd422d0ccd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (17ffed1d-39c2-44c3-b40d-d176f85bd6a0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.696777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b3eef63-7046-4231-ba33-efe4304bb314 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:07.698396 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b3eef63-7046-4231-ba33-efe4304bb314 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:07.699630 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1b3eef63-7046-4231-ba33-efe4304bb314 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.0655968 Mar 24 02:13:07.702549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56584) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:07.706449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5a733fc4-faea-40d2-8210-f7804fa1170d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (5ae6b345-443c-4040-84bd-8c9058264436), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.765548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/1bb4f5b0-a007-4763-bc4d-79c61bcc0a53/5409f9de-8bc5-4759-b83d-7e43b77c377d) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:07.776170 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a6347cd3-7a89-4dd7-8313-4dd422d0ccd1 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=375ffe6a0e6d475099b7baa0ef791b2b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6020226 Mar 24 02:13:07.777746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port c08d4ace-f0bf-4492-a3f9-f49cb1c331d6 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:07.780866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56586) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:07.799479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99ad1a12-fb34-43fe-bad0-a9c0a72a1542 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (85ea4ade-99a4-4f64-93f5-a2a5102bff1f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.818152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6347cd3-7a89-4dd7-8313-4dd422d0ccd1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17ffed1d-39c2-44c3-b40d-d176f85bd6a0,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:07.831568 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-99ad1a12-fb34-43fe-bad0-a9c0a72a1542 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): There was a conflict when trying to complete your request. Mar 24 02:13:07.832067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-99ad1a12-fb34-43fe-bad0-a9c0a72a1542 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:07.836108 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-99ad1a12-fb34-43fe-bad0-a9c0a72a1542 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/85ea4ade-99a4-4f64-93f5-a2a5102bff1f HTTP/1.1" status: 409 len: 466 time: 0.1326084 Mar 24 02:13:07.841797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56588) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:07.848412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-765138567'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:07.881117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a89cea59-95b8-408e-948e-842e97c5a139 admin admin] Publish callbacks [] for security_group (17ffed1d-39c2-44c3-b40d-d176f85bd6a0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.898328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:07.901758 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.905525 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:13:07.905881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:13:07.923385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a89cea59-95b8-408e-948e-842e97c5a139 admin admin] Publish callbacks [] for security_group (17ffed1d-39c2-44c3-b40d-d176f85bd6a0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.966220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 149} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:07.979164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d2aa1cfc-aa62-47aa-9135-047a2ea22478), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:07.979395 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Added segment d2aa1cfc-aa62-47aa-9135-047a2ea22478 of type vlan for network 3cc171f1-45cd-4c0d-af46-657530acea1a Mar 24 02:13:08.029821 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ed530a58-9ca5-4e5c-be94-feaeea0ec606 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:08.034862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (3cc171f1-45cd-4c0d-af46-657530acea1a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.043661 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a89cea59-95b8-408e-948e-842e97c5a139 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (17ffed1d-39c2-44c3-b40d-d176f85bd6a0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.047165 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a89cea59-95b8-408e-948e-842e97c5a139 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.051231 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a89cea59-95b8-408e-948e-842e97c5a139 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/17ffed1d-39c2-44c3-b40d-d176f85bd6a0 HTTP/1.1" status: 204 len: 168 time: 0.2694116 Mar 24 02:13:08.063173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a89cea59-95b8-408e-948e-842e97c5a139 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17ffed1d-39c2-44c3-b40d-d176f85bd6a0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:08.120193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (3cc171f1-45cd-4c0d-af46-657530acea1a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.131544 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:08.133280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.135225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a733fc4-faea-40d2-8210-f7804fa1170d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Router 5ae6b345-443c-4040-84bd-8c9058264436 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:13:08.168111 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.3248749 Mar 24 02:13:08.168814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56592) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:08.203035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'subnet': {'network_id': '3cc171f1-45cd-4c0d-af46-657530acea1a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:08.238498 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49e2d097-3ed9-4875-b7cb-9ae15580f62c None None] Network 85ea4ade-99a4-4f64-93f5-a2a5102bff1f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:08.264705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a733fc4-faea-40d2-8210-f7804fa1170d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:08.269009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5a733fc4-faea-40d2-8210-f7804fa1170d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.270592 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5a733fc4-faea-40d2-8210-f7804fa1170d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "PUT /v2.0/routers/5ae6b345-443c-4040-84bd-8c9058264436 HTTP/1.1" status: 200 len: 925 time: 2.4839389 Mar 24 02:13:08.272998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56596) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:08.311817 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Publish callbacks [] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.315951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a11ab363-af52-49f2-a34c-e736a552f545 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Network': ['ID=3cc171f1-45cd-4c0d-af46-657530acea1a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:08.325855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c014c17-8cc1-4c11-8787-cf62b06f3b27 None None] Sync routers for ids ['5ae6b345-443c-4040-84bd-8c9058264436'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:08.338784 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 3cc171f1-45cd-4c0d-af46-657530acea1a details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:08.383088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.402192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:08.405753 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-13ed85d1-b872-4c36-898f-a06f538c622d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/routers/5ae6b345-443c-4040-84bd-8c9058264436 HTTP/1.1" status: 200 len: 925 time: 0.1315422 Mar 24 02:13:08.406258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.406401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56598) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:08.492538 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1908bb7d-34a3-4587-9d86-3cff156dc44e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:08.495995 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1908bb7d-34a3-4587-9d86-3cff156dc44e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=5ae6b345-443c-4040-84bd-8c9058264436&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.0881574 Mar 24 02:13:08.497761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56606) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:08.526804 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Pushing event updated for resources: {'Port': ['ID=14392940-0f97-466b-8ec5-9cec4f7bf990,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:08.528985 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Current status of the port ed530a58-9ca5-4e5c-be94-feaeea0ec606 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:08.529372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.553407 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56608) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:08.570075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] For port ed530a58-9ca5-4e5c-be94-feaeea0ec606, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ed530a58-9ca5-4e5c-be94-feaeea0ec606,segment=NetworkSegment(c74b6e6a-8270-4d17-bc9f-5ebaa34fca20),segment_id=c74b6e6a-8270-4d17-bc9f-5ebaa34fca20)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:08.596890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.598490 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c014c17-8cc1-4c11-8787-cf62b06f3b27 None None] Routers {'5ae6b345-443c-4040-84bd-8c9058264436'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:08.599140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1c014c17-8cc1-4c11-8787-cf62b06f3b27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['5ae6b345-443c-4040-84bd-8c9058264436'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:08.614985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Allocated IP 172.20.0.5 (d7f5822e-534f-40d8-be30-994a25f1a852/858e8e5b-7f72-41ba-9520-39c18f731457/ed6e8479-974b-48e7-8ea6-3f208d3bb2c4) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:08.624393 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f1908ff1-b55c-44b0-8aa2-48d40078393b admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=6c227ff3ce184b0b8246e0685b879cb0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0668647 Mar 24 02:13:08.624664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56610) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:08.632627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb4396fd-e497-4cba-9d83-1d7f68881bee tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:08.636961 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cb4396fd-e497-4cba-9d83-1d7f68881bee tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 881 time: 0.1344755 Mar 24 02:13:08.639369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56612) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:08.640210 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Network d7f5822e-534f-40d8-be30-994a25f1a852 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:08.648599 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1c014c17-8cc1-4c11-8787-cf62b06f3b27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:08.650749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:08.664031 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:08.678256 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cb7d4844-d69a-4fb1-8304-7dc9358c6559 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ae6b345-443c-4040-84bd-8c9058264436 HTTP/1.1" status: 200 len: 205 time: 0.0377777 Mar 24 02:13:08.681273 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56614) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:08.689763 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-801a1969-fdcf-43d8-a416-ca2f4effa992 admin admin] Publish callbacks [] for security_group (5c41f506-36a5-4e66-868b-b670ea1b20f5), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.733179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9963403a-37a8-4847-b8af-6ba3e5587956 req-d20b0b6e-1946-49c8-8b94-3b4e6e3514cf tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:08.734677 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9963403a-37a8-4847-b8af-6ba3e5587956 req-d20b0b6e-1946-49c8-8b94-3b4e6e3514cf tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1656682 Mar 24 02:13:08.765047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Publish callbacks [] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.771120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-801a1969-fdcf-43d8-a416-ca2f4effa992 admin admin] Publish callbacks [] for security_group (5c41f506-36a5-4e66-868b-b670ea1b20f5), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.775784 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ed530a58-9ca5-4e5c-be94-feaeea0ec606 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:08.776161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.819879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-09e4ca51-f7e4-45ec-8bd1-ae0ea62a0412 None None] Provisioning complete for port ed530a58-9ca5-4e5c-be94-feaeea0ec606 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:08.820371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-09e4ca51-f7e4-45ec-8bd1-ae0ea62a0412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.870114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.876609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (5ae6b345-443c-4040-84bd-8c9058264436), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.880290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::3482:53ec:db8b:3a27 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/1bb4f5b0-a007-4763-bc4d-79c61bcc0a53/c08d4ace-f0bf-4492-a3f9-f49cb1c331d6) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:08.881317 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9963403a-37a8-4847-b8af-6ba3e5587956 req-0cfacf5a-0a56-46b7-804a-b38113e2ce8e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1354630 Mar 24 02:13:08.882414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c014c17-8cc1-4c11-8787-cf62b06f3b27 None None] Routers {'5ae6b345-443c-4040-84bd-8c9058264436'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:08.883110 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1c014c17-8cc1-4c11-8787-cf62b06f3b27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['5ae6b345-443c-4040-84bd-8c9058264436'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:08.895901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Attempting to bind port 14392940-0f97-466b-8ec5-9cec4f7bf990 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:08.896337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Attempting to bind port 14392940-0f97-466b-8ec5-9cec4f7bf990 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'b7f27dc5-bad5-4e56-8046-14e2dd220868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'd7f5822e-534f-40d8-be30-994a25f1a852'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:08.896698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Attempting to bind port 14392940-0f97-466b-8ec5-9cec4f7bf990 on network d7f5822e-534f-40d8-be30-994a25f1a852 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:08.942777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:13:08.946689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (dd332db5-c958-4e28-9386-ce0c0415aad7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.951925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1c014c17-8cc1-4c11-8787-cf62b06f3b27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:08.952537 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c014c17-8cc1-4c11-8787-cf62b06f3b27 None None] The sync data for ids ['5ae6b345-443c-4040-84bd-8c9058264436'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:08.958010 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:08.958010 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Checking segment: {'id': 'b7f27dc5-bad5-4e56-8046-14e2dd220868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'd7f5822e-534f-40d8-be30-994a25f1a852'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:08.958291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:08.958631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Bound using segment: {'id': 'b7f27dc5-bad5-4e56-8046-14e2dd220868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'd7f5822e-534f-40d8-be30-994a25f1a852'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:08.959028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Bound port: 14392940-0f97-466b-8ec5-9cec4f7bf990, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b7f27dc5-bad5-4e56-8046-14e2dd220868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'd7f5822e-534f-40d8-be30-994a25f1a852'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:08.959420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.000087 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ef432f9-37e3-4c85-b31e-ff5347da559c None None] Pushing event updated for resources: {'Port': ['ID=ed530a58-9ca5-4e5c-be94-feaeea0ec606,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:09.005787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:09.009926 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1cf4a6a-9025-4de4-9e86-07431a1e71e4 None None] DHCP port deletion for 85ea4ade-99a4-4f64-93f5-a2a5102bff1f request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:09.013723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks [] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.033035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-801a1969-fdcf-43d8-a416-ca2f4effa992 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (5c41f506-36a5-4e66-868b-b670ea1b20f5), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.035962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-801a1969-fdcf-43d8-a416-ca2f4effa992 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.039652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:09.039811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Subnet': ['ID=dd332db5-c958-4e28-9386-ce0c0415aad7,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:09.052329 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-801a1969-fdcf-43d8-a416-ca2f4effa992 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/5c41f506-36a5-4e66-868b-b670ea1b20f5 HTTP/1.1" status: 204 len: 168 time: 0.4146152 Mar 24 02:13:09.055297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Checking segment: {'id': 'd2aa1cfc-aa62-47aa-9135-047a2ea22478', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '3cc171f1-45cd-4c0d-af46-657530acea1a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:09.055658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network hostable DHCP agents. Network: 3cc171f1-45cd-4c0d-af46-657530acea1a, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:09.065373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:09.086595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network 3cc171f1-45cd-4c0d-af46-657530acea1a is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:09.093499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.104422 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 3cc171f1-45cd-4c0d-af46-657530acea1a) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:09.110577 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801a1969-fdcf-43d8-a416-ca2f4effa992 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c41f506-36a5-4e66-868b-b670ea1b20f5,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:09.119044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Pushing event updated for resources: {'Port': ['ID=5409f9de-8bc5-4759-b83d-7e43b77c377d,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:09.152796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:09.153393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.158560 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] For port 14392940-0f97-466b-8ec5-9cec4f7bf990, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:09.169480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Network d7f5822e-534f-40d8-be30-994a25f1a852 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:09.173064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] For port 14392940-0f97-466b-8ec5-9cec4f7bf990, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=14392940-0f97-466b-8ec5-9cec4f7bf990,segment=NetworkSegment(b7f27dc5-bad5-4e56-8046-14e2dd220868),segment_id=b7f27dc5-bad5-4e56-8046-14e2dd220868)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:09.175622 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:09.181103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:09.199491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (5ae6b345-443c-4040-84bd-8c9058264436), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.204728 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66e12599-9e32-408a-a93a-8e55c4c6a475 None None] Network 3cc171f1-45cd-4c0d-af46-657530acea1a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:09.214397 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e35f407b-9eae-4fd8-9e74-cc614def4725 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.0129108 Mar 24 02:13:09.215678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56620) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:09.222159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event updated for resources: {'Port': ['ID=ed6e8479-974b-48e7-8ea6-3f208d3bb2c4,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:09.224385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'port': {'network_id': '3cc171f1-45cd-4c0d-af46-657530acea1a', 'name': 'tempest-NetworksIpV6TestAttrs-243526613'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:09.251999 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:09.252628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.277124 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fd34207a-6d2d-4410-b26e-6a5d75a33933 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2735906 Mar 24 02:13:09.279803 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56622) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:09.289571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Request body: {'port': {'network_id': 'd7f5822e-534f-40d8-be30-994a25f1a852', 'name': 'tempest-ExtraDHCPOptionsTestJSON-759336406', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:09.290442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.api.validators [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] bootfile-name is not in valid_values {{(pid=104037) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:13:09.290978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.api.validators [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] tftp-server is not in valid_values {{(pid=104037) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:13:09.291463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.api.validators [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] server-ip-address is not in valid_values {{(pid=104037) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:13:09.321981 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-09e4ca51-f7e4-45ec-8bd1-ae0ea62a0412 None None] Current status of the port ed530a58-9ca5-4e5c-be94-feaeea0ec606 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:09.337886 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.423449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65219b8a-ae29-496e-a82d-ad876ba294b7 None None] Pushing event updated for resources: {'Port': ['ID=14392940-0f97-466b-8ec5-9cec4f7bf990,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:09.432319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Made reservation on behalf of cdbae0c829f34ceb835da84afcf97d40 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:09.442797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.475245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-09e4ca51-f7e4-45ec-8bd1-ae0ea62a0412 None None] Provisioning complete for port 1fd3bc66-3bb4-4226-9b33-72d945904603 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:09.478672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-09e4ca51-f7e4-45ec-8bd1-ae0ea62a0412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (1fd3bc66-3bb4-4226-9b33-72d945904603), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.496393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] device_id is not set on port 8399f9d2-a4ba-41af-8b3d-ae2a761a84ca yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:09.535081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Attempting to bind port 5409f9de-8bc5-4759-b83d-7e43b77c377d on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:09.535515 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Attempting to bind port 5409f9de-8bc5-4759-b83d-7e43b77c377d by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:09.536524 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Attempting to bind port 5409f9de-8bc5-4759-b83d-7e43b77c377d on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:09.564542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-09e4ca51-f7e4-45ec-8bd1-ae0ea62a0412 None None] Port 1fd3bc66-3bb4-4226-9b33-72d945904603 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:09.595873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (c08d4ace-f0bf-4492-a3f9-f49cb1c331d6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.626753 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:09.627303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:09.627803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.628321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:09.629042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Bound port: 5409f9de-8bc5-4759-b83d-7e43b77c377d, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:09.629522 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.647737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ed530a58-9ca5-4e5c-be94-feaeea0ec606 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:09.691148 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-3cc171f1-45cd-4c0d-af46-657530acea1a', 'network_id': '3cc171f1-45cd-4c0d-af46-657530acea1a', 'project_id': '0a478f43194148c295b3c5808a7fb554', 'fixed_ips': [{'subnet_id': 'dd332db5-c958-4e28-9386-ce0c0415aad7'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:09.692678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.706651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Allocated IP 172.20.0.7 (d7f5822e-534f-40d8-be30-994a25f1a852/858e8e5b-7f72-41ba-9520-39c18f731457/8399f9d2-a4ba-41af-8b3d-ae2a761a84ca) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:09.766245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c08d4ace-f0bf-4492-a3f9-f49cb1c331d6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.816648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Deleting port 7b3e5137-1d6f-4ae1-a63b-deb71df2469e {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:09.816648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (7b3e5137-1d6f-4ae1-a63b-deb71df2469e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.869274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Allocated IP 2001:db8::f816:3eff:fe88:d806 (3cc171f1-45cd-4c0d-af46-657530acea1a/dd332db5-c958-4e28-9386-ce0c0415aad7/f60f9893-f4c4-42d5-968b-bf4e3aeffefb) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:09.970133 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:09.975058 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:09.990956 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=c08d4ace-f0bf-4492-a3f9-f49cb1c331d6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:10.031596 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Publish callbacks [] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.035142 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:10.035695 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d1cf4a6a-9025-4de4-9e86-07431a1e71e4 None None] Deleting port ed530a58-9ca5-4e5c-be94-feaeea0ec606 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:10.036193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1cf4a6a-9025-4de4-9e86-07431a1e71e4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.042480 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] device_id is not set on port 877298c2-b172-4600-820f-4ebf49da2a4c yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:10.106061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d1cf4a6a-9025-4de4-9e86-07431a1e71e4 None None] For port ed530a58-9ca5-4e5c-be94-feaeea0ec606, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ed530a58-9ca5-4e5c-be94-feaeea0ec606,segment=NetworkSegment(c74b6e6a-8270-4d17-bc9f-5ebaa34fca20),segment_id=c74b6e6a-8270-4d17-bc9f-5ebaa34fca20)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:10.106768 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1cf4a6a-9025-4de4-9e86-07431a1e71e4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.125993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d1cf4a6a-9025-4de4-9e86-07431a1e71e4 None None] Calling delete_port for ed530a58-9ca5-4e5c-be94-feaeea0ec606 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:10.141039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks [] for port (8399f9d2-a4ba-41af-8b3d-ae2a761a84ca), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.144531 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:10.151125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d0e7041-ba92-4bae-b237-11c96b586e97 req-137a5feb-0573-4847-9a88-068f3770fa2b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:10.158167 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6d0e7041-ba92-4bae-b237-11c96b586e97 req-137a5feb-0573-4847-9a88-068f3770fa2b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1308372 Mar 24 02:13:10.213464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2913c88a-402b-4514-9681-a637d61013dc no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:10.230569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Allocated IP 2001:db8::f816:3eff:feac:c553 (3cc171f1-45cd-4c0d-af46-657530acea1a/dd332db5-c958-4e28-9386-ce0c0415aad7/877298c2-b172-4600-820f-4ebf49da2a4c) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:10.238352 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6d0e7041-ba92-4bae-b237-11c96b586e97 req-3fd607a6-e8f6-4ee3-b570-303aaf23b78b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0792074 Mar 24 02:13:10.241538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.248344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 2913c88a-402b-4514-9681-a637d61013dc {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:10.248693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2913c88a-402b-4514-9681-a637d61013dc not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:10.250078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (8399f9d2-a4ba-41af-8b3d-ae2a761a84ca), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.254075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1cf4a6a-9025-4de4-9e86-07431a1e71e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (ed530a58-9ca5-4e5c-be94-feaeea0ec606), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.326963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Network d7f5822e-534f-40d8-be30-994a25f1a852 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:10.334212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:10.340588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:10.344508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event updated for resources: {'Port': ['ID=8399f9d2-a4ba-41af-8b3d-ae2a761a84ca,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:10.409566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:10.410176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.435802 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-087c8c18-51e4-4fd6-9866-939d4aade9bc tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1151 time: 1.1533301 Mar 24 02:13:10.438207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56644) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:10.464601 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (7b3e5137-1d6f-4ae1-a63b-deb71df2469e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.479603 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Calling delete_port for 7b3e5137-1d6f-4ae1-a63b-deb71df2469e owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:10.492325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:10.505487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:10.511531 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.547801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 14392940-0f97-466b-8ec5-9cec4f7bf990 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:10.580476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de1fbe72-baeb-461d-8182-6cbeef506d9d tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:10.593542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1cf4a6a-9025-4de4-9e86-07431a1e71e4 None None] No DVR routers for this DVR port ed530a58-9ca5-4e5c-be94-feaeea0ec606 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:10.593687 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de1fbe72-baeb-461d-8182-6cbeef506d9d tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:10.605486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de1fbe72-baeb-461d-8182-6cbeef506d9d tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:10.617081 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-de1fbe72-baeb-461d-8182-6cbeef506d9d tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2614 time: 0.1774333 Mar 24 02:13:10.617727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56648) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:10.651203 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c06ec938-1a6c-47a7-b25f-e337a91f5d9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 3.5020723 Mar 24 02:13:10.652466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56650) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:10.681427 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Network 3cc171f1-45cd-4c0d-af46-657530acea1a is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:10.698405 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:10.707094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:10.718119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Pushing event updated for resources: {'Port': ['ID=f60f9893-f4c4-42d5-968b-bf4e3aeffefb,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:10.732737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] For port 5409f9de-8bc5-4759-b83d-7e43b77c377d, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:10.761134 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 14392940-0f97-466b-8ec5-9cec4f7bf990 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:10.764834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.783161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1cf4a6a-9025-4de4-9e86-07431a1e71e4 None None] Pushing event deleted for resources: {'Port': ['ID=ed530a58-9ca5-4e5c-be94-feaeea0ec606,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:10.811163 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] For port 5409f9de-8bc5-4759-b83d-7e43b77c377d, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5409f9de-8bc5-4759-b83d-7e43b77c377d,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:10.833385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6d704537-e19b-48b1-a0fc-e6cf81038a94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Deleting port 8399f9d2-a4ba-41af-8b3d-ae2a761a84ca {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:10.833948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d704537-e19b-48b1-a0fc-e6cf81038a94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (8399f9d2-a4ba-41af-8b3d-ae2a761a84ca), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.891614 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.965128 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Attempting to bind port f60f9893-f4c4-42d5-968b-bf4e3aeffefb on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:10.965504 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Attempting to bind port f60f9893-f4c4-42d5-968b-bf4e3aeffefb by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'd2aa1cfc-aa62-47aa-9135-047a2ea22478', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '3cc171f1-45cd-4c0d-af46-657530acea1a'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:10.965863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Attempting to bind port f60f9893-f4c4-42d5-968b-bf4e3aeffefb on network 3cc171f1-45cd-4c0d-af46-657530acea1a {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:10.978560 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:10.978933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Checking segment: {'id': 'd2aa1cfc-aa62-47aa-9135-047a2ea22478', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '3cc171f1-45cd-4c0d-af46-657530acea1a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:10.979337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.979728 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Bound using segment: {'id': 'd2aa1cfc-aa62-47aa-9135-047a2ea22478', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '3cc171f1-45cd-4c0d-af46-657530acea1a'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:10.980202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Bound port: f60f9893-f4c4-42d5-968b-bf4e3aeffefb, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd2aa1cfc-aa62-47aa-9135-047a2ea22478', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '3cc171f1-45cd-4c0d-af46-657530acea1a'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:10.980581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.990102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d704537-e19b-48b1-a0fc-e6cf81038a94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (8399f9d2-a4ba-41af-8b3d-ae2a761a84ca), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:10.996845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for port (877298c2-b172-4600-820f-4ebf49da2a4c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.008398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6d704537-e19b-48b1-a0fc-e6cf81038a94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Calling delete_port for 8399f9d2-a4ba-41af-8b3d-ae2a761a84ca owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:11.049928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aa1a8c2-d194-4ee4-9f4e-10cd4e3b5c66 None None] Pushing event updated for resources: {'Port': ['ID=5409f9de-8bc5-4759-b83d-7e43b77c377d,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:11.141681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a0894c2-3679-4808-a585-b33cd8883d77 None None] Network d7f5822e-534f-40d8-be30-994a25f1a852 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:11.155427 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (7b3e5137-1d6f-4ae1-a63b-deb71df2469e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.183307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dcc32b85-5732-4eb3-8df1-82214385ae14 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:11.191341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dcc32b85-5732-4eb3-8df1-82214385ae14 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:11.197323 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dcc32b85-5732-4eb3-8df1-82214385ae14 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1685 time: 0.5402684 Mar 24 02:13:11.201905 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56658) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:11.248486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] For port f60f9893-f4c4-42d5-968b-bf4e3aeffefb, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:11.272862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d704537-e19b-48b1-a0fc-e6cf81038a94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (8399f9d2-a4ba-41af-8b3d-ae2a761a84ca), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.320166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event deleted for resources: {'Port': ['ID=7b3e5137-1d6f-4ae1-a63b-deb71df2469e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:11.348902 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] For port f60f9893-f4c4-42d5-968b-bf4e3aeffefb, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f60f9893-f4c4-42d5-968b-bf4e3aeffefb,segment=NetworkSegment(d2aa1cfc-aa62-47aa-9135-047a2ea22478),segment_id=d2aa1cfc-aa62-47aa-9135-047a2ea22478)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:11.356629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 14392940-0f97-466b-8ec5-9cec4f7bf990 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:11.357046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.383827 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-eae6b996-92ff-438d-b387-07e2192171c9 None None] Provisioning complete for port 14392940-0f97-466b-8ec5-9cec4f7bf990 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:11.384195 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-eae6b996-92ff-438d-b387-07e2192171c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.388164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d704537-e19b-48b1-a0fc-e6cf81038a94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event deleted for resources: {'Port': ['ID=8399f9d2-a4ba-41af-8b3d-ae2a761a84ca,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:11.396525 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.447295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (877298c2-b172-4600-820f-4ebf49da2a4c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.580027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 14392940-0f97-466b-8ec5-9cec4f7bf990, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=14392940-0f97-466b-8ec5-9cec4f7bf990,segment=NetworkSegment(b7f27dc5-bad5-4e56-8046-14e2dd220868),segment_id=b7f27dc5-bad5-4e56-8046-14e2dd220868)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:11.603125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.639454 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network 3cc171f1-45cd-4c0d-af46-657530acea1a is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:11.652642 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d704537-e19b-48b1-a0fc-e6cf81038a94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.664801 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6d704537-e19b-48b1-a0fc-e6cf81038a94 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "DELETE /v2.0/ports/8399f9d2-a4ba-41af-8b3d-ae2a761a84ca HTTP/1.1" status: 204 len: 168 time: 1.0460265 Mar 24 02:13:11.668653 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:11.673018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56668) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:11.686235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af614091-283d-4570-b84b-7b803c2a71f7 req-1d3ea4c6-2021-469b-9dbe-03983b439b5c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:11.688072 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af614091-283d-4570-b84b-7b803c2a71f7 req-1d3ea4c6-2021-469b-9dbe-03983b439b5c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3079367 Mar 24 02:13:11.689530 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ed530a58-9ca5-4e5c-be94-feaeea0ec606 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:11.693376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f565ae-8b16-4c83-b34c-7350aa46cdd0 None None] Pushing event updated for resources: {'Port': ['ID=f60f9893-f4c4-42d5-968b-bf4e3aeffefb,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:11.696336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Request body: {'port': {'name': 'tempest-new-port-name-587221058', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:11.696963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.api.validators [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] bootfile-name is not in valid_values {{(pid=104036) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:13:11.697497 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.api.validators [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] tftp-server is not in valid_values {{(pid=104036) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:13:11.698021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.api.validators [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] server-ip-address is not in valid_values {{(pid=104036) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Mar 24 02:13:11.701651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:11.710778 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:11.711751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.738377 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (5ae6b345-443c-4040-84bd-8c9058264436), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.800725 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af614091-283d-4570-b84b-7b803c2a71f7 req-41b26104-54da-48d7-9d3c-4eadf9989bb4 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1041040 Mar 24 02:13:11.808897 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: ed530a58-9ca5-4e5c-be94-feaeea0ec606 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:11.809236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ed530a58-9ca5-4e5c-be94-feaeea0ec606 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:11.829218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-eae6b996-92ff-438d-b387-07e2192171c9 None None] Current status of the port 14392940-0f97-466b-8ec5-9cec4f7bf990 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:11.874590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56670) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:11.876588 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=14392940-0f97-466b-8ec5-9cec4f7bf990,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:11.988366 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (5ae6b345-443c-4040-84bd-8c9058264436), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:11.990252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Port': ['ID=877298c2-b172-4600-820f-4ebf49da2a4c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:11.995220 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (5ae6b345-443c-4040-84bd-8c9058264436), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.031842 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56674) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:12.039309 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a4d8b380-3b75-4911-9667-92cd527e8404 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 2.8183925 Mar 24 02:13:12.083805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-006304c2-4783-4982-973e-f913f3e56472 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-1898277536'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:12.084257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-006304c2-4783-4982-973e-f913f3e56472 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Unknown quota resources ['metering_label']. {{(pid=104037) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Mar 24 02:13:12.145346 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.180004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4ef852c1-a43e-4b92-990e-6150318ca02f None None] Provisioning complete for port 14392940-0f97-466b-8ec5-9cec4f7bf990 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:12.180828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4ef852c1-a43e-4b92-990e-6150318ca02f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.183404 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-27ca7a30-c812-4ba4-b9a6-282a9a443209 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Deleting subnet dd332db5-c958-4e28-9386-ce0c0415aad7 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:12.186886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27ca7a30-c812-4ba4-b9a6-282a9a443209 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for subnet (dd332db5-c958-4e28-9386-ce0c0415aad7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.196176 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (5ae6b345-443c-4040-84bd-8c9058264436), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.196748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Fanout notify agent at l3_agent the message router_deleted on router 5ae6b345-443c-4040-84bd-8c9058264436 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:12.210256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.216168 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e6cbd393-049f-42df-baf9-eb1b0d0d32e3 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/5ae6b345-443c-4040-84bd-8c9058264436 HTTP/1.1" status: 204 len: 168 time: 3.5317137 Mar 24 02:13:12.216794 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56676) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:12.237277 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-31dbd2d9-5b31-4224-a87a-9513bc128708 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1691621940', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:12.244051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f11978ca-22bc-4e82-8e9e-5a3476c47098 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port c08d4ace-f0bf-4492-a3f9-f49cb1c331d6 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:12.244393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11978ca-22bc-4e82-8e9e-5a3476c47098 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c08d4ace-f0bf-4492-a3f9-f49cb1c331d6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.251927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27ca7a30-c812-4ba4-b9a6-282a9a443209 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (dd332db5-c958-4e28-9386-ce0c0415aad7), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.379129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4ef852c1-a43e-4b92-990e-6150318ca02f None None] Current status of the port 14392940-0f97-466b-8ec5-9cec4f7bf990 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:12.395680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4ef852c1-a43e-4b92-990e-6150318ca02f None None] Provisioning complete for port ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:12.396417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4ef852c1-a43e-4b92-990e-6150318ca02f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.482866 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4ef852c1-a43e-4b92-990e-6150318ca02f None None] Port ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:12.509454 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27ca7a30-c812-4ba4-b9a6-282a9a443209 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (dd332db5-c958-4e28-9386-ce0c0415aad7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.645140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-72022401-8f80-4a20-87b7-cfc7d6ad251e None None] Provisioning complete for port ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:12.646080 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-72022401-8f80-4a20-87b7-cfc7d6ad251e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.651614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11978ca-22bc-4e82-8e9e-5a3476c47098 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c08d4ace-f0bf-4492-a3f9-f49cb1c331d6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.656939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f60f9893-f4c4-42d5-968b-bf4e3aeffefb up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:12.668918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f11978ca-22bc-4e82-8e9e-5a3476c47098 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for c08d4ace-f0bf-4492-a3f9-f49cb1c331d6 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:12.705896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-006304c2-4783-4982-973e-f913f3e56472 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Publish callbacks [] for metering_label (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.707338 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-006304c2-4783-4982-973e-f913f3e56472 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 478 time: 0.8317125 Mar 24 02:13:12.711819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56678) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:12.718903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-65427868-0a39-40a6-943b-d902384f9453 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.0.0/24', 'direction': 'ingress', 'metering_label_id': 'a4becf67-32f7-481a-a5e6-9c3ad9677dc2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:12.719525 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-65427868-0a39-40a6-943b-d902384f9453 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=104037) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Mar 24 02:13:12.798771 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-72022401-8f80-4a20-87b7-cfc7d6ad251e None None] Port ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:12.815367 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2d9-5b31-4224-a87a-9513bc128708 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (25f49c4c-0d36-4e53-92a4-3025c26217a9), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.816414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2d9-5b31-4224-a87a-9513bc128708 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (25f49c4c-0d36-4e53-92a4-3025c26217a9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.852239 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.services.metering.metering_plugin [None req-65427868-0a39-40a6-943b-d902384f9453 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Mar 24 02:13:12.853775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f60f9893-f4c4-42d5-968b-bf4e3aeffefb triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:12.857334 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.870192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27ca7a30-c812-4ba4-b9a6-282a9a443209 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (dd332db5-c958-4e28-9386-ce0c0415aad7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.961712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27ca7a30-c812-4ba4-b9a6-282a9a443209 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:12.972344 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-27ca7a30-c812-4ba4-b9a6-282a9a443209 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/subnets/dd332db5-c958-4e28-9386-ce0c0415aad7 HTTP/1.1" status: 204 len: 168 time: 0.9394507 Mar 24 02:13:12.979857 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56684) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:13.002722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-edb5d684-2171-442a-af2d-29c8c0581058 None None] Provisioning complete for port 5409f9de-8bc5-4759-b83d-7e43b77c377d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:13.003259 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edb5d684-2171-442a-af2d-29c8c0581058 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.095745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27ca7a30-c812-4ba4-b9a6-282a9a443209 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Subnet': ['ID=dd332db5-c958-4e28-9386-ce0c0415aad7,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:13.109992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1ed9882-2d29-4e13-8390-9379f20193c9 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:13.111557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1ed9882-2d29-4e13-8390-9379f20193c9 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:13.113019 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a1ed9882-2d29-4e13-8390-9379f20193c9 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.1307306 Mar 24 02:13:13.113550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f60f9893-f4c4-42d5-968b-bf4e3aeffefb is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:13.114062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.114435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11978ca-22bc-4e82-8e9e-5a3476c47098 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c08d4ace-f0bf-4492-a3f9-f49cb1c331d6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.134598 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56686) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:13.212867 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-edb5d684-2171-442a-af2d-29c8c0581058 None None] Current status of the port 5409f9de-8bc5-4759-b83d-7e43b77c377d is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:13.213413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edb5d684-2171-442a-af2d-29c8c0581058 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.224113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f11978ca-22bc-4e82-8e9e-5a3476c47098 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=c08d4ace-f0bf-4492-a3f9-f49cb1c331d6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:13.283673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port f60f9893-f4c4-42d5-968b-bf4e3aeffefb, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f60f9893-f4c4-42d5-968b-bf4e3aeffefb,segment=NetworkSegment(d2aa1cfc-aa62-47aa-9135-047a2ea22478),segment_id=d2aa1cfc-aa62-47aa-9135-047a2ea22478)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:13.288803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acd0b7cb-a73f-4602-bc16-a0491d92bfc3 None None] Network 3cc171f1-45cd-4c0d-af46-657530acea1a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:13.292603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-edb5d684-2171-442a-af2d-29c8c0581058 None None] For port 5409f9de-8bc5-4759-b83d-7e43b77c377d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5409f9de-8bc5-4759-b83d-7e43b77c377d,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:13.320977 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.321769 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5409f9de-8bc5-4759-b83d-7e43b77c377d up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:13.414780 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks [] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.446674 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=f60f9893-f4c4-42d5-968b-bf4e3aeffefb,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:13.449739 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edb5d684-2171-442a-af2d-29c8c0581058 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.463773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-edb5d684-2171-442a-af2d-29c8c0581058 None None] Could not find standard attr ID for object 8399f9d2-a4ba-41af-8b3d-ae2a761a84ca. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:13:13.465323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.527202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2d9-5b31-4224-a87a-9513bc128708 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (25f49c4c-0d36-4e53-92a4-3025c26217a9), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.589718 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11978ca-22bc-4e82-8e9e-5a3476c47098 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.596814 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f11978ca-22bc-4e82-8e9e-5a3476c47098 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/c08d4ace-f0bf-4492-a3f9-f49cb1c331d6 HTTP/1.1" status: 204 len: 168 time: 2.3496964 Mar 24 02:13:13.631341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56688) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:13.635076 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb5d684-2171-442a-af2d-29c8c0581058 None None] Pushing event updated for resources: {'Port': ['ID=5409f9de-8bc5-4759-b83d-7e43b77c377d,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:13.648597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-65427868-0a39-40a6-943b-d902384f9453 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Publish callbacks [] for metering_label_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.650356 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-65427868-0a39-40a6-943b-d902384f9453 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.9375381 Mar 24 02:13:13.654510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56690) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:13.657576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2d9-5b31-4224-a87a-9513bc128708 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (25f49c4c-0d36-4e53-92a4-3025c26217a9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.662268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5d2abd4f-0826-437e-bb34-3c1601ab7603 None None] Provisioning complete for port f60f9893-f4c4-42d5-968b-bf4e3aeffefb triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:13.663853 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5d2abd4f-0826-437e-bb34-3c1601ab7603 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.670259 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-80f762a9-5eff-4588-80b5-021b18f55400 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.1.0/24', 'direction': 'ingress', 'metering_label_id': 'a4becf67-32f7-481a-a5e6-9c3ad9677dc2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:13.672897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-80f762a9-5eff-4588-80b5-021b18f55400 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=104037) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Mar 24 02:13:13.740433 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5ae4f69b-8625-488b-bc5e-a560d7e4a13b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (3cc171f1-45cd-4c0d-af46-657530acea1a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.741767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 5409f9de-8bc5-4759-b83d-7e43b77c377d triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:13.742366 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.780108 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.services.metering.metering_plugin [None req-80f762a9-5eff-4588-80b5-021b18f55400 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Mar 24 02:13:13.780337 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-5ae4f69b-8625-488b-bc5e-a560d7e4a13b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): There was a conflict when trying to complete your request. Mar 24 02:13:13.783651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5ae4f69b-8625-488b-bc5e-a560d7e4a13b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:13.792681 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5ae4f69b-8625-488b-bc5e-a560d7e4a13b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/3cc171f1-45cd-4c0d-af46-657530acea1a HTTP/1.1" status: 409 len: 466 time: 0.6515887 Mar 24 02:13:13.793469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event updated for resources: {'Port': ['ID=ed6e8479-974b-48e7-8ea6-3f208d3bb2c4,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:13.808721 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56692) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:13.811612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2d9-5b31-4224-a87a-9513bc128708 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.813179 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-31dbd2d9-5b31-4224-a87a-9513bc128708 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 1.5932493 Mar 24 02:13:13.818788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-504027684'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:13.822298 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] In _notify_port_updated(), no bound segment for port ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 on network d7f5822e-534f-40d8-be30-994a25f1a852 {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:13:13.828222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:13.829008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.832867 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d9189cfe-be5f-447d-886f-530c05bfcc7b tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "PUT /v2.0/ports/ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 HTTP/1.1" status: 200 len: 1135 time: 2.1411753 Mar 24 02:13:13.832867 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56694) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:13.836968 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:13.841557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56696) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:13.892436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5409f9de-8bc5-4759-b83d-7e43b77c377d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:13.893691 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 14392940-0f97-466b-8ec5-9cec4f7bf990 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:13.930835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4176ba6-0368-486d-ada4-f5363ab40c5d None None] DHCP port deletion for 3cc171f1-45cd-4c0d-af46-657530acea1a request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:13.957904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5d2abd4f-0826-437e-bb34-3c1601ab7603 None None] Current status of the port f60f9893-f4c4-42d5-968b-bf4e3aeffefb is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:13.980787 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-672c5643-5ce7-4d39-94bb-e3eec451281a tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:13.981801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80f762a9-5eff-4588-80b5-021b18f55400 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Publish callbacks [] for metering_label_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.987642 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-672c5643-5ce7-4d39-94bb-e3eec451281a tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "GET /v2.0/ports/ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 HTTP/1.1" status: 200 len: 1135 time: 0.1398189 Mar 24 02:13:13.987642 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:13.987806 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-80f762a9-5eff-4588-80b5-021b18f55400 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.3211348 Mar 24 02:13:13.989317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56698) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:13.989622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:13.989732 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5d2abd4f-0826-437e-bb34-3c1601ab7603 None None] Could not find standard attr ID for object c08d4ace-f0bf-4492-a3f9-f49cb1c331d6. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:13:13.990058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56700) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:14.015799 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 14392940-0f97-466b-8ec5-9cec4f7bf990 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:14.016234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.016630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 129} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:14.026757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (058d03ac-dc6d-40ab-9d91-94bd4a3f99fa), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.027188 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Added segment 058d03ac-dc6d-40ab-9d91-94bd4a3f99fa of type vlan for network 7479113e-3c60-4d73-a4bc-70e500a7c21b Mar 24 02:13:14.067991 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f4176ba6-0368-486d-ada4-f5363ab40c5d None None] Deleting port f60f9893-f4c4-42d5-968b-bf4e3aeffefb {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:14.068284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f4176ba6-0368-486d-ada4-f5363ab40c5d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.069040 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (7479113e-3c60-4d73-a4bc-70e500a7c21b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.072406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c492481-1b63-465f-9d1c-c6003bb3aeb6 req-fbe3af15-c9b7-437d-a6cc-681f5e44ec26 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:14.073628 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9c492481-1b63-465f-9d1c-c6003bb3aeb6 req-fbe3af15-c9b7-437d-a6cc-681f5e44ec26 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 1.1165252 Mar 24 02:13:14.124209 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fde4b9a6-46d7-4b63-bc84-68a418ac4766 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-label-rules?id=db82f37d-c93f-4ccd-a13a-182c52626151 HTTP/1.1" status: 200 len: 464 time: 0.1237433 Mar 24 02:13:14.129069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18df30ca-f0bd-4bfa-ba14-34b5d6e0ce17 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:14.131762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18df30ca-f0bd-4bfa-ba14-34b5d6e0ce17 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:14.135804 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-18df30ca-f0bd-4bfa-ba14-34b5d6e0ce17 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.4966185 Mar 24 02:13:14.136974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56702) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:14.137425 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56704) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:14.170103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-67bc8615-0638-4cf0-9fc5-fe96099a74ed None None] Provisioning complete for port ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:14.170610 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-67bc8615-0638-4cf0-9fc5-fe96099a74ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.207159 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9c492481-1b63-465f-9d1c-c6003bb3aeb6 req-a3644428-a7eb-457e-b2b0-77ec2f57440f tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0995021 Mar 24 02:13:14.242072 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-653215a9-e3e0-4960-9c30-65768552caf0 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Deleting port ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:14.242420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-653215a9-e3e0-4960-9c30-65768552caf0 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.339801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (7479113e-3c60-4d73-a4bc-70e500a7c21b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.345204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:14.345821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.358434 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-653215a9-e3e0-4960-9c30-65768552caf0 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.359936 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f4176ba6-0368-486d-ada4-f5363ab40c5d None None] For port f60f9893-f4c4-42d5-968b-bf4e3aeffefb, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f60f9893-f4c4-42d5-968b-bf4e3aeffefb,segment=NetworkSegment(d2aa1cfc-aa62-47aa-9135-047a2ea22478),segment_id=d2aa1cfc-aa62-47aa-9135-047a2ea22478)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:14.360344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f4176ba6-0368-486d-ada4-f5363ab40c5d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.363613 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 14392940-0f97-466b-8ec5-9cec4f7bf990 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:14.373773 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-653215a9-e3e0-4960-9c30-65768552caf0 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Calling delete_port for ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:14.382890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f4176ba6-0368-486d-ada4-f5363ab40c5d None None] Calling delete_port for f60f9893-f4c4-42d5-968b-bf4e3aeffefb owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:14.384584 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-67bc8615-0638-4cf0-9fc5-fe96099a74ed None None] Port ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:14.390117 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (25f49c4c-0d36-4e53-92a4-3025c26217a9), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.405183 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-d58e1758-4fab-401a-96c2-73b2bd228734 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 1bb4f5b0-a007-4763-bc4d-79c61bcc0a53 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:14.408727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d58e1758-4fab-401a-96c2-73b2bd228734 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (1bb4f5b0-a007-4763-bc4d-79c61bcc0a53), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.472526 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f4176ba6-0368-486d-ada4-f5363ab40c5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (f60f9893-f4c4-42d5-968b-bf4e3aeffefb), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.493216 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d58e1758-4fab-401a-96c2-73b2bd228734 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (1bb4f5b0-a007-4763-bc4d-79c61bcc0a53), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.503068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5409f9de-8bc5-4759-b83d-7e43b77c377d up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:14.506808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4176ba6-0368-486d-ada4-f5363ab40c5d None None] Pushing event deleted for resources: {'Port': ['ID=f60f9893-f4c4-42d5-968b-bf4e3aeffefb,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:14.512503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-facb0b96-6a73-430a-b920-bf135834ed0b tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Publish callbacks [] for metering_label_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.516453 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-facb0b96-6a73-430a-b920-bf135834ed0b tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "DELETE /v2.0/metering/metering-label-rules/db82f37d-c93f-4ccd-a13a-182c52626151 HTTP/1.1" status: 204 len: 168 time: 0.3765419 Mar 24 02:13:14.517458 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56706) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:14.533515 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4176ba6-0368-486d-ada4-f5363ab40c5d None None] No DVR routers for this DVR port f60f9893-f4c4-42d5-968b-bf4e3aeffefb on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:14.551363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-653215a9-e3e0-4960-9c30-65768552caf0 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ed6e8479-974b-48e7-8ea6-3f208d3bb2c4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.567368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 5409f9de-8bc5-4759-b83d-7e43b77c377d triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:14.567842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.580289 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-653215a9-e3e0-4960-9c30-65768552caf0 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event deleted for resources: {'Port': ['ID=ed6e8479-974b-48e7-8ea6-3f208d3bb2c4,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:14.654445 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.8400812 Mar 24 02:13:14.661409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56708) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:14.661610 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8ebfde2f-cd77-457f-b951-3e13d4177bf4 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-label-rules?id=db82f37d-c93f-4ccd-a13a-182c52626151 HTTP/1.1" status: 200 len: 221 time: 0.0823853 Mar 24 02:13:14.666286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'subnet': {'network_id': '7479113e-3c60-4d73-a4bc-70e500a7c21b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:14.667516 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5409f9de-8bc5-4759-b83d-7e43b77c377d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:14.669488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56710) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:14.674968 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e0a3235e-4079-4599-958d-adb4c14223b0 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--1079866868', 'description': 'label created by tempest'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:14.675416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e0a3235e-4079-4599-958d-adb4c14223b0 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Unknown quota resources ['metering_label']. {{(pid=104036) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Mar 24 02:13:14.689933 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37cff480-461e-493e-8821-170f4b3809b2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Network': ['ID=7479113e-3c60-4d73-a4bc-70e500a7c21b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:14.704078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 7479113e-3c60-4d73-a4bc-70e500a7c21b details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:14.771664 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f60f9893-f4c4-42d5-968b-bf4e3aeffefb no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:14.788538 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-653215a9-e3e0-4960-9c30-65768552caf0 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.792420 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-653215a9-e3e0-4960-9c30-65768552caf0 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "DELETE /v2.0/ports/ed6e8479-974b-48e7-8ea6-3f208d3bb2c4 HTTP/1.1" status: 204 len: 168 time: 0.7853141 Mar 24 02:13:14.793193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:14.796674 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:14.800770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56712) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:14.805051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: f60f9893-f4c4-42d5-968b-bf4e3aeffefb {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:14.805720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f60f9893-f4c4-42d5-968b-bf4e3aeffefb not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:14.885211 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.071616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:13:15.073319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (a6b68e0a-4c16-4a41-a222-373e029b1e0e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.189181 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Subnet': ['ID=a6b68e0a-4c16-4a41-a222-373e029b1e0e,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:15.210882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Checking segment: {'id': '058d03ac-dc6d-40ab-9d91-94bd4a3f99fa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '7479113e-3c60-4d73-a4bc-70e500a7c21b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:15.211234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network hostable DHCP agents. Network: 7479113e-3c60-4d73-a4bc-70e500a7c21b, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:15.228261 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-0365820c-b54c-4b18-8a1b-d4ef67624a28 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1152308 Mar 24 02:13:15.237164 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d58e1758-4fab-401a-96c2-73b2bd228734 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (1bb4f5b0-a007-4763-bc4d-79c61bcc0a53), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.238070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network 7479113e-3c60-4d73-a4bc-70e500a7c21b is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:15.248103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 7479113e-3c60-4d73-a4bc-70e500a7c21b) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:15.258164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:15.259922 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9dbac56-4d04-46f1-ba0b-06316d407e46 None None] Network 7479113e-3c60-4d73-a4bc-70e500a7c21b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:15.261146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.287574 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cea2447e-56bc-46fd-9a30-6650460d35f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 818 time: 0.6235948 Mar 24 02:13:15.288565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56716) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:15.329404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e0a3235e-4079-4599-958d-adb4c14223b0 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Publish callbacks [] for metering_label (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.330597 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e0a3235e-4079-4599-958d-adb4c14223b0 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 470 time: 0.6592188 Mar 24 02:13:15.338090 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-01976dff-2c4a-4821-8d52-6cc1969fc720 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Deleting subnet 858e8e5b-7f72-41ba-9520-39c18f731457 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:15.340038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56718) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:15.352070 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-01976dff-2c4a-4821-8d52-6cc1969fc720 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks [] for subnet (858e8e5b-7f72-41ba-9520-39c18f731457), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.403408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-7479113e-3c60-4d73-a4bc-70e500a7c21b', 'network_id': '7479113e-3c60-4d73-a4bc-70e500a7c21b', 'project_id': '0a478f43194148c295b3c5808a7fb554', 'fixed_ips': [{'subnet_id': 'a6b68e0a-4c16-4a41-a222-373e029b1e0e'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:15.404444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.439806 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2d626a9c-d2bb-4aa9-b8aa-c668060dec0b tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-labels?id=01185f08-ca08-41c3-bee8-a36efbdccfb3 HTTP/1.1" status: 200 len: 468 time: 0.0941401 Mar 24 02:13:15.445187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56720) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:15.455556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-01976dff-2c4a-4821-8d52-6cc1969fc720 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (858e8e5b-7f72-41ba-9520-39c18f731457), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.458384 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d58e1758-4fab-401a-96c2-73b2bd228734 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (1bb4f5b0-a007-4763-bc4d-79c61bcc0a53), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.534717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-a6a0719f-34f7-466a-9c3d-fb69c68e19cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:15.536691 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-a6a0719f-34f7-466a-9c3d-fb69c68e19cc service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d597f5a6c32e40b9b8f2e09949c6fcfd&device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 1130 time: 0.2256811 Mar 24 02:13:15.548220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a9f3c5-b943-429f-8077-e3a360d483e4 req-6449323a-f8e7-4787-ae2a-337c20d86138 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:15.550031 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-08a9f3c5-b943-429f-8077-e3a360d483e4 req-6449323a-f8e7-4787-ae2a-337c20d86138 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1925781 Mar 24 02:13:15.556762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Allocated IP 2001:db8::f816:3eff:fe6b:a9d5 (7479113e-3c60-4d73-a4bc-70e500a7c21b/a6b68e0a-4c16-4a41-a222-373e029b1e0e/91f6df15-fa5c-471f-a9a2-84773c65ec14) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:15.562741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (7479113e-3c60-4d73-a4bc-70e500a7c21b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.573360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e544ee43-b4ac-4456-87c5-a4634e21f4eb None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:15.576392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d58e1758-4fab-401a-96c2-73b2bd228734 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.586101 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d58e1758-4fab-401a-96c2-73b2bd228734 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/1bb4f5b0-a007-4763-bc4d-79c61bcc0a53 HTTP/1.1" status: 204 len: 168 time: 1.4449277 Mar 24 02:13:15.589678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d58e1758-4fab-401a-96c2-73b2bd228734 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=1bb4f5b0-a007-4763-bc4d-79c61bcc0a53,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:15.593324 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56722) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:15.650648 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a7f28cae-5490-47a8-bd8a-c4fb91008477 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0466623 Mar 24 02:13:15.650648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56724) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:15.715204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (25f49c4c-0d36-4e53-92a4-3025c26217a9), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.740939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.763682 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-01976dff-2c4a-4821-8d52-6cc1969fc720 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (858e8e5b-7f72-41ba-9520-39c18f731457), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.795016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Publish callbacks [] for port (91f6df15-fa5c-471f-a9a2-84773c65ec14), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.805802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (91f6df15-fa5c-471f-a9a2-84773c65ec14), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.849837 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5eeeb2f-cf03-424d-bb8f-65574b033dd2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:15.853782 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c5eeeb2f-cf03-424d-bb8f-65574b033dd2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.2021432 Mar 24 02:13:15.856400 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56726) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:15.856961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Network 7479113e-3c60-4d73-a4bc-70e500a7c21b is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:15.864062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:15.864870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-76f91a5b-935a-4b0c-8357-fcdcee114a06 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Publish callbacks [] for metering_label (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.868932 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:15.869722 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-76f91a5b-935a-4b0c-8357-fcdcee114a06 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "DELETE /v2.0/metering/metering-labels/01185f08-ca08-41c3-bee8-a36efbdccfb3 HTTP/1.1" status: 204 len: 168 time: 0.4228117 Mar 24 02:13:15.873267 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56728) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:15.887461 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2359db4-9eb6-4757-b107-95107402a01e None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:15.897188 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-08a9f3c5-b943-429f-8077-e3a360d483e4 req-19d1fa04-53b4-4705-964b-e74f0791912e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3283665 Mar 24 02:13:15.906212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Pushing event updated for resources: {'Port': ['ID=91f6df15-fa5c-471f-a9a2-84773c65ec14,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:15.920139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-e6192c8c-66a6-4bf6-8dde-4e9182f9ca5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:15.921654 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-e6192c8c-66a6-4bf6-8dde-4e9182f9ca5b service neutron] 10.222.0.30 "GET /v2.0/networks?id=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 HTTP/1.1" status: 200 len: 912 time: 0.3327932 Mar 24 02:13:15.922414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (a6b68e0a-4c16-4a41-a222-373e029b1e0e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:15.961477 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9928dfab-e87a-4a42-881c-cc8467ef92d3 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-labels?id=01185f08-ca08-41c3-bee8-a36efbdccfb3 HTTP/1.1" status: 200 len: 216 time: 0.0809603 Mar 24 02:13:15.968648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56730) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:15.989175 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Allocated IP 172.26.2.47 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/5848e77c-4047-4a29-bdc6-dc1829e9725f) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:15.995184 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Attempting to bind port 91f6df15-fa5c-471f-a9a2-84773c65ec14 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:15.995639 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Attempting to bind port 91f6df15-fa5c-471f-a9a2-84773c65ec14 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '058d03ac-dc6d-40ab-9d91-94bd4a3f99fa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '7479113e-3c60-4d73-a4bc-70e500a7c21b'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:15.996390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Attempting to bind port 91f6df15-fa5c-471f-a9a2-84773c65ec14 on network 7479113e-3c60-4d73-a4bc-70e500a7c21b {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:15.999315 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46b77051-0f85-4ca4-bceb-9733367f581a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:16.000764 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-46b77051-0f85-4ca4-bceb-9733367f581a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1436222 Mar 24 02:13:16.001966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-01976dff-2c4a-4821-8d52-6cc1969fc720 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (858e8e5b-7f72-41ba-9520-39c18f731457), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.005657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56732) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:16.007206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:16.007661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Checking segment: {'id': '058d03ac-dc6d-40ab-9d91-94bd4a3f99fa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '7479113e-3c60-4d73-a4bc-70e500a7c21b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:16.008073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.008555 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Bound using segment: {'id': '058d03ac-dc6d-40ab-9d91-94bd4a3f99fa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '7479113e-3c60-4d73-a4bc-70e500a7c21b'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:16.009119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Bound port: 91f6df15-fa5c-471f-a9a2-84773c65ec14, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '058d03ac-dc6d-40ab-9d91-94bd4a3f99fa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '7479113e-3c60-4d73-a4bc-70e500a7c21b'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:16.009563 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (91f6df15-fa5c-471f-a9a2-84773c65ec14), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.012551 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a6d73d3c-323d-46ff-b345-34f6048061c7 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0384531 Mar 24 02:13:16.017711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56734) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:16.028188 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f2359db4-9eb6-4757-b107-95107402a01e None None] Deleting port 5409f9de-8bc5-4759-b83d-7e43b77c377d {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:16.028648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f2359db4-9eb6-4757-b107-95107402a01e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.043234 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c8b7d982-10a8-4526-ac87-3d90be3c3926 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0242755 Mar 24 02:13:16.048698 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56736) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:16.078176 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01976dff-2c4a-4821-8d52-6cc1969fc720 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event deleted for resources: {'Subnet': ['ID=858e8e5b-7f72-41ba-9520-39c18f731457,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:16.082706 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-623deee0-af96-40ae-bbdf-4c78646609de tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0717046 Mar 24 02:13:16.086370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-01976dff-2c4a-4821-8d52-6cc1969fc720 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.092123 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-01976dff-2c4a-4821-8d52-6cc1969fc720 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "DELETE /v2.0/subnets/858e8e5b-7f72-41ba-9520-39c18f731457 HTTP/1.1" status: 204 len: 168 time: 1.2903602 Mar 24 02:13:16.095653 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56738) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:16.096276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56740) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:16.109638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:16.111522 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6b064b6-9b57-42f0-8fc3-23283ed1bb46 None None] Network d7f5822e-534f-40d8-be30-994a25f1a852 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:16.129106 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9511dfdb-2cbb-4b01-91ab-d3f2ce6e1144 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-labels/a4becf67-32f7-481a-a5e6-9c3ad9677dc2 HTTP/1.1" status: 200 len: 473 time: 0.0792749 Mar 24 02:13:16.134227 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-5f1235cc-1287-4961-af3d-e57b30e1b0c7 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=dba04693-4495-4586-b5e4-7de9e3b2abd3 HTTP/1.1" status: 200 len: 1001 time: 0.1878724 Mar 24 02:13:16.134946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56742) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:16.156366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (a6b68e0a-4c16-4a41-a222-373e029b1e0e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.174108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f2359db4-9eb6-4757-b107-95107402a01e None None] For port 5409f9de-8bc5-4759-b83d-7e43b77c377d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5409f9de-8bc5-4759-b83d-7e43b77c377d,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:16.174503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f2359db4-9eb6-4757-b107-95107402a01e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.192751 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6ef17d65-cd15-4dbd-83b4-234e8ee81839 tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "GET /v2.0/metering/metering-label-rules/c692b2c1-0357-44fa-a6e3-4cd444331d26 HTTP/1.1" status: 200 len: 461 time: 0.0448089 Mar 24 02:13:16.207993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f2359db4-9eb6-4757-b107-95107402a01e None None] Calling delete_port for 5409f9de-8bc5-4759-b83d-7e43b77c377d owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:16.212395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] For port 91f6df15-fa5c-471f-a9a2-84773c65ec14, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:16.223518 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56744) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:16.232135 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Subnet': ['ID=a6b68e0a-4c16-4a41-a222-373e029b1e0e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:16.253126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] For port 91f6df15-fa5c-471f-a9a2-84773c65ec14, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=91f6df15-fa5c-471f-a9a2-84773c65ec14,segment=NetworkSegment(058d03ac-dc6d-40ab-9d91-94bd4a3f99fa),segment_id=058d03ac-dc6d-40ab-9d91-94bd4a3f99fa)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:16.254280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-c3277656-0ee0-4fe4-90c8-46ceb8566100 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:16.256304 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-c3277656-0ee0-4fe4-90c8-46ceb8566100 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dfc73b89-587b-4f56-aa2b-706a8f904224 HTTP/1.1" status: 200 len: 850 time: 0.1112232 Mar 24 02:13:16.286395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (91f6df15-fa5c-471f-a9a2-84773c65ec14), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.311357 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (d7f5822e-534f-40d8-be30-994a25f1a852), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.337586 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (7479113e-3c60-4d73-a4bc-70e500a7c21b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.372021 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-4e176a08-c72d-4963-b7af-e02988646edd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:16.374075 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-4e176a08-c72d-4963-b7af-e02988646edd service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0880361 Mar 24 02:13:16.380162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7479113e-3c60-4d73-a4bc-70e500a7c21b']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:16.401675 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5a8b2cd-3b36-4578-a91c-d825f521987b None None] Pushing event updated for resources: {'Port': ['ID=91f6df15-fa5c-471f-a9a2-84773c65ec14,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:16.422825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f2359db4-9eb6-4757-b107-95107402a01e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (5409f9de-8bc5-4759-b83d-7e43b77c377d), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.444031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for port (5848e77c-4047-4a29-bdc6-dc1829e9725f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.448781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dbf378e0-ff2f-406e-a0fe-69ee2de0bd9f tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Publish callbacks [] for metering_label_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.452466 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dbf378e0-ff2f-406e-a0fe-69ee2de0bd9f tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "DELETE /v2.0/metering/metering-label-rules/c692b2c1-0357-44fa-a6e3-4cd444331d26 HTTP/1.1" status: 204 len: 168 time: 0.2214484 Mar 24 02:13:16.465337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:16.468797 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.470695 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2359db4-9eb6-4757-b107-95107402a01e None None] Pushing event deleted for resources: {'Port': ['ID=5409f9de-8bc5-4759-b83d-7e43b77c377d,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:16.471738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56748) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:16.473208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2359db4-9eb6-4757-b107-95107402a01e None None] No DVR routers for this DVR port 5409f9de-8bc5-4759-b83d-7e43b77c377d on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:16.495499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de49f332-8537-4231-b4b3-33c19617095b None None] DHCP port deletion for d7f5822e-534f-40d8-be30-994a25f1a852 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:16.521896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '058d03ac-dc6d-40ab-9d91-94bd4a3f99fa') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:16.530916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '058d03ac-dc6d-40ab-9d91-94bd4a3f99fa') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:16.551352 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (058d03ac-dc6d-40ab-9d91-94bd4a3f99fa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.573060 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-c4acf54f-d83b-4dd1-9ef4-db5bc2bd77e1 service neutron] 10.222.0.30 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1863987 Mar 24 02:13:16.578629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (058d03ac-dc6d-40ab-9d91-94bd4a3f99fa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.591187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-de49f332-8537-4231-b4b3-33c19617095b None None] Deleting port 14392940-0f97-466b-8ec5-9cec4f7bf990 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:16.591855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de49f332-8537-4231-b4b3-33c19617095b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.659496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Releasing vlan 129 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:16.659899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (058d03ac-dc6d-40ab-9d91-94bd4a3f99fa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:16.662982 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:16.673564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5409f9de-8bc5-4759-b83d-7e43b77c377d no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:16.678629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-de49f332-8537-4231-b4b3-33c19617095b None None] For port 14392940-0f97-466b-8ec5-9cec4f7bf990, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=14392940-0f97-466b-8ec5-9cec4f7bf990,segment=NetworkSegment(b7f27dc5-bad5-4e56-8046-14e2dd220868),segment_id=b7f27dc5-bad5-4e56-8046-14e2dd220868)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:16.679037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de49f332-8537-4231-b4b3-33c19617095b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.713239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 5409f9de-8bc5-4759-b83d-7e43b77c377d {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:16.713650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5409f9de-8bc5-4759-b83d-7e43b77c377d not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:16.733535 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-de49f332-8537-4231-b4b3-33c19617095b None None] Calling delete_port for 14392940-0f97-466b-8ec5-9cec4f7bf990 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:16.741487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.db.api [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Mar 24 02:13:16.741487 dv-neutron-834874-3-hyperv neutron-server[104037]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Mar 24 02:13:16.741487 dv-neutron-834874-3-hyperv neutron-server[104037]: [parameters: {'id': '7479113e-3c60-4d73-a4bc-70e500a7c21b'}] Mar 24 02:13:16.741487 dv-neutron-834874-3-hyperv neutron-server[104037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104037) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:13:16.741912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG oslo_db.api [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:13:16.771585 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa2ee8e2-8254-486f-a8ba-cf9a4360dd7e req-34991ad9-da9c-496c-b146-b422b6c52b3c service neutron] 10.222.0.30 "GET /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1821575 Mar 24 02:13:16.798197 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (5848e77c-4047-4a29-bdc6-dc1829e9725f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.856985 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de49f332-8537-4231-b4b3-33c19617095b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.890531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de49f332-8537-4231-b4b3-33c19617095b None None] No DVR routers for this DVR port 14392940-0f97-466b-8ec5-9cec4f7bf990 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:16.892158 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de49f332-8537-4231-b4b3-33c19617095b None None] Pushing event deleted for resources: {'Port': ['ID=14392940-0f97-466b-8ec5-9cec4f7bf990,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:16.954896 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Deleting port 14392940-0f97-466b-8ec5-9cec4f7bf990 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:16.955204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.983335 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e8832a01-027b-4fae-95e7-d463d6d21eec tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] Publish callbacks [] for metering_label (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:16.984476 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e8832a01-027b-4fae-95e7-d463d6d21eec tempest-MeteringTestJSON-740192249 tempest-MeteringTestJSON-740192249-project-admin] 10.222.0.20 "DELETE /v2.0/metering/metering-labels/a4becf67-32f7-481a-a5e6-9c3ad9677dc2 HTTP/1.1" status: 204 len: 168 time: 0.5090508 Mar 24 02:13:17.004038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:17.043445 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:17.045337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event updated for resources: {'Port': ['ID=5848e77c-4047-4a29-bdc6-dc1829e9725f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:17.048521 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:17.068186 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32318826-9b0b-4773-8d93-7335a6880c41 req-e5811c4f-1260-402e-9ef8-67d3293bc4da tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:17.071088 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-32318826-9b0b-4773-8d93-7335a6880c41 req-e5811c4f-1260-402e-9ef8-67d3293bc4da tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.0700326 Mar 24 02:13:17.118570 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-32318826-9b0b-4773-8d93-7335a6880c41 req-9f16175c-f0a4-41a5-a748-e4527c952b28 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428340 Mar 24 02:13:17.132616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] For port 14392940-0f97-466b-8ec5-9cec4f7bf990, host dv-neutron-834874-3-hyperv, got binding levels [] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:17.133014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.152416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Calling delete_port for 14392940-0f97-466b-8ec5-9cec4f7bf990 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:17.154665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (2d62ad68-cfb0-40ad-a843-22efd731a467), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.158255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Port 14392940-0f97-466b-8ec5-9cec4f7bf990 was not found and therefore no delete operation was performed {{(pid=104036) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:571}} Mar 24 02:13:17.221992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (14392940-0f97-466b-8ec5-9cec4f7bf990), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.242782 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (7479113e-3c60-4d73-a4bc-70e500a7c21b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.295338 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:17.305397 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event deleted for resources: {'Port': ['ID=14392940-0f97-466b-8ec5-9cec4f7bf990,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:17.307224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:17.308862 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] No DVR routers for this DVR port 14392940-0f97-466b-8ec5-9cec4f7bf990 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:17.316072 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e4c4673-3776-4228-b04c-4e327d199639 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:17.317284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:17.317884 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.319189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Deleting port 91f6df15-fa5c-471f-a9a2-84773c65ec14 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:17.319527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (91f6df15-fa5c-471f-a9a2-84773c65ec14), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.333467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56756) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:17.382082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=2d62ad68-cfb0-40ad-a843-22efd731a467,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:17.411543 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] For port 91f6df15-fa5c-471f-a9a2-84773c65ec14, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=91f6df15-fa5c-471f-a9a2-84773c65ec14,segment=NetworkSegment(058d03ac-dc6d-40ab-9d91-94bd4a3f99fa),segment_id=058d03ac-dc6d-40ab-9d91-94bd4a3f99fa)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:17.411909 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (91f6df15-fa5c-471f-a9a2-84773c65ec14), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.434853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Calling delete_port for 91f6df15-fa5c-471f-a9a2-84773c65ec14 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:17.443804 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4ef60991-5f92-474c-b1f9-e1213d3c704b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.3463421 Mar 24 02:13:17.446708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56760) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:17.452500 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': '2d62ad68-cfb0-40ad-a843-22efd731a467', 'ip_address': '2001:db8::8b2a:470d:a7d2:84ac'}], 'name': 'tempest-NetworksTestDHCPv6-742726075'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:17.473871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (d7f5822e-534f-40d8-be30-994a25f1a852), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.478034 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '2d62ad68-cfb0-40ad-a843-22efd731a467'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:17.479765 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.515307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d7f5822e-534f-40d8-be30-994a25f1a852']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:17.528869 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b7f27dc5-bad5-4e56-8046-14e2dd220868') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:17.529277 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b7f27dc5-bad5-4e56-8046-14e2dd220868') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:17.541834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (b7f27dc5-bad5-4e56-8046-14e2dd220868), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.564930 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b7f27dc5-bad5-4e56-8046-14e2dd220868), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.572171 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Releasing vlan 104 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:17.572705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (b7f27dc5-bad5-4e56-8046-14e2dd220868), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:17.620671 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:17.665706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/2d62ad68-cfb0-40ad-a843-22efd731a467/936c97e9-b5d7-4ecf-a300-c34281814f26) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:17.829959 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50df05e3-e667-4813-93f4-04c5fcb5a93a None None] Network 7479113e-3c60-4d73-a4bc-70e500a7c21b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:17.883603 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a45c25e5-b5e6-4375-a0d3-37b8ff4226a3 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.890330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Publish callbacks [] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.906588 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.946423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ffe35a26-0685-428f-a474-470446ab2e21 None None] Provisioning complete for port 91f6df15-fa5c-471f-a9a2-84773c65ec14 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:17.946813 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ffe35a26-0685-428f-a474-470446ab2e21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (91f6df15-fa5c-471f-a9a2-84773c65ec14), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:17.972830 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:13:18.001429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (91f6df15-fa5c-471f-a9a2-84773c65ec14), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.041149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (d7f5822e-534f-40d8-be30-994a25f1a852), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.042933 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Port': ['ID=91f6df15-fa5c-471f-a9a2-84773c65ec14,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:18.054687 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:18.055576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.074464 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] 10.222.0.20 "DELETE /v2.0/networks/d7f5822e-534f-40d8-be30-994a25f1a852 HTTP/1.1" status: 204 len: 168 time: 1.9659309 Mar 24 02:13:18.094300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No DVR routers for this DVR port 91f6df15-fa5c-471f-a9a2-84773c65ec14 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:18.112198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2367363b-e59e-4c2e-a9f9-9019e9261259 tempest-ExtraDHCPOptionsTestJSON-776600054 tempest-ExtraDHCPOptionsTestJSON-776600054-project] Pushing event deleted for resources: {'Network': ['ID=d7f5822e-534f-40d8-be30-994a25f1a852,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:18.127495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:18.132490 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ffe35a26-0685-428f-a474-470446ab2e21 None None] Port 91f6df15-fa5c-471f-a9a2-84773c65ec14 was deleted so its status cannot be updated. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:336}} Mar 24 02:13:18.145401 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:18.171199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:18.172838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (25f49c4c-0d36-4e53-92a4-3025c26217a9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.272965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Pushing event updated for resources: {'Port': ['ID=936c97e9-b5d7-4ecf-a300-c34281814f26,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:18.390234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (7479113e-3c60-4d73-a4bc-70e500a7c21b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.424176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.426491 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Attempting to bind port 936c97e9-b5d7-4ecf-a300-c34281814f26 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:18.426975 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Attempting to bind port 936c97e9-b5d7-4ecf-a300-c34281814f26 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:18.427255 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Attempting to bind port 936c97e9-b5d7-4ecf-a300-c34281814f26 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:18.437994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:18.438371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:18.438802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.440704 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:18.441192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Bound port: 936c97e9-b5d7-4ecf-a300-c34281814f26, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:18.441576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.460336 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7479113e-3c60-4d73-a4bc-70e500a7c21b']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:18.488555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '058d03ac-dc6d-40ab-9d91-94bd4a3f99fa') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:18.489051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '058d03ac-dc6d-40ab-9d91-94bd4a3f99fa') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:18.492771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a45c25e5-b5e6-4375-a0d3-37b8ff4226a3 admin admin] Publish callbacks [] for security_group (670b81b3-9442-4469-a53a-7b02ee36415b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.530825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa98f78f-3880-4b64-9f63-a96284f4764d None None] DHCP port deletion for 7479113e-3c60-4d73-a4bc-70e500a7c21b request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:18.538953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a45c25e5-b5e6-4375-a0d3-37b8ff4226a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (670b81b3-9442-4469-a53a-7b02ee36415b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.550321 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (058d03ac-dc6d-40ab-9d91-94bd4a3f99fa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.554411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 73aa2020-af9a-4d38-9155-f5a369b4a9e7 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:18.569775 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56768) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:18.578977 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] For port 936c97e9-b5d7-4ecf-a300-c34281814f26, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:18.580295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a4650d2-eb04-4352-bfe0-9efaa9d10eec req-7a364216-0017-490a-9bd0-780d27f8a3e4 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:18.586369 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] For port 936c97e9-b5d7-4ecf-a300-c34281814f26, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=936c97e9-b5d7-4ecf-a300-c34281814f26,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:18.586565 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2a4650d2-eb04-4352-bfe0-9efaa9d10eec req-7a364216-0017-490a-9bd0-780d27f8a3e4 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3179567 Mar 24 02:13:18.597513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.632647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (058d03ac-dc6d-40ab-9d91-94bd4a3f99fa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.633583 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (25f49c4c-0d36-4e53-92a4-3025c26217a9), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.638386 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (25f49c4c-0d36-4e53-92a4-3025c26217a9), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.651125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 14392940-0f97-466b-8ec5-9cec4f7bf990 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:18.681023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 14392940-0f97-466b-8ec5-9cec4f7bf990 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:18.681388 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 14392940-0f97-466b-8ec5-9cec4f7bf990 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:18.700407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Releasing vlan 129 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:18.700861 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (058d03ac-dc6d-40ab-9d91-94bd4a3f99fa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:18.703759 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:18.710024 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 91f6df15-fa5c-471f-a9a2-84773c65ec14 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:18.722506 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a45c25e5-b5e6-4375-a0d3-37b8ff4226a3 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=4b941858050e460e81675c21d7a590e7&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3863835 Mar 24 02:13:18.737531 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56772) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:18.742169 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d5e71b-134f-46e5-aa45-7d86ef7f39d3 None None] Pushing event updated for resources: {'Port': ['ID=936c97e9-b5d7-4ecf-a300-c34281814f26,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:18.744928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 91f6df15-fa5c-471f-a9a2-84773c65ec14 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:18.745274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 91f6df15-fa5c-471f-a9a2-84773c65ec14 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:18.774830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a45c25e5-b5e6-4375-a0d3-37b8ff4226a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=670b81b3-9442-4469-a53a-7b02ee36415b,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:18.845125 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a8415872-7a41-495f-9429-ea99547fc827 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=cdbae0c829f34ceb835da84afcf97d40&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2739491 Mar 24 02:13:18.849030 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56774) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:18.864500 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2a4650d2-eb04-4352-bfe0-9efaa9d10eec req-cb543007-8820-4c73-a823-54ef9355cb52 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2767944 Mar 24 02:13:18.888180 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (7479113e-3c60-4d73-a4bc-70e500a7c21b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.892308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.899092 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/7479113e-3c60-4d73-a4bc-70e500a7c21b HTTP/1.1" status: 204 len: 168 time: 3.6094072 Mar 24 02:13:18.901590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56776) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:18.923676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-362316022'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:18.939293 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Router 25f49c4c-0d36-4e53-92a4-3025c26217a9 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:18.949050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70ee8e20-b5f3-447b-8ef6-b1578e3c08c2 admin admin] Publish callbacks [] for security_group (97b45e55-3a9b-4cd0-aa81-6b6d35e64c8a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:18.981384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d018dda5-9b9c-464e-b615-165d5980153a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Network': ['ID=7479113e-3c60-4d73-a4bc-70e500a7c21b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:18.989585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a8d40953-87fe-4a3c-acd7-bc9e09a52e85 admin admin] Publish callbacks [] for security_group (670b81b3-9442-4469-a53a-7b02ee36415b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.048553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70ee8e20-b5f3-447b-8ef6-b1578e3c08c2 admin admin] Publish callbacks [] for security_group (97b45e55-3a9b-4cd0-aa81-6b6d35e64c8a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.056321 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:19.059800 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.075596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a8d40953-87fe-4a3c-acd7-bc9e09a52e85 admin admin] Publish callbacks [] for security_group (670b81b3-9442-4469-a53a-7b02ee36415b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.117374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:19.121474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 143} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:19.124706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::8b2a:470d:a7d2:84ac (6f3080fc-791f-4748-a0a2-9eff6ea2a609/2d62ad68-cfb0-40ad-a843-22efd731a467/73aa2020-af9a-4d38-9155-f5a369b4a9e7) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:19.125694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.129860 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0955d005-6be5-415f-acc8-67740e715a92 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "PUT /v2.0/routers/25f49c4c-0d36-4e53-92a4-3025c26217a9 HTTP/1.1" status: 200 len: 883 time: 5.2965803 Mar 24 02:13:19.130731 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56778) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:19.136196 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f8d4c1a-492f-4a5a-b79b-34f994ed6d6c None None] Sync routers for ids ['25f49c4c-0d36-4e53-92a4-3025c26217a9'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:19.149750 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f8d4c1a-492f-4a5a-b79b-34f994ed6d6c None None] Routers {'25f49c4c-0d36-4e53-92a4-3025c26217a9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:19.150354 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4f8d4c1a-492f-4a5a-b79b-34f994ed6d6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['25f49c4c-0d36-4e53-92a4-3025c26217a9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:19.159735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1ba01708-9907-4e4f-bfc9-99dd559da8e7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.160275 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Added segment 1ba01708-9907-4e4f-bfc9-99dd559da8e7 of type vlan for network a1a292b2-3165-4bc7-be44-6fae5fecc383 Mar 24 02:13:19.208236 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70ee8e20-b5f3-447b-8ef6-b1578e3c08c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (97b45e55-3a9b-4cd0-aa81-6b6d35e64c8a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.212635 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70ee8e20-b5f3-447b-8ef6-b1578e3c08c2 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.217920 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-70ee8e20-b5f3-447b-8ef6-b1578e3c08c2 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/97b45e55-3a9b-4cd0-aa81-6b6d35e64c8a HTTP/1.1" status: 204 len: 168 time: 0.3677146 Mar 24 02:13:19.233264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70ee8e20-b5f3-447b-8ef6-b1578e3c08c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97b45e55-3a9b-4cd0-aa81-6b6d35e64c8a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:19.245354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (a1a292b2-3165-4bc7-be44-6fae5fecc383), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.305187 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4627da3e-ec4d-496d-bbfc-ab1ed8faae46 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/routers/25f49c4c-0d36-4e53-92a4-3025c26217a9 HTTP/1.1" status: 200 len: 924 time: 0.1726341 Mar 24 02:13:19.308116 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56782) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:19.320432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a8d40953-87fe-4a3c-acd7-bc9e09a52e85 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (670b81b3-9442-4469-a53a-7b02ee36415b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.323406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a8d40953-87fe-4a3c-acd7-bc9e09a52e85 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.324637 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a8d40953-87fe-4a3c-acd7-bc9e09a52e85 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/670b81b3-9442-4469-a53a-7b02ee36415b HTTP/1.1" status: 204 len: 168 time: 0.5864220 Mar 24 02:13:19.376569 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4f8d4c1a-492f-4a5a-b79b-34f994ed6d6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:19.378564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d40953-87fe-4a3c-acd7-bc9e09a52e85 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=670b81b3-9442-4469-a53a-7b02ee36415b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:19.384628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (a1a292b2-3165-4bc7-be44-6fae5fecc383), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.391148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:19.393960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.400851 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f8d4c1a-492f-4a5a-b79b-34f994ed6d6c None None] Routers {'25f49c4c-0d36-4e53-92a4-3025c26217a9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:19.401424 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4f8d4c1a-492f-4a5a-b79b-34f994ed6d6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['25f49c4c-0d36-4e53-92a4-3025c26217a9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:19.416256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f47037c9-46ed-46f2-818f-f7b2b686d5e1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:19.418039 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f47037c9-46ed-46f2-818f-f7b2b686d5e1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=25f49c4c-0d36-4e53-92a4-3025c26217a9&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1087332 Mar 24 02:13:19.420945 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56786) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:19.474480 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4f8d4c1a-492f-4a5a-b79b-34f994ed6d6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:19.475880 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f8d4c1a-492f-4a5a-b79b-34f994ed6d6c None None] The sync data for ids ['25f49c4c-0d36-4e53-92a4-3025c26217a9'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:19.545191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa670e28-71b7-4cb7-aa9d-471455d7e71d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:19.551108 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fa670e28-71b7-4cb7-aa9d-471455d7e71d tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 881 time: 0.1288700 Mar 24 02:13:19.556651 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.6443965 Mar 24 02:13:19.558316 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56792) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:19.559050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56794) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:19.574876 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'subnet': {'network_id': 'a1a292b2-3165-4bc7-be44-6fae5fecc383', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:19.646852 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d0d08530-20e9-47e3-861d-478db448fcd5 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=25f49c4c-0d36-4e53-92a4-3025c26217a9 HTTP/1.1" status: 200 len: 205 time: 0.0864646 Mar 24 02:13:19.648208 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56800) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:19.684110 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17291de7-a535-49c3-9a22-6007922d15ee tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Network': ['ID=a1a292b2-3165-4bc7-be44-6fae5fecc383,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:19.695601 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network a1a292b2-3165-4bc7-be44-6fae5fecc383 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:19.733848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (73aa2020-af9a-4d38-9155-f5a369b4a9e7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.771298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:19.776339 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.796818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56804) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:19.827145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da318a10-bb1a-4ec4-89f4-05924a8f9e68 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.885555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (73aa2020-af9a-4d38-9155-f5a369b4a9e7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.902734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (25f49c4c-0d36-4e53-92a4-3025c26217a9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:19.994355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:20.021780 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:20.029338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:20.034607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:20.035242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.035622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da318a10-bb1a-4ec4-89f4-05924a8f9e68 admin admin] Publish callbacks [] for security_group (446f3cc0-4b8e-44e7-9961-4d954d37e4c2), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.037623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=73aa2020-af9a-4d38-9155-f5a369b4a9e7,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:20.040950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da318a10-bb1a-4ec4-89f4-05924a8f9e68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (446f3cc0-4b8e-44e7-9961-4d954d37e4c2), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.088271 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-61744533-e123-4f6c-9047-7c783c29bba3 None None] Provisioning complete for port 936c97e9-b5d7-4ecf-a300-c34281814f26 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:20.088913 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-61744533-e123-4f6c-9047-7c783c29bba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.095899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (25f49c4c-0d36-4e53-92a4-3025c26217a9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.105499 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-da318a10-bb1a-4ec4-89f4-05924a8f9e68 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=a3e8a82c32c548b888fc99cd713478d9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3079252 Mar 24 02:13:20.107284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56812) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:20.108000 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da318a10-bb1a-4ec4-89f4-05924a8f9e68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=446f3cc0-4b8e-44e7-9961-4d954d37e4c2,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:20.109321 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-edb4a5c6-b035-4d7c-9ba9-0b327f5c2f4b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.6613450 Mar 24 02:13:20.112838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56814) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:20.124712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7cdb961e-2dbb-4cf5-a04b-a62abbe1bd5e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': '2d62ad68-cfb0-40ad-a843-22efd731a467', 'ip_address': '2001:db8::8b2a:470d:a7d2:84ac'}], 'name': 'tempest-NetworksTestDHCPv6-1073293132'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:20.224898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-61744533-e123-4f6c-9047-7c783c29bba3 None None] Current status of the port 936c97e9-b5d7-4ecf-a300-c34281814f26 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:20.235514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-61744533-e123-4f6c-9047-7c783c29bba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.265588 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Deleting port 5848e77c-4047-4a29-bdc6-dc1829e9725f {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:20.265936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5848e77c-4047-4a29-bdc6-dc1829e9725f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.274329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90165d74-cd6d-4ca5-942a-5b1f9839da0a req-bb96462e-11ee-4a63-aae6-ac683c5d3d38 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:20.283713 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-90165d74-cd6d-4ca5-942a-5b1f9839da0a req-bb96462e-11ee-4a63-aae6-ac683c5d3d38 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3128717 Mar 24 02:13:20.285879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-61744533-e123-4f6c-9047-7c783c29bba3 None None] For port 936c97e9-b5d7-4ecf-a300-c34281814f26, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=936c97e9-b5d7-4ecf-a300-c34281814f26,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:20.291718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (6afff741-56e2-430c-bc84-b11b8e639e7b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.293068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-61744533-e123-4f6c-9047-7c783c29bba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.354489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-395a4231-8c92-44d4-8dab-c4248e1be5e9 admin admin] Publish callbacks [] for security_group (446f3cc0-4b8e-44e7-9961-4d954d37e4c2), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.374733 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61744533-e123-4f6c-9047-7c783c29bba3 None None] Pushing event updated for resources: {'Port': ['ID=936c97e9-b5d7-4ecf-a300-c34281814f26,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:20.385974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7cdb961e-2dbb-4cf5-a04b-a62abbe1bd5e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:20.438049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-395a4231-8c92-44d4-8dab-c4248e1be5e9 admin admin] Publish callbacks [] for security_group (446f3cc0-4b8e-44e7-9961-4d954d37e4c2), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.450665 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Subnet': ['ID=6afff741-56e2-430c-bc84-b11b8e639e7b,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:20.455465 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-90165d74-cd6d-4ca5-942a-5b1f9839da0a req-b20041a0-5676-4a3a-b61f-ba9659843ea0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1709385 Mar 24 02:13:20.457680 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5848e77c-4047-4a29-bdc6-dc1829e9725f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.461408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Checking segment: {'id': '1ba01708-9907-4e4f-bfc9-99dd559da8e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'a1a292b2-3165-4bc7-be44-6fae5fecc383'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:20.461640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network hostable DHCP agents. Network: a1a292b2-3165-4bc7-be44-6fae5fecc383, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:20.493956 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Calling delete_port for 5848e77c-4047-4a29-bdc6-dc1829e9725f owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:20.502191 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network a1a292b2-3165-4bc7-be44-6fae5fecc383 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:20.517529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, a1a292b2-3165-4bc7-be44-6fae5fecc383) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:20.522645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:20.523315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.531651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-395a4231-8c92-44d4-8dab-c4248e1be5e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (446f3cc0-4b8e-44e7-9961-4d954d37e4c2), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.534338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1848ea11-4ab4-425d-b6ba-59783d6ea86a None None] Network a1a292b2-3165-4bc7-be44-6fae5fecc383 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:20.534489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-395a4231-8c92-44d4-8dab-c4248e1be5e9 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.535554 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-395a4231-8c92-44d4-8dab-c4248e1be5e9 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/446f3cc0-4b8e-44e7-9961-4d954d37e4c2 HTTP/1.1" status: 204 len: 168 time: 0.4216070 Mar 24 02:13:20.536312 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56826) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:20.571545 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a05f6777-6c36-40d5-8249-3f8bd7424c73 None None] Provisioning complete for port 73aa2020-af9a-4d38-9155-f5a369b4a9e7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:20.571952 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a05f6777-6c36-40d5-8249-3f8bd7424c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (73aa2020-af9a-4d38-9155-f5a369b4a9e7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.572649 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-395a4231-8c92-44d4-8dab-c4248e1be5e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=446f3cc0-4b8e-44e7-9961-4d954d37e4c2,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:20.609990 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a5c5b926-a1cf-46f3-8eab-c45a202394dc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.0468307 Mar 24 02:13:20.616296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56832) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:20.672963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7cdb961e-2dbb-4cf5-a04b-a62abbe1bd5e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.700510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-7cdb961e-2dbb-4cf5-a04b-a62abbe1bd5e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port fc32882e-f890-4e0a-a2e0-d07665f45006 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:20.704292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 936c97e9-b5d7-4ecf-a300-c34281814f26 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:20.860904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a05f6777-6c36-40d5-8249-3f8bd7424c73 None None] Port 73aa2020-af9a-4d38-9155-f5a369b4a9e7 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:20.881528 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (a1a292b2-3165-4bc7-be44-6fae5fecc383), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:20.939951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cce62f7-34c6-46cd-aefd-b26d98bffbfc req-57741573-276f-426c-920d-5f45ff4cbc9b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:20.941505 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0cce62f7-34c6-46cd-aefd-b26d98bffbfc req-57741573-276f-426c-920d-5f45ff4cbc9b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1446927 Mar 24 02:13:20.986231 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-a1a292b2-3165-4bc7-be44-6fae5fecc383', 'network_id': 'a1a292b2-3165-4bc7-be44-6fae5fecc383', 'project_id': '0a478f43194148c295b3c5808a7fb554', 'fixed_ips': [{'subnet_id': '6afff741-56e2-430c-bc84-b11b8e639e7b'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:20.988556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.006249 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 936c97e9-b5d7-4ecf-a300-c34281814f26 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:21.009850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.029519 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (5848e77c-4047-4a29-bdc6-dc1829e9725f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.040041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (6afff741-56e2-430c-bc84-b11b8e639e7b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.062016 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-351897479'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:21.068008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event deleted for resources: {'Port': ['ID=5848e77c-4047-4a29-bdc6-dc1829e9725f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:21.070043 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0cce62f7-34c6-46cd-aefd-b26d98bffbfc req-8a8bfdbd-91ed-4250-99be-843446f579be tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1175148 Mar 24 02:13:21.095496 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-7cdb961e-2dbb-4cf5-a04b-a62abbe1bd5e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): There was a conflict when trying to complete your request. Mar 24 02:13:21.095496 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7cdb961e-2dbb-4cf5-a04b-a62abbe1bd5e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:21.095703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-40ab5640-0c01-4fa3-997d-de1da1c3706c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:21.095703 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-40ab5640-0c01-4fa3-997d-de1da1c3706c service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 1130 time: 0.1384974 Mar 24 02:13:21.198041 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7cdb961e-2dbb-4cf5-a04b-a62abbe1bd5e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 409 len: 389 time: 1.0844753 Mar 24 02:13:21.199856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56844) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:21.209595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-e35bb329-6796-4416-8a6a-2b134c107b4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:21.210946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (25f49c4c-0d36-4e53-92a4-3025c26217a9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.211563 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-e35bb329-6796-4416-8a6a-2b134c107b4e service neutron] 10.222.0.30 "GET /v2.0/networks?id=597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 200 len: 913 time: 0.1092842 Mar 24 02:13:21.221731 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Allocated IP 2001:db8::2 (a1a292b2-3165-4bc7-be44-6fae5fecc383/6afff741-56e2-430c-bc84-b11b8e639e7b/7226e971-7fbe-4192-bf1b-99b74e96d95b) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:21.268626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:21.272726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.291543 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-0e213961-b05e-4a6b-8a40-642f2a6b933d service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 200 len: 1001 time: 0.0713055 Mar 24 02:13:21.344287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.364736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-b2355b7a-83ec-4b03-abb1-7209643ddea5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:21.364931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 936c97e9-b5d7-4ecf-a300-c34281814f26 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:21.367006 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-b2355b7a-83ec-4b03-abb1-7209643ddea5 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=56374a24-4e35-434f-b4b8-860ef8289893 HTTP/1.1" status: 200 len: 851 time: 0.0684617 Mar 24 02:13:21.375912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (25f49c4c-0d36-4e53-92a4-3025c26217a9), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.382758 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (25f49c4c-0d36-4e53-92a4-3025c26217a9), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.440593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Publish callbacks [] for port (7226e971-7fbe-4192-bf1b-99b74e96d95b), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.443789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93b71c19-b29c-4648-acdb-5f2530596e75 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:21.444763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-671d55ef-ba61-4c36-9586-7e11c1e2bd38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:21.446688 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-671d55ef-ba61-4c36-9586-7e11c1e2bd38 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=597625fc-4c02-4901-9b3e-46b781f61da1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0736334 Mar 24 02:13:21.448609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (7226e971-7fbe-4192-bf1b-99b74e96d95b), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.452987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93b71c19-b29c-4648-acdb-5f2530596e75 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:21.454776 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-93b71c19-b29c-4648-acdb-5f2530596e75 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1686 time: 0.2533963 Mar 24 02:13:21.458888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56852) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:21.493177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Network a1a292b2-3165-4bc7-be44-6fae5fecc383 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:21.496261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:21.500370 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:21.522838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (6afff741-56e2-430c-bc84-b11b8e639e7b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.546717 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Pushing event updated for resources: {'Port': ['ID=7226e971-7fbe-4192-bf1b-99b74e96d95b,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:21.561147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (25f49c4c-0d36-4e53-92a4-3025c26217a9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.561648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Fanout notify agent at l3_agent the message router_deleted on router 25f49c4c-0d36-4e53-92a4-3025c26217a9 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:21.568476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Subnet': ['ID=6afff741-56e2-430c-bc84-b11b8e639e7b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:21.571520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.576151 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3a2e8df3-ff67-4e2e-b230-165c9c61cdd7 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/25f49c4c-0d36-4e53-92a4-3025c26217a9 HTTP/1.1" status: 204 len: 168 time: 1.9235356 Mar 24 02:13:21.580017 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56858) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:21.593166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-85d75441-0754-4dd2-9f2b-918b2cf357ed tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1122706168', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:21.636114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Attempting to bind port 7226e971-7fbe-4192-bf1b-99b74e96d95b on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:21.636454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Attempting to bind port 7226e971-7fbe-4192-bf1b-99b74e96d95b by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '1ba01708-9907-4e4f-bfc9-99dd559da8e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'a1a292b2-3165-4bc7-be44-6fae5fecc383'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:21.636906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Attempting to bind port 7226e971-7fbe-4192-bf1b-99b74e96d95b on network a1a292b2-3165-4bc7-be44-6fae5fecc383 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:21.649505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:21.650067 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Checking segment: {'id': '1ba01708-9907-4e4f-bfc9-99dd559da8e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'a1a292b2-3165-4bc7-be44-6fae5fecc383'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:21.650685 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.651134 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Bound using segment: {'id': '1ba01708-9907-4e4f-bfc9-99dd559da8e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'a1a292b2-3165-4bc7-be44-6fae5fecc383'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:21.651663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Bound port: 7226e971-7fbe-4192-bf1b-99b74e96d95b, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1ba01708-9907-4e4f-bfc9-99dd559da8e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'a1a292b2-3165-4bc7-be44-6fae5fecc383'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:21.652097 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7226e971-7fbe-4192-bf1b-99b74e96d95b), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.655096 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-a43c8b2e-eb99-4bd2-8e8b-f5ab03dfda9f service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2017734 Mar 24 02:13:21.659901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (a1a292b2-3165-4bc7-be44-6fae5fecc383), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.665998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85d75441-0754-4dd2-9f2b-918b2cf357ed tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (96a5816b-7046-4612-9a87-c6fb23f51c32), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.667042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85d75441-0754-4dd2-9f2b-918b2cf357ed tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (96a5816b-7046-4612-9a87-c6fb23f51c32), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.688405 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-89a6aeb8-5e03-4010-a718-94d3659ff4bc tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 73aa2020-af9a-4d38-9155-f5a369b4a9e7 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:21.689066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-89a6aeb8-5e03-4010-a718-94d3659ff4bc tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (73aa2020-af9a-4d38-9155-f5a369b4a9e7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.717213 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56860) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:21.739719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a1a292b2-3165-4bc7-be44-6fae5fecc383']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:21.746302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] For port 7226e971-7fbe-4192-bf1b-99b74e96d95b, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:21.754056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1ba01708-9907-4e4f-bfc9-99dd559da8e7') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:21.754482 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1ba01708-9907-4e4f-bfc9-99dd559da8e7') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:21.754799 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] For port 7226e971-7fbe-4192-bf1b-99b74e96d95b, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7226e971-7fbe-4192-bf1b-99b74e96d95b,segment=NetworkSegment(1ba01708-9907-4e4f-bfc9-99dd559da8e7),segment_id=1ba01708-9907-4e4f-bfc9-99dd559da8e7)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:21.755152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for security_group (a32a8910-fb7a-4b58-8732-2f89ae4ca1e9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.768872 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a32a8910-fb7a-4b58-8732-2f89ae4ca1e9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.769964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7226e971-7fbe-4192-bf1b-99b74e96d95b), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.772323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (1ba01708-9907-4e4f-bfc9-99dd559da8e7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.801335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1ba01708-9907-4e4f-bfc9-99dd559da8e7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.808873 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bc136832-c7e0-43cf-8292-10a6de3d0c20 req-9d3e1fc5-350f-4d4b-96ad-e28c56c491b5 service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1461670 Mar 24 02:13:21.812051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Releasing vlan 143 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:21.814671 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (1ba01708-9907-4e4f-bfc9-99dd559da8e7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:21.818121 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:21.861302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85d75441-0754-4dd2-9f2b-918b2cf357ed tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (96a5816b-7046-4612-9a87-c6fb23f51c32), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.874026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85d75441-0754-4dd2-9f2b-918b2cf357ed tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (96a5816b-7046-4612-9a87-c6fb23f51c32), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.887750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a32a8910-fb7a-4b58-8732-2f89ae4ca1e9,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:21.898611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-secgroup--1497921636'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:21.905642 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85d75441-0754-4dd2-9f2b-918b2cf357ed tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.906505 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-85d75441-0754-4dd2-9f2b-918b2cf357ed tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.3240376 Mar 24 02:13:21.910368 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-89a6aeb8-5e03-4010-a718-94d3659ff4bc tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (73aa2020-af9a-4d38-9155-f5a369b4a9e7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.913543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90059fab-2871-408d-b7fa-2413eff20dcd None None] Pushing event updated for resources: {'Port': ['ID=7226e971-7fbe-4192-bf1b-99b74e96d95b,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:21.920103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56864) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:21.926077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': True}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:21.928005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.930397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b70a24ab-4177-4285-a87e-d9c58ce0292d None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:13:21.942311 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:21.951846 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.db.api [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Mar 24 02:13:21.951846 dv-neutron-834874-3-hyperv neutron-server[104037]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Mar 24 02:13:21.951846 dv-neutron-834874-3-hyperv neutron-server[104037]: [parameters: {'id': 'a1a292b2-3165-4bc7-be44-6fae5fecc383'}] Mar 24 02:13:21.951846 dv-neutron-834874-3-hyperv neutron-server[104037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104037) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:13:21.952527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG oslo_db.api [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:13:22.036375 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (d5f327de-ffad-4263-99e6-57831f0fc8f8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.041838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d5f327de-ffad-4263-99e6-57831f0fc8f8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.063920 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b70a24ab-4177-4285-a87e-d9c58ce0292d None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:13:22.089408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d5f327de-ffad-4263-99e6-57831f0fc8f8,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:22.151706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (aa10313e-7209-42ab-bf96-53573a69ce6b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.158312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (aa10313e-7209-42ab-bf96-53573a69ce6b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.208220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.212673 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.4910557 Mar 24 02:13:22.226068 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56868) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:22.233945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed00ea97-55d1-452f-8cf2-636a7c996ec1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aa10313e-7209-42ab-bf96-53573a69ce6b,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:22.298901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584a8d8b-1278-433c-b80d-fea274fb4a7c req-2c48be78-0f8d-4bec-afa3-13bc6153bc6c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:22.300699 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-584a8d8b-1278-433c-b80d-fea274fb4a7c req-2c48be78-0f8d-4bec-afa3-13bc6153bc6c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1152005 Mar 24 02:13:22.316022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-89a6aeb8-5e03-4010-a718-94d3659ff4bc tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 73aa2020-af9a-4d38-9155-f5a369b4a9e7 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:22.332884 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0edd3dd2-5179-4050-980d-41be435c58b1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4539 time: 0.1026890 Mar 24 02:13:22.333086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 113} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:22.333086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56870) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:22.346367 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-db0a3d0d-3d23-4a72-b005-adefc5b23a4b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-security--1022437907', 'description': 'tempest-security-description-85656314'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:22.390735 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-584a8d8b-1278-433c-b80d-fea274fb4a7c req-2480b6f1-eebb-404f-a029-c7d49ae136ce tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0745726 Mar 24 02:13:22.409078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (769c981e-2cd6-4647-8a34-7b067e17b24a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.409572 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added segment 769c981e-2cd6-4647-8a34-7b067e17b24a of type vlan for network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 Mar 24 02:13:22.454106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (a1a292b2-3165-4bc7-be44-6fae5fecc383), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.511813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Deleting port 7226e971-7fbe-4192-bf1b-99b74e96d95b {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:22.512188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (7226e971-7fbe-4192-bf1b-99b74e96d95b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.552819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-db0a3d0d-3d23-4a72-b005-adefc5b23a4b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (aa10313e-7209-42ab-bf96-53573a69ce6b), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.569487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (97acd41e-65de-4a40-9f5c-ad8b6aa7efb6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.580440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] For port 7226e971-7fbe-4192-bf1b-99b74e96d95b, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7226e971-7fbe-4192-bf1b-99b74e96d95b,segment=NetworkSegment(1ba01708-9907-4e4f-bfc9-99dd559da8e7),segment_id=1ba01708-9907-4e4f-bfc9-99dd559da8e7)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:22.580808 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (7226e971-7fbe-4192-bf1b-99b74e96d95b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.594423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Calling delete_port for 7226e971-7fbe-4192-bf1b-99b74e96d95b owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:22.652761 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c1ce16f-4b77-46c4-9918-94b55f90694c None None] Network a1a292b2-3165-4bc7-be44-6fae5fecc383 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:22.667309 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (96a5816b-7046-4612-9a87-c6fb23f51c32), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.684578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (7226e971-7fbe-4192-bf1b-99b74e96d95b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.711479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Port': ['ID=7226e971-7fbe-4192-bf1b-99b74e96d95b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:22.715615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No DVR routers for this DVR port 7226e971-7fbe-4192-bf1b-99b74e96d95b on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:22.749488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (97acd41e-65de-4a40-9f5c-ad8b6aa7efb6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.754621 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:22.755209 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.794230 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (a1a292b2-3165-4bc7-be44-6fae5fecc383), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.795272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-db0a3d0d-3d23-4a72-b005-adefc5b23a4b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (aa10313e-7209-42ab-bf96-53573a69ce6b), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.816825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a1a292b2-3165-4bc7-be44-6fae5fecc383']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:22.827357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1ba01708-9907-4e4f-bfc9-99dd559da8e7') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:22.827657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1ba01708-9907-4e4f-bfc9-99dd559da8e7') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:22.837674 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (1ba01708-9907-4e4f-bfc9-99dd559da8e7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.847839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-db0a3d0d-3d23-4a72-b005-adefc5b23a4b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (aa10313e-7209-42ab-bf96-53573a69ce6b), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.850394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-db0a3d0d-3d23-4a72-b005-adefc5b23a4b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.851623 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-db0a3d0d-3d23-4a72-b005-adefc5b23a4b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "PUT /v2.0/security-groups/aa10313e-7209-42ab-bf96-53573a69ce6b HTTP/1.1" status: 200 len: 1793 time: 0.5112734 Mar 24 02:13:22.854446 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1ba01708-9907-4e4f-bfc9-99dd559da8e7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.856348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56872) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:22.872896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Releasing vlan 143 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:22.873288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (1ba01708-9907-4e4f-bfc9-99dd559da8e7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:22.876187 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:22.883980 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 2.3449020 Mar 24 02:13:22.895545 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56874) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:22.903943 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2076210123'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:22.913840 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-89a6aeb8-5e03-4010-a718-94d3659ff4bc tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (73aa2020-af9a-4d38-9155-f5a369b4a9e7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.934469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-494dcd82-372f-4c00-8e71-ba33f4cf3015 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Network': ['ID=97acd41e-65de-4a40-9f5c-ad8b6aa7efb6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:22.947409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:22.949904 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f85e8cf9-637f-4d22-86ea-409e57c8415a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups/aa10313e-7209-42ab-bf96-53573a69ce6b HTTP/1.1" status: 200 len: 1793 time: 0.0924399 Mar 24 02:13:22.951211 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56876) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:22.959112 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db0a3d0d-3d23-4a72-b005-adefc5b23a4b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aa10313e-7209-42ab-bf96-53573a69ce6b,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:22.960240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (a1a292b2-3165-4bc7-be44-6fae5fecc383), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.963754 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a6aeb8-5e03-4010-a718-94d3659ff4bc tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=73aa2020-af9a-4d38-9155-f5a369b4a9e7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:22.978706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:22.981868 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/a1a292b2-3165-4bc7-be44-6fae5fecc383 HTTP/1.1" status: 204 len: 168 time: 2.3644867 Mar 24 02:13:22.986968 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56878) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:22.997988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1774855069'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:23.004120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-89a6aeb8-5e03-4010-a718-94d3659ff4bc tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.008232 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-89a6aeb8-5e03-4010-a718-94d3659ff4bc tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/73aa2020-af9a-4d38-9155-f5a369b4a9e7 HTTP/1.1" status: 204 len: 168 time: 1.5449476 Mar 24 02:13:23.011191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56880) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:23.022396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:23.025571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.037748 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:23.041076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.049930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b7091f-3b7c-4590-96f6-7d80ae0e4b5b tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Network': ['ID=a1a292b2-3165-4bc7-be44-6fae5fecc383,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:23.079123 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e39acc1d-c848-4be0-8c33-1844a14e226e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (aa10313e-7209-42ab-bf96-53573a69ce6b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.086373 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 124} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:23.106078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 140} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:23.110148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.110491 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Added segment 3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c of type vlan for network d6019ba1-a738-4215-a07e-2da26ecfd9bd Mar 24 02:13:23.112536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e39acc1d-c848-4be0-8c33-1844a14e226e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (aa10313e-7209-42ab-bf96-53573a69ce6b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.122307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba0c2eb1-4114-4e6b-b4f3-934fc0b4f1bd tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:23.123907 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba0c2eb1-4114-4e6b-b4f3-934fc0b4f1bd tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:23.125506 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ba0c2eb1-4114-4e6b-b4f3-934fc0b4f1bd tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1129146 Mar 24 02:13:23.128678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56882) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:23.130932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.131296 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added segment 4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7 of type vlan for network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 Mar 24 02:13:23.178711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.225180 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (d6019ba1-a738-4215-a07e-2da26ecfd9bd), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.247885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-1d970b6d-4615-4c58-8dbe-4f696118e25d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 2d62ad68-cfb0-40ad-a843-22efd731a467 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:23.259279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1d970b6d-4615-4c58-8dbe-4f696118e25d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (2d62ad68-cfb0-40ad-a843-22efd731a467), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.284476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e39acc1d-c848-4be0-8c33-1844a14e226e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (aa10313e-7209-42ab-bf96-53573a69ce6b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.286456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.287029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e39acc1d-c848-4be0-8c33-1844a14e226e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.288700 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e39acc1d-c848-4be0-8c33-1844a14e226e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/aa10313e-7209-42ab-bf96-53573a69ce6b HTTP/1.1" status: 204 len: 168 time: 0.3359747 Mar 24 02:13:23.292199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:23.292817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.297194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56884) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:23.311658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (d6019ba1-a738-4215-a07e-2da26ecfd9bd), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.321843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:23.322306 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.342019 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e39acc1d-c848-4be0-8c33-1844a14e226e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa10313e-7209-42ab-bf96-53573a69ce6b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:23.366503 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.4672558 Mar 24 02:13:23.366735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1d970b6d-4615-4c58-8dbe-4f696118e25d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (2d62ad68-cfb0-40ad-a843-22efd731a467), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.367798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (96a5816b-7046-4612-9a87-c6fb23f51c32), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.368199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56886) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:23.395678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.398839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2d46485-eaa2-452f-b262-336175069e5b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Network': ['ID=7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:23.409858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:23.428767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'subnet': {'network_id': '97acd41e-65de-4a40-9f5c-ad8b6aa7efb6', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:23.458978 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.4666908 Mar 24 02:13:23.464280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56890) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:23.470764 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Request body: {'subnet': {'network_id': 'd6019ba1-a738-4215-a07e-2da26ecfd9bd', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:23.560949 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27e0fb38-c00b-4414-ae50-3aac3caf435a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Network': ['ID=d6019ba1-a738-4215-a07e-2da26ecfd9bd,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:23.571929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network d6019ba1-a738-4215-a07e-2da26ecfd9bd details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:23.583394 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4685cc06-23e8-49e0-a8c8-887aadc0c699 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2802384 Mar 24 02:13:23.585156 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56892) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:23.589105 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Allocated IP 172.26.2.219 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/32e369ec-1af2-4744-981d-02929aaa6b78) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:23.623146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Made reservation on behalf of 0a478f43194148c295b3c5808a7fb554 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:23.626407 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.633061 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-7bc8e37f-b4bd-4560-a21e-55b98e9813da tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] delete failed (client error): The resource could not be found. Mar 24 02:13:23.634090 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7bc8e37f-b4bd-4560-a21e-55b98e9813da tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/aa10313e-7209-42ab-bf96-53573a69ce6b HTTP/1.1" status: 404 len: 347 time: 0.0458663 Mar 24 02:13:23.638740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56894) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:23.648175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e1428445-c778-424b-a8ba-577a27745d86 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-secgroup--1259193581'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:23.675871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:23.679211 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.686502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1d970b6d-4615-4c58-8dbe-4f696118e25d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (2d62ad68-cfb0-40ad-a843-22efd731a467), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.704873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a908b9-b896-4f6a-86f2-d62a11a02f48 req-ddf8f34a-53ab-43f9-bb16-94cdaa9cd211 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:23.706310 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d1a908b9-b896-4f6a-86f2-d62a11a02f48 req-ddf8f34a-53ab-43f9-bb16-94cdaa9cd211 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2026951 Mar 24 02:13:23.775672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for port (32e369ec-1af2-4744-981d-02929aaa6b78), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.794020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1428445-c778-424b-a8ba-577a27745d86 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.874427 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (32e369ec-1af2-4744-981d-02929aaa6b78), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.881088 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d1a908b9-b896-4f6a-86f2-d62a11a02f48 req-2b09fb17-09e8-43a9-bca8-65721ab101e7 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1253579 Mar 24 02:13:23.886964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1d970b6d-4615-4c58-8dbe-4f696118e25d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (2d62ad68-cfb0-40ad-a843-22efd731a467), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.928767 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:23.933932 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1d970b6d-4615-4c58-8dbe-4f696118e25d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:23.940718 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1d970b6d-4615-4c58-8dbe-4f696118e25d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/2d62ad68-cfb0-40ad-a843-22efd731a467 HTTP/1.1" status: 204 len: 168 time: 0.8106706 Mar 24 02:13:23.941019 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:23.942776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3581105c-f33e-4602-aaa2-e14eb71806eb None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:23.942971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56898) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:23.948166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:23.948290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d970b6d-4615-4c58-8dbe-4f696118e25d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=2d62ad68-cfb0-40ad-a843-22efd731a467,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:23.958990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event updated for resources: {'Port': ['ID=32e369ec-1af2-4744-981d-02929aaa6b78,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:24.039186 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8fc73e9d-6ae9-4d80-bc12-200dc21a1f45 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0858436 Mar 24 02:13:24.040487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56900) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:24.047854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:24.132918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52ca4c79-e20e-407d-ae51-7cc7c9b12ac2 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:24.190549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-52ca4c79-e20e-407d-ae51-7cc7c9b12ac2 None None] Deleting port 936c97e9-b5d7-4ecf-a300-c34281814f26 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:24.190855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-52ca4c79-e20e-407d-ae51-7cc7c9b12ac2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.203510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:13:24.212981 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (0572cc3c-ebbd-4cb6-a040-0b8a752dddff), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.257554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-52ca4c79-e20e-407d-ae51-7cc7c9b12ac2 None None] For port 936c97e9-b5d7-4ecf-a300-c34281814f26, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=936c97e9-b5d7-4ecf-a300-c34281814f26,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:24.257948 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-52ca4c79-e20e-407d-ae51-7cc7c9b12ac2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.271736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-52ca4c79-e20e-407d-ae51-7cc7c9b12ac2 None None] Calling delete_port for 936c97e9-b5d7-4ecf-a300-c34281814f26 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:24.326328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1428445-c778-424b-a8ba-577a27745d86 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (51610ae5-74cb-4f9f-ace9-e7be001f6932), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.326923 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:24.330305 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.336578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1428445-c778-424b-a8ba-577a27745d86 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (51610ae5-74cb-4f9f-ace9-e7be001f6932), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.344317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event updated for resources: {'Subnet': ['ID=0572cc3c-ebbd-4cb6-a040-0b8a752dddff,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:24.369645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-52ca4c79-e20e-407d-ae51-7cc7c9b12ac2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (936c97e9-b5d7-4ecf-a300-c34281814f26), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.394280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1428445-c778-424b-a8ba-577a27745d86 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.399454 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e1428445-c778-424b-a8ba-577a27745d86 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.7557285 Mar 24 02:13:24.399611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52ca4c79-e20e-407d-ae51-7cc7c9b12ac2 None None] Pushing event deleted for resources: {'Port': ['ID=936c97e9-b5d7-4ecf-a300-c34281814f26,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:24.404109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52ca4c79-e20e-407d-ae51-7cc7c9b12ac2 None None] No DVR routers for this DVR port 936c97e9-b5d7-4ecf-a300-c34281814f26 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:24.406148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56902) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:24.421967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d3c1c85b-e220-4ddb-8604-eb891742c923 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '51610ae5-74cb-4f9f-ace9-e7be001f6932', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:24.434678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1428445-c778-424b-a8ba-577a27745d86 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=51610ae5-74cb-4f9f-ace9-e7be001f6932,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:24.445197 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (222f25e2-9089-4c48-b74a-f3cca2685179), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.458066 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f2aeae-a3a9-40e6-874b-f6d93f40bc9c req-10679b92-44c8-412d-8e30-eb70f33b3415 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:24.459608 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-03f2aeae-a3a9-40e6-874b-f6d93f40bc9c req-10679b92-44c8-412d-8e30-eb70f33b3415 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.4790404 Mar 24 02:13:24.460169 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Checking segment: {'id': '3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'd6019ba1-a738-4215-a07e-2da26ecfd9bd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:24.460274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network hostable DHCP agents. Network: d6019ba1-a738-4215-a07e-2da26ecfd9bd, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:24.527368 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d3c1c85b-e220-4ddb-8604-eb891742c923 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (5c179d81-5010-498a-9375-6b1f0f4ad32f), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.532677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Network d6019ba1-a738-4215-a07e-2da26ecfd9bd is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:24.539212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 936c97e9-b5d7-4ecf-a300-c34281814f26 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:24.548147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (96a5816b-7046-4612-9a87-c6fb23f51c32), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.555229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Subnet': ['ID=222f25e2-9089-4c48-b74a-f3cca2685179,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:24.568520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 936c97e9-b5d7-4ecf-a300-c34281814f26 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:24.569643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 936c97e9-b5d7-4ecf-a300-c34281814f26 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:24.586997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, d6019ba1-a738-4215-a07e-2da26ecfd9bd) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:24.595755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc564f8c-46e1-4379-adae-6a8cef92d2a3 None None] Network d6019ba1-a738-4215-a07e-2da26ecfd9bd requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:24.610742 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-03f2aeae-a3a9-40e6-874b-f6d93f40bc9c req-e8fd9841-a157-451f-846d-5533f231869e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1252453 Mar 24 02:13:24.617868 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:24.618474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.632462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d3c1c85b-e220-4ddb-8604-eb891742c923 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (5c179d81-5010-498a-9375-6b1f0f4ad32f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.634641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Checking segment: {'id': '769c981e-2cd6-4647-8a34-7b067e17b24a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '97acd41e-65de-4a40-9f5c-ad8b6aa7efb6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:24.634924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network hostable DHCP agents. Network: 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:24.641565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d3c1c85b-e220-4ddb-8604-eb891742c923 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (5c179d81-5010-498a-9375-6b1f0f4ad32f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.667235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3c1c85b-e220-4ddb-8604-eb891742c923 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5c179d81-5010-498a-9375-6b1f0f4ad32f,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:24.677637 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d3c1c85b-e220-4ddb-8604-eb891742c923 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.683210 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d3c1c85b-e220-4ddb-8604-eb891742c923 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2685778 Mar 24 02:13:24.684808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56906) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:24.692079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:24.700011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:24.705801 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9f7991e6-8d75-4d1e-99bc-5165553b4ad6 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 1.2375250 Mar 24 02:13:24.712557 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:24.713213 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.716320 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56908) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:24.716757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-037093c3-419a-486c-8c76-e52dd8c41790 None None] Network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:24.761512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-d6019ba1-a738-4215-a07e-2da26ecfd9bd', 'network_id': 'd6019ba1-a738-4215-a07e-2da26ecfd9bd', 'project_id': '0a478f43194148c295b3c5808a7fb554', 'fixed_ips': [{'subnet_id': '0572cc3c-ebbd-4cb6-a040-0b8a752dddff'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:24.762438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.778052 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71c3951a-7866-4ff0-8283-57585b3072b1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (5c179d81-5010-498a-9375-6b1f0f4ad32f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.813480 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71c3951a-7866-4ff0-8283-57585b3072b1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (5c179d81-5010-498a-9375-6b1f0f4ad32f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.844349 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d860b6e2-6969-416c-b42f-a8ab9668a16e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4444749 Mar 24 02:13:24.845453 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56912) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:24.864800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'subnet': {'network_id': '7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:24.934908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (d6019ba1-a738-4215-a07e-2da26ecfd9bd), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.937737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-97acd41e-65de-4a40-9f5c-ad8b6aa7efb6', 'network_id': '97acd41e-65de-4a40-9f5c-ad8b6aa7efb6', 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'fixed_ips': [{'subnet_id': '222f25e2-9089-4c48-b74a-f3cca2685179'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:24.938767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:24.943709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e22892f-9e45-4f5c-ab53-c97c3eac131b req-7734b3c5-02c7-4679-9223-6a5d2f10c327 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:24.951219 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2e22892f-9e45-4f5c-ab53-c97c3eac131b req-7734b3c5-02c7-4679-9223-6a5d2f10c327 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1182559 Mar 24 02:13:24.976523 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Allocated IP 2001:db8::f816:3eff:feb5:30a0 (d6019ba1-a738-4215-a07e-2da26ecfd9bd/0572cc3c-ebbd-4cb6-a040-0b8a752dddff/4c00815d-113c-46ac-b77c-363e76a05b0f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:25.027093 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2e22892f-9e45-4f5c-ab53-c97c3eac131b req-a154989b-8e89-4fba-bbba-30a2c12444b2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0753856 Mar 24 02:13:25.046009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (0572cc3c-ebbd-4cb6-a040-0b8a752dddff), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.181368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Allocated IP 2001:db8::2 (97acd41e-65de-4a40-9f5c-ad8b6aa7efb6/222f25e2-9089-4c48-b74a-f3cca2685179/c6417f3b-22fb-45bc-92a5-17c345dcb84f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:25.186971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-096a4a4f-f048-4c15-aae0-8283f07065cf req-699f79bf-111c-43fe-80c1-f022ae6e55a0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:25.188890 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-096a4a4f-f048-4c15-aae0-8283f07065cf req-699f79bf-111c-43fe-80c1-f022ae6e55a0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.0623651 Mar 24 02:13:25.244358 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-096a4a4f-f048-4c15-aae0-8283f07065cf req-7feedf95-6d30-4222-93eb-4400712024f1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451856 Mar 24 02:13:25.261741 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (3086ab7d-8ae1-44ba-8477-48853d6e333b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.295805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Publish callbacks [] for port (4c00815d-113c-46ac-b77c-363e76a05b0f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.308903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (4c00815d-113c-46ac-b77c-363e76a05b0f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.321301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71c3951a-7866-4ff0-8283-57585b3072b1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (5c179d81-5010-498a-9375-6b1f0f4ad32f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.326562 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-71c3951a-7866-4ff0-8283-57585b3072b1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.326872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (0572cc3c-ebbd-4cb6-a040-0b8a752dddff), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.330134 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-71c3951a-7866-4ff0-8283-57585b3072b1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/5c179d81-5010-498a-9375-6b1f0f4ad32f HTTP/1.1" status: 204 len: 168 time: 0.6411083 Mar 24 02:13:25.334219 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56920) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:25.353920 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:25.363818 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Network d6019ba1-a738-4215-a07e-2da26ecfd9bd is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:25.369855 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:25.371761 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:25.378546 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71c3951a-7866-4ff0-8283-57585b3072b1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=5c179d81-5010-498a-9375-6b1f0f4ad32f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:25.380865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:25.381488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.382611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:25.384501 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Subnet': ['ID=0572cc3c-ebbd-4cb6-a040-0b8a752dddff,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:25.390708 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Pushing event updated for resources: {'Port': ['ID=4c00815d-113c-46ac-b77c-363e76a05b0f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:25.411881 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=3086ab7d-8ae1-44ba-8477-48853d6e333b,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:25.428549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (96a5816b-7046-4612-9a87-c6fb23f51c32), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.434212 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-28f8de88-8bdc-4cda-b13e-7207dfe0d649 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.3925555 Mar 24 02:13:25.438150 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56922) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:25.445095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b3dd9f52-4897-4b23-81fa-22f919555ded tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': '3086ab7d-8ae1-44ba-8477-48853d6e333b', 'ip_address': '2001:db8:0:1::2'}], 'name': 'tempest-NetworksTestDHCPv6-1142738410'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:25.449042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (96a5816b-7046-4612-9a87-c6fb23f51c32), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.449831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35dce368-c67e-4f91-b9e0-699ab59fba28 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:25.490060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:25.493933 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.504377 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-48a1129d-b618-4324-9b30-cf2f4837ffcc tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1629510 Mar 24 02:13:25.507288 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56924) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:25.510848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (d6019ba1-a738-4215-a07e-2da26ecfd9bd), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.520182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8e590b-f889-4d77-a19d-fa61465cf76f req-7676dc9a-50b2-42c1-bda5-521170434ccc tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:25.527011 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7d8e590b-f889-4d77-a19d-fa61465cf76f req-7676dc9a-50b2-42c1-bda5-521170434ccc tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1870165 Mar 24 02:13:25.543359 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Publish callbacks [] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.551710 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Attempting to bind port 4c00815d-113c-46ac-b77c-363e76a05b0f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:25.552318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Attempting to bind port 4c00815d-113c-46ac-b77c-363e76a05b0f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'd6019ba1-a738-4215-a07e-2da26ecfd9bd'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:25.552835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Attempting to bind port 4c00815d-113c-46ac-b77c-363e76a05b0f on network d6019ba1-a738-4215-a07e-2da26ecfd9bd {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:25.559967 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.567172 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d6019ba1-a738-4215-a07e-2da26ecfd9bd']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:25.576369 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:25.576737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Checking segment: {'id': '3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'd6019ba1-a738-4215-a07e-2da26ecfd9bd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:25.577135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.577524 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Bound using segment: {'id': '3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'd6019ba1-a738-4215-a07e-2da26ecfd9bd'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:25.578004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Bound port: 4c00815d-113c-46ac-b77c-363e76a05b0f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'd6019ba1-a738-4215-a07e-2da26ecfd9bd'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:25.578860 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4c00815d-113c-46ac-b77c-363e76a05b0f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.587886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:25.587886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:25.606177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.632789 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7d8e590b-f889-4d77-a19d-fa61465cf76f req-02febfd3-949f-473f-bfb8-0986ee6c496d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1046522 Mar 24 02:13:25.633344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:25.649608 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Pushing event updated for resources: {'Port': ['ID=c6417f3b-22fb-45bc-92a5-17c345dcb84f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:25.649608 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:25.649608 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:25.652008 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.673550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Releasing vlan 124 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:25.674167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:25.677433 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:25.794383 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.db.api [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Mar 24 02:13:25.794383 dv-neutron-834874-3-hyperv neutron-server[104037]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Mar 24 02:13:25.794383 dv-neutron-834874-3-hyperv neutron-server[104037]: [parameters: {'id': 'd6019ba1-a738-4215-a07e-2da26ecfd9bd'}] Mar 24 02:13:25.794383 dv-neutron-834874-3-hyperv neutron-server[104037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104037) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:13:25.795310 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG oslo_db.api [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:13:25.850602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-19b805c5-e21a-4032-93a0-b2136d2becc0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (51610ae5-74cb-4f9f-ace9-e7be001f6932), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.856273 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '3086ab7d-8ae1-44ba-8477-48853d6e333b'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:25.857473 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:25.887696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3dd9f52-4897-4b23-81fa-22f919555ded tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:25.889807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a78aeaa-3e9e-4ab7-9587-73b6f3264e02 req-514a1074-43c2-4d0b-823f-ec829687e6d2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:25.897742 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7a78aeaa-3e9e-4ab7-9587-73b6f3264e02 req-514a1074-43c2-4d0b-823f-ec829687e6d2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.0743580 Mar 24 02:13:25.926401 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] For port 4c00815d-113c-46ac-b77c-363e76a05b0f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:25.929223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Attempting to bind port c6417f3b-22fb-45bc-92a5-17c345dcb84f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:25.929714 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Attempting to bind port c6417f3b-22fb-45bc-92a5-17c345dcb84f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '769c981e-2cd6-4647-8a34-7b067e17b24a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '97acd41e-65de-4a40-9f5c-ad8b6aa7efb6'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:25.930075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Attempting to bind port c6417f3b-22fb-45bc-92a5-17c345dcb84f on network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:25.935021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] For port 4c00815d-113c-46ac-b77c-363e76a05b0f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4c00815d-113c-46ac-b77c-363e76a05b0f,segment=NetworkSegment(3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c),segment_id=3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:25.963143 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7a78aeaa-3e9e-4ab7-9587-73b6f3264e02 req-b7b68a4d-788e-40fa-8e4e-2bfcf8b6e8ec tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0644627 Mar 24 02:13:25.983865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-19b805c5-e21a-4032-93a0-b2136d2becc0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (51610ae5-74cb-4f9f-ace9-e7be001f6932), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.024422 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:26.024723 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Checking segment: {'id': '769c981e-2cd6-4647-8a34-7b067e17b24a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '97acd41e-65de-4a40-9f5c-ad8b6aa7efb6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:26.025132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.025531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Bound using segment: {'id': '769c981e-2cd6-4647-8a34-7b067e17b24a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '97acd41e-65de-4a40-9f5c-ad8b6aa7efb6'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:26.026290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Bound port: c6417f3b-22fb-45bc-92a5-17c345dcb84f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '769c981e-2cd6-4647-8a34-7b067e17b24a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '97acd41e-65de-4a40-9f5c-ad8b6aa7efb6'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:26.027088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.029028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4c00815d-113c-46ac-b77c-363e76a05b0f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.050728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Router 96a5816b-7046-4612-9a87-c6fb23f51c32 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:26.084817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (7be7dde7-21ee-46c4-996c-e9d6dea102c7), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.124332 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b3dd9f52-4897-4b23-81fa-22f919555ded tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.205839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-19b805c5-e21a-4032-93a0-b2136d2becc0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (51610ae5-74cb-4f9f-ace9-e7be001f6932), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.208546 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-19b805c5-e21a-4032-93a0-b2136d2becc0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.210222 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-19b805c5-e21a-4032-93a0-b2136d2becc0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/51610ae5-74cb-4f9f-ace9-e7be001f6932 HTTP/1.1" status: 204 len: 168 time: 0.7033954 Mar 24 02:13:26.214862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f629eb-ff20-4657-874a-11611232bd3e None None] Pushing event updated for resources: {'Port': ['ID=4c00815d-113c-46ac-b77c-363e76a05b0f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:26.225665 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56930) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:26.226284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d889b7bd-eda5-469e-8979-8d32f3940c6b None None] Network d6019ba1-a738-4215-a07e-2da26ecfd9bd requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:26.257104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19b805c5-e21a-4032-93a0-b2136d2becc0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=51610ae5-74cb-4f9f-ace9-e7be001f6932,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:26.260798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-b3dd9f52-4897-4b23-81fa-22f919555ded tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 854db86a-d886-40f9-b077-dd1657f51f94 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:26.272037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Subnet': ['ID=7be7dde7-21ee-46c4-996c-e9d6dea102c7,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:26.272255 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] For port c6417f3b-22fb-45bc-92a5-17c345dcb84f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:26.276128 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ca183ece-b5cb-47c7-9c67-955b89f75f07 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0492020 Mar 24 02:13:26.287134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56932) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:26.296602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (d6019ba1-a738-4215-a07e-2da26ecfd9bd), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.315891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/3086ab7d-8ae1-44ba-8477-48853d6e333b/e58640b9-bc91-467e-86dc-e8b5c52a49e3) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:26.318875 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] For port c6417f3b-22fb-45bc-92a5-17c345dcb84f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c6417f3b-22fb-45bc-92a5-17c345dcb84f,segment=NetworkSegment(769c981e-2cd6-4647-8a34-7b067e17b24a),segment_id=769c981e-2cd6-4647-8a34-7b067e17b24a)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:26.322169 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c0a94143-ac84-453a-a89d-2d35e3d5deaa tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-secgroup--2109289175'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:26.338258 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.360726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Deleting port 4c00815d-113c-46ac-b77c-363e76a05b0f {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:26.360726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4c00815d-113c-46ac-b77c-363e76a05b0f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.361969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Checking segment: {'id': '4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:26.362402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network hostable DHCP agents. Network: 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:26.417786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a94143-ac84-453a-a89d-2d35e3d5deaa tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.433992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] For port 4c00815d-113c-46ac-b77c-363e76a05b0f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4c00815d-113c-46ac-b77c-363e76a05b0f,segment=NetworkSegment(3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c),segment_id=3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:26.436926 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4c00815d-113c-46ac-b77c-363e76a05b0f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.440339 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:26.445109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.446290 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-275defaa-680d-40af-adca-3f4972c8742e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "PUT /v2.0/routers/96a5816b-7046-4612-9a87-c6fb23f51c32 HTTP/1.1" status: 200 len: 919 time: 4.5251942 Mar 24 02:13:26.453361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56934) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:26.463153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Calling delete_port for 4c00815d-113c-46ac-b77c-363e76a05b0f owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:26.465989 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f8c53a6-0a29-453c-8258-f7ca25a5b192 None None] Sync routers for ids ['96a5816b-7046-4612-9a87-c6fb23f51c32'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:26.494457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f139219f-67d7-4852-9acc-0a7de706efcc None None] Pushing event updated for resources: {'Port': ['ID=c6417f3b-22fb-45bc-92a5-17c345dcb84f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:26.512393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f8c53a6-0a29-453c-8258-f7ca25a5b192 None None] Routers {'96a5816b-7046-4612-9a87-c6fb23f51c32'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:26.513015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6f8c53a6-0a29-453c-8258-f7ca25a5b192 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['96a5816b-7046-4612-9a87-c6fb23f51c32'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:26.514794 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:26.554019 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6f8c53a6-0a29-453c-8258-f7ca25a5b192 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:26.571408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:26.576977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:26.577587 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.577918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (4c00815d-113c-46ac-b77c-363e76a05b0f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.589881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cb1e982-1d95-4bd2-972b-a8681d8061de None None] Network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:26.615002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Port': ['ID=4c00815d-113c-46ac-b77c-363e76a05b0f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:26.619768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No DVR routers for this DVR port 4c00815d-113c-46ac-b77c-363e76a05b0f on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:26.620412 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f53800ca-7c74-4f7a-a5e5-600800e0e915 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.7676058 Mar 24 02:13:26.624458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56936) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:26.648810 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9784d5eb-790c-4a9c-ac67-f6c2cdbe662e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/routers/96a5816b-7046-4612-9a87-c6fb23f51c32 HTTP/1.1" status: 200 len: 925 time: 0.1915984 Mar 24 02:13:26.651722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56938) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:26.653774 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-96a4113d-7c67-4844-8b0d-198eea5ddc9a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-93726191', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:26.673245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f8c53a6-0a29-453c-8258-f7ca25a5b192 None None] Routers {'96a5816b-7046-4612-9a87-c6fb23f51c32'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:26.673974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6f8c53a6-0a29-453c-8258-f7ca25a5b192 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['96a5816b-7046-4612-9a87-c6fb23f51c32'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:26.701051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a94143-ac84-453a-a89d-2d35e3d5deaa tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (002b7bde-84e6-437c-a10d-63552629fdd7), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.711141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a94143-ac84-453a-a89d-2d35e3d5deaa tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (002b7bde-84e6-437c-a10d-63552629fdd7), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.726825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (d6019ba1-a738-4215-a07e-2da26ecfd9bd), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.728951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6f8c53a6-0a29-453c-8258-f7ca25a5b192 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:26.730224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f8c53a6-0a29-453c-8258-f7ca25a5b192 None None] The sync data for ids ['96a5816b-7046-4612-9a87-c6fb23f51c32'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:26.731177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-96a4113d-7c67-4844-8b0d-198eea5ddc9a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (2f78564e-0ab3-4c6e-8e01-d720fac2db18), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.732248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-96a4113d-7c67-4844-8b0d-198eea5ddc9a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (2f78564e-0ab3-4c6e-8e01-d720fac2db18), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.740698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Publish callbacks [] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.755755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.761484 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d6019ba1-a738-4215-a07e-2da26ecfd9bd']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:26.794977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a94143-ac84-453a-a89d-2d35e3d5deaa tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=002b7bde-84e6-437c-a10d-63552629fdd7,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:26.806479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:26.807976 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:26.818451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a94143-ac84-453a-a89d-2d35e3d5deaa tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.823922 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c0a94143-ac84-453a-a89d-2d35e3d5deaa tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5321386 Mar 24 02:13:26.824942 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56940) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:26.831098 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ae3c18b-939d-44c6-ab9c-939a2ae097b7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:26.835658 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4ae3c18b-939d-44c6-ab9c-939a2ae097b7 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=96a5816b-7046-4612-9a87-c6fb23f51c32&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1806884 Mar 24 02:13:26.838687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d00b1e3e-e876-4660-9662-fa1c24c68f0f tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '002b7bde-84e6-437c-a10d-63552629fdd7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:26.845549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:26.856611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:26.859981 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886', 'network_id': '7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886', 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'fixed_ips': [{'subnet_id': '7be7dde7-21ee-46c4-996c-e9d6dea102c7'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:26.863432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.865047 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56942) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:26.866970 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-b3dd9f52-4897-4b23-81fa-22f919555ded tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:13:26.867483 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b3dd9f52-4897-4b23-81fa-22f919555ded tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:26.868155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:26.872478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Pushing event updated for resources: {'Port': ['ID=e58640b9-bc91-467e-86dc-e8b5c52a49e3,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:26.873802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-96a4113d-7c67-4844-8b0d-198eea5ddc9a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (2f78564e-0ab3-4c6e-8e01-d720fac2db18), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.880566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.901756 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.904703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-96a4113d-7c67-4844-8b0d-198eea5ddc9a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (2f78564e-0ab3-4c6e-8e01-d720fac2db18), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.930158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Releasing vlan 124 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:26.930822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (3ea1008d-c1b1-47ed-95d7-e0b6f8322b2c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:26.934819 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:26.940984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-96a4113d-7c67-4844-8b0d-198eea5ddc9a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:26.944092 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-96a4113d-7c67-4844-8b0d-198eea5ddc9a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 702 time: 0.3183913 Mar 24 02:13:26.957166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56944) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:26.971295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d00b1e3e-e876-4660-9662-fa1c24c68f0f tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (50cfafe3-d901-4dcb-b383-c6e327239d20), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.006824 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b3dd9f52-4897-4b23-81fa-22f919555ded tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 400 len: 350 time: 1.5673816 Mar 24 02:13:27.026781 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Attempting to bind port e58640b9-bc91-467e-86dc-e8b5c52a49e3 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:27.027149 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Attempting to bind port e58640b9-bc91-467e-86dc-e8b5c52a49e3 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:27.027514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Attempting to bind port e58640b9-bc91-467e-86dc-e8b5c52a49e3 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:27.038979 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:27.039711 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:27.040115 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.040506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:27.040968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Bound port: e58640b9-bc91-467e-86dc-e8b5c52a49e3, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:27.041572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.042995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56948) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.089637 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74d5186e-ffbf-44df-9cc8-270a32fa90b1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:27.091089 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-74d5186e-ffbf-44df-9cc8-270a32fa90b1 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 881 time: 0.2202728 Mar 24 02:13:27.097086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56950) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.123929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Allocated IP 2001:db8:1::2 (7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886/7be7dde7-21ee-46c4-996c-e9d6dea102c7/fa8224fd-63a8-406e-b5ee-8a578673c625) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:27.135730 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a8648a9d-83a7-43f0-8244-9d225758fcfa tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=96a5816b-7046-4612-9a87-c6fb23f51c32 HTTP/1.1" status: 200 len: 205 time: 0.0373254 Mar 24 02:13:27.140238 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56952) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.196578 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] For port e58640b9-bc91-467e-86dc-e8b5c52a49e3, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:27.208203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d00b1e3e-e876-4660-9662-fa1c24c68f0f tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (50cfafe3-d901-4dcb-b383-c6e327239d20), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.215115 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] For port e58640b9-bc91-467e-86dc-e8b5c52a49e3, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e58640b9-bc91-467e-86dc-e8b5c52a49e3,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:27.222932 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.239129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d00b1e3e-e876-4660-9662-fa1c24c68f0f tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (50cfafe3-d901-4dcb-b383-c6e327239d20), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.254009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09d0c460-fba8-402a-8226-738c432d8350 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:27.259796 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-09d0c460-fba8-402a-8226-738c432d8350 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.2069962 Mar 24 02:13:27.264803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56954) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.277090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (d6019ba1-a738-4215-a07e-2da26ecfd9bd), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.303385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.308251 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/d6019ba1-a738-4215-a07e-2da26ecfd9bd HTTP/1.1" status: 204 len: 168 time: 2.5878067 Mar 24 02:13:27.314251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89df127d-a93f-409a-864d-393f81524e03 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Network': ['ID=d6019ba1-a738-4215-a07e-2da26ecfd9bd,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:27.315599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56956) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.323933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54efa743-9053-4b7c-ad8f-23abdfa319ab None None] Pushing event updated for resources: {'Port': ['ID=e58640b9-bc91-467e-86dc-e8b5c52a49e3,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:27.325050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1d01b1-c22d-477d-b29e-34ed455afe59 req-1388b8ec-d011-4b5b-a2df-176b0db6a9f1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:27.332194 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a1d01b1-c22d-477d-b29e-34ed455afe59 req-1388b8ec-d011-4b5b-a2df-176b0db6a9f1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2516725 Mar 24 02:13:27.350495 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d00b1e3e-e876-4660-9662-fa1c24c68f0f tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=50cfafe3-d901-4dcb-b383-c6e327239d20,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:27.377091 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d00b1e3e-e876-4660-9662-fa1c24c68f0f tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.378507 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d00b1e3e-e876-4660-9662-fa1c24c68f0f tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5441196 Mar 24 02:13:27.380203 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-db351a09-a3d7-405c-b1d2-7c134cec5521 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.385709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Publish callbacks [] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.387053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56958) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.391624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55ff962d-3986-42fd-a56a-d37d385ab42d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:27.393887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55ff962d-3986-42fd-a56a-d37d385ab42d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:27.395451 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ddb9f983-37b8-4e7a-9494-ded8f117fac7 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '002b7bde-84e6-437c-a10d-63552629fdd7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:27.400098 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-55ff962d-3986-42fd-a56a-d37d385ab42d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1314232 Mar 24 02:13:27.400628 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.403926 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56960) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.414780 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-77571eef-6f6e-4335-89c8-1ff095307616 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): The resource could not be found. Mar 24 02:13:27.415233 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-77571eef-6f6e-4335-89c8-1ff095307616 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:27.421242 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-77571eef-6f6e-4335-89c8-1ff095307616 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/subnets/0572cc3c-ebbd-4cb6-a040-0b8a752dddff HTTP/1.1" status: 404 len: 337 time: 0.0831203 Mar 24 02:13:27.421541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56962) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.470223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:27.478778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:27.486492 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-53695a54-c15f-4f75-881c-2aa911698508 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): The resource could not be found. Mar 24 02:13:27.486977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-53695a54-c15f-4f75-881c-2aa911698508 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:27.492996 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-53695a54-c15f-4f75-881c-2aa911698508 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/d6019ba1-a738-4215-a07e-2da26ecfd9bd HTTP/1.1" status: 404 len: 339 time: 0.0462275 Mar 24 02:13:27.493160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:27.494823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Pushing event updated for resources: {'Port': ['ID=fa8224fd-63a8-406e-b5ee-8a578673c625,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:27.499520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56964) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.551333 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (96a5816b-7046-4612-9a87-c6fb23f51c32), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.571083 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Attempting to bind port fa8224fd-63a8-406e-b5ee-8a578673c625 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:27.571331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Attempting to bind port fa8224fd-63a8-406e-b5ee-8a578673c625 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:27.571863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Attempting to bind port fa8224fd-63a8-406e-b5ee-8a578673c625 on network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:27.578250 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:27.578823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Checking segment: {'id': '4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:27.579409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.579938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Bound using segment: {'id': '4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:27.580555 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Bound port: fa8224fd-63a8-406e-b5ee-8a578673c625, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:27.581117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.608822 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a1d01b1-c22d-477d-b29e-34ed455afe59 req-42163fca-64e4-4ca2-ade4-8f0760bead2e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2755404 Mar 24 02:13:27.614058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddb9f983-37b8-4e7a-9494-ded8f117fac7 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (2d4f2b47-d21a-4c97-a4ed-cd7a348e5d17), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.711714 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] For port fa8224fd-63a8-406e-b5ee-8a578673c625, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:27.715205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] For port fa8224fd-63a8-406e-b5ee-8a578673c625, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fa8224fd-63a8-406e-b5ee-8a578673c625,segment=NetworkSegment(4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7),segment_id=4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:27.720193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-728eaadb-651c-4f43-b166-93b968306179 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 3086ab7d-8ae1-44ba-8477-48853d6e333b {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:27.727692 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-728eaadb-651c-4f43-b166-93b968306179 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (3086ab7d-8ae1-44ba-8477-48853d6e333b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.731684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.736634 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.781155 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddb9f983-37b8-4e7a-9494-ded8f117fac7 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (2d4f2b47-d21a-4c97-a4ed-cd7a348e5d17), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.791542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddb9f983-37b8-4e7a-9494-ded8f117fac7 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (2d4f2b47-d21a-4c97-a4ed-cd7a348e5d17), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.824236 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-728eaadb-651c-4f43-b166-93b968306179 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (3086ab7d-8ae1-44ba-8477-48853d6e333b), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.866128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddb9f983-37b8-4e7a-9494-ded8f117fac7 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2d4f2b47-d21a-4c97-a4ed-cd7a348e5d17,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:27.891531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f799fb6c-882d-419d-b6d5-9d3014142a73 None None] Pushing event updated for resources: {'Port': ['ID=fa8224fd-63a8-406e-b5ee-8a578673c625,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:27.931730 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-5bd52f70-6197-475e-bd82-c0b9147614ea tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): The resource could not be found. Mar 24 02:13:27.937824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5bd52f70-6197-475e-bd82-c0b9147614ea tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:27.948092 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5bd52f70-6197-475e-bd82-c0b9147614ea tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/subnets/6afff741-56e2-430c-bc84-b11b8e639e7b HTTP/1.1" status: 404 len: 337 time: 0.4467838 Mar 24 02:13:27.955117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddb9f983-37b8-4e7a-9494-ded8f117fac7 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.958851 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ddb9f983-37b8-4e7a-9494-ded8f117fac7 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5658619 Mar 24 02:13:27.958851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56970) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.959068 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56972) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:27.967540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (96a5816b-7046-4612-9a87-c6fb23f51c32), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:27.968399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-bb4390dd-86e3-4856-82df-f327b03e19a4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '002b7bde-84e6-437c-a10d-63552629fdd7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:27.995971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-728eaadb-651c-4f43-b166-93b968306179 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (3086ab7d-8ae1-44ba-8477-48853d6e333b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.049553 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-b97877f1-5713-4c0c-8647-9780ec40ff28 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): The resource could not be found. Mar 24 02:13:28.050083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b97877f1-5713-4c0c-8647-9780ec40ff28 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:28.053895 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b97877f1-5713-4c0c-8647-9780ec40ff28 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/a1a292b2-3165-4bc7-be44-6fae5fecc383 HTTP/1.1" status: 404 len: 339 time: 0.0907953 Mar 24 02:13:28.056304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56976) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:28.088187 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-4d682584-0076-44c5-9d9b-332fef18f34e tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): The resource could not be found. Mar 24 02:13:28.088665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4d682584-0076-44c5-9d9b-332fef18f34e tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:28.091831 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4d682584-0076-44c5-9d9b-332fef18f34e tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/subnets/a6b68e0a-4c16-4a41-a222-373e029b1e0e HTTP/1.1" status: 404 len: 337 time: 0.0331452 Mar 24 02:13:28.097717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56978) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:28.130295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb4390dd-86e3-4856-82df-f327b03e19a4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (afd3769b-5015-44f4-b287-307972ee520d), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.135011 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-563a786e-711c-4a2a-81ef-afd0996d9697 None None] Network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:28.141036 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-171ac44b-a726-45d7-b534-124110ed012a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): The resource could not be found. Mar 24 02:13:28.141547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-171ac44b-a726-45d7-b534-124110ed012a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:28.148761 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-171ac44b-a726-45d7-b534-124110ed012a tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/7479113e-3c60-4d73-a4bc-70e500a7c21b HTTP/1.1" status: 404 len: 339 time: 0.0497088 Mar 24 02:13:28.157455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56980) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:28.227818 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ef17c4-f2b0-4d9c-bfe5-9cc26fec0d50 req-698cc3a9-64a7-4ae0-a313-805784469660 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:28.229359 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-62ef17c4-f2b0-4d9c-bfe5-9cc26fec0d50 req-698cc3a9-64a7-4ae0-a313-805784469660 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2687407 Mar 24 02:13:28.284011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Deleting port 32e369ec-1af2-4744-981d-02929aaa6b78 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:28.284805 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (32e369ec-1af2-4744-981d-02929aaa6b78), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.346336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-728eaadb-651c-4f43-b166-93b968306179 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (3086ab7d-8ae1-44ba-8477-48853d6e333b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.379585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb4390dd-86e3-4856-82df-f327b03e19a4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (afd3769b-5015-44f4-b287-307972ee520d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.385745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 2001:db8::1 (97acd41e-65de-4a40-9f5c-ad8b6aa7efb6/222f25e2-9089-4c48-b74a-f3cca2685179/9a3c8ddc-6137-4044-be73-0711b6f5b780) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:28.395278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb4390dd-86e3-4856-82df-f327b03e19a4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (afd3769b-5015-44f4-b287-307972ee520d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.404540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-728eaadb-651c-4f43-b166-93b968306179 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=3086ab7d-8ae1-44ba-8477-48853d6e333b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:28.408779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-728eaadb-651c-4f43-b166-93b968306179 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.412017 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-728eaadb-651c-4f43-b166-93b968306179 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/3086ab7d-8ae1-44ba-8477-48853d6e333b HTTP/1.1" status: 204 len: 168 time: 1.0069644 Mar 24 02:13:28.415297 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-62ef17c4-f2b0-4d9c-bfe5-9cc26fec0d50 req-84ef9cb8-fdd4-4918-ba36-e09254e0723c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1780531 Mar 24 02:13:28.421234 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56982) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:28.422092 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb4390dd-86e3-4856-82df-f327b03e19a4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=afd3769b-5015-44f4-b287-307972ee520d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:28.481276 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ab28feaa-1415-431b-bdf3-cdc09123e290 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0554645 Mar 24 02:13:28.486204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56984) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:28.507965 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:28.511009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb4390dd-86e3-4856-82df-f327b03e19a4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.516021 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bb4390dd-86e3-4856-82df-f327b03e19a4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5483565 Mar 24 02:13:28.519358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56986) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:28.526898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (32e369ec-1af2-4744-981d-02929aaa6b78), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.529790 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6dffe6bd-af9a-4085-8561-11a0f8fe9ca8 None None] Provisioning complete for port c6417f3b-22fb-45bc-92a5-17c345dcb84f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:28.531224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6dffe6bd-af9a-4085-8561-11a0f8fe9ca8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.578567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-9dcc1e34-cbe5-40e8-934d-ed6117d0477b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '002b7bde-84e6-437c-a10d-63552629fdd7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:28.614626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e9177ce7-f30d-46ee-8ec4-246c05458b92 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Deleting port 877298c2-b172-4600-820f-4ebf49da2a4c {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:28.615183 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9177ce7-f30d-46ee-8ec4-246c05458b92 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (877298c2-b172-4600-820f-4ebf49da2a4c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.650099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9dcc1e34-cbe5-40e8-934d-ed6117d0477b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (68c36929-87cf-4e0d-a608-826394d8b55f), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.697062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9177ce7-f30d-46ee-8ec4-246c05458b92 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (877298c2-b172-4600-820f-4ebf49da2a4c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.712330 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e9177ce7-f30d-46ee-8ec4-246c05458b92 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Calling delete_port for 877298c2-b172-4600-820f-4ebf49da2a4c owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:28.735146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.738476 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6dffe6bd-af9a-4085-8561-11a0f8fe9ca8 None None] Current status of the port c6417f3b-22fb-45bc-92a5-17c345dcb84f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:28.750576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6dffe6bd-af9a-4085-8561-11a0f8fe9ca8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.818312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.819225 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6dffe6bd-af9a-4085-8561-11a0f8fe9ca8 None None] For port c6417f3b-22fb-45bc-92a5-17c345dcb84f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c6417f3b-22fb-45bc-92a5-17c345dcb84f,segment=NetworkSegment(769c981e-2cd6-4647-8a34-7b067e17b24a),segment_id=769c981e-2cd6-4647-8a34-7b067e17b24a)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:28.819472 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Calling delete_port for 32e369ec-1af2-4744-981d-02929aaa6b78 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:28.829663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e58640b9-bc91-467e-86dc-e8b5c52a49e3 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:28.830454 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9177ce7-f30d-46ee-8ec4-246c05458b92 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (877298c2-b172-4600-820f-4ebf49da2a4c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.843764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6dffe6bd-af9a-4085-8561-11a0f8fe9ca8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.858732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9177ce7-f30d-46ee-8ec4-246c05458b92 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.864600 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e9177ce7-f30d-46ee-8ec4-246c05458b92 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/ports/877298c2-b172-4600-820f-4ebf49da2a4c HTTP/1.1" status: 204 len: 168 time: 0.7028546 Mar 24 02:13:28.865220 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56988) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:28.901729 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:28.907607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:28.919830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:28.926132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (2f78564e-0ab3-4c6e-8e01-d720fac2db18), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.937840 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9177ce7-f30d-46ee-8ec4-246c05458b92 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Port': ['ID=877298c2-b172-4600-820f-4ebf49da2a4c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:28.959013 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dffe6bd-af9a-4085-8561-11a0f8fe9ca8 None None] Pushing event updated for resources: {'Port': ['ID=c6417f3b-22fb-45bc-92a5-17c345dcb84f,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:28.990879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port e58640b9-bc91-467e-86dc-e8b5c52a49e3 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:28.991497 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-93d2781d-c609-4fbd-98a3-ecc07932adfc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): The resource could not be found. Mar 24 02:13:28.991634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:28.992031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-93d2781d-c609-4fbd-98a3-ecc07932adfc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:28.995449 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-93d2781d-c609-4fbd-98a3-ecc07932adfc tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/subnets/dd332db5-c958-4e28-9386-ce0c0415aad7 HTTP/1.1" status: 404 len: 337 time: 0.1195920 Mar 24 02:13:29.008995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 56990) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:29.073566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=9a3c8ddc-6137-4044-be73-0711b6f5b780,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:29.119586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port e58640b9-bc91-467e-86dc-e8b5c52a49e3 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:29.119915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.120967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9dcc1e34-cbe5-40e8-934d-ed6117d0477b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (68c36929-87cf-4e0d-a608-826394d8b55f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.153356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9dcc1e34-cbe5-40e8-934d-ed6117d0477b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (68c36929-87cf-4e0d-a608-826394d8b55f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.195522 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dcc1e34-cbe5-40e8-934d-ed6117d0477b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=68c36929-87cf-4e0d-a608-826394d8b55f,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:29.205739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9dcc1e34-cbe5-40e8-934d-ed6117d0477b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.206265 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port e58640b9-bc91-467e-86dc-e8b5c52a49e3, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e58640b9-bc91-467e-86dc-e8b5c52a49e3,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:29.215072 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9dcc1e34-cbe5-40e8-934d-ed6117d0477b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.6380885 Mar 24 02:13:29.216981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56994) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:29.220038 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.220999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c6417f3b-22fb-45bc-92a5-17c345dcb84f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:29.229439 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e5e5273-14a3-4e48-9b4b-cbc59d21f392 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:29.244611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-15dde9d4-dd47-4539-94a3-b90c46e98b19 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '002b7bde-84e6-437c-a10d-63552629fdd7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:29.270225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.299081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-15dde9d4-dd47-4539-94a3-b90c46e98b19 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (96acd37a-24a3-4d2a-b6aa-e515dd83e2e5), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.373634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7d723cf0-5e5e-4e4c-b486-11931608adce None None] Provisioning complete for port c6417f3b-22fb-45bc-92a5-17c345dcb84f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:29.375547 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d723cf0-5e5e-4e4c-b486-11931608adce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.525097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-15dde9d4-dd47-4539-94a3-b90c46e98b19 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (96acd37a-24a3-4d2a-b6aa-e515dd83e2e5), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.526849 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:29.533203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.541980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-15dde9d4-dd47-4539-94a3-b90c46e98b19 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (96acd37a-24a3-4d2a-b6aa-e515dd83e2e5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.547879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=e58640b9-bc91-467e-86dc-e8b5c52a49e3,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:29.585976 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port c6417f3b-22fb-45bc-92a5-17c345dcb84f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:29.586713 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.607175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15dde9d4-dd47-4539-94a3-b90c46e98b19 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=96acd37a-24a3-4d2a-b6aa-e515dd83e2e5,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:29.618827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-15dde9d4-dd47-4539-94a3-b90c46e98b19 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.620008 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-15dde9d4-dd47-4539-94a3-b90c46e98b19 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.3794374 Mar 24 02:13:29.622894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 56998) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:29.661062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f0de653-5c91-4472-a619-8f9f8211a4f2 None None] Network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:29.709632 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f75fc42c-6a63-4100-ad90-6ba7ce9864c0 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:29.712062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (3cc171f1-45cd-4c0d-af46-657530acea1a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.764917 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7d723cf0-5e5e-4e4c-b486-11931608adce None None] Current status of the port c6417f3b-22fb-45bc-92a5-17c345dcb84f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:29.870683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f75fc42c-6a63-4100-ad90-6ba7ce9864c0 None None] Deleting port e58640b9-bc91-467e-86dc-e8b5c52a49e3 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:29.870964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f75fc42c-6a63-4100-ad90-6ba7ce9864c0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.872683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port c6417f3b-22fb-45bc-92a5-17c345dcb84f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:29.873778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fa8224fd-63a8-406e-b5ee-8a578673c625 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:29.910068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (3cc171f1-45cd-4c0d-af46-657530acea1a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.948446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3cc171f1-45cd-4c0d-af46-657530acea1a']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:29.965665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (32e369ec-1af2-4744-981d-02929aaa6b78), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.971267 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd2aa1cfc-aa62-47aa-9135-047a2ea22478') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:29.971571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd2aa1cfc-aa62-47aa-9135-047a2ea22478') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:29.983399 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Provisioning complete for port 9a3c8ddc-6137-4044-be73-0711b6f5b780 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:29.983775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.987651 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f75fc42c-6a63-4100-ad90-6ba7ce9864c0 None None] For port e58640b9-bc91-467e-86dc-e8b5c52a49e3, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e58640b9-bc91-467e-86dc-e8b5c52a49e3,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:29.987651 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f75fc42c-6a63-4100-ad90-6ba7ce9864c0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:29.998550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ed81ab-834d-4e5b-b92d-c81ff3f4e0bc req-2f223da6-8a43-4bde-9830-3c6b02efdd31 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:30.005502 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19ed81ab-834d-4e5b-b92d-c81ff3f4e0bc req-2f223da6-8a43-4bde-9830-3c6b02efdd31 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.4562869 Mar 24 02:13:30.025014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd9f06ca-07da-476a-ba0d-930fd2d98954 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (96acd37a-24a3-4d2a-b6aa-e515dd83e2e5), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.032745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f75fc42c-6a63-4100-ad90-6ba7ce9864c0 None None] Calling delete_port for e58640b9-bc91-467e-86dc-e8b5c52a49e3 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:30.047943 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd9f06ca-07da-476a-ba0d-930fd2d98954 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (96acd37a-24a3-4d2a-b6aa-e515dd83e2e5), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.048150 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Port 9a3c8ddc-6137-4044-be73-0711b6f5b780 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:30.048907 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (d2aa1cfc-aa62-47aa-9135-047a2ea22478), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.058251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event deleted for resources: {'Port': ['ID=32e369ec-1af2-4744-981d-02929aaa6b78,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:30.094683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fa8224fd-63a8-406e-b5ee-8a578673c625 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:30.094683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.113981 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19ed81ab-834d-4e5b-b92d-c81ff3f4e0bc req-ca1630f6-49ab-48dc-b00e-f7e17e724327 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1030290 Mar 24 02:13:30.137643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd9f06ca-07da-476a-ba0d-930fd2d98954 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (96acd37a-24a3-4d2a-b6aa-e515dd83e2e5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.141143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d2aa1cfc-aa62-47aa-9135-047a2ea22478), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.143655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (9362b47d-ea99-4b80-a75f-89f0370e647a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.150237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd9f06ca-07da-476a-ba0d-930fd2d98954 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.153919 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fd9f06ca-07da-476a-ba0d-930fd2d98954 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/96acd37a-24a3-4d2a-b6aa-e515dd83e2e5 HTTP/1.1" status: 204 len: 168 time: 0.5275462 Mar 24 02:13:30.153919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9f06ca-07da-476a-ba0d-930fd2d98954 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=96acd37a-24a3-4d2a-b6aa-e515dd83e2e5,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:30.156049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57002) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:30.156176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Provisioning complete for port fa8224fd-63a8-406e-b5ee-8a578673c625 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:30.156176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.206684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.215186 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.216170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (2f78564e-0ab3-4c6e-8e01-d720fac2db18), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.242136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=9362b47d-ea99-4b80-a75f-89f0370e647a,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:30.247628 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:30.248342 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (d2aa1cfc-aa62-47aa-9135-047a2ea22478), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:30.254373 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:30.266709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f75fc42c-6a63-4100-ad90-6ba7ce9864c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (e58640b9-bc91-467e-86dc-e8b5c52a49e3), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.306787 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d80d9d6f-5d0f-4cea-9b07-39a069bab97a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5731 time: 0.1503398 Mar 24 02:13:30.307572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f75fc42c-6a63-4100-ad90-6ba7ce9864c0 None None] Pushing event deleted for resources: {'Port': ['ID=e58640b9-bc91-467e-86dc-e8b5c52a49e3,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:30.314281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (96a5816b-7046-4612-9a87-c6fb23f51c32), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.317904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:30.318704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57004) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:30.332111 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:30.333348 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f75fc42c-6a63-4100-ad90-6ba7ce9864c0 None None] No DVR routers for this DVR port e58640b9-bc91-467e-86dc-e8b5c52a49e3 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:30.334885 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fa8224fd-63a8-406e-b5ee-8a578673c625 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:30.335266 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.360401 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ccbcb28f-1a46-462a-9b32-7ee0fb922854 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:30.409301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Current status of the port fa8224fd-63a8-406e-b5ee-8a578673c625 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:30.409698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.445154 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port fa8224fd-63a8-406e-b5ee-8a578673c625, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fa8224fd-63a8-406e-b5ee-8a578673c625,segment=NetworkSegment(4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7),segment_id=4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:30.447100 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=9a3c8ddc-6137-4044-be73-0711b6f5b780,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:30.455317 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.463781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:30.469097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:30.482902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (96a5816b-7046-4612-9a87-c6fb23f51c32), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.483115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-846c683a-f8bc-42d1-b06d-7ea969fd98a6 req-8ba2d510-2796-44ca-bc8f-5013e0afb13e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:30.484695 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-846c683a-f8bc-42d1-b06d-7ea969fd98a6 req-8ba2d510-2796-44ca-bc8f-5013e0afb13e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2011070 Mar 24 02:13:30.485646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (96a5816b-7046-4612-9a87-c6fb23f51c32), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.553452 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-94b76efc-433f-4bde-8f91-6017b0f2ae95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.565317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:30.566051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.573052 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (3cc171f1-45cd-4c0d-af46-657530acea1a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.576444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (96a5816b-7046-4612-9a87-c6fb23f51c32), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.576981 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Fanout notify agent at l3_agent the message router_deleted on router 96a5816b-7046-4612-9a87-c6fb23f51c32 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:30.588482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=fa8224fd-63a8-406e-b5ee-8a578673c625,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:30.591066 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:13:30.591371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:13:30.595860 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '9362b47d-ea99-4b80-a75f-89f0370e647a'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:30.596499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.606099 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.610530 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/3cc171f1-45cd-4c0d-af46-657530acea1a HTTP/1.1" status: 204 len: 168 time: 1.5902259 Mar 24 02:13:30.614498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57006) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:30.622021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.623913 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ef57b0c3-2cde-4168-9513-b4dec8480026 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/96a5816b-7046-4612-9a87-c6fb23f51c32 HTTP/1.1" status: 204 len: 168 time: 3.4827862 Mar 24 02:13:30.627923 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-846c683a-f8bc-42d1-b06d-7ea969fd98a6 req-0a36c37c-da3d-4e3e-b125-ea4ce85ddf58 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1342115 Mar 24 02:13:30.656963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57008) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:30.664587 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4f5cdfe-2be4-4f80-b3f1-5052f8b4ec83 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (68c36929-87cf-4e0d-a608-826394d8b55f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.673430 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5998fb71-ccf0-45f7-a4ca-4945f6a84b73 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Network': ['ID=3cc171f1-45cd-4c0d-af46-657530acea1a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:30.676833 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4f5cdfe-2be4-4f80-b3f1-5052f8b4ec83 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (68c36929-87cf-4e0d-a608-826394d8b55f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.686985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6a48c431-9a27-49a5-870e-8b5036a2564e tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-302653237', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:30.705947 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-66b3907f-4019-4d5a-a6b8-f2058d96db85 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 2.2002847 Mar 24 02:13:30.718623 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57012) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:30.727287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6c801906-2b50-4054-8f17-26dc429fc59e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-1711707979', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:30.760881 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4f5cdfe-2be4-4f80-b3f1-5052f8b4ec83 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (68c36929-87cf-4e0d-a608-826394d8b55f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.767807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4f5cdfe-2be4-4f80-b3f1-5052f8b4ec83 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.768910 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d4f5cdfe-2be4-4f80-b3f1-5052f8b4ec83 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/68c36929-87cf-4e0d-a608-826394d8b55f HTTP/1.1" status: 204 len: 168 time: 0.4491649 Mar 24 02:13:30.769819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6c801906-2b50-4054-8f17-26dc429fc59e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (fb9fb294-ad4d-466a-87d0-9a9068b79455), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.770880 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6c801906-2b50-4054-8f17-26dc429fc59e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (fb9fb294-ad4d-466a-87d0-9a9068b79455), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.776243 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57014) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:30.785020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4f5cdfe-2be4-4f80-b3f1-5052f8b4ec83 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=68c36929-87cf-4e0d-a608-826394d8b55f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:30.839859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6c801906-2b50-4054-8f17-26dc429fc59e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router_controller (fb9fb294-ad4d-466a-87d0-9a9068b79455), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.848077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6c801906-2b50-4054-8f17-26dc429fc59e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (fb9fb294-ad4d-466a-87d0-9a9068b79455), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.851605 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6a48c431-9a27-49a5-870e-8b5036a2564e tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (388178b9-9c76-43cb-bb65-63d48483707e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.852697 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6a48c431-9a27-49a5-870e-8b5036a2564e tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (388178b9-9c76-43cb-bb65-63d48483707e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.865219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/9362b47d-ea99-4b80-a75f-89f0370e647a/04485fce-1a2a-4acb-87d3-3eb46f93aa8f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:30.872418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6c801906-2b50-4054-8f17-26dc429fc59e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.873668 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6c801906-2b50-4054-8f17-26dc429fc59e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.1539655 Mar 24 02:13:30.877050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57016) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:30.915804 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6a48c431-9a27-49a5-870e-8b5036a2564e tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (388178b9-9c76-43cb-bb65-63d48483707e), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.932203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6a48c431-9a27-49a5-870e-8b5036a2564e tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (388178b9-9c76-43cb-bb65-63d48483707e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:30.985049 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4e645a20-4e92-4f43-b49c-a2cbe660fd2f tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5190 time: 0.1986322 Mar 24 02:13:30.987382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57018) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:30.995158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c253d783-b547-4cb5-bdd5-3b510e43fb06 req-f6854381-464c-4778-8dad-10f782855459 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:30.996699 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c253d783-b547-4cb5-bdd5-3b510e43fb06 req-f6854381-464c-4778-8dad-10f782855459 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2400253 Mar 24 02:13:31.007750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router 2f78564e-0ab3-4c6e-8e01-d720fac2db18 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:31.011331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c902cb0b-b7fb-4e9e-82c7-a712b6bf58f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Deleting port 1fd3bc66-3bb4-4226-9b33-72d945904603 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:31.011685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c902cb0b-b7fb-4e9e-82c7-a712b6bf58f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1fd3bc66-3bb4-4226-9b33-72d945904603), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.021450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c6417f3b-22fb-45bc-92a5-17c345dcb84f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:31.023749 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6a48c431-9a27-49a5-870e-8b5036a2564e tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.027540 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6a48c431-9a27-49a5-870e-8b5036a2564e tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.3673596 Mar 24 02:13:31.030768 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57020) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:31.035620 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': False}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:31.109335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.168885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-adf52a37-7b58-4cd8-a0c1-7860d2fac07a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (afd3769b-5015-44f4-b287-307972ee520d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.172824 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port c6417f3b-22fb-45bc-92a5-17c345dcb84f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:31.173566 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.177085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Current status of the port fa8224fd-63a8-406e-b5ee-8a578673c625 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:31.208140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-44d6d52a-7a26-43bc-af58-cd0283f81f17 None None] Could not find standard attr ID for object e58640b9-bc91-467e-86dc-e8b5c52a49e3. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:13:31.220378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-adf52a37-7b58-4cd8-a0c1-7860d2fac07a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (afd3769b-5015-44f4-b287-307972ee520d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.226033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c902cb0b-b7fb-4e9e-82c7-a712b6bf58f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1fd3bc66-3bb4-4226-9b33-72d945904603), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.254883 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c253d783-b547-4cb5-bdd5-3b510e43fb06 req-0ae68cb4-341a-4913-8c9e-7c797b14706e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2500436 Mar 24 02:13:31.255789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c902cb0b-b7fb-4e9e-82c7-a712b6bf58f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Calling delete_port for 1fd3bc66-3bb4-4226-9b33-72d945904603 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:31.296930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:31.321309 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-129b52c5-8f69-41e0-83f4-4e64f43cc7f6 None None] Sync routers for ids ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:31.329040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port c6417f3b-22fb-45bc-92a5-17c345dcb84f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:31.339184 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-385bab95-ce66-4fa9-aa25-6979a58e3a28 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/2f78564e-0ab3-4c6e-8e01-d720fac2db18/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3808179 Mar 24 02:13:31.340217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-adf52a37-7b58-4cd8-a0c1-7860d2fac07a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (afd3769b-5015-44f4-b287-307972ee520d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.343720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57024) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:31.348303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Publish callbacks [] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.360147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-adf52a37-7b58-4cd8-a0c1-7860d2fac07a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.360699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.364039 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-adf52a37-7b58-4cd8-a0c1-7860d2fac07a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/afd3769b-5015-44f4-b287-307972ee520d HTTP/1.1" status: 204 len: 168 time: 0.3639667 Mar 24 02:13:31.368216 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57026) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:31.369495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-81914e0b-7365-4a2d-b9bf-0f87f9616ae5 None None] Provisioning complete for port 9a3c8ddc-6137-4044-be73-0711b6f5b780 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:31.369873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-81914e0b-7365-4a2d-b9bf-0f87f9616ae5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.380184 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-129b52c5-8f69-41e0-83f4-4e64f43cc7f6 None None] Routers {'2f78564e-0ab3-4c6e-8e01-d720fac2db18'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:31.384475 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-129b52c5-8f69-41e0-83f4-4e64f43cc7f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:31.393934 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf52a37-7b58-4cd8-a0c1-7860d2fac07a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=afd3769b-5015-44f4-b287-307972ee520d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:31.411343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (388178b9-9c76-43cb-bb65-63d48483707e), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.434245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:31.435837 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fd61661-df01-4f28-8bf3-c179d451455d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:31.440864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:31.445523 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8fd61661-df01-4f28-8bf3-c179d451455d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports/9a3c8ddc-6137-4044-be73-0711b6f5b780 HTTP/1.1" status: 200 len: 911 time: 0.0984046 Mar 24 02:13:31.446796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57028) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:31.453847 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:31.467942 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.473764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Pushing event updated for resources: {'Port': ['ID=04485fce-1a2a-4acb-87d3-3eb46f93aa8f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:31.485357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c902cb0b-b7fb-4e9e-82c7-a712b6bf58f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (1fd3bc66-3bb4-4226-9b33-72d945904603), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.511731 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-81914e0b-7365-4a2d-b9bf-0f87f9616ae5 None None] Port 9a3c8ddc-6137-4044-be73-0711b6f5b780 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:31.515656 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-129b52c5-8f69-41e0-83f4-4e64f43cc7f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:31.536761 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-129b52c5-8f69-41e0-83f4-4e64f43cc7f6 None None] Routers {'2f78564e-0ab3-4c6e-8e01-d720fac2db18'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:31.537933 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-129b52c5-8f69-41e0-83f4-4e64f43cc7f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:31.546745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-81914e0b-7365-4a2d-b9bf-0f87f9616ae5 None None] Provisioning complete for port fa8224fd-63a8-406e-b5ee-8a578673c625 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:31.547118 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-81914e0b-7365-4a2d-b9bf-0f87f9616ae5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.552348 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e58640b9-bc91-467e-86dc-e8b5c52a49e3 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:31.560994 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c902cb0b-b7fb-4e9e-82c7-a712b6bf58f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Port': ['ID=1fd3bc66-3bb4-4226-9b33-72d945904603,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:31.597042 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-129b52c5-8f69-41e0-83f4-4e64f43cc7f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:31.597696 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-129b52c5-8f69-41e0-83f4-4e64f43cc7f6 None None] The sync data for ids ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:31.601857 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a282a801-4ce9-49c6-9a32-d996e6503327 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4649 time: 0.2320752 Mar 24 02:13:31.606156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57030) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:31.609695 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: e58640b9-bc91-467e-86dc-e8b5c52a49e3 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:31.610202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e58640b9-bc91-467e-86dc-e8b5c52a49e3 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:31.616917 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Attempting to bind port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:31.617294 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Attempting to bind port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:31.617661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Attempting to bind port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:31.626510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c902cb0b-b7fb-4e9e-82c7-a712b6bf58f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.628466 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:31.628849 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:31.629256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.629656 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:31.630140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Bound port: 04485fce-1a2a-4acb-87d3-3eb46f93aa8f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:31.630636 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c902cb0b-b7fb-4e9e-82c7-a712b6bf58f2 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/ports/1fd3bc66-3bb4-4226-9b33-72d945904603 HTTP/1.1" status: 204 len: 168 time: 1.0150626 Mar 24 02:13:31.633208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.633570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57032) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:31.662253 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e058288-8901-4656-a6f4-5e4190dc72d3 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] DELETE failed (client error): The resource could not be found. Mar 24 02:13:31.663364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5e058288-8901-4656-a6f4-5e4190dc72d3 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:31.669887 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5e058288-8901-4656-a6f4-5e4190dc72d3 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/subnets/b95f1f2f-b31b-4f68-b502-9909e35405ba HTTP/1.1" status: 404 len: 337 time: 0.0319259 Mar 24 02:13:31.669887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57034) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:31.740615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-81914e0b-7365-4a2d-b9bf-0f87f9616ae5 None None] Current status of the port fa8224fd-63a8-406e-b5ee-8a578673c625 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:31.743456 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b09cb99-91b2-42e7-bab3-eb55bb78adfa req-767882d1-3ce9-4e50-bc52-3808f54633cf tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:31.744791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] For port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:31.750824 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9b09cb99-91b2-42e7-bab3-eb55bb78adfa req-767882d1-3ce9-4e50-bc52-3808f54633cf tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1910708 Mar 24 02:13:31.757487 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] For port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=04485fce-1a2a-4acb-87d3-3eb46f93aa8f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:31.765169 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.799065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (85ea4ade-99a4-4f64-93f5-a2a5102bff1f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.827974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-980802ca-d30d-40b3-aaf3-bc935e78c993 None None] Pushing event updated for resources: {'Port': ['ID=04485fce-1a2a-4acb-87d3-3eb46f93aa8f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:31.833449 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9b09cb99-91b2-42e7-bab3-eb55bb78adfa req-710fa0c4-1e41-4dfc-9fe1-f20ff1b0ac94 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0769675 Mar 24 02:13:31.963397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (85ea4ade-99a4-4f64-93f5-a2a5102bff1f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:31.990823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['85ea4ade-99a4-4f64-93f5-a2a5102bff1f']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:32.005304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c74b6e6a-8270-4d17-bc9f-5ebaa34fca20') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:32.005607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c74b6e6a-8270-4d17-bc9f-5ebaa34fca20') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:32.018646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (c74b6e6a-8270-4d17-bc9f-5ebaa34fca20), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.023370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11c5fd56-b4d8-46c3-abfd-bedcaaaf5684 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (2d4f2b47-d21a-4c97-a4ed-cd7a348e5d17), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.031849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eba9225-73c6-471b-97f4-f789ca82c73c req-a964f90a-c4d5-45ca-ab4e-cba959ad88bd tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:32.035066 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2eba9225-73c6-471b-97f4-f789ca82c73c req-a964f90a-c4d5-45ca-ab4e-cba959ad88bd tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1175268 Mar 24 02:13:32.069397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (c74b6e6a-8270-4d17-bc9f-5ebaa34fca20), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.080475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Releasing vlan 101 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:32.080866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (c74b6e6a-8270-4d17-bc9f-5ebaa34fca20), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:32.083933 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:32.096592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11c5fd56-b4d8-46c3-abfd-bedcaaaf5684 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (2d4f2b47-d21a-4c97-a4ed-cd7a348e5d17), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.155644 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2eba9225-73c6-471b-97f4-f789ca82c73c req-2c55cbf2-ab19-4d7c-839b-0a48e61b6875 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1107228 Mar 24 02:13:32.167870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (85ea4ade-99a4-4f64-93f5-a2a5102bff1f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.173849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.177366 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/85ea4ade-99a4-4f64-93f5-a2a5102bff1f HTTP/1.1" status: 204 len: 168 time: 0.5072114 Mar 24 02:13:32.181370 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57038) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:32.231087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62df8f30-3247-4d0a-8e27-d7641fdd684d tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Network': ['ID=85ea4ade-99a4-4f64-93f5-a2a5102bff1f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:32.281255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-2bbc522d-af0b-448c-bc67-1ea0d4f3b9cf tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Deleting subnet fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:32.285525 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2bbc522d-af0b-448c-bc67-1ea0d4f3b9cf tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for subnet (fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.330486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2bbc522d-af0b-448c-bc67-1ea0d4f3b9cf tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.362114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47438219-de47-46f0-a748-e9d131e2b5c1 req-727cca7a-acd1-462c-8bbb-f99a579072b6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:32.363890 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-47438219-de47-46f0-a748-e9d131e2b5c1 req-727cca7a-acd1-462c-8bbb-f99a579072b6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1195009 Mar 24 02:13:32.379556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11c5fd56-b4d8-46c3-abfd-bedcaaaf5684 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (2d4f2b47-d21a-4c97-a4ed-cd7a348e5d17), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.379826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.385044 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11c5fd56-b4d8-46c3-abfd-bedcaaaf5684 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.386678 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-11c5fd56-b4d8-46c3-abfd-bedcaaaf5684 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/2d4f2b47-d21a-4c97-a4ed-cd7a348e5d17 HTTP/1.1" status: 204 len: 168 time: 0.7776423 Mar 24 02:13:32.399264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57042) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:32.445467 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c5fd56-b4d8-46c3-abfd-bedcaaaf5684 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=2d4f2b47-d21a-4c97-a4ed-cd7a348e5d17,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:32.460122 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-47438219-de47-46f0-a748-e9d131e2b5c1 req-1697eea5-2087-4056-9f69-35afe6801301 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0867078 Mar 24 02:13:32.466878 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2bbc522d-af0b-448c-bc67-1ea0d4f3b9cf tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.517837 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::1 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/9362b47d-ea99-4b80-a75f-89f0370e647a/e869bc64-3516-44b3-9f7b-f860f2de0dcd) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:32.534638 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2bbc522d-af0b-448c-bc67-1ea0d4f3b9cf tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.564046 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bbc522d-af0b-448c-bc67-1ea0d4f3b9cf tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Subnet': ['ID=fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:32.578597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2bbc522d-af0b-448c-bc67-1ea0d4f3b9cf tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.581970 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2bbc522d-af0b-448c-bc67-1ea0d4f3b9cf tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/subnets/fd99a45a-96a9-4f0b-bae4-698a1cbdcb9d HTTP/1.1" status: 204 len: 168 time: 0.3996434 Mar 24 02:13:32.584986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57046) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:32.588973 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b29c5a68-5a0e-449a-848f-2c45b0093301 None None] Network e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:32.652480 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ae9bce29-a115-4c5f-89ca-0d659e0bdff7 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4108 time: 0.2517467 Mar 24 02:13:32.652715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57048) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:32.705250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.711786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb112063-9297-4c96-a26e-c3b598b7ae5a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (50cfafe3-d901-4dcb-b383-c6e327239d20), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.721124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb112063-9297-4c96-a26e-c3b598b7ae5a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (50cfafe3-d901-4dcb-b383-c6e327239d20), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.729842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 04485fce-1a2a-4acb-87d3-3eb46f93aa8f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:32.735742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (388178b9-9c76-43cb-bb65-63d48483707e), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.759762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb112063-9297-4c96-a26e-c3b598b7ae5a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (50cfafe3-d901-4dcb-b383-c6e327239d20), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.771866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb112063-9297-4c96-a26e-c3b598b7ae5a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.774003 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bb112063-9297-4c96-a26e-c3b598b7ae5a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/50cfafe3-d901-4dcb-b383-c6e327239d20 HTTP/1.1" status: 204 len: 168 time: 0.1204484 Mar 24 02:13:32.778387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57050) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:32.795168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:32.795455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.828787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb112063-9297-4c96-a26e-c3b598b7ae5a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=50cfafe3-d901-4dcb-b383-c6e327239d20,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:32.834936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.868504 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b6fdb315-0713-46c9-944b-1f2e270ce0b2 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0617893 Mar 24 02:13:32.871996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57052) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:32.898106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:32.899222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.911863 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.917957 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Deleting port 3cbcc90c-9b98-40db-bfa7-656d69fa744d {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:32.918289 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.934538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=04485fce-1a2a-4acb-87d3-3eb46f93aa8f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:32.937905 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-150cc5ac-7d54-4bef-bd00-b520afb71445 None None] DHCP port deletion for e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:32.951496 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:32.952856 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fa8224fd-63a8-406e-b5ee-8a578673c625 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:33.006896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ac007ae-36e5-4716-ba50-bbfcd5cebe58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (002b7bde-84e6-437c-a10d-63552629fdd7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.038465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] For port 3cbcc90c-9b98-40db-bfa7-656d69fa744d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3cbcc90c-9b98-40db-bfa7-656d69fa744d,segment=NetworkSegment(41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe),segment_id=41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:33.039086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.045873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.056473 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ac007ae-36e5-4716-ba50-bbfcd5cebe58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (002b7bde-84e6-437c-a10d-63552629fdd7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.067612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Calling delete_port for 3cbcc90c-9b98-40db-bfa7-656d69fa744d owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:33.129701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=04485fce-1a2a-4acb-87d3-3eb46f93aa8f,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:33.136743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Allocated IP 172.26.2.178 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/a98a3a59-a660-4780-9dea-1ab0ced44965) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:33.153498 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-150cc5ac-7d54-4bef-bd00-b520afb71445 None None] Deleting port 3cbcc90c-9b98-40db-bfa7-656d69fa744d {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:33.153875 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-150cc5ac-7d54-4bef-bd00-b520afb71445 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.159058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ac007ae-36e5-4716-ba50-bbfcd5cebe58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (002b7bde-84e6-437c-a10d-63552629fdd7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.167947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ac007ae-36e5-4716-ba50-bbfcd5cebe58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.167947 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4ac007ae-36e5-4716-ba50-bbfcd5cebe58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/002b7bde-84e6-437c-a10d-63552629fdd7 HTTP/1.1" status: 204 len: 168 time: 0.2925079 Mar 24 02:13:33.172957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57054) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:33.183920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac007ae-36e5-4716-ba50-bbfcd5cebe58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=002b7bde-84e6-437c-a10d-63552629fdd7,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:33.204028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fa8224fd-63a8-406e-b5ee-8a578673c625 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:33.204476 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.223752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.237364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.266023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Port': ['ID=3cbcc90c-9b98-40db-bfa7-656d69fa744d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:33.268561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] No DVR routers for this DVR port 3cbcc90c-9b98-40db-bfa7-656d69fa744d on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:33.273519 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-150cc5ac-7d54-4bef-bd00-b520afb71445 None None] For port 3cbcc90c-9b98-40db-bfa7-656d69fa744d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3cbcc90c-9b98-40db-bfa7-656d69fa744d,segment=NetworkSegment(41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe),segment_id=41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:33.273917 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-150cc5ac-7d54-4bef-bd00-b520afb71445 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.282959 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-74887889-521b-45f5-8352-a94845297eaf None None] Provisioning complete for port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:33.283327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-74887889-521b-45f5-8352-a94845297eaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.291405 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-150cc5ac-7d54-4bef-bd00-b520afb71445 None None] Calling delete_port for 3cbcc90c-9b98-40db-bfa7-656d69fa744d owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:33.355891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.383461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:33.395066 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:33.395725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:33.407517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.410775 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-05219317-5415-47b4-b8eb-afdbace8fe28 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2341149 Mar 24 02:13:33.416126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57056) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:33.422229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:33.422440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-94a3158e-f57d-4d0d-9efd-1a21fc23c616 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-secgroup--32415440'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:33.423009 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fa8224fd-63a8-406e-b5ee-8a578673c625 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:33.434646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.444721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Releasing vlan 136 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:33.445109 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (41c4c0d5-306b-4239-a70f-f8dd7b4c4dbe), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:33.448278 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:33.454963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=e869bc64-3516-44b3-9f7b-f860f2de0dcd,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:33.458846 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:33.461715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:33.463248 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (fb9fb294-ad4d-466a-87d0-9a9068b79455), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.468199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-150cc5ac-7d54-4bef-bd00-b520afb71445 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (3cbcc90c-9b98-40db-bfa7-656d69fa744d), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.494893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94a3158e-f57d-4d0d-9efd-1a21fc23c616 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.497763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-150cc5ac-7d54-4bef-bd00-b520afb71445 None None] Pushing event deleted for resources: {'Port': ['ID=3cbcc90c-9b98-40db-bfa7-656d69fa744d,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:33.511436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-150cc5ac-7d54-4bef-bd00-b520afb71445 None None] No DVR routers for this DVR port 3cbcc90c-9b98-40db-bfa7-656d69fa744d on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:33.514133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-74887889-521b-45f5-8352-a94845297eaf None None] Current status of the port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:33.541981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.553976 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.557422 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] 10.222.0.20 "DELETE /v2.0/networks/e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418 HTTP/1.1" status: 204 len: 168 time: 0.9713016 Mar 24 02:13:33.573656 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cc3310-f3ab-4099-afc6-b31b148cbfb5 tempest-NetworksIpV6TestAttrs-2107786003 tempest-NetworksIpV6TestAttrs-2107786003-project] Pushing event deleted for resources: {'Network': ['ID=e2c45ad5-95ca-4fbc-9a8f-4d2ee5745418,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:33.588935 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 2001:db8:1::1 (7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886/7be7dde7-21ee-46c4-996c-e9d6dea102c7/ccf52e84-3f3f-433d-bf89-dcc255e62ff8) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:33.621093 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94a3158e-f57d-4d0d-9efd-1a21fc23c616 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (dee7485d-8bd7-41aa-950c-500eb0b9dc66), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.633178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94a3158e-f57d-4d0d-9efd-1a21fc23c616 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (dee7485d-8bd7-41aa-950c-500eb0b9dc66), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.633420 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for port (a98a3a59-a660-4780-9dea-1ab0ced44965), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.663055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a3158e-f57d-4d0d-9efd-1a21fc23c616 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dee7485d-8bd7-41aa-950c-500eb0b9dc66,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:33.678968 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94a3158e-f57d-4d0d-9efd-1a21fc23c616 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.680615 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-94a3158e-f57d-4d0d-9efd-1a21fc23c616 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.2632580 Mar 24 02:13:33.685169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57060) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:33.709014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d9d97576-36da-479e-af77-ac7455b95147 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': 'dee7485d-8bd7-41aa-950c-500eb0b9dc66', 'direction': 'ingress', 'protocol': 17}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:33.715864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.747777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d9d97576-36da-479e-af77-ac7455b95147 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (47fc7419-0bcd-4b9b-b670-c3259be1f52e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.751752 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.802397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef1bb910-07f8-4921-9de5-968f52cd0f1b None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:13:33.819924 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a98a3a59-a660-4780-9dea-1ab0ced44965), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.822329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d9d97576-36da-479e-af77-ac7455b95147 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (47fc7419-0bcd-4b9b-b670-c3259be1f52e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.828051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d9d97576-36da-479e-af77-ac7455b95147 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (47fc7419-0bcd-4b9b-b670-c3259be1f52e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.866406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d97576-36da-479e-af77-ac7455b95147 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=47fc7419-0bcd-4b9b-b670-c3259be1f52e,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:33.871023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c051eedc-2f5f-4b0d-ac3f-a96abbde9113 None None] Provisioning complete for port e869bc64-3516-44b3-9f7b-f860f2de0dcd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:33.871463 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c051eedc-2f5f-4b0d-ac3f-a96abbde9113 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.889552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d9d97576-36da-479e-af77-ac7455b95147 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.890792 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d9d97576-36da-479e-af77-ac7455b95147 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.1931653 Mar 24 02:13:33.893601 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57064) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:33.949341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57066) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:33.951589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c051eedc-2f5f-4b0d-ac3f-a96abbde9113 None None] Port e869bc64-3516-44b3-9f7b-f860f2de0dcd cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:33.974240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:33.977419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef1bb910-07f8-4921-9de5-968f52cd0f1b None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:13:33.980030 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbfb0d07-68fa-4583-8793-e8387151cc45 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (dee7485d-8bd7-41aa-950c-500eb0b9dc66), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:33.987092 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:33.989700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:34.009390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbfb0d07-68fa-4583-8793-e8387151cc45 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (dee7485d-8bd7-41aa-950c-500eb0b9dc66), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.034254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Pushing event updated for resources: {'Port': ['ID=a98a3a59-a660-4780-9dea-1ab0ced44965,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:34.049719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.063714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbfb0d07-68fa-4583-8793-e8387151cc45 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (dee7485d-8bd7-41aa-950c-500eb0b9dc66), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.067382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbfb0d07-68fa-4583-8793-e8387151cc45 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.069703 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dbfb0d07-68fa-4583-8793-e8387151cc45 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/dee7485d-8bd7-41aa-950c-500eb0b9dc66 HTTP/1.1" status: 204 len: 168 time: 0.1738207 Mar 24 02:13:34.075438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57070) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:34.104041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbfb0d07-68fa-4583-8793-e8387151cc45 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dee7485d-8bd7-41aa-950c-500eb0b9dc66,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:34.145796 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-357adf49-1ca4-4634-a43e-1a1eb1b340dd tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0689559 Mar 24 02:13:34.151790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57072) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:34.156118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d76d3780-2773-4567-8ccd-0f41abd3e50a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-secgroup--2127687167'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:34.185852 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1e2e30e3-7526-4d87-8928-cae3968c9954 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=0a478f43194148c295b3c5808a7fb554&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2352049 Mar 24 02:13:34.189810 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57074) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:34.206702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d76d3780-2773-4567-8ccd-0f41abd3e50a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.274819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9527cac1-d83c-44c3-8dbe-d5f3004fcd06 admin admin] Publish callbacks [] for security_group (1e9612c6-d218-462e-9785-b176d6768c13), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.278126 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.307137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9527cac1-d83c-44c3-8dbe-d5f3004fcd06 admin admin] Publish callbacks [] for security_group (1e9612c6-d218-462e-9785-b176d6768c13), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.335271 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d76d3780-2773-4567-8ccd-0f41abd3e50a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (0f7902ff-07bb-49b5-80fd-aa6d8c01afe0), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.347422 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d76d3780-2773-4567-8ccd-0f41abd3e50a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0f7902ff-07bb-49b5-80fd-aa6d8c01afe0), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.380784 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d76d3780-2773-4567-8ccd-0f41abd3e50a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.385063 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d76d3780-2773-4567-8ccd-0f41abd3e50a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.2298474 Mar 24 02:13:34.385364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57076) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:34.390918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-512b4165-1a18-4bde-9cad-49f3c3c8c997 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-secgroup--1091968461'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:34.395976 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d76d3780-2773-4567-8ccd-0f41abd3e50a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0f7902ff-07bb-49b5-80fd-aa6d8c01afe0,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:34.403289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:34.408544 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9527cac1-d83c-44c3-8dbe-d5f3004fcd06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1e9612c6-d218-462e-9785-b176d6768c13), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.411280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9527cac1-d83c-44c3-8dbe-d5f3004fcd06 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.412464 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9527cac1-d83c-44c3-8dbe-d5f3004fcd06 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/1e9612c6-d218-462e-9785-b176d6768c13 HTTP/1.1" status: 204 len: 168 time: 0.2217050 Mar 24 02:13:34.424190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9527cac1-d83c-44c3-8dbe-d5f3004fcd06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e9612c6-d218-462e-9785-b176d6768c13,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:34.425987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:34.428862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-512b4165-1a18-4bde-9cad-49f3c3c8c997 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.433086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:34.433447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (2f78564e-0ab3-4c6e-8e01-d720fac2db18), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.517399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-512b4165-1a18-4bde-9cad-49f3c3c8c997 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (1b01f022-1e30-430a-a652-aaca897cb724), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.522684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-512b4165-1a18-4bde-9cad-49f3c3c8c997 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1b01f022-1e30-430a-a652-aaca897cb724), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.579301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-512b4165-1a18-4bde-9cad-49f3c3c8c997 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1b01f022-1e30-430a-a652-aaca897cb724,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:34.588777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-512b4165-1a18-4bde-9cad-49f3c3c8c997 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.590606 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-512b4165-1a18-4bde-9cad-49f3c3c8c997 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.2033558 Mar 24 02:13:34.593022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57084) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:34.598849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ef548bf2-5168-4f55-a4ac-06fb0a2be2b0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '0f7902ff-07bb-49b5-80fd-aa6d8c01afe0', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '1b01f022-1e30-430a-a652-aaca897cb724', 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:34.642591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ef548bf2-5168-4f55-a4ac-06fb0a2be2b0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (3ca6d48b-247b-43e2-99e8-641bd5f803e3), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.649851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 04485fce-1a2a-4acb-87d3-3eb46f93aa8f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:34.725869 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:34.726375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.754827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ef548bf2-5168-4f55-a4ac-06fb0a2be2b0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (3ca6d48b-247b-43e2-99e8-641bd5f803e3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.760146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ef548bf2-5168-4f55-a4ac-06fb0a2be2b0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (3ca6d48b-247b-43e2-99e8-641bd5f803e3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.777325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef548bf2-5168-4f55-a4ac-06fb0a2be2b0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3ca6d48b-247b-43e2-99e8-641bd5f803e3,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:34.800244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ef548bf2-5168-4f55-a4ac-06fb0a2be2b0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.805875 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ef548bf2-5168-4f55-a4ac-06fb0a2be2b0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.2112803 Mar 24 02:13:34.806943 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57088) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:34.841090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd940cc8-f52b-439b-8d59-3e1f8183410e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (3ca6d48b-247b-43e2-99e8-641bd5f803e3), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.845161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=ccf52e84-3f3f-433d-bf89-dcc255e62ff8,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:34.852880 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd940cc8-f52b-439b-8d59-3e1f8183410e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (3ca6d48b-247b-43e2-99e8-641bd5f803e3), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.880356 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:34.908049 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.909134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd940cc8-f52b-439b-8d59-3e1f8183410e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (3ca6d48b-247b-43e2-99e8-641bd5f803e3), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.918626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.919392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (fb9fb294-ad4d-466a-87d0-9a9068b79455), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.920668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd940cc8-f52b-439b-8d59-3e1f8183410e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.924384 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cd940cc8-f52b-439b-8d59-3e1f8183410e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/3ca6d48b-247b-43e2-99e8-641bd5f803e3 HTTP/1.1" status: 204 len: 168 time: 0.1144226 Mar 24 02:13:34.925961 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57094) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:34.929453 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-81eb6672-002f-4bf4-974e-e10bab7957a9 None None] Provisioning complete for port ccf52e84-3f3f-433d-bf89-dcc255e62ff8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:34.930041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-81eb6672-002f-4bf4-974e-e10bab7957a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.956239 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd940cc8-f52b-439b-8d59-3e1f8183410e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=3ca6d48b-247b-43e2-99e8-641bd5f803e3,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:34.963479 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:34.995180 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-81eb6672-002f-4bf4-974e-e10bab7957a9 None None] Port ccf52e84-3f3f-433d-bf89-dcc255e62ff8 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:34.996734 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3cbcc90c-9b98-40db-bfa7-656d69fa744d no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:35.004554 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e964ab9b-3d3e-4d8b-a51b-34b385907d21 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0658271 Mar 24 02:13:35.004554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57098) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:35.025145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router_gateway (388178b9-9c76-43cb-bb65-63d48483707e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.035079 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 3cbcc90c-9b98-40db-bfa7-656d69fa744d {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:35.035432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3cbcc90c-9b98-40db-bfa7-656d69fa744d not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:35.070755 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-36f154c3-b165-4089-b100-f9b2d928015c tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (1b01f022-1e30-430a-a652-aaca897cb724), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.095417 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-36f154c3-b165-4089-b100-f9b2d928015c tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (1b01f022-1e30-430a-a652-aaca897cb724), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.102147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=e869bc64-3516-44b3-9f7b-f860f2de0dcd,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:35.184013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-36f154c3-b165-4089-b100-f9b2d928015c tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1b01f022-1e30-430a-a652-aaca897cb724), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.190314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-36f154c3-b165-4089-b100-f9b2d928015c tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.193833 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-36f154c3-b165-4089-b100-f9b2d928015c tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/1b01f022-1e30-430a-a652-aaca897cb724 HTTP/1.1" status: 204 len: 168 time: 0.1861169 Mar 24 02:13:35.195980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57106) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:35.212817 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f154c3-b165-4089-b100-f9b2d928015c tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b01f022-1e30-430a-a652-aaca897cb724,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:35.260013 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ad953ec7-aeba-49af-9109-0f79264f87c5 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4539 time: 0.0603921 Mar 24 02:13:35.260437 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57108) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:35.264356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:35.271049 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:35.321216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c4cdc6cb-899e-49e9-ae29-16b6dd1973fd tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (0f7902ff-07bb-49b5-80fd-aa6d8c01afe0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.353629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c4cdc6cb-899e-49e9-ae29-16b6dd1973fd tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (0f7902ff-07bb-49b5-80fd-aa6d8c01afe0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.407579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57112) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:35.415769 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c4cdc6cb-899e-49e9-ae29-16b6dd1973fd tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0f7902ff-07bb-49b5-80fd-aa6d8c01afe0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.418495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c4cdc6cb-899e-49e9-ae29-16b6dd1973fd tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.422553 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c4cdc6cb-899e-49e9-ae29-16b6dd1973fd tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/0f7902ff-07bb-49b5-80fd-aa6d8c01afe0 HTTP/1.1" status: 204 len: 168 time: 0.1580474 Mar 24 02:13:35.422846 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57116) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:35.442125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4cdc6cb-899e-49e9-ae29-16b6dd1973fd tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f7902ff-07bb-49b5-80fd-aa6d8c01afe0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:35.498762 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3632abe6-63cb-488d-85ef-029e6277ef2f tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0733223 Mar 24 02:13:35.499663 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57118) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:35.506892 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-9e0aab52-87c5-4001-85bf-7f46747910e4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-secgroup--1429159903'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:35.537138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-40934525'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:35.548286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9e0aab52-87c5-4001-85bf-7f46747910e4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.580172 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:35.584089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.599987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.603853 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Router fb9fb294-ad4d-466a-87d0-9a9068b79455 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:35.610675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (388178b9-9c76-43cb-bb65-63d48483707e), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.632194 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2cc9b03a-35be-47fc-a802-472d43c12571 None None] Provisioning complete for port e869bc64-3516-44b3-9f7b-f860f2de0dcd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:35.632565 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2cc9b03a-35be-47fc-a802-472d43c12571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.669727 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2cc9b03a-35be-47fc-a802-472d43c12571 None None] Port e869bc64-3516-44b3-9f7b-f860f2de0dcd cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:35.680019 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9e0aab52-87c5-4001-85bf-7f46747910e4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (ec84d6fc-452e-4bed-9ece-d9f195548885), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.687031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9e0aab52-87c5-4001-85bf-7f46747910e4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (ec84d6fc-452e-4bed-9ece-d9f195548885), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.704670 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (388178b9-9c76-43cb-bb65-63d48483707e), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.732996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9e0aab52-87c5-4001-85bf-7f46747910e4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.734209 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9e0aab52-87c5-4001-85bf-7f46747910e4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.2334046 Mar 24 02:13:35.739106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57120) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:35.747773 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-81c098b9-1de5-4266-993b-88053abf95a5 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': 'ec84d6fc-452e-4bed-9ece-d9f195548885', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:35.755914 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e0aab52-87c5-4001-85bf-7f46747910e4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ec84d6fc-452e-4bed-9ece-d9f195548885,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:35.762718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for security_group (d083b7f5-3ecb-4127-8d86-2c5de1725211), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.770357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d083b7f5-3ecb-4127-8d86-2c5de1725211), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.801946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 124} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:35.812973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.817070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-81c098b9-1de5-4266-993b-88053abf95a5 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (25547443-278d-440e-8b94-4dbf3e36661c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.820126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d083b7f5-3ecb-4127-8d86-2c5de1725211,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:35.823117 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:35.825958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (314ce7c4-6689-4197-9105-543740a0d3ef), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.826310 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment 314ce7c4-6689-4197-9105-543740a0d3ef of type vlan for network a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a Mar 24 02:13:35.826975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.827729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (2f78564e-0ab3-4c6e-8e01-d720fac2db18), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.833304 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fce6e832-ff61-44bc-9389-783787997ae5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "PUT /v2.0/routers/fb9fb294-ad4d-466a-87d0-9a9068b79455/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.9545310 Mar 24 02:13:35.836636 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Sync routers for ids ['fb9fb294-ad4d-466a-87d0-9a9068b79455'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:35.839156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57122) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:35.854790 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Routers {'fb9fb294-ad4d-466a-87d0-9a9068b79455'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:35.855609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['fb9fb294-ad4d-466a-87d0-9a9068b79455'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:35.904678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.940171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-81c098b9-1de5-4266-993b-88053abf95a5 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (25547443-278d-440e-8b94-4dbf3e36661c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.945802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-81c098b9-1de5-4266-993b-88053abf95a5 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (25547443-278d-440e-8b94-4dbf3e36661c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.952036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:35.957024 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:35.957637 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.001895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:36.023032 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c098b9-1de5-4266-993b-88053abf95a5 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=25547443-278d-440e-8b94-4dbf3e36661c,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:36.023645 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:36.027440 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=ccf52e84-3f3f-433d-bf89-dcc255e62ff8,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:36.037247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-81c098b9-1de5-4266-993b-88053abf95a5 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.039011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef971b43-b370-478e-93cc-9e9f8a48fea3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:36.040449 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ef971b43-b370-478e-93cc-9e9f8a48fea3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports/e869bc64-3516-44b3-9f7b-f860f2de0dcd HTTP/1.1" status: 200 len: 911 time: 0.1986866 Mar 24 02:13:36.042652 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-81c098b9-1de5-4266-993b-88053abf95a5 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.3022475 Mar 24 02:13:36.043250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57124) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:36.043580 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57126) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:36.067334 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 0.6573510 Mar 24 02:13:36.099031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba17b83-ac05-4e9f-9a0f-d3d72cc5d6ed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:36.116635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1787d231-5071-45f0-a19c-2e50a15658e3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (25547443-278d-440e-8b94-4dbf3e36661c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.129087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1787d231-5071-45f0-a19c-2e50a15658e3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (25547443-278d-440e-8b94-4dbf3e36661c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.129448 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:36.169907 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a0a7721-d39e-4414-b21d-710ff771a40d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:36.175298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a0a7721-d39e-4414-b21d-710ff771a40d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:36.180136 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6a0a7721-d39e-4414-b21d-710ff771a40d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.1240571 Mar 24 02:13:36.192202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Set router fb9fb294-ad4d-466a-87d0-9a9068b79455 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:13:36.195953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57128) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:36.268719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57130) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:36.276791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': 'a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a', 'cidr': '172.20.255.240/28', 'ip_version': 4, 'gateway_ip': '172.20.255.241'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:36.315034 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1787d231-5071-45f0-a19c-2e50a15658e3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (25547443-278d-440e-8b94-4dbf3e36661c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.333013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1787d231-5071-45f0-a19c-2e50a15658e3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.336884 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1787d231-5071-45f0-a19c-2e50a15658e3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/25547443-278d-440e-8b94-4dbf3e36661c HTTP/1.1" status: 204 len: 168 time: 0.2894082 Mar 24 02:13:36.344404 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57132) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:36.376387 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Router 388178b9-9c76-43cb-bb65-63d48483707e is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:36.381056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1787d231-5071-45f0-a19c-2e50a15658e3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=25547443-278d-440e-8b94-4dbf3e36661c,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:36.384827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router 2f78564e-0ab3-4c6e-8e01-d720fac2db18 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:13:36.451974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb9fb294-ad4d-466a-87d0-9a9068b79455', 'name': 'tempest-NetworksTestDHCPv6-router-1711707979', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:30Z', 'updated_at': '2022-03-24T02:13:33Z', 'revision_number': 2, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None, '_interfaces': [{'id': 'e869bc64-3516-44b3-9f7b-f860f2de0dcd', 'name': '', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'mac_address': 'fa:16:3e:79:cd:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb9fb294-ad4d-466a-87d0-9a9068b79455', 'device_owner': 'network:router_interface', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': '9362b47d-ea99-4b80-a75f-89f0370e647a', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:32Z', 'updated_at': '2022-03-24T02:13:34Z', 'revision_number': 2, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'subnets': [{'id': '9362b47d-ea99-4b80-a75f-89f0370e647a', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:36.479743 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Checking router: fb9fb294-ad4d-466a-87d0-9a9068b79455 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:13:36.480106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Updating router fb9fb294-ad4d-466a-87d0-9a9068b79455 port e869bc64-3516-44b3-9f7b-f860f2de0dcd binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:13:36.486343 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-478344d8-757b-441b-b56c-36045531893c tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1393831 Mar 24 02:13:36.487549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57134) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:36.526428 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3413fe2e-c3c8-4d9b-975e-10ae0889dbef None None] Provisioning complete for port ccf52e84-3f3f-433d-bf89-dcc255e62ff8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:36.526835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3413fe2e-c3c8-4d9b-975e-10ae0889dbef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.528514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.548970 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:36.551301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.596418 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3413fe2e-c3c8-4d9b-975e-10ae0889dbef None None] Port ccf52e84-3f3f-433d-bf89-dcc255e62ff8 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:36.684712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:36.690042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.691325 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7ba61424-ac35-487b-8aeb-eef36b91884f tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "PUT /v2.0/routers/388178b9-9c76-43cb-bb65-63d48483707e HTTP/1.1" status: 200 len: 919 time: 5.6590631 Mar 24 02:13:36.697939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57136) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:36.698635 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e51c3ab-441e-4539-9994-e2793c897900 None None] Sync routers for ids ['388178b9-9c76-43cb-bb65-63d48483707e'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:36.704343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:36.712647 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c0a1eb58-51d7-4887-9018-7ffa1c8030eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/2f78564e-0ab3-4c6e-8e01-d720fac2db18/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2581775 Mar 24 02:13:36.716278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57138) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:36.728712 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e51c3ab-441e-4539-9994-e2793c897900 None None] Routers {'388178b9-9c76-43cb-bb65-63d48483707e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:36.729572 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-7e51c3ab-441e-4539-9994-e2793c897900 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['388178b9-9c76-43cb-bb65-63d48483707e'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:36.746501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cffdbaf0-b056-4a43-b1d1-2f69e7cc0de2 None None] Sync routers for ids ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:36.780207 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-7e51c3ab-441e-4539-9994-e2793c897900 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:36.792771 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e51c3ab-441e-4539-9994-e2793c897900 None None] Routers {'388178b9-9c76-43cb-bb65-63d48483707e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:36.793676 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-7e51c3ab-441e-4539-9994-e2793c897900 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['388178b9-9c76-43cb-bb65-63d48483707e'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:36.845620 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-7e51c3ab-441e-4539-9994-e2793c897900 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:36.846886 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e51c3ab-441e-4539-9994-e2793c897900 None None] The sync data for ids ['388178b9-9c76-43cb-bb65-63d48483707e'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:36.872962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-095c22b1-3b0f-4a02-baf2-fb27307b2e4a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:36.877152 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-095c22b1-3b0f-4a02-baf2-fb27307b2e4a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports/ccf52e84-3f3f-433d-bf89-dcc255e62ff8 HTTP/1.1" status: 200 len: 913 time: 0.1551969 Mar 24 02:13:36.880178 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57140) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:36.892752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a4c3632a-68fa-4f11-a541-e9567715c10a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (ec84d6fc-452e-4bed-9ece-d9f195548885), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.894965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Publish callbacks [] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.900208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cffdbaf0-b056-4a43-b1d1-2f69e7cc0de2 None None] Routers {'2f78564e-0ab3-4c6e-8e01-d720fac2db18'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:36.900988 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-cffdbaf0-b056-4a43-b1d1-2f69e7cc0de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:36.905686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.934553 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a4c3632a-68fa-4f11-a541-e9567715c10a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (ec84d6fc-452e-4bed-9ece-d9f195548885), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:36.991069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-cffdbaf0-b056-4a43-b1d1-2f69e7cc0de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:36.997558 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6509e4f6-03ec-4591-86f1-5ad2a6828cd5 None None] Pushing event updated for resources: {'Port': ['ID=e869bc64-3516-44b3-9f7b-f860f2de0dcd,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:37.026304 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cffdbaf0-b056-4a43-b1d1-2f69e7cc0de2 None None] Routers {'2f78564e-0ab3-4c6e-8e01-d720fac2db18'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:37.027362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-cffdbaf0-b056-4a43-b1d1-2f69e7cc0de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:37.045781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a4c3632a-68fa-4f11-a541-e9567715c10a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (ec84d6fc-452e-4bed-9ece-d9f195548885), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.048804 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a4c3632a-68fa-4f11-a541-e9567715c10a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.052418 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a4c3632a-68fa-4f11-a541-e9567715c10a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/ec84d6fc-452e-4bed-9ece-d9f195548885 HTTP/1.1" status: 204 len: 168 time: 0.5615530 Mar 24 02:13:37.058012 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57142) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:37.066583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-cffdbaf0-b056-4a43-b1d1-2f69e7cc0de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:37.067254 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cffdbaf0-b056-4a43-b1d1-2f69e7cc0de2 None None] The sync data for ids ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:37.095088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c3632a-68fa-4f11-a541-e9567715c10a tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec84d6fc-452e-4bed-9ece-d9f195548885,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:37.161979 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Attempting to bind port e869bc64-3516-44b3-9f7b-f860f2de0dcd on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:37.163535 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Attempting to bind port e869bc64-3516-44b3-9f7b-f860f2de0dcd by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:37.164044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Attempting to bind port e869bc64-3516-44b3-9f7b-f860f2de0dcd on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:37.171484 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:37.172094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:37.172665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.173209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:37.173857 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Bound port: e869bc64-3516-44b3-9f7b-f860f2de0dcd, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:37.174413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.193382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (fb9fb294-ad4d-466a-87d0-9a9068b79455), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.199362 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d73ead98-35fe-4510-bfa2-b29976aabc0b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1389832 Mar 24 02:13:37.231159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57144) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:37.259171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] For port e869bc64-3516-44b3-9f7b-f860f2de0dcd, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:37.263424 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] For port e869bc64-3516-44b3-9f7b-f860f2de0dcd, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e869bc64-3516-44b3-9f7b-f860f2de0dcd,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:37.266244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-408fc409-fc2b-4efd-befc-472e6f9087d3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-secgroup--1546970015'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:37.275634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.309899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-408fc409-fc2b-4efd-befc-472e6f9087d3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.342410 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Routers {'fb9fb294-ad4d-466a-87d0-9a9068b79455'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:37.342774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['fb9fb294-ad4d-466a-87d0-9a9068b79455'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:37.364377 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9bc7210c-bd15-42a7-af64-c9e10e0e2015 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/routers/388178b9-9c76-43cb-bb65-63d48483707e HTTP/1.1" status: 200 len: 925 time: 0.6616969 Mar 24 02:13:37.380429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57146) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:37.429907 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-83e39882-5287-4ae1-a3a6-2945f9712d51 None None] Provisioning complete for port e869bc64-3516-44b3-9f7b-f860f2de0dcd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:37.430295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83e39882-5287-4ae1-a3a6-2945f9712d51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.474692 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (de633914-0d11-47c4-9878-19082d997ae6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.500293 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] Set router fb9fb294-ad4d-466a-87d0-9a9068b79455 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:13:37.558131 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=de633914-0d11-47c4-9878-19082d997ae6,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:37.571481 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6509e4f6-03ec-4591-86f1-5ad2a6828cd5 None None] Pushing event updated for resources: {'Port': ['ID=e869bc64-3516-44b3-9f7b-f860f2de0dcd,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:37.600513 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': '314ce7c4-6689-4197-9105-543740a0d3ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:37.600875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:37.603558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70a5d6f4-bdc2-4054-b13e-bd7420238920 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:37.605841 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-70a5d6f4-bdc2-4054-b13e-bd7420238920 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=388178b9-9c76-43cb-bb65-63d48483707e&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2242498 Mar 24 02:13:37.609774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57148) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:37.623229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-408fc409-fc2b-4efd-befc-472e6f9087d3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (5c6e8992-0428-4c0f-936c-478f8a73adf9), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.634590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-408fc409-fc2b-4efd-befc-472e6f9087d3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (5c6e8992-0428-4c0f-936c-478f8a73adf9), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.691681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-408fc409-fc2b-4efd-befc-472e6f9087d3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.696151 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-408fc409-fc2b-4efd-befc-472e6f9087d3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.4608812 Mar 24 02:13:37.697607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57150) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:37.703270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-94e45368-9d48-4ee9-8b2e-44cb71777d3b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '5c6e8992-0428-4c0f-936c-478f8a73adf9', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:37.711281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408fc409-fc2b-4efd-befc-472e6f9087d3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5c6e8992-0428-4c0f-936c-478f8a73adf9,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:37.717049 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:37.738588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port e869bc64-3516-44b3-9f7b-f860f2de0dcd {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:37.739033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.749392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:37.754072 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:37.755584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.769749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-937797de-e7d5-4ec6-b447-5881c73bac63 None None] Network a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:37.772862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-83e39882-5287-4ae1-a3a6-2945f9712d51 None None] Current status of the port e869bc64-3516-44b3-9f7b-f860f2de0dcd is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:37.773248 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83e39882-5287-4ae1-a3a6-2945f9712d51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.798600 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-80cd0991-756c-4247-9c87-5456379dae48 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 816 time: 1.5250363 Mar 24 02:13:37.800120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57152) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:37.800717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8251d379-c3ea-4e1a-91dc-732175a16e85 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:37.804716 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8251d379-c3ea-4e1a-91dc-732175a16e85 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 881 time: 0.1900387 Mar 24 02:13:37.807807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57154) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:37.827615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1338348930'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:37.830661 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94e45368-9d48-4ee9-8b2e-44cb71777d3b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (197bc595-0d73-4827-a62c-026df809f7d2), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.842903 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8466cb14-71ee-48c9-9393-81372dfe8995 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=388178b9-9c76-43cb-bb65-63d48483707e HTTP/1.1" status: 200 len: 205 time: 0.0340202 Mar 24 02:13:37.847005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57156) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:37.875059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] For port e869bc64-3516-44b3-9f7b-f860f2de0dcd, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e869bc64-3516-44b3-9f7b-f860f2de0dcd,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:37.875375 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.878487 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-83e39882-5287-4ae1-a3a6-2945f9712d51 None None] For port e869bc64-3516-44b3-9f7b-f860f2de0dcd, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e869bc64-3516-44b3-9f7b-f860f2de0dcd,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:37.900412 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83e39882-5287-4ae1-a3a6-2945f9712d51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.901312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:37.905651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.907606 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for e869bc64-3516-44b3-9f7b-f860f2de0dcd owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:37.955346 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb9fb294-ad4d-466a-87d0-9a9068b79455', 'name': 'tempest-NetworksTestDHCPv6-router-1711707979', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:30Z', 'updated_at': '2022-03-24T02:13:33Z', 'revision_number': 2, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None, '_interfaces': [{'id': 'e869bc64-3516-44b3-9f7b-f860f2de0dcd', 'name': '', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'mac_address': 'fa:16:3e:79:cd:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb9fb294-ad4d-466a-87d0-9a9068b79455', 'device_owner': 'network:router_interface', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': '9362b47d-ea99-4b80-a75f-89f0370e647a', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:32Z', 'updated_at': '2022-03-24T02:13:37Z', 'revision_number': 4, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'subnets': [{'id': '9362b47d-ea99-4b80-a75f-89f0370e647a', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:37.980338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94e45368-9d48-4ee9-8b2e-44cb71777d3b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (197bc595-0d73-4827-a62c-026df809f7d2), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:37.985185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 112} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:37.991722 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94e45368-9d48-4ee9-8b2e-44cb71777d3b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (197bc595-0d73-4827-a62c-026df809f7d2), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.010987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (617bc2de-1af6-4d45-b99a-db0f05b4d628), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.011331 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment 617bc2de-1af6-4d45-b99a-db0f05b4d628 of type vlan for network d5dd9df3-1b8f-4413-b8c5-20ddecbe71de Mar 24 02:13:38.014738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6424b41c-f5de-4b28-9d7d-5693f9517beb None None] The sync data for ids ['fb9fb294-ad4d-466a-87d0-9a9068b79455'] in dv-neutron-834874-3-hyperv is: [{'id': 'fb9fb294-ad4d-466a-87d0-9a9068b79455', 'name': 'tempest-NetworksTestDHCPv6-router-1711707979', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:30Z', 'updated_at': '2022-03-24T02:13:33Z', 'revision_number': 2, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None, '_interfaces': [{'id': 'e869bc64-3516-44b3-9f7b-f860f2de0dcd', 'name': '', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'mac_address': 'fa:16:3e:79:cd:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb9fb294-ad4d-466a-87d0-9a9068b79455', 'device_owner': 'network:router_interface', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': '9362b47d-ea99-4b80-a75f-89f0370e647a', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:32Z', 'updated_at': '2022-03-24T02:13:37Z', 'revision_number': 4, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'subnets': [{'id': '9362b47d-ea99-4b80-a75f-89f0370e647a', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:38.027792 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a', 'network_id': 'a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': 'de633914-0d11-47c4-9878-19082d997ae6'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:38.031573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.049499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83e39882-5287-4ae1-a3a6-2945f9712d51 None None] Pushing event updated for resources: {'Port': ['ID=e869bc64-3516-44b3-9f7b-f860f2de0dcd,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:38.056941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94e45368-9d48-4ee9-8b2e-44cb71777d3b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=197bc595-0d73-4827-a62c-026df809f7d2,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:38.060981 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (2f78564e-0ab3-4c6e-8e01-d720fac2db18), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.092342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-879cd620-8457-48e8-a97c-751a2b3bc624 None None] Provisioning complete for port e869bc64-3516-44b3-9f7b-f860f2de0dcd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:38.092852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-879cd620-8457-48e8-a97c-751a2b3bc624 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.096870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94e45368-9d48-4ee9-8b2e-44cb71777d3b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.098090 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-94e45368-9d48-4ee9-8b2e-44cb71777d3b tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3982275 Mar 24 02:13:38.099829 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (d5dd9df3-1b8f-4413-b8c5-20ddecbe71de), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.106445 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57160) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:38.107385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (388178b9-9c76-43cb-bb65-63d48483707e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.188581 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8f72fcf0-4cdb-4c0e-aaec-9a6a7c3ebe75 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules/197bc595-0d73-4827-a62c-026df809f7d2 HTTP/1.1" status: 200 len: 763 time: 0.0823765 Mar 24 02:13:38.197243 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57162) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:38.207730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (d5dd9df3-1b8f-4413-b8c5-20ddecbe71de), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.213731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:38.213934 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.303774 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.4795845 Mar 24 02:13:38.312817 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57164) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:38.320042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': 'd5dd9df3-1b8f-4413-b8c5-20ddecbe71de', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': True, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:38.361071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8dc21b5-341f-4ed2-ac7a-806d8e449ccd tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=d5dd9df3-1b8f-4413-b8c5-20ddecbe71de,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:38.391482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (388178b9-9c76-43cb-bb65-63d48483707e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.391623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network d5dd9df3-1b8f-4413-b8c5-20ddecbe71de details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:38.402550 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fc50e86a-9e6a-40ae-a884-7c44b6f52002 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.2007546 Mar 24 02:13:38.404674 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57166) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:38.484099 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.plugins.ml2.db [None req-879cd620-8457-48e8-a97c-751a2b3bc624 None None] No ports have port_id starting with e869bc64-3516-44b3-9f7b-f860f2de0dcd Mar 24 02:13:38.487003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (e869bc64-3516-44b3-9f7b-f860f2de0dcd), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.500452 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f9786d7-28a1-445a-90fb-811506c125ba tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (197bc595-0d73-4827-a62c-026df809f7d2), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.504133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Allocated IP 172.20.255.242 (a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a/de633914-0d11-47c4-9878-19082d997ae6/234134f6-92b3-4f3b-83e2-0e33e1c8439f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:38.515984 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f9786d7-28a1-445a-90fb-811506c125ba tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (197bc595-0d73-4827-a62c-026df809f7d2), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.534898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=e869bc64-3516-44b3-9f7b-f860f2de0dcd,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:38.556883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:38.560398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.593328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Deleting port a98a3a59-a660-4780-9dea-1ab0ced44965 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:38.593661 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a98a3a59-a660-4780-9dea-1ab0ced44965), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.633639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f9786d7-28a1-445a-90fb-811506c125ba tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (197bc595-0d73-4827-a62c-026df809f7d2), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.640899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f9786d7-28a1-445a-90fb-811506c125ba tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.644729 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1f9786d7-28a1-445a-90fb-811506c125ba tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/197bc595-0d73-4827-a62c-026df809f7d2 HTTP/1.1" status: 204 len: 168 time: 0.2340620 Mar 24 02:13:38.693790 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57170) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:38.715916 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f9786d7-28a1-445a-90fb-811506c125ba tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=197bc595-0d73-4827-a62c-026df809f7d2,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:38.760106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e869bc64-3516-44b3-9f7b-f860f2de0dcd up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:38.798426 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a1ef8ce4-316d-42e9-a53b-ad9ebb6aa43d tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1007478 Mar 24 02:13:38.802259 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57172) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:38.803995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a98a3a59-a660-4780-9dea-1ab0ced44965), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.810463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-99e97307-3067-4260-9e79-d07196a8b642 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '5c6e8992-0428-4c0f-936c-478f8a73adf9', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:38.823379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: e869bc64-3516-44b3-9f7b-f860f2de0dcd {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:38.823729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e869bc64-3516-44b3-9f7b-f860f2de0dcd not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Mar 24 02:13:38.824255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port ccf52e84-3f3f-433d-bf89-dcc255e62ff8 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:38.824594 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.828110 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Calling delete_port for a98a3a59-a660-4780-9dea-1ab0ced44965 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:38.858192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Port e869bc64-3516-44b3-9f7b-f860f2de0dcd not found, will not notify nova. {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Mar 24 02:13:38.874024 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (fb9fb294-ad4d-466a-87d0-9a9068b79455), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.877838 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Publish callbacks [] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.892584 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:38.950246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Network a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:38.967509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:38.970585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Pushing event updated for resources: {'Port': ['ID=234134f6-92b3-4f3b-83e2-0e33e1c8439f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:38.973468 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:39.005605 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.013536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99e97307-3067-4260-9e79-d07196a8b642 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (be314ce9-b2b6-43b8-836b-8ae50e588d30), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.051521 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Attempting to bind port 234134f6-92b3-4f3b-83e2-0e33e1c8439f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:39.051890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Attempting to bind port 234134f6-92b3-4f3b-83e2-0e33e1c8439f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '314ce7c4-6689-4197-9105-543740a0d3ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:39.052302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Attempting to bind port 234134f6-92b3-4f3b-83e2-0e33e1c8439f on network a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:39.056628 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for ccf52e84-3f3f-433d-bf89-dcc255e62ff8 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:39.061397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:39.061775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Checking segment: {'id': '314ce7c4-6689-4197-9105-543740a0d3ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:39.062875 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.063325 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Bound using segment: {'id': '314ce7c4-6689-4197-9105-543740a0d3ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:39.064212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Bound port: 234134f6-92b3-4f3b-83e2-0e33e1c8439f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '314ce7c4-6689-4197-9105-543740a0d3ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:39.064600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.162860 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] For port 234134f6-92b3-4f3b-83e2-0e33e1c8439f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:39.168116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] For port 234134f6-92b3-4f3b-83e2-0e33e1c8439f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=234134f6-92b3-4f3b-83e2-0e33e1c8439f,segment=NetworkSegment(314ce7c4-6689-4197-9105-543740a0d3ef),segment_id=314ce7c4-6689-4197-9105-543740a0d3ef)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:39.179281 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.187144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Router fb9fb294-ad4d-466a-87d0-9a9068b79455 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:13:39.242922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99e97307-3067-4260-9e79-d07196a8b642 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (be314ce9-b2b6-43b8-836b-8ae50e588d30), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.249474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a98a3a59-a660-4780-9dea-1ab0ced44965), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.256571 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa3e5402-16ae-4184-b836-97cad590e666 None None] Pushing event updated for resources: {'Port': ['ID=234134f6-92b3-4f3b-83e2-0e33e1c8439f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:39.263142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99e97307-3067-4260-9e79-d07196a8b642 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (be314ce9-b2b6-43b8-836b-8ae50e588d30), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.292548 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event deleted for resources: {'Port': ['ID=a98a3a59-a660-4780-9dea-1ab0ced44965,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:39.335457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (f84a6fc8-df97-4505-81dd-32693a6871dc), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.380041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e97307-3067-4260-9e79-d07196a8b642 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=be314ce9-b2b6-43b8-836b-8ae50e588d30,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:39.398712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (388178b9-9c76-43cb-bb65-63d48483707e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.401985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99e97307-3067-4260-9e79-d07196a8b642 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.402380 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-99e97307-3067-4260-9e79-d07196a8b642 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5970516 Mar 24 02:13:39.405909 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:39.411954 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6ff470b6-ca4e-4289-b2ce-537a10021090 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "PUT /v2.0/routers/fb9fb294-ad4d-466a-87d0-9a9068b79455/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2149956 Mar 24 02:13:39.415129 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57174) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:39.415467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57176) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:39.433392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (ccf52e84-3f3f-433d-bf89-dcc255e62ff8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.484042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=f84a6fc8-df97-4505-81dd-32693a6871dc,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:39.496778 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a23b98c4-cd11-45e0-957e-ed6a34492378 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules/be314ce9-b2b6-43b8-836b-8ae50e588d30 HTTP/1.1" status: 200 len: 763 time: 0.0802059 Mar 24 02:13:39.502732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57178) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:39.521056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': '617bc2de-1af6-4d45-b99a-db0f05b4d628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'd5dd9df3-1b8f-4413-b8c5-20ddecbe71de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:39.521426 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: d5dd9df3-1b8f-4413-b8c5-20ddecbe71de, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:39.532638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=ccf52e84-3f3f-433d-bf89-dcc255e62ff8,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:39.546604 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e248c77-698f-47e3-929b-bd32185a9007 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:39.547217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e248c77-698f-47e3-929b-bd32185a9007 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:39.551239 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5e248c77-698f-47e3-929b-bd32185a9007 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1312978 Mar 24 02:13:39.553575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57180) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:39.569832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (388178b9-9c76-43cb-bb65-63d48483707e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.573322 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (388178b9-9c76-43cb-bb65-63d48483707e), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.601804 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network d5dd9df3-1b8f-4413-b8c5-20ddecbe71de is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:39.622577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, d5dd9df3-1b8f-4413-b8c5-20ddecbe71de) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:39.630556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:39.631219 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.631666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-145cbcc9-dc2f-48a9-9fbf-b4ab95a39722 None None] Network d5dd9df3-1b8f-4413-b8c5-20ddecbe71de requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:39.648139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-8aa6f5e8-e411-46aa-a650-3b5b1896df3e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 9362b47d-ea99-4b80-a75f-89f0370e647a {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:39.651689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8aa6f5e8-e411-46aa-a650-3b5b1896df3e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (9362b47d-ea99-4b80-a75f-89f0370e647a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.704194 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-772c8f73-cb2f-4259-bb3e-0ce5725d1ea1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 873 time: 1.3901310 Mar 24 02:13:39.709582 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57182) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:39.762426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (2f78564e-0ab3-4c6e-8e01-d720fac2db18), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.781022 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-16be6eda-244d-4772-b83a-0c7535114316 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.2493682 Mar 24 02:13:39.786087 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57184) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:39.786852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (388178b9-9c76-43cb-bb65-63d48483707e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.788518 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Fanout notify agent at l3_agent the message router_deleted on router 388178b9-9c76-43cb-bb65-63d48483707e {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:39.796126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-d5dd9df3-1b8f-4413-b8c5-20ddecbe71de', 'network_id': 'd5dd9df3-1b8f-4413-b8c5-20ddecbe71de', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': 'f84a6fc8-df97-4505-81dd-32693a6871dc'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:39.797004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.800399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8aa6f5e8-e411-46aa-a650-3b5b1896df3e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (9362b47d-ea99-4b80-a75f-89f0370e647a), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.809438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.814460 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-83bc6bb1-30ed-4e8f-8854-c4ef387614f4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/388178b9-9c76-43cb-bb65-63d48483707e HTTP/1.1" status: 204 len: 168 time: 1.9617794 Mar 24 02:13:39.816876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57186) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:39.828441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-315088778', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:39.942079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (d5dd9df3-1b8f-4413-b8c5-20ddecbe71de), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.946928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8aa6f5e8-e411-46aa-a650-3b5b1896df3e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (9362b47d-ea99-4b80-a75f-89f0370e647a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:39.979712 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Allocated IP 172.20.0.2 (d5dd9df3-1b8f-4413-b8c5-20ddecbe71de/f84a6fc8-df97-4505-81dd-32693a6871dc/d58aeac6-c7ef-471b-b94a-ea047e921ca4) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:40.045934 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (f84a6fc8-df97-4505-81dd-32693a6871dc), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.086654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8aa6f5e8-e411-46aa-a650-3b5b1896df3e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (9362b47d-ea99-4b80-a75f-89f0370e647a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.124954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa6f5e8-e411-46aa-a650-3b5b1896df3e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=9362b47d-ea99-4b80-a75f-89f0370e647a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:40.132174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8aa6f5e8-e411-46aa-a650-3b5b1896df3e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.135286 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8aa6f5e8-e411-46aa-a650-3b5b1896df3e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/9362b47d-ea99-4b80-a75f-89f0370e647a HTTP/1.1" status: 204 len: 168 time: 0.5807905 Mar 24 02:13:40.145717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57188) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:40.174108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e7d8144-948f-4e5f-a436-38af57af3fbc None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:40.190401 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] Sync routers for ids ['fb9fb294-ad4d-466a-87d0-9a9068b79455'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:40.210213 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] Routers {'fb9fb294-ad4d-466a-87d0-9a9068b79455'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:40.210866 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['fb9fb294-ad4d-466a-87d0-9a9068b79455'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:40.232630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1db3cace-925c-4f66-b3c3-b5acbc1585f0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (be314ce9-b2b6-43b8-836b-8ae50e588d30), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.246544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1db3cace-925c-4f66-b3c3-b5acbc1585f0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (be314ce9-b2b6-43b8-836b-8ae50e588d30), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.250504 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (c501a2f5-fd22-4d71-b444-ffa881c70170), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.251626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (c501a2f5-fd22-4d71-b444-ffa881c70170), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.262959 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Publish callbacks [] for port (d58aeac6-c7ef-471b-b94a-ea047e921ca4), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.278485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (d58aeac6-c7ef-471b-b94a-ea047e921ca4), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.310413 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1db3cace-925c-4f66-b3c3-b5acbc1585f0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (be314ce9-b2b6-43b8-836b-8ae50e588d30), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.336994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Network d5dd9df3-1b8f-4413-b8c5-20ddecbe71de is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:40.342786 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:40.343289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1db3cace-925c-4f66-b3c3-b5acbc1585f0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.347187 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1db3cace-925c-4f66-b3c3-b5acbc1585f0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/be314ce9-b2b6-43b8-836b-8ae50e588d30 HTTP/1.1" status: 204 len: 168 time: 0.5573761 Mar 24 02:13:40.347344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:40.350317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57190) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:40.368333 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (c501a2f5-fd22-4d71-b444-ffa881c70170), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.369580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db3cace-925c-4f66-b3c3-b5acbc1585f0 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=be314ce9-b2b6-43b8-836b-8ae50e588d30,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:40.380434 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] Set router fb9fb294-ad4d-466a-87d0-9a9068b79455 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:13:40.416629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Pushing event updated for resources: {'Port': ['ID=d58aeac6-c7ef-471b-b94a-ea047e921ca4,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:40.431138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Attempting to bind port d58aeac6-c7ef-471b-b94a-ea047e921ca4 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:40.431562 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Attempting to bind port d58aeac6-c7ef-471b-b94a-ea047e921ca4 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '617bc2de-1af6-4d45-b99a-db0f05b4d628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'd5dd9df3-1b8f-4413-b8c5-20ddecbe71de'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:40.431929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Attempting to bind port d58aeac6-c7ef-471b-b94a-ea047e921ca4 on network d5dd9df3-1b8f-4413-b8c5-20ddecbe71de {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:40.441629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:40.448737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Checking segment: {'id': '617bc2de-1af6-4d45-b99a-db0f05b4d628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'd5dd9df3-1b8f-4413-b8c5-20ddecbe71de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:40.449243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.450018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Bound using segment: {'id': '617bc2de-1af6-4d45-b99a-db0f05b4d628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'd5dd9df3-1b8f-4413-b8c5-20ddecbe71de'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:40.450650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Bound port: d58aeac6-c7ef-471b-b94a-ea047e921ca4, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '617bc2de-1af6-4d45-b99a-db0f05b4d628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'd5dd9df3-1b8f-4413-b8c5-20ddecbe71de'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:40.451258 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d58aeac6-c7ef-471b-b94a-ea047e921ca4), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.487644 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb9fb294-ad4d-466a-87d0-9a9068b79455', 'name': 'tempest-NetworksTestDHCPv6-router-1711707979', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:30Z', 'updated_at': '2022-03-24T02:13:38Z', 'revision_number': 3, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:40.504788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e1649bb-ee9e-4897-9c2f-ee579b654126 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:40.564577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] For port d58aeac6-c7ef-471b-b94a-ea047e921ca4, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:40.566227 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] Checking router: fb9fb294-ad4d-466a-87d0-9a9068b79455 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:13:40.569504 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] For port d58aeac6-c7ef-471b-b94a-ea047e921ca4, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d58aeac6-c7ef-471b-b94a-ea047e921ca4,segment=NetworkSegment(617bc2de-1af6-4d45-b99a-db0f05b4d628),segment_id=617bc2de-1af6-4d45-b99a-db0f05b4d628)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:40.583528 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] Routers {'fb9fb294-ad4d-466a-87d0-9a9068b79455'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:40.584222 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['fb9fb294-ad4d-466a-87d0-9a9068b79455'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:40.605764 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-27b1d0f2-0ec9-4ecc-9b4f-ef2e485247e5 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2530134 Mar 24 02:13:40.617677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d58aeac6-c7ef-471b-b94a-ea047e921ca4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.680901 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57192) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:40.686696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d45d6275-60db-4ed1-a419-c077c3922803 None None] Pushing event updated for resources: {'Port': ['ID=d58aeac6-c7ef-471b-b94a-ea047e921ca4,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:40.738338 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] Set router fb9fb294-ad4d-466a-87d0-9a9068b79455 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:13:40.759028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7e1649bb-ee9e-4897-9c2f-ee579b654126 None None] Deleting port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:40.759396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e1649bb-ee9e-4897-9c2f-ee579b654126 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.763576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-62fd6fa5-4781-4998-afbb-2702a1549148 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': '5c6e8992-0428-4c0f-936c-478f8a73adf9', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:40.798838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router 2f78564e-0ab3-4c6e-8e01-d720fac2db18 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:13:40.821845 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 234134f6-92b3-4f3b-83e2-0e33e1c8439f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:40.823822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (c501a2f5-fd22-4d71-b444-ffa881c70170), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.861189 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb9fb294-ad4d-466a-87d0-9a9068b79455', 'name': 'tempest-NetworksTestDHCPv6-router-1711707979', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:30Z', 'updated_at': '2022-03-24T02:13:38Z', 'revision_number': 3, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:40.887319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7e1649bb-ee9e-4897-9c2f-ee579b654126 None None] For port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=04485fce-1a2a-4acb-87d3-3eb46f93aa8f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:40.887727 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e1649bb-ee9e-4897-9c2f-ee579b654126 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.902147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (f84a6fc8-df97-4505-81dd-32693a6871dc), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:40.913236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7e1649bb-ee9e-4897-9c2f-ee579b654126 None None] Calling delete_port for 04485fce-1a2a-4acb-87d3-3eb46f93aa8f owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:40.931980 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992f6493-4a44-44c1-b260-2a6e22186c4c None None] The sync data for ids ['fb9fb294-ad4d-466a-87d0-9a9068b79455'] in dv-neutron-834874-3-hyperv is: [{'id': 'fb9fb294-ad4d-466a-87d0-9a9068b79455', 'name': 'tempest-NetworksTestDHCPv6-router-1711707979', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:30Z', 'updated_at': '2022-03-24T02:13:38Z', 'revision_number': 3, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:41.031464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 234134f6-92b3-4f3b-83e2-0e33e1c8439f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:41.031707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.035841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=f84a6fc8-df97-4505-81dd-32693a6871dc,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:41.048539 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cfb503df-ea18-4906-a417-39baee4796da tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 710 time: 0.9002569 Mar 24 02:13:41.049518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57194) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:41.060741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e1649bb-ee9e-4897-9c2f-ee579b654126 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (04485fce-1a2a-4acb-87d3-3eb46f93aa8f), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.090821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:41.097374 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6e2115a4-389f-4d3e-a20b-49ba3929e573 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/2f78564e-0ab3-4c6e-8e01-d720fac2db18/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1946275 Mar 24 02:13:41.100828 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62fd6fa5-4781-4998-afbb-2702a1549148 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (4e70ab94-8cd8-4516-8aac-15e604ec53a4), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.112071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14a931b2-06cf-41f4-b771-8ad1ffe3718a None None] Sync routers for ids ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:41.114414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57196) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:41.121567 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e1649bb-ee9e-4897-9c2f-ee579b654126 None None] Pushing event deleted for resources: {'Port': ['ID=04485fce-1a2a-4acb-87d3-3eb46f93aa8f,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:41.128310 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e1649bb-ee9e-4897-9c2f-ee579b654126 None None] No DVR routers for this DVR port 04485fce-1a2a-4acb-87d3-3eb46f93aa8f on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:41.136972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (d5dd9df3-1b8f-4413-b8c5-20ddecbe71de), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.155745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9dbf2860-3664-4589-b435-a99e1d09be40 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router (fb9fb294-ad4d-466a-87d0-9a9068b79455), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.155918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14a931b2-06cf-41f4-b771-8ad1ffe3718a None None] Routers {'2f78564e-0ab3-4c6e-8e01-d720fac2db18'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:41.155918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-14a931b2-06cf-41f4-b771-8ad1ffe3718a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:41.216645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47903ece-795f-42f9-92c8-127c8ead4903 None None] Network a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:41.223700 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-14a931b2-06cf-41f4-b771-8ad1ffe3718a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:41.225909 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d5dd9df3-1b8f-4413-b8c5-20ddecbe71de']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:41.240414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '617bc2de-1af6-4d45-b99a-db0f05b4d628') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:41.240414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '617bc2de-1af6-4d45-b99a-db0f05b4d628') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:41.315351 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c5dbe4eb-e6c0-4012-95a9-db46d4e5daf9 None None] Provisioning complete for port 234134f6-92b3-4f3b-83e2-0e33e1c8439f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:41.315788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5dbe4eb-e6c0-4012-95a9-db46d4e5daf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.321256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 234134f6-92b3-4f3b-83e2-0e33e1c8439f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:41.322808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.325481 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14a931b2-06cf-41f4-b771-8ad1ffe3718a None None] Routers {'2f78564e-0ab3-4c6e-8e01-d720fac2db18'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:41.326337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-14a931b2-06cf-41f4-b771-8ad1ffe3718a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:41.349896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (617bc2de-1af6-4d45-b99a-db0f05b4d628), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.429124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (617bc2de-1af6-4d45-b99a-db0f05b4d628), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.432193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9dbf2860-3664-4589-b435-a99e1d09be40 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (fb9fb294-ad4d-466a-87d0-9a9068b79455), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.437004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-14a931b2-06cf-41f4-b771-8ad1ffe3718a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:41.438068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14a931b2-06cf-41f4-b771-8ad1ffe3718a None None] The sync data for ids ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:41.442575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9dbf2860-3664-4589-b435-a99e1d09be40 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router_controller (fb9fb294-ad4d-466a-87d0-9a9068b79455), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.450457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:41.450851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (617bc2de-1af6-4d45-b99a-db0f05b4d628), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:41.454027 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:41.474202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62fd6fa5-4781-4998-afbb-2702a1549148 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (4e70ab94-8cd8-4516-8aac-15e604ec53a4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.484198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62fd6fa5-4781-4998-afbb-2702a1549148 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (4e70ab94-8cd8-4516-8aac-15e604ec53a4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.515768 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62fd6fa5-4781-4998-afbb-2702a1549148 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4e70ab94-8cd8-4516-8aac-15e604ec53a4,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:41.528404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 234134f6-92b3-4f3b-83e2-0e33e1c8439f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=234134f6-92b3-4f3b-83e2-0e33e1c8439f,segment=NetworkSegment(314ce7c4-6689-4197-9105-543740a0d3ef),segment_id=314ce7c4-6689-4197-9105-543740a0d3ef)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:41.542790 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.618992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62fd6fa5-4781-4998-afbb-2702a1549148 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.625881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57198) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:41.628321 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-62fd6fa5-4781-4998-afbb-2702a1549148 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9464090 Mar 24 02:13:41.642166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c5dbe4eb-e6c0-4012-95a9-db46d4e5daf9 None None] Current status of the port 234134f6-92b3-4f3b-83e2-0e33e1c8439f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:41.649099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9dbf2860-3664-4589-b435-a99e1d09be40 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (fb9fb294-ad4d-466a-87d0-9a9068b79455), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.650396 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9dbf2860-3664-4589-b435-a99e1d09be40 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Fanout notify agent at l3_agent the message router_deleted on router fb9fb294-ad4d-466a-87d0-9a9068b79455 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:41.657778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 04485fce-1a2a-4acb-87d3-3eb46f93aa8f no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:41.669704 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9dbf2860-3664-4589-b435-a99e1d09be40 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.674216 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9dbf2860-3664-4589-b435-a99e1d09be40 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/routers/fb9fb294-ad4d-466a-87d0-9a9068b79455 HTTP/1.1" status: 204 len: 168 time: 0.6179338 Mar 24 02:13:41.674216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57200) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:41.679226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:41.689606 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=234134f6-92b3-4f3b-83e2-0e33e1c8439f,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:41.695626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 04485fce-1a2a-4acb-87d3-3eb46f93aa8f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:41.695626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 04485fce-1a2a-4acb-87d3-3eb46f93aa8f not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:41.696417 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5b3d466e-ff59-4d99-bc68-e2f96c869dfb tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules/4e70ab94-8cd8-4516-8aac-15e604ec53a4 HTTP/1.1" status: 200 len: 764 time: 0.0692141 Mar 24 02:13:41.708334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.db.api [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Mar 24 02:13:41.708334 dv-neutron-834874-3-hyperv neutron-server[104037]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Mar 24 02:13:41.708334 dv-neutron-834874-3-hyperv neutron-server[104037]: [parameters: {'id': 'd5dd9df3-1b8f-4413-b8c5-20ddecbe71de'}] Mar 24 02:13:41.708334 dv-neutron-834874-3-hyperv neutron-server[104037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104037) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:13:41.708834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57202) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:41.709313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG oslo_db.api [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:13:41.717837 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (c501a2f5-fd22-4d71-b444-ffa881c70170), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.757026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.796608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:41.800397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.860059 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-50725c76-ba0a-4356-9afd-79706fe797c1 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4114 time: 0.1475677 Mar 24 02:13:41.863284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57204) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:41.934921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48573594-855e-47b8-a6f9-0b94b2290b58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (4e70ab94-8cd8-4516-8aac-15e604ec53a4), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.956501 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48573594-855e-47b8-a6f9-0b94b2290b58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (4e70ab94-8cd8-4516-8aac-15e604ec53a4), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:41.968464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-029f5da5-3c1e-451a-8845-6b8ecc2cabd0 None None] Provisioning complete for port 234134f6-92b3-4f3b-83e2-0e33e1c8439f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:41.968833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-029f5da5-3c1e-451a-8845-6b8ecc2cabd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.005036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Allocated IP 172.26.2.150 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/0eb76691-da90-4f4c-9c3b-1a9c77254faa) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:42.025603 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (d27abda3-e811-404d-adbf-44e0463872f5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.026110 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48573594-855e-47b8-a6f9-0b94b2290b58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (4e70ab94-8cd8-4516-8aac-15e604ec53a4), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.031168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-48573594-855e-47b8-a6f9-0b94b2290b58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.032295 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-48573594-855e-47b8-a6f9-0b94b2290b58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/4e70ab94-8cd8-4516-8aac-15e604ec53a4 HTTP/1.1" status: 204 len: 168 time: 0.1680248 Mar 24 02:13:42.037796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57208) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:42.059603 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48573594-855e-47b8-a6f9-0b94b2290b58 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=4e70ab94-8cd8-4516-8aac-15e604ec53a4,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:42.074785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-029f5da5-3c1e-451a-8845-6b8ecc2cabd0 None None] Current status of the port 234134f6-92b3-4f3b-83e2-0e33e1c8439f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:42.088526 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:42.095333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:42.100922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:42.101514 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.105542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=d27abda3-e811-404d-adbf-44e0463872f5,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:42.107396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95927986-17f5-4f1b-a8b1-7a85ffdc4e29 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:42.122769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (2f78564e-0ab3-4c6e-8e01-d720fac2db18), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.137096 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a5b72aa8-49e7-4da7-9fd8-dee336da0bd7 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0977845 Mar 24 02:13:42.139708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57210) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:42.160966 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b95ac052-cc7e-4f25-a776-989b54e3bd55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.4837492 Mar 24 02:13:42.166537 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57212) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:42.168717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-61686325-c7a5-494b-93cc-a816cebad51c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-1041238598', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:42.214462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (d5dd9df3-1b8f-4413-b8c5-20ddecbe71de), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.234229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for port (0eb76691-da90-4f4c-9c3b-1a9c77254faa), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.243509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-61686325-c7a5-494b-93cc-a816cebad51c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (f6328e56-c489-492c-b183-d553d2d4b4f6), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.244608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-61686325-c7a5-494b-93cc-a816cebad51c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (f6328e56-c489-492c-b183-d553d2d4b4f6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.257654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69987060-42fc-4d18-8f87-b42d1a8c6898 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (5c6e8992-0428-4c0f-936c-478f8a73adf9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.322384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69987060-42fc-4d18-8f87-b42d1a8c6898 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (5c6e8992-0428-4c0f-936c-478f8a73adf9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.340688 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0eb76691-da90-4f4c-9c3b-1a9c77254faa), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.384813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:42.386274 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-61686325-c7a5-494b-93cc-a816cebad51c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router_controller (f6328e56-c489-492c-b183-d553d2d4b4f6), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.398182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:42.401058 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:42.401193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-61686325-c7a5-494b-93cc-a816cebad51c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (f6328e56-c489-492c-b183-d553d2d4b4f6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.433618 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-61686325-c7a5-494b-93cc-a816cebad51c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.433983 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': 'd27abda3-e811-404d-adbf-44e0463872f5'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:42.434914 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-61686325-c7a5-494b-93cc-a816cebad51c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.2727482 Mar 24 02:13:42.438934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event updated for resources: {'Port': ['ID=0eb76691-da90-4f4c-9c3b-1a9c77254faa,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:42.441288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57214) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:42.441611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.486934 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69987060-42fc-4d18-8f87-b42d1a8c6898 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (5c6e8992-0428-4c0f-936c-478f8a73adf9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.489488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69987060-42fc-4d18-8f87-b42d1a8c6898 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.491245 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-69987060-42fc-4d18-8f87-b42d1a8c6898 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/5c6e8992-0428-4c0f-936c-478f8a73adf9 HTTP/1.1" status: 204 len: 168 time: 0.3504345 Mar 24 02:13:42.510756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57216) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:42.531609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Deleting port d58aeac6-c7ef-471b-b94a-ea047e921ca4 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:42.531948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d58aeac6-c7ef-471b-b94a-ea047e921ca4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.601076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69987060-42fc-4d18-8f87-b42d1a8c6898 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c6e8992-0428-4c0f-936c-478f8a73adf9,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:42.640966 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/d27abda3-e811-404d-adbf-44e0463872f5/d0fe88f2-0fba-4d6f-a26e-af7d59695a54) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:42.768301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] For port d58aeac6-c7ef-471b-b94a-ea047e921ca4, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d58aeac6-c7ef-471b-b94a-ea047e921ca4,segment=NetworkSegment(617bc2de-1af6-4d45-b99a-db0f05b4d628),segment_id=617bc2de-1af6-4d45-b99a-db0f05b4d628)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:42.768819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d58aeac6-c7ef-471b-b94a-ea047e921ca4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.769107 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d58aeac6-c7ef-471b-b94a-ea047e921ca4 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:42.788853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Calling delete_port for d58aeac6-c7ef-471b-b94a-ea047e921ca4 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:42.849618 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fa6c1f1c-e520-40d1-84fd-a19ea648c303 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.3373399 Mar 24 02:13:42.857391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57218) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:42.863500 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-487dd246-c4f8-4cfd-b257-b432541bc337 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group': {'name': 'tempest-secgroup--2105836748'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:42.867514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f2dc565-f622-449a-9416-3b3278df11cf None None] Network d5dd9df3-1b8f-4413-b8c5-20ddecbe71de requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:42.873933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d58aeac6-c7ef-471b-b94a-ea047e921ca4 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:42.873933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d58aeac6-c7ef-471b-b94a-ea047e921ca4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.900276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 9a3c8ddc-6137-4044-be73-0711b6f5b780 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:42.900517 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.919208 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (c501a2f5-fd22-4d71-b444-ffa881c70170), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.979947 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-487dd246-c4f8-4cfd-b257-b432541bc337 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:42.990875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.003554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Publish callbacks [] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.015078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8c3a0b6d-3499-4024-997c-d5778671d1fb None None] Provisioning complete for port d58aeac6-c7ef-471b-b94a-ea047e921ca4 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:43.015451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8c3a0b6d-3499-4024-997c-d5778671d1fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d58aeac6-c7ef-471b-b94a-ea047e921ca4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.054361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.077530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (d58aeac6-c7ef-471b-b94a-ea047e921ca4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.101996 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No ports have port_id starting with d58aeac6-c7ef-471b-b94a-ea047e921ca4 Mar 24 02:13:43.112758 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Port': ['ID=d58aeac6-c7ef-471b-b94a-ea047e921ca4,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:43.123270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No DVR routers for this DVR port d58aeac6-c7ef-471b-b94a-ea047e921ca4 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:43.127413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 234134f6-92b3-4f3b-83e2-0e33e1c8439f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:43.133602 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:43.169280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:43.176285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:43.178979 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8c3a0b6d-3499-4024-997c-d5778671d1fb None None] Could not find standard attr ID for object d58aeac6-c7ef-471b-b94a-ea047e921ca4. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:13:43.180463 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Pushing event updated for resources: {'Port': ['ID=d0fe88f2-0fba-4d6f-a26e-af7d59695a54,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:43.197148 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.plugins.ml2.db [None req-8c3a0b6d-3499-4024-997c-d5778671d1fb None None] No ports have port_id starting with d58aeac6-c7ef-471b-b94a-ea047e921ca4 Mar 24 02:13:43.250259 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (d5dd9df3-1b8f-4413-b8c5-20ddecbe71de), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.295238 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Attempting to bind port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:43.295590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Attempting to bind port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:43.295951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Attempting to bind port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:43.305051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d5dd9df3-1b8f-4413-b8c5-20ddecbe71de']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:43.310835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 234134f6-92b3-4f3b-83e2-0e33e1c8439f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:43.311484 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.314200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:43.314769 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:43.315280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.316607 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:43.316607 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Bound port: d0fe88f2-0fba-4d6f-a26e-af7d59695a54, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:43.317262 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.322089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '617bc2de-1af6-4d45-b99a-db0f05b4d628') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:43.322302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '617bc2de-1af6-4d45-b99a-db0f05b4d628') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:43.341831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (617bc2de-1af6-4d45-b99a-db0f05b4d628), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.352089 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f91e2ea4-505c-4f96-93f4-c584d3fd37bd None None] DHCP port deletion for d5dd9df3-1b8f-4413-b8c5-20ddecbe71de request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:43.404084 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (617bc2de-1af6-4d45-b99a-db0f05b4d628), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.410408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::1 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/d27abda3-e811-404d-adbf-44e0463872f5/12a23db5-fe86-4e1d-b018-747c2d8bbebc) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:43.416527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:43.417185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (617bc2de-1af6-4d45-b99a-db0f05b4d628), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:43.420574 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:43.422673 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.441077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 9a3c8ddc-6137-4044-be73-0711b6f5b780 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:43.479373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] For port d0fe88f2-0fba-4d6f-a26e-af7d59695a54, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:43.486479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] For port d0fe88f2-0fba-4d6f-a26e-af7d59695a54, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d0fe88f2-0fba-4d6f-a26e-af7d59695a54,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:43.491518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 234134f6-92b3-4f3b-83e2-0e33e1c8439f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:43.497514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.526449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e869bc64-3516-44b3-9f7b-f860f2de0dcd no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:43.536845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (d5dd9df3-1b8f-4413-b8c5-20ddecbe71de), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.548006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.557621 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/d5dd9df3-1b8f-4413-b8c5-20ddecbe71de HTTP/1.1" status: 204 len: 168 time: 3.8388243 Mar 24 02:13:43.557828 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57220) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:43.565170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: e869bc64-3516-44b3-9f7b-f860f2de0dcd {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:43.565511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e869bc64-3516-44b3-9f7b-f860f2de0dcd not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:43.569721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71eefc51-424d-4171-95db-b53e4925fe77 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=d5dd9df3-1b8f-4413-b8c5-20ddecbe71de,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:43.604095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8de476d-c4a2-4da1-afea-7fafca5618fc None None] Pushing event updated for resources: {'Port': ['ID=d0fe88f2-0fba-4d6f-a26e-af7d59695a54,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:43.606850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1565980097'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:43.626861 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-487dd246-c4f8-4cfd-b257-b432541bc337 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (e8435e5f-51a2-44fb-85bd-f4c1f47cdca6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.635453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.638387 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-487dd246-c4f8-4cfd-b257-b432541bc337 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e8435e5f-51a2-44fb-85bd-f4c1f47cdca6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.674122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.680648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:43.684134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.700248 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (c501a2f5-fd22-4d71-b444-ffa881c70170), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.712726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-487dd246-c4f8-4cfd-b257-b432541bc337 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.714224 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-487dd246-c4f8-4cfd-b257-b432541bc337 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.8547149 Mar 24 02:13:43.715413 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:43.718084 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57222) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:43.719455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-487dd246-c4f8-4cfd-b257-b432541bc337 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e8435e5f-51a2-44fb-85bd-f4c1f47cdca6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:43.723135 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ce51a6b4-b814-4404-8abe-ec76d284c683 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Request body: {'security_group_rule': {'security_group_id': 'e8435e5f-51a2-44fb-85bd-f4c1f47cdca6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:43.732420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:43.735272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 149} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:43.738452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:43.739015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (f6328e56-c489-492c-b183-d553d2d4b4f6), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.745193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (062d1a0e-e86a-43ba-8530-9dd026347327), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.745411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=12a23db5-fe86-4e1d-b018-747c2d8bbebc,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:43.745521 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment 062d1a0e-e86a-43ba-8530-9dd026347327 of type vlan for network 1c5346a8-419f-4cf9-b148-63a16b6321b0 Mar 24 02:13:43.839624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce51a6b4-b814-4404-8abe-ec76d284c683 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (a5870522-a6b1-4566-a902-8b124de73019), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.901360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (1c5346a8-419f-4cf9-b148-63a16b6321b0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.935793 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce51a6b4-b814-4404-8abe-ec76d284c683 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (a5870522-a6b1-4566-a902-8b124de73019), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.936658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.949095 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce51a6b4-b814-4404-8abe-ec76d284c683 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (a5870522-a6b1-4566-a902-8b124de73019), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.964913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (1c5346a8-419f-4cf9-b148-63a16b6321b0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.971567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:43.972204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:43.991246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce51a6b4-b814-4404-8abe-ec76d284c683 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a5870522-a6b1-4566-a902-8b124de73019,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:44.003826 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce51a6b4-b814-4404-8abe-ec76d284c683 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.005299 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ce51a6b4-b814-4404-8abe-ec76d284c683 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2859983 Mar 24 02:13:44.008193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57224) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:44.073495 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.5164001 Mar 24 02:13:44.080001 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57226) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:44.089063 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': '1c5346a8-419f-4cf9-b148-63a16b6321b0', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:44.148917 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5b788b4f-e119-418e-a5e4-2b9159739fe9 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (e8435e5f-51a2-44fb-85bd-f4c1f47cdca6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.151974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c61ab8d-6b6d-459b-9125-65c8e159f2c0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=1c5346a8-419f-4cf9-b148-63a16b6321b0,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:44.163210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (9a3c8ddc-6137-4044-be73-0711b6f5b780), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.172901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 1c5346a8-419f-4cf9-b148-63a16b6321b0 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:44.211260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=9a3c8ddc-6137-4044-be73-0711b6f5b780,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:44.218613 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5b788b4f-e119-418e-a5e4-2b9159739fe9 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (e8435e5f-51a2-44fb-85bd-f4c1f47cdca6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.330030 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Router c501a2f5-fd22-4d71-b444-ffa881c70170 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:44.334074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5b788b4f-e119-418e-a5e4-2b9159739fe9 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e8435e5f-51a2-44fb-85bd-f4c1f47cdca6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.337609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5b788b4f-e119-418e-a5e4-2b9159739fe9 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.342082 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5b788b4f-e119-418e-a5e4-2b9159739fe9 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/e8435e5f-51a2-44fb-85bd-f4c1f47cdca6 HTTP/1.1" status: 204 len: 168 time: 0.3327844 Mar 24 02:13:44.342703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57228) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:44.350839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (2f78564e-0ab3-4c6e-8e01-d720fac2db18), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.356141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:44.359541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.363335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b788b4f-e119-418e-a5e4-2b9159739fe9 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8435e5f-51a2-44fb-85bd-f4c1f47cdca6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:44.400221 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.431544 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.433516 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (f6328e56-c489-492c-b183-d553d2d4b4f6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.447639 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d20bd5b8-0075-4445-95fe-1a725500aa9e tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0934432 Mar 24 02:13:44.452508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57230) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:44.563418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=12a23db5-fe86-4e1d-b018-747c2d8bbebc,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:44.594888 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-812ea5ea-0fcb-4833-8261-08c7b62056c4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.1369379 Mar 24 02:13:44.595822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57232) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:44.614576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Performing IP validity checks on allocation pools {{(pid=104036) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:322}} Mar 24 02:13:44.615082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking for overlaps among allocation pools and gateway ip {{(pid=104036) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:343}} Mar 24 02:13:44.617315 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-75941579-f25c-4ad0-803c-88532ce5d0a3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] delete failed (client error): The resource could not be found. Mar 24 02:13:44.619965 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-75941579-f25c-4ad0-803c-88532ce5d0a3 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "DELETE /v2.0/security-groups/e8435e5f-51a2-44fb-85bd-f4c1f47cdca6 HTTP/1.1" status: 404 len: 347 time: 0.0221994 Mar 24 02:13:44.622737 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57234) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:44.635227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:44.636704 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:44.661085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:44.674171 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6db2524-a1f2-454b-8b7e-470bdc3da4a7 None None] Sync routers for ids ['c501a2f5-fd22-4d71-b444-ffa881c70170'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:44.676934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d0fe88f2-0fba-4d6f-a26e-af7d59695a54 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:44.691787 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6db2524-a1f2-454b-8b7e-470bdc3da4a7 None None] Routers {'c501a2f5-fd22-4d71-b444-ffa881c70170'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:44.692571 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-a6db2524-a1f2-454b-8b7e-470bdc3da4a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c501a2f5-fd22-4d71-b444-ffa881c70170'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:44.749604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:44.749901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.755751 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-a6db2524-a1f2-454b-8b7e-470bdc3da4a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:44.769067 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6db2524-a1f2-454b-8b7e-470bdc3da4a7 None None] Routers {'c501a2f5-fd22-4d71-b444-ffa881c70170'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:44.770006 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-a6db2524-a1f2-454b-8b7e-470bdc3da4a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c501a2f5-fd22-4d71-b444-ffa881c70170'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:44.776207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Router f6328e56-c489-492c-b183-d553d2d4b4f6 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:44.807550 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-a6db2524-a1f2-454b-8b7e-470bdc3da4a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:44.812974 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6db2524-a1f2-454b-8b7e-470bdc3da4a7 None None] The sync data for ids ['c501a2f5-fd22-4d71-b444-ffa881c70170'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:44.841329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.843316 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e9a5d036-5908-4600-92c7-1fee77e40add tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 5.0208261 Mar 24 02:13:44.854734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57238) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:44.864725 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:44.903531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.906843 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:44.907234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:44.907347 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:44.922333 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c2c77c88-5276-4f91-bcdc-4eba63d314d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "PUT /v2.0/routers/f6328e56-c489-492c-b183-d553d2d4b4f6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4768393 Mar 24 02:13:44.922997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57240) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:44.923239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Sync routers for ids ['f6328e56-c489-492c-b183-d553d2d4b4f6'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:44.955352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Routers {'f6328e56-c489-492c-b183-d553d2d4b4f6'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:44.956062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f6328e56-c489-492c-b183-d553d2d4b4f6'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:44.963199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router 2f78564e-0ab3-4c6e-8e01-d720fac2db18 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:13:44.970201 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-deea6913-bc38-4e56-8f2f-93e1063c06b4 tempest-SecGroupTest-696600457 tempest-SecGroupTest-696600457-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.3458374 Mar 24 02:13:44.973402 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-521a26c5-d13c-45c0-9cd0-edb74ddbeae3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:44.977917 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-521a26c5-d13c-45c0-9cd0-edb74ddbeae3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports/12a23db5-fe86-4e1d-b018-747c2d8bbebc HTTP/1.1" status: 200 len: 911 time: 0.0509126 Mar 24 02:13:44.978739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57244) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:45.050337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d02ccafc-40fb-46f6-a940-394197eccfec tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:45.063776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d02ccafc-40fb-46f6-a940-394197eccfec tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:45.065006 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d02ccafc-40fb-46f6-a940-394197eccfec tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1653 time: 0.0859365 Mar 24 02:13:45.066225 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-822c46bd-51da-4659-94bd-93257667fd93 None None] Provisioning complete for port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:45.066345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-822c46bd-51da-4659-94bd-93257667fd93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:45.075613 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d0fe88f2-0fba-4d6f-a26e-af7d59695a54, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d0fe88f2-0fba-4d6f-a26e-af7d59695a54,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:45.083418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57246) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:45.107273 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:45.183958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d0fe88f2-0fba-4d6f-a26e-af7d59695a54,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:45.211065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d58aeac6-c7ef-471b-b94a-ea047e921ca4 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:45.250710 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Set router f6328e56-c489-492c-b183-d553d2d4b4f6 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:13:45.252840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d58aeac6-c7ef-471b-b94a-ea047e921ca4 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:45.253183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d58aeac6-c7ef-471b-b94a-ea047e921ca4 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:45.438202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (723c7a3c-1afc-42c9-9487-e1f0431035c7), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:45.442329 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-822c46bd-51da-4659-94bd-93257667fd93 None None] Current status of the port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:45.500658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57250) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:45.503477 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=723c7a3c-1afc-42c9-9487-e1f0431035c7,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:45.508325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:45.516720 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d7063811-c1ca-43e3-aab8-19e315befdc7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/2f78564e-0ab3-4c6e-8e01-d720fac2db18/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3939838 Mar 24 02:13:45.518109 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-325a9949-e139-4158-9626-95b370bd95b1 None None] Sync routers for ids ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:45.522739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57252) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:45.531596 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-325a9949-e139-4158-9626-95b370bd95b1 None None] Routers {'2f78564e-0ab3-4c6e-8e01-d720fac2db18'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:45.532383 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-325a9949-e139-4158-9626-95b370bd95b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:45.569674 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a375cad5-b8e6-4a57-a676-bbb0e6f3b66a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=2f78564e-0ab3-4c6e-8e01-d720fac2db18 HTTP/1.1" status: 200 len: 205 time: 0.0430770 Mar 24 02:13:45.580654 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57256) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:45.622349 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-325a9949-e139-4158-9626-95b370bd95b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:45.632869 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-325a9949-e139-4158-9626-95b370bd95b1 None None] Routers {'2f78564e-0ab3-4c6e-8e01-d720fac2db18'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:45.633611 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-325a9949-e139-4158-9626-95b370bd95b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:45.691353 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-325a9949-e139-4158-9626-95b370bd95b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:45.693307 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-325a9949-e139-4158-9626-95b370bd95b1 None None] The sync data for ids ['2f78564e-0ab3-4c6e-8e01-d720fac2db18'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:45.757290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': '062d1a0e-e86a-43ba-8530-9dd026347327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '1c5346a8-419f-4cf9-b148-63a16b6321b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:45.757658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: 1c5346a8-419f-4cf9-b148-63a16b6321b0, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:45.776283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0bb08cd6-3482-4a82-9831-984599043509 None None] Provisioning complete for port 12a23db5-fe86-4e1d-b018-747c2d8bbebc triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:45.776660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0bb08cd6-3482-4a82-9831-984599043509 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:45.788735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2f130bcd-32d1-4169-97a2-002a7b4b9655 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (2f78564e-0ab3-4c6e-8e01-d720fac2db18), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:45.820550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0bb08cd6-3482-4a82-9831-984599043509 None None] Port 12a23db5-fe86-4e1d-b018-747c2d8bbebc cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:45.825272 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f6328e56-c489-492c-b183-d553d2d4b4f6', 'name': 'tempest-NetworksTestDHCPv6-router-1041238598', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:42Z', 'updated_at': '2022-03-24T02:13:43Z', 'revision_number': 2, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None, '_interfaces': [{'id': '12a23db5-fe86-4e1d-b018-747c2d8bbebc', 'name': '', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'mac_address': 'fa:16:3e:df:29:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f6328e56-c489-492c-b183-d553d2d4b4f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 420, 'fixed_ips': [{'subnet_id': 'd27abda3-e811-404d-adbf-44e0463872f5', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:43Z', 'updated_at': '2022-03-24T02:13:44Z', 'revision_number': 2, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'subnets': [{'id': 'd27abda3-e811-404d-adbf-44e0463872f5', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:45.855547 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Checking router: f6328e56-c489-492c-b183-d553d2d4b4f6 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:13:45.855899 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Updating router f6328e56-c489-492c-b183-d553d2d4b4f6 port 12a23db5-fe86-4e1d-b018-747c2d8bbebc binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:13:45.886482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:45.900324 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network 1c5346a8-419f-4cf9-b148-63a16b6321b0 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:45.907169 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-013f6cf3-9687-490f-bf46-f07bc52e2e25 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=b3964097be93482e80fe8f431f73e4aa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3921621 Mar 24 02:13:45.926973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57258) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:45.972125 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (c501a2f5-fd22-4d71-b444-ffa881c70170), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.000343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0f595336-68cd-4a85-9919-54eebf5cee87 None None] Provisioning complete for port 12a23db5-fe86-4e1d-b018-747c2d8bbebc triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:46.000715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0f595336-68cd-4a85-9919-54eebf5cee87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.007977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 1c5346a8-419f-4cf9-b148-63a16b6321b0) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:46.013360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:46.013972 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.019670 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5b6e824-5c67-4f7e-b1cf-6a6a62931f13 admin admin] Publish callbacks [] for security_group (d5f327de-ffad-4263-99e6-57831f0fc8f8), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.030686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0125ce99-e204-49a3-a261-e29c89737927 None None] Network 1c5346a8-419f-4cf9-b148-63a16b6321b0 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:46.032007 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_gateway (c501a2f5-fd22-4d71-b444-ffa881c70170), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.037909 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2f130bcd-32d1-4169-97a2-002a7b4b9655 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (2f78564e-0ab3-4c6e-8e01-d720fac2db18), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.041600 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2f130bcd-32d1-4169-97a2-002a7b4b9655 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (2f78564e-0ab3-4c6e-8e01-d720fac2db18), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.055202 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5ae2a060-edfb-4765-8757-dc56554a7497 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 792 time: 1.9724045 Mar 24 02:13:46.059290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57260) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:46.065263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5b6e824-5c67-4f7e-b1cf-6a6a62931f13 admin admin] Publish callbacks [] for security_group (d5f327de-ffad-4263-99e6-57831f0fc8f8), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.067139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (f6328e56-c489-492c-b183-d553d2d4b4f6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.134615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0f595336-68cd-4a85-9919-54eebf5cee87 None None] Port 12a23db5-fe86-4e1d-b018-747c2d8bbebc cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:46.169042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2f130bcd-32d1-4169-97a2-002a7b4b9655 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (2f78564e-0ab3-4c6e-8e01-d720fac2db18), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.169539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f130bcd-32d1-4169-97a2-002a7b4b9655 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Fanout notify agent at l3_agent the message router_deleted on router 2f78564e-0ab3-4c6e-8e01-d720fac2db18 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:46.178763 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2f130bcd-32d1-4169-97a2-002a7b4b9655 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.179632 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2f130bcd-32d1-4169-97a2-002a7b4b9655 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/2f78564e-0ab3-4c6e-8e01-d720fac2db18 HTTP/1.1" status: 204 len: 168 time: 0.5936801 Mar 24 02:13:46.183148 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57264) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:46.225852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-1c5346a8-419f-4cf9-b148-63a16b6321b0', 'network_id': '1c5346a8-419f-4cf9-b148-63a16b6321b0', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': '723c7a3c-1afc-42c9-9487-e1f0431035c7'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:46.226908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.236517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5b6e824-5c67-4f7e-b1cf-6a6a62931f13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d5f327de-ffad-4263-99e6-57831f0fc8f8), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.239130 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5b6e824-5c67-4f7e-b1cf-6a6a62931f13 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.243096 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a5b6e824-5c67-4f7e-b1cf-6a6a62931f13 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/d5f327de-ffad-4263-99e6-57831f0fc8f8 HTTP/1.1" status: 204 len: 168 time: 0.3137107 Mar 24 02:13:46.305384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b6e824-5c67-4f7e-b1cf-6a6a62931f13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5f327de-ffad-4263-99e6-57831f0fc8f8,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:46.408378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Publish callbacks [] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.421694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 12a23db5-fe86-4e1d-b018-747c2d8bbebc {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:46.422184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.439493 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.486677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-decd77aa-c7de-40cd-a427-0b0250b74f61 None None] Pushing event updated for resources: {'Port': ['ID=12a23db5-fe86-4e1d-b018-747c2d8bbebc,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:46.516643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Allocated IP 172.20.0.3 (1c5346a8-419f-4cf9-b148-63a16b6321b0/723c7a3c-1afc-42c9-9487-e1f0431035c7/c1365041-777f-49d2-9d87-b692a80b0976) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:46.585532 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.617090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 12a23db5-fe86-4e1d-b018-747c2d8bbebc owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:46.676133 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Deleting port 0eb76691-da90-4f4c-9c3b-1a9c77254faa {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:46.676629 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0eb76691-da90-4f4c-9c3b-1a9c77254faa), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.701370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (1c5346a8-419f-4cf9-b148-63a16b6321b0), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.708105 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-8feb950f-039a-4c3b-982c-5d6dd5197630 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting subnet 7be7dde7-21ee-46c4-996c-e9d6dea102c7 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:46.739473 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Publish callbacks [] for port (c1365041-777f-49d2-9d87-b692a80b0976), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.743374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8feb950f-039a-4c3b-982c-5d6dd5197630 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (7be7dde7-21ee-46c4-996c-e9d6dea102c7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.747625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d0fe88f2-0fba-4d6f-a26e-af7d59695a54 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:46.777208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (c1365041-777f-49d2-9d87-b692a80b0976), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.836404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8feb950f-039a-4c3b-982c-5d6dd5197630 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (7be7dde7-21ee-46c4-996c-e9d6dea102c7), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.901979 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Network 1c5346a8-419f-4cf9-b148-63a16b6321b0 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:46.902618 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0eb76691-da90-4f4c-9c3b-1a9c77254faa), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.928521 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Calling delete_port for 0eb76691-da90-4f4c-9c3b-1a9c77254faa owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:46.929462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:46.940153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:46.945254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:46.951329 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Pushing event updated for resources: {'Port': ['ID=c1365041-777f-49d2-9d87-b692a80b0976,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:46.971179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Attempting to bind port 12a23db5-fe86-4e1d-b018-747c2d8bbebc on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:46.971556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Attempting to bind port 12a23db5-fe86-4e1d-b018-747c2d8bbebc by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:46.971921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Attempting to bind port 12a23db5-fe86-4e1d-b018-747c2d8bbebc on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:46.973687 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4e59a145-c971-4d18-825a-eda03f7a7cc1 None None] Could not find standard attr ID for object 12a23db5-fe86-4e1d-b018-747c2d8bbebc. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:13:46.998214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=12a23db5-fe86-4e1d-b018-747c2d8bbebc,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:47.004069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:47.004460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:47.004870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.005277 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:47.005773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Bound port: 12a23db5-fe86-4e1d-b018-747c2d8bbebc, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:47.006193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (12a23db5-fe86-4e1d-b018-747c2d8bbebc), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.010249 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:47.010643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.108074 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Port 12a23db5-fe86-4e1d-b018-747c2d8bbebc has been deleted concurrently {{(pid=104038) _commit_port_binding /opt/stack/neutron/neutron/plugins/ml2/plugin.py:671}} Mar 24 02:13:47.112363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (f6328e56-c489-492c-b183-d553d2d4b4f6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.126056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Attempting to bind port c1365041-777f-49d2-9d87-b692a80b0976 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:47.126430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Attempting to bind port c1365041-777f-49d2-9d87-b692a80b0976 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '062d1a0e-e86a-43ba-8530-9dd026347327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '1c5346a8-419f-4cf9-b148-63a16b6321b0'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:47.126824 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Attempting to bind port c1365041-777f-49d2-9d87-b692a80b0976 on network 1c5346a8-419f-4cf9-b148-63a16b6321b0 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:47.144044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:47.144442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Checking segment: {'id': '062d1a0e-e86a-43ba-8530-9dd026347327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '1c5346a8-419f-4cf9-b148-63a16b6321b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:47.144854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.145269 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Bound using segment: {'id': '062d1a0e-e86a-43ba-8530-9dd026347327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '1c5346a8-419f-4cf9-b148-63a16b6321b0'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:47.145783 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Bound port: c1365041-777f-49d2-9d87-b692a80b0976, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '062d1a0e-e86a-43ba-8530-9dd026347327', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '1c5346a8-419f-4cf9-b148-63a16b6321b0'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:47.146168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c1365041-777f-49d2-9d87-b692a80b0976), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.164545 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Deleting port c1365041-777f-49d2-9d87-b692a80b0976 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:47.165093 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c1365041-777f-49d2-9d87-b692a80b0976), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.178223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Routers {'f6328e56-c489-492c-b183-d553d2d4b4f6'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:47.178894 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f6328e56-c489-492c-b183-d553d2d4b4f6'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:47.263329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8feb950f-039a-4c3b-982c-5d6dd5197630 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (7be7dde7-21ee-46c4-996c-e9d6dea102c7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.350123 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] Set router f6328e56-c489-492c-b183-d553d2d4b4f6 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:13:47.352098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Router f6328e56-c489-492c-b183-d553d2d4b4f6 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:13:47.374863 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] For port c1365041-777f-49d2-9d87-b692a80b0976, host dv-neutron-834874-3-hyperv, got binding levels [] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:47.375436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c1365041-777f-49d2-9d87-b692a80b0976), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.403204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Calling delete_port for c1365041-777f-49d2-9d87-b692a80b0976 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:47.427053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0eb76691-da90-4f4c-9c3b-1a9c77254faa), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.437173 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f6328e56-c489-492c-b183-d553d2d4b4f6', 'name': 'tempest-NetworksTestDHCPv6-router-1041238598', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:42Z', 'updated_at': '2022-03-24T02:13:46Z', 'revision_number': 3, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:47.456942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:47.470921 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bf9913a8-f0e1-4e27-abc8-7147baaa5264 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "PUT /v2.0/routers/f6328e56-c489-492c-b183-d553d2d4b4f6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3837781 Mar 24 02:13:47.472170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57290) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:47.472831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] For port c1365041-777f-49d2-9d87-b692a80b0976, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:47.478990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7543d93f-cdce-47c3-80dc-aa5014ee2a5c None None] The sync data for ids ['f6328e56-c489-492c-b183-d553d2d4b4f6'] in dv-neutron-834874-3-hyperv is: [{'id': 'f6328e56-c489-492c-b183-d553d2d4b4f6', 'name': 'tempest-NetworksTestDHCPv6-router-1041238598', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:42Z', 'updated_at': '2022-03-24T02:13:46Z', 'revision_number': 3, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:47.489274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:47.494327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] For port c1365041-777f-49d2-9d87-b692a80b0976, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c1365041-777f-49d2-9d87-b692a80b0976,segment=NetworkSegment(062d1a0e-e86a-43ba-8530-9dd026347327),segment_id=062d1a0e-e86a-43ba-8530-9dd026347327)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:47.498242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Pushing event deleted for resources: {'Port': ['ID=0eb76691-da90-4f4c-9c3b-1a9c77254faa,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:47.512431 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c1365041-777f-49d2-9d87-b692a80b0976), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.517667 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8feb950f-039a-4c3b-982c-5d6dd5197630 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (7be7dde7-21ee-46c4-996c-e9d6dea102c7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.567948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6374eb0c-f79c-453c-84b0-d7047baecf64 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:47.568179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-085dcb44-47aa-4891-8a2a-63163eb98ddb None None] Network 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:47.574211 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6374eb0c-f79c-453c-84b0-d7047baecf64 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:47.575977 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6374eb0c-f79c-453c-84b0-d7047baecf64 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1028354 Mar 24 02:13:47.578888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57292) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:47.583094 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8feb950f-039a-4c3b-982c-5d6dd5197630 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Subnet': ['ID=7be7dde7-21ee-46c4-996c-e9d6dea102c7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:47.658449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7388e12c-0bf1-4abb-8821-3cfc1ece847a None None] Pushing event updated for resources: {'Port': ['ID=c1365041-777f-49d2-9d87-b692a80b0976,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:47.661237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-9be01c05-158f-4dab-8d3b-eeb25143ad1e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet d27abda3-e811-404d-adbf-44e0463872f5 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:47.667364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9be01c05-158f-4dab-8d3b-eeb25143ad1e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (d27abda3-e811-404d-adbf-44e0463872f5), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.723098 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8feb950f-039a-4c3b-982c-5d6dd5197630 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.728999 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8feb950f-039a-4c3b-982c-5d6dd5197630 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/7be7dde7-21ee-46c4-996c-e9d6dea102c7 HTTP/1.1" status: 204 len: 168 time: 1.5421083 Mar 24 02:13:47.731948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57296) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:47.767705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c1365041-777f-49d2-9d87-b692a80b0976), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.809954 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (c501a2f5-fd22-4d71-b444-ffa881c70170), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.823208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-cbad0314-dc4d-4613-848b-7767251c1fec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting subnet 222f25e2-9089-4c48-b74a-f3cca2685179 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:47.829895 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9be01c05-158f-4dab-8d3b-eeb25143ad1e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (d27abda3-e811-404d-adbf-44e0463872f5), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.844771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cbad0314-dc4d-4613-848b-7767251c1fec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (222f25e2-9089-4c48-b74a-f3cca2685179), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:47.923467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fee73d08-7df4-46ad-a5cd-38c2229e0245 None None] DHCP port deletion for 7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:47.933457 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Port': ['ID=c1365041-777f-49d2-9d87-b692a80b0976,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:47.950485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cbad0314-dc4d-4613-848b-7767251c1fec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (222f25e2-9089-4c48-b74a-f3cca2685179), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.006995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No DVR routers for this DVR port c1365041-777f-49d2-9d87-b692a80b0976 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:48.028228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fee73d08-7df4-46ad-a5cd-38c2229e0245 None None] Deleting port fa8224fd-63a8-406e-b5ee-8a578673c625 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:48.028601 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fee73d08-7df4-46ad-a5cd-38c2229e0245 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.092739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9be01c05-158f-4dab-8d3b-eeb25143ad1e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (d27abda3-e811-404d-adbf-44e0463872f5), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.127883 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-fee73d08-7df4-46ad-a5cd-38c2229e0245 None None] For port fa8224fd-63a8-406e-b5ee-8a578673c625, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fa8224fd-63a8-406e-b5ee-8a578673c625,segment=NetworkSegment(4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7),segment_id=4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:48.127883 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fee73d08-7df4-46ad-a5cd-38c2229e0245 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.144010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (723c7a3c-1afc-42c9-9487-e1f0431035c7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.168927 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fee73d08-7df4-46ad-a5cd-38c2229e0245 None None] Calling delete_port for fa8224fd-63a8-406e-b5ee-8a578673c625 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:48.171891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cbad0314-dc4d-4613-848b-7767251c1fec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (222f25e2-9089-4c48-b74a-f3cca2685179), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.246189 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (c501a2f5-fd22-4d71-b444-ffa881c70170), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.251564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9be01c05-158f-4dab-8d3b-eeb25143ad1e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (d27abda3-e811-404d-adbf-44e0463872f5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.256841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (c501a2f5-fd22-4d71-b444-ffa881c70170), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.290639 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be01c05-158f-4dab-8d3b-eeb25143ad1e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=d27abda3-e811-404d-adbf-44e0463872f5,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:48.293269 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9be01c05-158f-4dab-8d3b-eeb25143ad1e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.297010 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9be01c05-158f-4dab-8d3b-eeb25143ad1e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/d27abda3-e811-404d-adbf-44e0463872f5 HTTP/1.1" status: 204 len: 168 time: 0.7168429 Mar 24 02:13:48.300833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57306) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:48.303054 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bc82d2b-01f6-4ae8-b359-4c26f7b2cee8 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:48.309047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cbad0314-dc4d-4613-848b-7767251c1fec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (222f25e2-9089-4c48-b74a-f3cca2685179), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.368091 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Router c501a2f5-fd22-4d71-b444-ffa881c70170 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:13:48.383165 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (723c7a3c-1afc-42c9-9487-e1f0431035c7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.397879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbad0314-dc4d-4613-848b-7767251c1fec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Subnet': ['ID=222f25e2-9089-4c48-b74a-f3cca2685179,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:48.405859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cbad0314-dc4d-4613-848b-7767251c1fec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.409126 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cbad0314-dc4d-4613-848b-7767251c1fec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/222f25e2-9089-4c48-b74a-f3cca2685179 HTTP/1.1" status: 204 len: 168 time: 0.6760354 Mar 24 02:13:48.412187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57312) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:48.453458 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d20883b-35f2-472e-a8b9-6b3b5e2cb8d7 None None] Network 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:48.497843 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-33558e24-b7b0-4db4-9f73-058d440dfd17 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 710 time: 0.1958027 Mar 24 02:13:48.509118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57314) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:48.519949 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (1c5346a8-419f-4cf9-b148-63a16b6321b0), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.545828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fee73d08-7df4-46ad-a5cd-38c2229e0245 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (fa8224fd-63a8-406e-b5ee-8a578673c625), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.550660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1c5346a8-419f-4cf9-b148-63a16b6321b0']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:48.561104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '062d1a0e-e86a-43ba-8530-9dd026347327') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:48.561398 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '062d1a0e-e86a-43ba-8530-9dd026347327') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:48.572824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (062d1a0e-e86a-43ba-8530-9dd026347327), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.586915 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (062d1a0e-e86a-43ba-8530-9dd026347327), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.593292 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:48.593482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (062d1a0e-e86a-43ba-8530-9dd026347327), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.606139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.621497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fee73d08-7df4-46ad-a5cd-38c2229e0245 None None] Pushing event deleted for resources: {'Port': ['ID=fa8224fd-63a8-406e-b5ee-8a578673c625,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:48.626144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-15baf0d9-6ac8-4e84-bacc-2a9aa3228d73 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router (f6328e56-c489-492c-b183-d553d2d4b4f6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.632019 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fee73d08-7df4-46ad-a5cd-38c2229e0245 None None] No DVR routers for this DVR port fa8224fd-63a8-406e-b5ee-8a578673c625 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:48.675700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=723c7a3c-1afc-42c9-9487-e1f0431035c7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:48.719291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0edda6e8-fa0d-4d7b-8faa-d75d63869d62 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:48.722386 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:48.739715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:48.748048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.751691 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c32ced20-4a36-4580-896b-8918b050cf55 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "PUT /v2.0/routers/c501a2f5-fd22-4d71-b444-ffa881c70170 HTTP/1.1" status: 200 len: 709 time: 3.8922539 Mar 24 02:13:48.751691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (1c5346a8-419f-4cf9-b148-63a16b6321b0), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.754945 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.759324 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/1c5346a8-419f-4cf9-b148-63a16b6321b0 HTTP/1.1" status: 204 len: 168 time: 2.7000961 Mar 24 02:13:48.759893 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57316) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:48.765179 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57318) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:48.781777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-550245937'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:48.787860 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-feaa6ac1-a94f-42d0-8dcc-aaa7e43ff19b None None] DHCP port deletion for 97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:48.792459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fa8224fd-63a8-406e-b5ee-8a578673c625 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:48.796343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d82908-69ab-4c47-a018-174ed329bd14 None None] Sync routers for ids ['c501a2f5-fd22-4d71-b444-ffa881c70170'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:48.827305 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f522deb0-73e5-4830-b0fb-3d9005126331 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=1c5346a8-419f-4cf9-b148-63a16b6321b0,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:48.832318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: fa8224fd-63a8-406e-b5ee-8a578673c625 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:48.832904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fa8224fd-63a8-406e-b5ee-8a578673c625 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:48.869150 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08d82908-69ab-4c47-a018-174ed329bd14 None None] Routers {'c501a2f5-fd22-4d71-b444-ffa881c70170'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:48.870666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-08d82908-69ab-4c47-a018-174ed329bd14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c501a2f5-fd22-4d71-b444-ffa881c70170'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:48.885311 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f369ef35-06f7-4b0c-8fb2-c016fafd5b83 tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/routers/c501a2f5-fd22-4d71-b444-ffa881c70170 HTTP/1.1" status: 200 len: 744 time: 0.1188219 Mar 24 02:13:48.885934 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57320) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:48.889988 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:48.894443 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.929197 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 100} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:48.947139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4dae513e-c17b-4168-b083-81e2a5baba65), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:48.947526 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment 4dae513e-c17b-4168-b083-81e2a5baba65 of type vlan for network ae635ae4-cdbd-40ef-9e49-21e17f06f1ca Mar 24 02:13:48.981539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57322) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:48.988533 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1117352014', 'description': 'tempest-secgroup-smoke-1117352014 description', 'project_id': '615b57fe01bd445f87fb9f1a86851430'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:49.012847 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (ae635ae4-cdbd-40ef-9e49-21e17f06f1ca), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.034131 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.034348 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7ddefb5c-13b5-4859-9bcb-636641529b7e tempest-RoutersIpV6AdminTest-626296639 tempest-RoutersIpV6AdminTest-626296639-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=c501a2f5-fd22-4d71-b444-ffa881c70170 HTTP/1.1" status: 200 len: 205 time: 0.1413331 Mar 24 02:13:49.038399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57324) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:49.049620 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.049994 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.060819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (ae635ae4-cdbd-40ef-9e49-21e17f06f1ca), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.066285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:49.066894 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.078304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-15baf0d9-6ac8-4e84-bacc-2a9aa3228d73 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (f6328e56-c489-492c-b183-d553d2d4b4f6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.078720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-08d82908-69ab-4c47-a018-174ed329bd14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:49.085956 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-03ff7fb4-402d-4d5d-85c4-c35d5a2e460d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=c501a2f5-fd22-4d71-b444-ffa881c70170 HTTP/1.1" status: 200 len: 205 time: 0.0436454 Mar 24 02:13:49.087962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-15baf0d9-6ac8-4e84-bacc-2a9aa3228d73 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router_controller (f6328e56-c489-492c-b183-d553d2d4b4f6), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.089280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57326) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:49.104734 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0edda6e8-fa0d-4d7b-8faa-d75d63869d62 None None] Deleting port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:49.105238 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0edda6e8-fa0d-4d7b-8faa-d75d63869d62 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.105944 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:49.108846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08d82908-69ab-4c47-a018-174ed329bd14 None None] Routers {'c501a2f5-fd22-4d71-b444-ffa881c70170'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:49.109574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-08d82908-69ab-4c47-a018-174ed329bd14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c501a2f5-fd22-4d71-b444-ffa881c70170'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:49.159622 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.3902030 Mar 24 02:13:49.163915 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57328) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:49.172978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': 'ae635ae4-cdbd-40ef-9e49-21e17f06f1ca', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:49.197487 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-08d82908-69ab-4c47-a018-174ed329bd14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:49.198353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d82908-69ab-4c47-a018-174ed329bd14 None None] The sync data for ids ['c501a2f5-fd22-4d71-b444-ffa881c70170'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:49.214891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-feaa6ac1-a94f-42d0-8dcc-aaa7e43ff19b None None] Deleting port c6417f3b-22fb-45bc-92a5-17c345dcb84f {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:49.215360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-feaa6ac1-a94f-42d0-8dcc-aaa7e43ff19b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.283163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18bf3be6-1e8f-4eff-ae66-663675a59f75 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=ae635ae4-cdbd-40ef-9e49-21e17f06f1ca,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:49.283819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-0edda6e8-fa0d-4d7b-8faa-d75d63869d62 None None] For port d0fe88f2-0fba-4d6f-a26e-af7d59695a54, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d0fe88f2-0fba-4d6f-a26e-af7d59695a54,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:49.283819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0edda6e8-fa0d-4d7b-8faa-d75d63869d62 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.292805 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:49.296340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.307618 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network ae635ae4-cdbd-40ef-9e49-21e17f06f1ca details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:49.309987 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0edda6e8-fa0d-4d7b-8faa-d75d63869d62 None None] Calling delete_port for d0fe88f2-0fba-4d6f-a26e-af7d59695a54 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:49.413102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-feaa6ac1-a94f-42d0-8dcc-aaa7e43ff19b None None] For port c6417f3b-22fb-45bc-92a5-17c345dcb84f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c6417f3b-22fb-45bc-92a5-17c345dcb84f,segment=NetworkSegment(769c981e-2cd6-4647-8a34-7b067e17b24a),segment_id=769c981e-2cd6-4647-8a34-7b067e17b24a)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:49.413850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-feaa6ac1-a94f-42d0-8dcc-aaa7e43ff19b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.431747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group (919370df-d899-4ffe-8d0a-4c4db42fadcb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.434210 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-feaa6ac1-a94f-42d0-8dcc-aaa7e43ff19b None None] Calling delete_port for c6417f3b-22fb-45bc-92a5-17c345dcb84f owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:49.443393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (919370df-d899-4ffe-8d0a-4c4db42fadcb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.449562 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] Sync routers for ids ['f6328e56-c489-492c-b183-d553d2d4b4f6'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:49.461926 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] Routers {'f6328e56-c489-492c-b183-d553d2d4b4f6'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:49.462837 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f6328e56-c489-492c-b183-d553d2d4b4f6'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:49.477206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'SecurityGroup': ['ID=919370df-d899-4ffe-8d0a-4c4db42fadcb,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:49.489635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:49.490732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:49.528085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.544796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-15baf0d9-6ac8-4e84-bacc-2a9aa3228d73 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (f6328e56-c489-492c-b183-d553d2d4b4f6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.545831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15baf0d9-6ac8-4e84-bacc-2a9aa3228d73 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Fanout notify agent at l3_agent the message router_deleted on router f6328e56-c489-492c-b183-d553d2d4b4f6 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:49.570198 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-15baf0d9-6ac8-4e84-bacc-2a9aa3228d73 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.575954 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-15baf0d9-6ac8-4e84-bacc-2a9aa3228d73 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/routers/f6328e56-c489-492c-b183-d553d2d4b4f6 HTTP/1.1" status: 204 len: 168 time: 1.0641418 Mar 24 02:13:49.577999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57330) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:49.581636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdfbc84c-8216-4378-b2ee-8d6930f5c6f6 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (c501a2f5-fd22-4d71-b444-ffa881c70170), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.644799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group (b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.653082 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] Set router f6328e56-c489-492c-b183-d553d2d4b4f6 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:13:49.666110 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.684902 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0edda6e8-fa0d-4d7b-8faa-d75d63869d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (d0fe88f2-0fba-4d6f-a26e-af7d59695a54), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.697656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.698959 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.7164259 Mar 24 02:13:49.708285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57332) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:49.715853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.721341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-91dfa844-016c-4cfc-b595-a607bc8bea93 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'security_group_rule': {'security_group_id': 'b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8', 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:49.727065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Releasing vlan 140 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:49.727497 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (4b19a0c8-6d4f-4af1-bdcd-bd362952aeb7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:49.730865 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:49.736872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0edda6e8-fa0d-4d7b-8faa-d75d63869d62 None None] Pushing event deleted for resources: {'Port': ['ID=d0fe88f2-0fba-4d6f-a26e-af7d59695a54,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:49.751077 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0edda6e8-fa0d-4d7b-8faa-d75d63869d62 None None] No DVR routers for this DVR port d0fe88f2-0fba-4d6f-a26e-af7d59695a54 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:49.752028 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f6328e56-c489-492c-b183-d553d2d4b4f6', 'name': 'tempest-NetworksTestDHCPv6-router-1041238598', 'tenant_id': '61b2614e46ca47e598c15c239d583ee4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:42Z', 'updated_at': '2022-03-24T02:13:46Z', 'revision_number': 3, 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:49.770732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (5502286a-a0a7-45cd-a920-a7677d14542e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.782668 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] Checking router: f6328e56-c489-492c-b183-d553d2d4b4f6 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:13:49.783724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-feaa6ac1-a94f-42d0-8dcc-aaa7e43ff19b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (c6417f3b-22fb-45bc-92a5-17c345dcb84f), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.785873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4451476d-d5ae-4d29-a4fd-219fad8a25ac None None] Could not find standard attr ID for object c1365041-777f-49d2-9d87-b692a80b0976. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:13:49.792885 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24ddcd77-9cb0-4581-9adf-c1a7678e0288 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:49.794682 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-24ddcd77-9cb0-4581-9adf-c1a7678e0288 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.2154088 Mar 24 02:13:49.800162 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] Routers set() bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:49.801171 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] Router IDs set() for agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:463}} Mar 24 02:13:49.803316 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_agentschedulers_db [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'f6328e56-c489-492c-b183-d553d2d4b4f6'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent'). {{(pid=104039) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Mar 24 02:13:49.803912 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd94a8bb-72ee-42da-8d65-29c8fb47e043 None None] The sync data for ids ['f6328e56-c489-492c-b183-d553d2d4b4f6'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:49.805443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57334) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:49.824724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-91dfa844-016c-4cfc-b595-a607bc8bea93 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (1924ad35-3e3e-4d10-a47c-871896fcc2ce), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.828862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef972458-5f34-40df-be4e-1720fe82d915 None None] DHCP port deletion for 1c5346a8-419f-4cf9-b148-63a16b6321b0 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:49.831042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feaa6ac1-a94f-42d0-8dcc-aaa7e43ff19b None None] Pushing event deleted for resources: {'Port': ['ID=c6417f3b-22fb-45bc-92a5-17c345dcb84f,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:49.835556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-feaa6ac1-a94f-42d0-8dcc-aaa7e43ff19b None None] No DVR routers for this DVR port c6417f3b-22fb-45bc-92a5-17c345dcb84f on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:49.874763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18ea66ac-d327-4ae6-83ae-0fceeb5f57ef None None] Network 1c5346a8-419f-4cf9-b148-63a16b6321b0 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:49.888644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b30444-513e-428d-bacf-e4d0617120a2 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:49.894205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18ea66ac-d327-4ae6-83ae-0fceeb5f57ef None None] Network 1c5346a8-419f-4cf9-b148-63a16b6321b0 could not be found, it might have been deleted concurrently. {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:196}} Mar 24 02:13:49.908791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=5502286a-a0a7-45cd-a920-a7677d14542e,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:49.944804 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.949001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdfbc84c-8216-4378-b2ee-8d6930f5c6f6 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (c501a2f5-fd22-4d71-b444-ffa881c70170), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.957155 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.963686 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/networks/7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886 HTTP/1.1" status: 204 len: 168 time: 1.5479236 Mar 24 02:13:49.963864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': '4dae513e-c17b-4168-b083-81e2a5baba65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ae635ae4-cdbd-40ef-9e49-21e17f06f1ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:49.963975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdfbc84c-8216-4378-b2ee-8d6930f5c6f6 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router_controller (c501a2f5-fd22-4d71-b444-ffa881c70170), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:49.964066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: ae635ae4-cdbd-40ef-9e49-21e17f06f1ca, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:49.965656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57336) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:49.977791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-652ddd78-6ce2-401d-9aa5-fb82c62eff4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:49.979300 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-652ddd78-6ce2-401d-9aa5-fb82c62eff4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1729281 Mar 24 02:13:49.982085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57338) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:49.982871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed14bf6d-19a0-47eb-9a6d-158f57e01267 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Network': ['ID=7ea58fd0-8d20-47e4-9dba-cd4c4d6dd886,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:50.045913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-91dfa844-016c-4cfc-b595-a607bc8bea93 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (1924ad35-3e3e-4d10-a47c-871896fcc2ce), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.055170 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-91dfa844-016c-4cfc-b595-a607bc8bea93 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (1924ad35-3e3e-4d10-a47c-871896fcc2ce), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.061429 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7ad13b35-99ae-4b4e-8526-34021e2da01e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0718939 Mar 24 02:13:50.062805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57340) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.068273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:50.072870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdfbc84c-8216-4378-b2ee-8d6930f5c6f6 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (c501a2f5-fd22-4d71-b444-ffa881c70170), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.073397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fdfbc84c-8216-4378-b2ee-8d6930f5c6f6 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Fanout notify agent at l3_agent the message router_deleted on router c501a2f5-fd22-4d71-b444-ffa881c70170 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:50.089279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdfbc84c-8216-4378-b2ee-8d6930f5c6f6 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.089715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network ae635ae4-cdbd-40ef-9e49-21e17f06f1ca is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:50.090433 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fdfbc84c-8216-4378-b2ee-8d6930f5c6f6 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/c501a2f5-fd22-4d71-b444-ffa881c70170 HTTP/1.1" status: 204 len: 168 time: 0.9957039 Mar 24 02:13:50.095354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57342) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.113129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (97acd41e-65de-4a40-9f5c-ad8b6aa7efb6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.129297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91dfa844-016c-4cfc-b595-a607bc8bea93 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1924ad35-3e3e-4d10-a47c-871896fcc2ce,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:50.131325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, ae635ae4-cdbd-40ef-9e49-21e17f06f1ca) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:50.138405 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-471ba314-ce4f-4008-af57-53585466bdd9 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=c501a2f5-fd22-4d71-b444-ffa881c70170 HTTP/1.1" status: 200 len: 205 time: 0.0365305 Mar 24 02:13:50.138405 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-91dfa844-016c-4cfc-b595-a607bc8bea93 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.140394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57344) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.141220 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c36fc5f-29e5-4ca2-a5c4-3da335f6114f None None] Network ae635ae4-cdbd-40ef-9e49-21e17f06f1ca requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:50.141799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57346) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.147132 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-91dfa844-016c-4cfc-b595-a607bc8bea93 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4299157 Mar 24 02:13:50.148178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-88b6c18d-d379-477f-8afb-5ab42f4bb8d1 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'security_group_rule': {'security_group_id': 'b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8', 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:50.153271 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:50.153876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.180141 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-57e511b6-e0ce-40ec-85c3-66f6a8f8d58f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.0160005 Mar 24 02:13:50.191850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57348) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.210996 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-f6274e88-de29-47bf-8345-f4c7ba9ce5ec tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] delete failed (client error): The resource could not be found. Mar 24 02:13:50.211710 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f6274e88-de29-47bf-8345-f4c7ba9ce5ec tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/c501a2f5-fd22-4d71-b444-ffa881c70170 HTTP/1.1" status: 404 len: 336 time: 0.0687914 Mar 24 02:13:50.221138 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57350) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.242988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-88b6c18d-d379-477f-8afb-5ab42f4bb8d1 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (56d84465-de4b-452e-914d-8e6cc76d4119), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.250312 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-ae635ae4-cdbd-40ef-9e49-21e17f06f1ca', 'network_id': 'ae635ae4-cdbd-40ef-9e49-21e17f06f1ca', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': '5502286a-a0a7-45cd-a920-a7677d14542e'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:50.251933 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:50.252096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.255293 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.299879 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6de5069d-d193-41bc-8271-73adb5252866 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=388178b9-9c76-43cb-bb65-63d48483707e HTTP/1.1" status: 200 len: 205 time: 0.0762458 Mar 24 02:13:50.306872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57352) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.355338 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (97acd41e-65de-4a40-9f5c-ad8b6aa7efb6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.371931 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-320e2cb0-06e1-40a8-bffe-5cf104953d6a tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] delete failed (client error): The resource could not be found. Mar 24 02:13:50.372743 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-320e2cb0-06e1-40a8-bffe-5cf104953d6a tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/388178b9-9c76-43cb-bb65-63d48483707e HTTP/1.1" status: 404 len: 336 time: 0.0627177 Mar 24 02:13:50.377868 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57354) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.390895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['97acd41e-65de-4a40-9f5c-ad8b6aa7efb6']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:50.404831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Allocated IP 172.20.0.1 (ae635ae4-cdbd-40ef-9e49-21e17f06f1ca/5502286a-a0a7-45cd-a920-a7677d14542e/ed8a6065-8e8b-4dc3-9fd0-746afa838732) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:50.410471 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '769c981e-2cd6-4647-8a34-7b067e17b24a') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:50.410798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '769c981e-2cd6-4647-8a34-7b067e17b24a') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:50.423371 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-be19f781-a4b6-4db6-b78e-2d2133dfd466 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=96a5816b-7046-4612-9a87-c6fb23f51c32 HTTP/1.1" status: 200 len: 205 time: 0.0424805 Mar 24 02:13:50.424430 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (ae635ae4-cdbd-40ef-9e49-21e17f06f1ca), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.426045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57358) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.429654 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (769c981e-2cd6-4647-8a34-7b067e17b24a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.450003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (769c981e-2cd6-4647-8a34-7b067e17b24a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.474310 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Releasing vlan 113 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:50.475270 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (769c981e-2cd6-4647-8a34-7b067e17b24a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.476214 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-40850759-75be-4730-a8b1-53d61d90b1e4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] delete failed (client error): The resource could not be found. Mar 24 02:13:50.477268 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-40850759-75be-4730-a8b1-53d61d90b1e4 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/96a5816b-7046-4612-9a87-c6fb23f51c32 HTTP/1.1" status: 404 len: 336 time: 0.0502286 Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:50.478630 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:50.480456 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-88b6c18d-d379-477f-8afb-5ab42f4bb8d1 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (56d84465-de4b-452e-914d-8e6cc76d4119), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.480944 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57360) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.513537 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-103199de-2d47-46b1-87da-297bfc89fa50 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=25f49c4c-0d36-4e53-92a4-3025c26217a9 HTTP/1.1" status: 200 len: 205 time: 0.0315306 Mar 24 02:13:50.515926 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57362) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.523846 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-88b6c18d-d379-477f-8afb-5ab42f4bb8d1 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (56d84465-de4b-452e-914d-8e6cc76d4119), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.546612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (5502286a-a0a7-45cd-a920-a7677d14542e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.574656 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-c15a63ab-a82b-4545-985a-4f82829dd739 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] delete failed (client error): The resource could not be found. Mar 24 02:13:50.578154 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c15a63ab-a82b-4545-985a-4f82829dd739 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/25f49c4c-0d36-4e53-92a4-3025c26217a9 HTTP/1.1" status: 404 len: 336 time: 0.0589061 Mar 24 02:13:50.581066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57364) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.587117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Publish callbacks [] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.595722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (97acd41e-65de-4a40-9f5c-ad8b6aa7efb6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.600234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88b6c18d-d379-477f-8afb-5ab42f4bb8d1 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=56d84465-de4b-452e-914d-8e6cc76d4119,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:50.602919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.621621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-88b6c18d-d379-477f-8afb-5ab42f4bb8d1 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.622936 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-88b6c18d-d379-477f-8afb-5ab42f4bb8d1 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4788597 Mar 24 02:13:50.625811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57366) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.628632 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0ce5c135-5f1f-4d4b-8980-af711f962b46 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ae6b345-443c-4040-84bd-8c9058264436 HTTP/1.1" status: 200 len: 205 time: 0.0442307 Mar 24 02:13:50.628632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.631136 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/networks/97acd41e-65de-4a40-9f5c-ad8b6aa7efb6 HTTP/1.1" status: 204 len: 168 time: 0.6650507 Mar 24 02:13:50.633066 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c57b2212-3fa4-45be-ad78-84a6461e6489 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'security_group_rule': {'security_group_id': 'b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8', 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:50.635290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57368) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.635977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57370) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.643179 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1310021782'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:50.667738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Network ae635ae4-cdbd-40ef-9e49-21e17f06f1ca is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:50.672711 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:50.680044 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0fcef6f-a52d-4eff-8ce7-fcedd5f44c22 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Network': ['ID=97acd41e-65de-4a40-9f5c-ad8b6aa7efb6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:50.680413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:50.691782 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d0fe88f2-0fba-4d6f-a26e-af7d59695a54 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:50.696076 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Pushing event updated for resources: {'Port': ['ID=ed8a6065-8e8b-4dc3-9fd0-746afa838732,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:50.714722 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c57b2212-3fa4-45be-ad78-84a6461e6489 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (649ddf49-19e5-4a1d-a151-29713bff1e25), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.739332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d0fe88f2-0fba-4d6f-a26e-af7d59695a54 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:50.739674 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d0fe88f2-0fba-4d6f-a26e-af7d59695a54 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:50.740303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c1365041-777f-49d2-9d87-b692a80b0976 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:50.780882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: c1365041-777f-49d2-9d87-b692a80b0976 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:50.781221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c1365041-777f-49d2-9d87-b692a80b0976 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:50.781813 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c6417f3b-22fb-45bc-92a5-17c345dcb84f no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:50.803475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c57b2212-3fa4-45be-ad78-84a6461e6489 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (649ddf49-19e5-4a1d-a151-29713bff1e25), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.809008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: c6417f3b-22fb-45bc-92a5-17c345dcb84f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:50.809360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c6417f3b-22fb-45bc-92a5-17c345dcb84f not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:50.812843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c57b2212-3fa4-45be-ad78-84a6461e6489 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (649ddf49-19e5-4a1d-a151-29713bff1e25), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.814053 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Attempting to bind port ed8a6065-8e8b-4dc3-9fd0-746afa838732 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:50.814434 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Attempting to bind port ed8a6065-8e8b-4dc3-9fd0-746afa838732 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '4dae513e-c17b-4168-b083-81e2a5baba65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ae635ae4-cdbd-40ef-9e49-21e17f06f1ca'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:50.814826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Attempting to bind port ed8a6065-8e8b-4dc3-9fd0-746afa838732 on network ae635ae4-cdbd-40ef-9e49-21e17f06f1ca {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:50.821051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:50.821374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Checking segment: {'id': '4dae513e-c17b-4168-b083-81e2a5baba65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ae635ae4-cdbd-40ef-9e49-21e17f06f1ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:50.821960 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.822490 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Bound using segment: {'id': '4dae513e-c17b-4168-b083-81e2a5baba65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ae635ae4-cdbd-40ef-9e49-21e17f06f1ca'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:50.823170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Bound port: ed8a6065-8e8b-4dc3-9fd0-746afa838732, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4dae513e-c17b-4168-b083-81e2a5baba65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ae635ae4-cdbd-40ef-9e49-21e17f06f1ca'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:50.823719 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.845850 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c57b2212-3fa4-45be-ad78-84a6461e6489 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.847257 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c57b2212-3fa4-45be-ad78-84a6461e6489 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2206771 Mar 24 02:13:50.852286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57372) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:50.875400 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:13:50.879440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c29f1a4d-f368-46b9-8e5f-031fccab4aff tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'security_group_rule': {'security_group_id': 'b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8', 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:50.892617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (1d2b302e-0646-4d13-8be3-bb6737db4c30), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.894765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c57b2212-3fa4-45be-ad78-84a6461e6489 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=649ddf49-19e5-4a1d-a151-29713bff1e25,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:50.898652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] For port ed8a6065-8e8b-4dc3-9fd0-746afa838732, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:50.902863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] For port ed8a6065-8e8b-4dc3-9fd0-746afa838732, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ed8a6065-8e8b-4dc3-9fd0-746afa838732,segment=NetworkSegment(4dae513e-c17b-4168-b083-81e2a5baba65),segment_id=4dae513e-c17b-4168-b083-81e2a5baba65)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:50.913153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.950457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:50.956190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c29f1a4d-f368-46b9-8e5f-031fccab4aff tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (54660319-cafc-4709-8f87-d0d48930c68b), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.960389 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:50.969502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:50.970089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:50.980597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8cbf7e2a-3517-4a9a-83ab-80a419cd5bad None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:51.011051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=1d2b302e-0646-4d13-8be3-bb6737db4c30,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:51.025204 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-c38c3f7e-59ad-481c-bc10-c73425936cf6 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] delete failed (client error): The resource could not be found. Mar 24 02:13:51.028796 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c38c3f7e-59ad-481c-bc10-c73425936cf6 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/5ae6b345-443c-4040-84bd-8c9058264436 HTTP/1.1" status: 404 len: 336 time: 0.3882411 Mar 24 02:13:51.028796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:51.030130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.034137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57374) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:51.040974 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-72c0b558-8efb-4409-8da3-593cdbc96159 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.9770312 Mar 24 02:13:51.045296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57376) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:51.050436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:51.080055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b634a30-7225-46c1-9b13-7e480149250b None None] Pushing event updated for resources: {'Port': ['ID=ed8a6065-8e8b-4dc3-9fd0-746afa838732,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:51.099908 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d3f20a32-6e0c-47bc-9941-53373613b29d tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "GET /v2.0/ports?device_id=b5ea29cc-f908-4e06-9b0e-23b705106b0f HTTP/1.1" status: 200 len: 205 time: 0.0620446 Mar 24 02:13:51.102310 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57378) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:51.107607 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (5502286a-a0a7-45cd-a920-a7677d14542e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.139869 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 106} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:51.140297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '1d2b302e-0646-4d13-8be3-bb6737db4c30'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:51.142054 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.147298 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=5502286a-a0a7-45cd-a920-a7677d14542e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:51.163359 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-f2ba6f45-2af8-4d43-bab0-cf6cd302ff41 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] delete failed (client error): The resource could not be found. Mar 24 02:13:51.163359 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f2ba6f45-2af8-4d43-bab0-cf6cd302ff41 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/routers/b5ea29cc-f908-4e06-9b0e-23b705106b0f HTTP/1.1" status: 404 len: 336 time: 0.0597022 Mar 24 02:13:51.168938 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57380) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:51.173623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c29f1a4d-f368-46b9-8e5f-031fccab4aff tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (54660319-cafc-4709-8f87-d0d48930c68b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.197065 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (64361f9e-cc6b-4823-a7ba-4e9a794c3111), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.197405 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added segment 64361f9e-cc6b-4823-a7ba-4e9a794c3111 of type vlan for network 99f7ef54-5971-4750-bd3c-eb633e689cd2 Mar 24 02:13:51.206599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c29f1a4d-f368-46b9-8e5f-031fccab4aff tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (54660319-cafc-4709-8f87-d0d48930c68b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.218334 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-a028fa35-8bde-4041-9bdd-47c2b76d8656 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] DELETE failed (client error): The resource could not be found. Mar 24 02:13:51.218817 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a028fa35-8bde-4041-9bdd-47c2b76d8656 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:13:51.221772 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a028fa35-8bde-4041-9bdd-47c2b76d8656 tempest-RoutersIpV6AdminTest-212244696 tempest-RoutersIpV6AdminTest-212244696-project] 10.222.0.20 "DELETE /v2.0/subnets/6723a6f9-b722-45c9-8a12-6ff6721ad967 HTTP/1.1" status: 404 len: 337 time: 0.0502188 Mar 24 02:13:51.238149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c29f1a4d-f368-46b9-8e5f-031fccab4aff tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=54660319-cafc-4709-8f87-d0d48930c68b,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:51.253142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c29f1a4d-f368-46b9-8e5f-031fccab4aff tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.254336 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c29f1a4d-f368-46b9-8e5f-031fccab4aff tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4007568 Mar 24 02:13:51.259800 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57384) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:51.264450 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-44e7927c-0888-4b0f-9114-fda1d065d94c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'security_group_rule': {'security_group_id': 'b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8', 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:51.264602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (ae635ae4-cdbd-40ef-9e49-21e17f06f1ca), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.331050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (99f7ef54-5971-4750-bd3c-eb633e689cd2), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.340245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ae635ae4-cdbd-40ef-9e49-21e17f06f1ca']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:51.350141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:51.354343 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.370746 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-44e7927c-0888-4b0f-9114-fda1d065d94c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Project 615b57fe01bd445f87fb9f1a86851430 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:13:51.379576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (99f7ef54-5971-4750-bd3c-eb633e689cd2), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.385894 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Allocated IP 2001:db8::f816:3eff:fecf:3ee1 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/1d2b302e-0646-4d13-8be3-bb6737db4c30/6098d2e0-efee-4758-80ea-dca48118ba4c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:51.386383 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:51.387027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.405383 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4dae513e-c17b-4168-b083-81e2a5baba65') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:51.405640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4dae513e-c17b-4168-b083-81e2a5baba65') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:51.431286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-44e7927c-0888-4b0f-9114-fda1d065d94c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (43d15f7f-8d4e-43fa-819a-79f83b444853), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.516661 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Network': ['ID=99f7ef54-5971-4750-bd3c-eb633e689cd2,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:51.534277 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-55036fc2-1864-4062-98c4-9c95cc314b52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.8924565 Mar 24 02:13:51.534277 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (4dae513e-c17b-4168-b083-81e2a5baba65), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.534834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 99f7ef54-5971-4750-bd3c-eb633e689cd2 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:51.536612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57386) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:51.542200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'subnet': {'network_id': '99f7ef54-5971-4750-bd3c-eb633e689cd2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:51.589187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-44e7927c-0888-4b0f-9114-fda1d065d94c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (43d15f7f-8d4e-43fa-819a-79f83b444853), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.600602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-44e7927c-0888-4b0f-9114-fda1d065d94c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (43d15f7f-8d4e-43fa-819a-79f83b444853), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.641443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e7927c-0888-4b0f-9114-fda1d065d94c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=43d15f7f-8d4e-43fa-819a-79f83b444853,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:51.644457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Publish callbacks [] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.648231 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-44e7927c-0888-4b0f-9114-fda1d065d94c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.654271 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-44e7927c-0888-4b0f-9114-fda1d065d94c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3934233 Mar 24 02:13:51.656376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.656662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57390) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:51.662552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-86a94cc9-ef10-4882-93a5-c47c8f584b48 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'security_group_rule': {'security_group_id': 'b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8', 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:51.679945 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:51.681975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57392) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:51.684511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.694263 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4dae513e-c17b-4168-b083-81e2a5baba65), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.706350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:51.712696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:51.717521 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:51.721173 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Pushing event updated for resources: {'Port': ['ID=6098d2e0-efee-4758-80ea-dca48118ba4c,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:51.729592 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-86a94cc9-ef10-4882-93a5-c47c8f584b48 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Project 615b57fe01bd445f87fb9f1a86851430 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:13:51.736972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-86a94cc9-ef10-4882-93a5-c47c8f584b48 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (74256289-e756-4b4e-ba7e-ee62867b33b1), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.775282 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 100 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:51.775690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (4dae513e-c17b-4168-b083-81e2a5baba65), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:51.779035 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:51.782746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Attempting to bind port 6098d2e0-efee-4758-80ea-dca48118ba4c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:51.783213 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Attempting to bind port 6098d2e0-efee-4758-80ea-dca48118ba4c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:51.783704 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Attempting to bind port 6098d2e0-efee-4758-80ea-dca48118ba4c on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:51.790423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:51.790831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:51.791234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.791924 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:51.792447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Bound port: 6098d2e0-efee-4758-80ea-dca48118ba4c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:51.793005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.830611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-86a94cc9-ef10-4882-93a5-c47c8f584b48 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (74256289-e756-4b4e-ba7e-ee62867b33b1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.842078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-86a94cc9-ef10-4882-93a5-c47c8f584b48 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (74256289-e756-4b4e-ba7e-ee62867b33b1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.874491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.db.api [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Mar 24 02:13:51.874491 dv-neutron-834874-3-hyperv neutron-server[104036]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Mar 24 02:13:51.874491 dv-neutron-834874-3-hyperv neutron-server[104036]: [parameters: {'id': 'ae635ae4-cdbd-40ef-9e49-21e17f06f1ca'}] Mar 24 02:13:51.874491 dv-neutron-834874-3-hyperv neutron-server[104036]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104036) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:13:51.874925 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG oslo_db.api [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:13:51.879579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] For port 6098d2e0-efee-4758-80ea-dca48118ba4c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:51.882767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] For port 6098d2e0-efee-4758-80ea-dca48118ba4c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=6098d2e0-efee-4758-80ea-dca48118ba4c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:51.889233 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.895145 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86a94cc9-ef10-4882-93a5-c47c8f584b48 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=74256289-e756-4b4e-ba7e-ee62867b33b1,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:51.910205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-83173100-e528-4b1e-b008-1762e7bffa32 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.944071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-86a94cc9-ef10-4882-93a5-c47c8f584b48 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:51.947275 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-86a94cc9-ef10-4882-93a5-c47c8f584b48 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2876863 Mar 24 02:13:51.960492 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57396) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:51.960745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38e02e37-8d27-4b89-94eb-d0a4672194aa None None] Pushing event updated for resources: {'Port': ['ID=6098d2e0-efee-4758-80ea-dca48118ba4c,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:51.979637 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'network': {'name': 'tempest-network-smoke--2038570020', 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'port_security_enabled': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:52.033327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (e0adc6a6-7058-4e9b-a2d4-16c1d9161eda), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.034724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Made reservation on behalf of 615b57fe01bd445f87fb9f1a86851430 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:52.039039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.065436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (f2c288fe-54ac-4876-8b72-9e75353078e1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.106858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Subnet': ['ID=e0adc6a6-7058-4e9b-a2d4-16c1d9161eda,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:52.115817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Checking segment: {'id': '64361f9e-cc6b-4823-a7ba-4e9a794c3111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '99f7ef54-5971-4750-bd3c-eb633e689cd2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:52.116511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network hostable DHCP agents. Network: 99f7ef54-5971-4750-bd3c-eb633e689cd2, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:52.133979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:52.140498 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 99f7ef54-5971-4750-bd3c-eb633e689cd2 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:52.144008 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:52.151645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 131} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:52.157724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:52.158337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.161899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 99f7ef54-5971-4750-bd3c-eb633e689cd2) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:52.168388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:52.169096 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.173835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f6562ac-d6db-4bf2-bb01-f349e4e89b29 None None] Network 99f7ef54-5971-4750-bd3c-eb633e689cd2 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:52.184074 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1377480 Mar 24 02:13:52.189131 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57400) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:52.193358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b448347f-bded-4382-8e80-6253172a6577), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.193701 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Added segment b448347f-bded-4382-8e80-6253172a6577 of type vlan for network 1ff12164-ce98-442e-81ee-e22f78c3a0ff Mar 24 02:13:52.198342 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:4b:af:c1', 'name': 'tempest-NetworksTestDHCPv6-376733751'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:52.207154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b35f1784-e2e9-4b00-aa34-d3b0f35a83d5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=f2c288fe-54ac-4876-8b72-9e75353078e1,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:52.289363 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2884e5f6-defb-402d-823c-9f175ed66e66 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7515454 Mar 24 02:13:52.293774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57402) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:52.298486 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b520fc73-40f1-4c56-8e04-9cee398e4886 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1036844295', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:52.314921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-83173100-e528-4b1e-b008-1762e7bffa32 admin admin] Publish callbacks [] for security_group (f080dd5b-bf50-4fb1-8f0d-2b0297c25ce7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.320561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (1ff12164-ce98-442e-81ee-e22f78c3a0ff), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.324482 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-83173100-e528-4b1e-b008-1762e7bffa32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f080dd5b-bf50-4fb1-8f0d-2b0297c25ce7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.350398 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b520fc73-40f1-4c56-8e04-9cee398e4886 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.352210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b520fc73-40f1-4c56-8e04-9cee398e4886 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.364062 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-83173100-e528-4b1e-b008-1762e7bffa32 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=d183d861b9904ca49ca1d5ba498a7781&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6800480 Mar 24 02:13:52.366212 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57404) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:52.367640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-99f7ef54-5971-4750-bd3c-eb633e689cd2', 'network_id': '99f7ef54-5971-4750-bd3c-eb633e689cd2', 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'fixed_ips': [{'subnet_id': 'e0adc6a6-7058-4e9b-a2d4-16c1d9161eda'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:52.369397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.383182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (ae635ae4-cdbd-40ef-9e49-21e17f06f1ca), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.422114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83173100-e528-4b1e-b008-1762e7bffa32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f080dd5b-bf50-4fb1-8f0d-2b0297c25ce7,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:52.427357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (1ff12164-ce98-442e-81ee-e22f78c3a0ff), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.433400 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:52.434276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.524737 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b520fc73-40f1-4c56-8e04-9cee398e4886 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.539284 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.5793076 Mar 24 02:13:52.543288 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57406) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:52.544342 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b520fc73-40f1-4c56-8e04-9cee398e4886 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.570500 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'admin_state_up': True, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:52.576421 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8e5db90-43f1-4424-b084-ac0270635f6c None None] Network ae635ae4-cdbd-40ef-9e49-21e17f06f1ca requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:52.579584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e98979-cfda-4be7-a495-0df9f0f69d62 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'Network': ['ID=1ff12164-ce98-442e-81ee-e22f78c3a0ff,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:52.623298 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Publish callbacks [] for security_group (f080dd5b-bf50-4fb1-8f0d-2b0297c25ce7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.632702 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 1ff12164-ce98-442e-81ee-e22f78c3a0ff details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:52.637799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:52.658765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b520fc73-40f1-4c56-8e04-9cee398e4886 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.659965 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b520fc73-40f1-4c56-8e04-9cee398e4886 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.3649099 Mar 24 02:13:52.668076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57408) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:52.687947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'port': {'network_id': '99f7ef54-5971-4750-bd3c-eb633e689cd2', 'name': 'tempest-RoutersIpV6Test-98380288'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:52.692955 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6098d2e0-efee-4758-80ea-dca48118ba4c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:52.724658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Publish callbacks [] for security_group (f080dd5b-bf50-4fb1-8f0d-2b0297c25ce7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.727478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (c4a3de90-537a-4022-b079-9feeedff6892), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.728929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (c4a3de90-537a-4022-b079-9feeedff6892), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.753170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Allocated IP 2001:db8::2 (99f7ef54-5971-4750-bd3c-eb633e689cd2/e0adc6a6-7058-4e9b-a2d4-16c1d9161eda/9f1195f9-7086-4fff-b115-8f533dd127e8) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:52.792859 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d2e5b22e-4f09-4d24-a032-5169886097e4 None None] Provisioning complete for port ed8a6065-8e8b-4dc3-9fd0-746afa838732 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:52.793232 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d2e5b22e-4f09-4d24-a032-5169886097e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.798774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Deleting port ed8a6065-8e8b-4dc3-9fd0-746afa838732 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:52.799113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.834833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:52.838770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.859358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] device_id is not set on port ace295fb-9814-42ee-8b9a-35af62ea0ae4 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:52.897251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for router_controller (c4a3de90-537a-4022-b079-9feeedff6892), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:52.924349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.014895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f080dd5b-bf50-4fb1-8f0d-2b0297c25ce7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.017004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.018152 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/f080dd5b-bf50-4fb1-8f0d-2b0297c25ce7 HTTP/1.1" status: 204 len: 168 time: 0.6500442 Mar 24 02:13:53.029862 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] For port ed8a6065-8e8b-4dc3-9fd0-746afa838732, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ed8a6065-8e8b-4dc3-9fd0-746afa838732,segment=NetworkSegment(4dae513e-c17b-4168-b083-81e2a5baba65),segment_id=4dae513e-c17b-4168-b083-81e2a5baba65)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:53.030221 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.046004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 00fecc99-a30c-4d17-84ff-9c9a91a877c4 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:13:53.082295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:53.083072 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.153358 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Calling delete_port for ed8a6065-8e8b-4dc3-9fd0-746afa838732 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:53.191166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] DHCP port deletion for ae635ae4-cdbd-40ef-9e49-21e17f06f1ca request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:13:53.214250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f080dd5b-bf50-4fb1-8f0d-2b0297c25ce7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:53.242641 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.243239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.243908 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.244571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.245061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.245547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.246048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.247709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.248225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.249054 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.249306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d2e5b22e-4f09-4d24-a032-5169886097e4 None None] Current status of the port ed8a6065-8e8b-4dc3-9fd0-746afa838732 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:53.249705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d2e5b22e-4f09-4d24-a032-5169886097e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.249965 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.250669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.250861 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.251193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.251678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06b60038-bd82-45e1-abf1-9802455a989a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.306228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for router_gateway (c4a3de90-537a-4022-b079-9feeedff6892), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.347648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Publish callbacks [] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.391259 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.393047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:53.393434 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.419615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d2e5b22e-4f09-4d24-a032-5169886097e4 None None] For port ed8a6065-8e8b-4dc3-9fd0-746afa838732, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ed8a6065-8e8b-4dc3-9fd0-746afa838732,segment=NetworkSegment(4dae513e-c17b-4168-b083-81e2a5baba65),segment_id=4dae513e-c17b-4168-b083-81e2a5baba65)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:53.453939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d2e5b22e-4f09-4d24-a032-5169886097e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.485016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Network 99f7ef54-5971-4750-bd3c-eb633e689cd2 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:53.491290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57414) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:53.494337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:53.502053 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Pushing event updated for resources: {'Port': ['ID=9f1195f9-7086-4fff-b115-8f533dd127e8,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:53.511347 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:53.521971 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 6098d2e0-efee-4758-80ea-dca48118ba4c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=6098d2e0-efee-4758-80ea-dca48118ba4c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:53.524621 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.527462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] Deleting port ed8a6065-8e8b-4dc3-9fd0-746afa838732 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:53.527836 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.529832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-811471da-f62d-4077-975d-5893f6de10cb None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:53.535870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.536386 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.536740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.537780 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.538116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.539450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.539790 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.540121 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.540474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.540972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.541146 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.541494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.541820 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.542142 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.543058 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:53.558942 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.559722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ed8a6065-8e8b-4dc3-9fd0-746afa838732 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:53.595614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Port': ['ID=ed8a6065-8e8b-4dc3-9fd0-746afa838732,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:53.603354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No DVR routers for this DVR port ed8a6065-8e8b-4dc3-9fd0-746afa838732 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:53.606786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 172.20.0.4 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/f2c288fe-54ac-4876-8b72-9e75353078e1/00fecc99-a30c-4d17-84ff-9c9a91a877c4) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:53.619602 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dbdf6960-782b-49b5-af3e-03427aed1e2e admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=de44dd991a01489cb0ad2761eac48843&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1251228 Mar 24 02:13:53.628530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57416) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:53.658432 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fe4b:afc1 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/1d2b302e-0646-4d13-8be3-bb6737db4c30/00fecc99-a30c-4d17-84ff-9c9a91a877c4) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:53.713117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e5b22e-4f09-4d24-a032-5169886097e4 None None] Pushing event deleted for resources: {'Port': ['ID=ed8a6065-8e8b-4dc3-9fd0-746afa838732,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:53.717115 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: ed8a6065-8e8b-4dc3-9fd0-746afa838732 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:53.717952 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ed8a6065-8e8b-4dc3-9fd0-746afa838732 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Mar 24 02:13:53.733680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 2001:db8::3c3 (99f7ef54-5971-4750-bd3c-eb633e689cd2/e0adc6a6-7058-4e9b-a2d4-16c1d9161eda/ace295fb-9814-42ee-8b9a-35af62ea0ae4) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:53.786510 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Port ed8a6065-8e8b-4dc3-9fd0-746afa838732 not found, will not notify nova. {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Mar 24 02:13:53.799575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] For port ed8a6065-8e8b-4dc3-9fd0-746afa838732, host dv-neutron-834874-3-hyperv, got binding levels [] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:53.799961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.815624 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-18bf57f8-19dc-4bcb-8162-045ca7917704 None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:53.815994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-18bf57f8-19dc-4bcb-8162-045ca7917704 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.822382 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Attempting to bind port 9f1195f9-7086-4fff-b115-8f533dd127e8 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:13:53.822773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Attempting to bind port 9f1195f9-7086-4fff-b115-8f533dd127e8 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '64361f9e-cc6b-4823-a7ba-4e9a794c3111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '99f7ef54-5971-4750-bd3c-eb633e689cd2'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:13:53.823138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Attempting to bind port 9f1195f9-7086-4fff-b115-8f533dd127e8 on network 99f7ef54-5971-4750-bd3c-eb633e689cd2 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:13:53.832179 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (ae635ae4-cdbd-40ef-9e49-21e17f06f1ca), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.857608 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] Calling delete_port for ed8a6065-8e8b-4dc3-9fd0-746afa838732 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:53.870410 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.ipam_backend_mixin [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] Port ed8a6065-8e8b-4dc3-9fd0-746afa838732 was not found and therefore no delete operation was performed {{(pid=104038) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:571}} Mar 24 02:13:53.872790 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:13:53.873161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Checking segment: {'id': '64361f9e-cc6b-4823-a7ba-4e9a794c3111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '99f7ef54-5971-4750-bd3c-eb633e689cd2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:53.873755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.874152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Bound using segment: {'id': '64361f9e-cc6b-4823-a7ba-4e9a794c3111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '99f7ef54-5971-4750-bd3c-eb633e689cd2'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:13:53.874654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Bound port: 9f1195f9-7086-4fff-b115-8f533dd127e8, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64361f9e-cc6b-4823-a7ba-4e9a794c3111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '99f7ef54-5971-4750-bd3c-eb633e689cd2'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:13:53.875037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.879818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ae635ae4-cdbd-40ef-9e49-21e17f06f1ca']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:53.884677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (ed8a6065-8e8b-4dc3-9fd0-746afa838732), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.894972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=6098d2e0-efee-4758-80ea-dca48118ba4c,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:53.911147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.942972 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8ace5e28-9c6b-4901-8bc9-6c3a90706faf admin admin] Publish callbacks [] for security_group (82cf2f8a-b25d-4080-a4f0-eb1f828acedc), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.948669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4dae513e-c17b-4168-b083-81e2a5baba65') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:53.948964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4dae513e-c17b-4168-b083-81e2a5baba65') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:53.950610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.955299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] Pushing event deleted for resources: {'Port': ['ID=ed8a6065-8e8b-4dc3-9fd0-746afa838732,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:53.959716 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90e079fc-8be1-472f-8b4b-b7350de5e025 None None] No DVR routers for this DVR port ed8a6065-8e8b-4dc3-9fd0-746afa838732 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:13:53.981054 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for router_gateway (c4a3de90-537a-4022-b079-9feeedff6892), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:53.986185 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (4dae513e-c17b-4168-b083-81e2a5baba65), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.016160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 99f7ef54-5971-4750-bd3c-eb633e689cd2 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:54.023089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:54.028328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:54.033525 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:54.034222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.038496 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.047660 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=ace295fb-9814-42ee-8b9a-35af62ea0ae4,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:54.054428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8ace5e28-9c6b-4901-8bc9-6c3a90706faf admin admin] Publish callbacks [] for security_group (82cf2f8a-b25d-4080-a4f0-eb1f828acedc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.056505 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4dae513e-c17b-4168-b083-81e2a5baba65), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.069090 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] For port 9f1195f9-7086-4fff-b115-8f533dd127e8, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:13:54.069295 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 927 time: 1.3959465 Mar 24 02:13:54.069295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.069295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.070002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.070186 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.070506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-18bf57f8-19dc-4bcb-8162-045ca7917704 None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:54.070637 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.071061 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.071460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.071859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.072713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.072713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.072982 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.073376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.073789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.074325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57418) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:54.074503 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.074968 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eabc2194-60ca-4dc8-8d46-885c67b5c13d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:13:54.099047 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 100 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:54.099472 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (4dae513e-c17b-4168-b083-81e2a5baba65), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:54.106813 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:54.151261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ec77821-7c40-4635-8c9c-8643ecdf2c62 None None] Update dhcp port {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': '1d2b302e-0646-4d13-8be3-bb6737db4c30', 'ip_address': '2001:db8::f816:3eff:fecf:3ee1'}, {'subnet_id': 'f2c288fe-54ac-4876-8b72-9e75353078e1'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': '6098d2e0-efee-4758-80ea-dca48118ba4c'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:13:54.182274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3ec77821-7c40-4635-8c9c-8643ecdf2c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.281896 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (00fecc99-a30c-4d17-84ff-9c9a91a877c4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.307707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] For port 9f1195f9-7086-4fff-b115-8f533dd127e8, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f1195f9-7086-4fff-b115-8f533dd127e8,segment=NetworkSegment(64361f9e-cc6b-4823-a7ba-4e9a794c3111),segment_id=64361f9e-cc6b-4823-a7ba-4e9a794c3111)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:13:54.314179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.363496 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (ae635ae4-cdbd-40ef-9e49-21e17f06f1ca), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.382189 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b55c5f9-8fef-4939-bc0d-e4d8d86da6e3 None None] Pushing event updated for resources: {'Port': ['ID=9f1195f9-7086-4fff-b115-8f533dd127e8,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:54.397482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.400640 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/ae635ae4-cdbd-40ef-9e49-21e17f06f1ca HTTP/1.1" status: 204 len: 168 time: 4.2065265 Mar 24 02:13:54.407785 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57420) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:54.414415 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1929518328'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:54.425470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084a0e7e-aad5-4d3e-bcca-af92939bee63 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=ae635ae4-cdbd-40ef-9e49-21e17f06f1ca,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:54.443916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:54.451902 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.480134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 145} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:54.491128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1cf99d37-4b24-486b-b8ae-e0571ab11e6a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.491468 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment 1cf99d37-4b24-486b-b8ae-e0571ab11e6a of type vlan for network 5efe4cb6-b6db-4464-8dbd-f168e295408e Mar 24 02:13:54.508517 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8ace5e28-9c6b-4901-8bc9-6c3a90706faf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (82cf2f8a-b25d-4080-a4f0-eb1f828acedc), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.511812 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8ace5e28-9c6b-4901-8bc9-6c3a90706faf admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.513262 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8ace5e28-9c6b-4901-8bc9-6c3a90706faf admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/82cf2f8a-b25d-4080-a4f0-eb1f828acedc HTTP/1.1" status: 204 len: 168 time: 0.8834755 Mar 24 02:13:54.534619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (5efe4cb6-b6db-4464-8dbd-f168e295408e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.539748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Allocated IP 172.26.2.112 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/276b4a0e-938f-4560-8acb-b1e286da1948) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:54.543662 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (00fecc99-a30c-4d17-84ff-9c9a91a877c4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.545314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ace5e28-9c6b-4901-8bc9-6c3a90706faf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82cf2f8a-b25d-4080-a4f0-eb1f828acedc,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:54.586974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (5efe4cb6-b6db-4464-8dbd-f168e295408e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.594725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:54.595634 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.644711 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-3ec77821-7c40-4635-8c9c-8643ecdf2c62 None None] Allocated IP 172.20.0.2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/f2c288fe-54ac-4876-8b72-9e75353078e1/6098d2e0-efee-4758-80ea-dca48118ba4c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:54.681242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:54.700118 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:54.710349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:54.733283 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.3216121 Mar 24 02:13:54.735749 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57426) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:54.741893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': '5efe4cb6-b6db-4464-8dbd-f168e295408e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:54.745694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf31ebc9-5b47-43c2-b1db-ba4718a2d969 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=5efe4cb6-b6db-4464-8dbd-f168e295408e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:54.765118 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 5efe4cb6-b6db-4464-8dbd-f168e295408e details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:54.780183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6098d2e0-efee-4758-80ea-dca48118ba4c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:54.837342 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=00fecc99-a30c-4d17-84ff-9c9a91a877c4,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:54.875937 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:54.876589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.931105 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for port (276b4a0e-938f-4560-8acb-b1e286da1948), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.939502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:54.940435 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3ec77821-7c40-4635-8c9c-8643ecdf2c62 None None] For port 6098d2e0-efee-4758-80ea-dca48118ba4c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=6098d2e0-efee-4758-80ea-dca48118ba4c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:54.946905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.955209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57430) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:54.956032 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dafaff55-d530-4a76-ae46-82916fafdaa1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1026 time: 2.7644317 Mar 24 02:13:54.958244 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:54.958652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.959353 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:54.975282 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:13:55.018284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3ec77821-7c40-4635-8c9c-8643ecdf2c62 None None] Publish callbacks [] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:55.029039 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3ec77821-7c40-4635-8c9c-8643ecdf2c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:55.029912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:55.113531 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af1412a3-3598-4a31-a867-45b3e21cb5e7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:55.124517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af1412a3-3598-4a31-a867-45b3e21cb5e7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:55.126500 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-af1412a3-3598-4a31-a867-45b3e21cb5e7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1862 time: 0.1694224 Mar 24 02:13:55.133638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57434) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:55.181905 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:55.184676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec77821-7c40-4635-8c9c-8643ecdf2c62 None None] Pushing event updated for resources: {'Port': ['ID=6098d2e0-efee-4758-80ea-dca48118ba4c,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:55.193887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:55.207876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:55.232379 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:13:55.261499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ed8a6065-8e8b-4dc3-9fd0-746afa838732 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:13:55.309102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: ed8a6065-8e8b-4dc3-9fd0-746afa838732 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:13:55.309578 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ed8a6065-8e8b-4dc3-9fd0-746afa838732 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:13:55.363821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (e2334f57-37b4-42cc-8409-be8c2d837f6d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:55.428871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=e2334f57-37b4-42cc-8409-be8c2d837f6d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:55.440546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': '1cf99d37-4b24-486b-b8ae-e0571ab11e6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '5efe4cb6-b6db-4464-8dbd-f168e295408e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:55.440920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: 5efe4cb6-b6db-4464-8dbd-f168e295408e, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:55.468044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network 5efe4cb6-b6db-4464-8dbd-f168e295408e is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:55.483041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 5efe4cb6-b6db-4464-8dbd-f168e295408e) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:55.492280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:55.492981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:55.493581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72d00bd0-b2bb-4823-a3f8-97333a4b4461 None None] Network 5efe4cb6-b6db-4464-8dbd-f168e295408e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:55.517665 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7d36171b-6815-4099-87b1-c80e50f53fa5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7804859 Mar 24 02:13:55.520357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57444) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:55.690150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (5efe4cb6-b6db-4464-8dbd-f168e295408e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:55.725036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd8209ac-85a7-4e29-acb1-20bb03fb0df5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-5efe4cb6-b6db-4464-8dbd-f168e295408e', 'network_id': '5efe4cb6-b6db-4464-8dbd-f168e295408e', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': 'e2334f57-37b4-42cc-8409-be8c2d837f6d'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:55.725911 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bd8209ac-85a7-4e29-acb1-20bb03fb0df5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:55.766257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (e2334f57-37b4-42cc-8409-be8c2d837f6d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:55.790868 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'Port': ['ID=276b4a0e-938f-4560-8acb-b1e286da1948,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:55.898468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (e2334f57-37b4-42cc-8409-be8c2d837f6d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:55.946529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=e2334f57-37b4-42cc-8409-be8c2d837f6d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server [None req-bd8209ac-85a7-4e29-acb1-20bb03fb0df5 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet e2334f57-37b4-42cc-8409-be8c2d837f6d: This subnet is being modified by another concurrent operation. Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 278, in create_dhcp_port Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:13:55.949967 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1504, in create_port Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1469, in _create_port_db Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1467, in create_port_db Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 691, in _ipam_get_subnets Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnet.lock_register( Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise exception Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet e2334f57-37b4-42cc-8409-be8c2d837f6d: This subnet is being modified by another concurrent operation. Mar 24 02:13:55.953384 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Mar 24 02:13:56.009253 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5c18451b-4bda-4209-bcb1-cb89e2dfe19f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 00fecc99-a30c-4d17-84ff-9c9a91a877c4 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:13:56.009607 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c18451b-4bda-4209-bcb1-cb89e2dfe19f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (00fecc99-a30c-4d17-84ff-9c9a91a877c4), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.027390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eba1426e-70c7-433e-b111-efe115f9838e None None] Network 5efe4cb6-b6db-4464-8dbd-f168e295408e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:56.053103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (5efe4cb6-b6db-4464-8dbd-f168e295408e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.110013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5efe4cb6-b6db-4464-8dbd-f168e295408e']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:56.119336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.144269 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1cf99d37-4b24-486b-b8ae-e0571ab11e6a') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:56.145128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1cf99d37-4b24-486b-b8ae-e0571ab11e6a') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:56.159904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (1cf99d37-4b24-486b-b8ae-e0571ab11e6a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.186370 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1cf99d37-4b24-486b-b8ae-e0571ab11e6a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.194367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 145 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:13:56.195014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (1cf99d37-4b24-486b-b8ae-e0571ab11e6a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.204129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:13:56.227273 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:13:56.276234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f21ea21-e771-4e3c-873d-71e368e51be1 None None] Network 99f7ef54-5971-4750-bd3c-eb633e689cd2 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:56.305041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (5efe4cb6-b6db-4464-8dbd-f168e295408e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.311765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.317903 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/5efe4cb6-b6db-4464-8dbd-f168e295408e HTTP/1.1" status: 204 len: 168 time: 0.7938757 Mar 24 02:13:56.328458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57456) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:56.368005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1598991703'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:56.395126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78aa61bd-116e-410a-bb9a-31550f23a8ca tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=5efe4cb6-b6db-4464-8dbd-f168e295408e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:56.400062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:56.404368 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.424756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c18451b-4bda-4209-bcb1-cb89e2dfe19f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (00fecc99-a30c-4d17-84ff-9c9a91a877c4), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.456906 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5c18451b-4bda-4209-bcb1-cb89e2dfe19f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 00fecc99-a30c-4d17-84ff-9c9a91a877c4 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:13:56.461849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 132} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:13:56.473284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=ace295fb-9814-42ee-8b9a-35af62ea0ae4,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:56.479459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4cecb672-f3de-42ea-b8ba-4e9d580ce805), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.480223 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment 4cecb672-f3de-42ea-b8ba-4e9d580ce805 of type vlan for network 39216f75-889f-4474-ad77-7887f16468aa Mar 24 02:13:56.504066 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2143620a-9cb6-4be8-868c-69783c4f4ef1 None None] Provisioning complete for port 9f1195f9-7086-4fff-b115-8f533dd127e8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:56.505208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2143620a-9cb6-4be8-868c-69783c4f4ef1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.634980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (39216f75-889f-4474-ad77-7887f16468aa), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.636099 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2143620a-9cb6-4be8-868c-69783c4f4ef1 None None] Current status of the port 9f1195f9-7086-4fff-b115-8f533dd127e8 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:56.636501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2143620a-9cb6-4be8-868c-69783c4f4ef1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.688607 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.689898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2143620a-9cb6-4be8-868c-69783c4f4ef1 None None] For port 9f1195f9-7086-4fff-b115-8f533dd127e8, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f1195f9-7086-4fff-b115-8f533dd127e8,segment=NetworkSegment(64361f9e-cc6b-4823-a7ba-4e9a794c3111),segment_id=64361f9e-cc6b-4823-a7ba-4e9a794c3111)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:13:56.690823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for router_gateway (c4a3de90-537a-4022-b079-9feeedff6892), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.707405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (39216f75-889f-4474-ad77-7887f16468aa), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.712811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:56.713397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.721237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2143620a-9cb6-4be8-868c-69783c4f4ef1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.797795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f1195f9-7086-4fff-b115-8f533dd127e8 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:56.853429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2143620a-9cb6-4be8-868c-69783c4f4ef1 None None] Pushing event updated for resources: {'Port': ['ID=9f1195f9-7086-4fff-b115-8f533dd127e8,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:56.855154 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.5212154 Mar 24 02:13:56.856496 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57468) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:56.866540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': '39216f75-889f-4474-ad77-7887f16468aa', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:56.867626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9a3e27-ac6d-49c7-a38a-dfdeff34a7e9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=39216f75-889f-4474-ad77-7887f16468aa,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:56.896042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9a6cfb84-d4cb-4ccd-9f9c-96907e1f0a56 None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:56.897279 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9a6cfb84-d4cb-4ccd-9f9c-96907e1f0a56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:56.900638 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 39216f75-889f-4474-ad77-7887f16468aa details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:13:56.902692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57470) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:56.991256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5680e6c0-0fd0-4e2e-82a4-50d813364c9e None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:13:57.044959 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-936a71bf-8524-49c8-b00e-3fa6f01a6d6f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Request body: {'router': {'name': 'tempest-pretest-check-1864252372'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:57.048830 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9f1195f9-7086-4fff-b115-8f533dd127e8 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:57.049205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.070737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-936a71bf-8524-49c8-b00e-3fa6f01a6d6f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (9c0ffc65-744a-4430-ba66-99e83d00eb9a), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.071392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-936a71bf-8524-49c8-b00e-3fa6f01a6d6f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (9c0ffc65-744a-4430-ba66-99e83d00eb9a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.170774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.194317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:57.194606 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9a6cfb84-d4cb-4ccd-9f9c-96907e1f0a56 None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:57.197704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.231905 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5680e6c0-0fd0-4e2e-82a4-50d813364c9e None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:13:57.246869 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9f1195f9-7086-4fff-b115-8f533dd127e8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:57.247891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6098d2e0-efee-4758-80ea-dca48118ba4c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:57.254049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9a6cfb84-d4cb-4ccd-9f9c-96907e1f0a56 None None] Provisioning complete for port 00fecc99-a30c-4d17-84ff-9c9a91a877c4 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:57.254352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9a6cfb84-d4cb-4ccd-9f9c-96907e1f0a56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (00fecc99-a30c-4d17-84ff-9c9a91a877c4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.311712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Performing IP validity checks on allocation pools {{(pid=104036) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:322}} Mar 24 02:13:57.312221 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking for overlaps among allocation pools and gateway ip {{(pid=104036) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:343}} Mar 24 02:13:57.320112 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c18451b-4bda-4209-bcb1-cb89e2dfe19f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (00fecc99-a30c-4d17-84ff-9c9a91a877c4), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.356087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-936a71bf-8524-49c8-b00e-3fa6f01a6d6f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (9c0ffc65-744a-4430-ba66-99e83d00eb9a), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.361816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-936a71bf-8524-49c8-b00e-3fa6f01a6d6f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (9c0ffc65-744a-4430-ba66-99e83d00eb9a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.377255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-936a71bf-8524-49c8-b00e-3fa6f01a6d6f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.378636 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-936a71bf-8524-49c8-b00e-3fa6f01a6d6f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 729 time: 0.4747624 Mar 24 02:13:57.381585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57474) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:57.393802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9a6cfb84-d4cb-4ccd-9f9c-96907e1f0a56 None None] Port 00fecc99-a30c-4d17-84ff-9c9a91a877c4 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:57.400122 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-31d9ec77-529e-4e8f-b9a9-ff013db5f68a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.423314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:57.423314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.438641 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c18451b-4bda-4209-bcb1-cb89e2dfe19f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=00fecc99-a30c-4d17-84ff-9c9a91a877c4,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:57.441100 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (c4a3de90-537a-4022-b079-9feeedff6892), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.466951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc88e802-3852-4182-a45e-4ffe9a33c327 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (9c0ffc65-744a-4430-ba66-99e83d00eb9a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.569720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b9a94fbd-a0f8-4392-ac30-4a23afa98281 None None] Provisioning complete for port ace295fb-9814-42ee-8b9a-35af62ea0ae4 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:57.569720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b9a94fbd-a0f8-4392-ac30-4a23afa98281 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.619181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:57.633002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b9a94fbd-a0f8-4392-ac30-4a23afa98281 None None] Port ace295fb-9814-42ee-8b9a-35af62ea0ae4 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:57.644723 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b9a94fbd-a0f8-4392-ac30-4a23afa98281 None None] Provisioning complete for port 9f1195f9-7086-4fff-b115-8f533dd127e8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:57.645455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b9a94fbd-a0f8-4392-ac30-4a23afa98281 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.652558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc88e802-3852-4182-a45e-4ffe9a33c327 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (9c0ffc65-744a-4430-ba66-99e83d00eb9a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.655320 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc88e802-3852-4182-a45e-4ffe9a33c327 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (9c0ffc65-744a-4430-ba66-99e83d00eb9a), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.718898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc88e802-3852-4182-a45e-4ffe9a33c327 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (9c0ffc65-744a-4430-ba66-99e83d00eb9a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.718898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc88e802-3852-4182-a45e-4ffe9a33c327 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 9c0ffc65-744a-4430-ba66-99e83d00eb9a {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:57.723885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc88e802-3852-4182-a45e-4ffe9a33c327 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.724836 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dc88e802-3852-4182-a45e-4ffe9a33c327 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "DELETE /v2.0/routers/9c0ffc65-744a-4430-ba66-99e83d00eb9a HTTP/1.1" status: 204 len: 168 time: 0.3422425 Mar 24 02:13:57.733951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57476) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:57.741808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-26f7b3fb-e399-4403-b5ff-31fc7651880f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Request body: {'router': {'name': 'tempest-router-2108883065', 'distributed': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:57.748920 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c18451b-4bda-4209-bcb1-cb89e2dfe19f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.754704 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5c18451b-4bda-4209-bcb1-cb89e2dfe19f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/00fecc99-a30c-4d17-84ff-9c9a91a877c4 HTTP/1.1" status: 204 len: 168 time: 2.6177406 Mar 24 02:13:57.755471 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57478) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:57.758978 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b9a94fbd-a0f8-4392-ac30-4a23afa98281 None None] Current status of the port 9f1195f9-7086-4fff-b115-8f533dd127e8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:57.828394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba06e214-5fa5-4e12-89f4-fd0b685bcab7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:57.829868 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba06e214-5fa5-4e12-89f4-fd0b685bcab7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:57.831253 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba06e214-5fa5-4e12-89f4-fd0b685bcab7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:57.832969 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ba06e214-5fa5-4e12-89f4-fd0b685bcab7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.0758171 Mar 24 02:13:57.835687 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57480) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:57.902692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-412ab5eb-8b9d-4895-92ac-d029bce288bb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 1d2b302e-0646-4d13-8be3-bb6737db4c30 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:57.906761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-412ab5eb-8b9d-4895-92ac-d029bce288bb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (1d2b302e-0646-4d13-8be3-bb6737db4c30), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:57.952018 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-412ab5eb-8b9d-4895-92ac-d029bce288bb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (1d2b302e-0646-4d13-8be3-bb6737db4c30), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.051152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-412ab5eb-8b9d-4895-92ac-d029bce288bb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (1d2b302e-0646-4d13-8be3-bb6737db4c30), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.100692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3f9b2f0f-a420-47f0-90ec-c8872cf95db6 None None] Provisioning complete for port ace295fb-9814-42ee-8b9a-35af62ea0ae4 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:58.101788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3f9b2f0f-a420-47f0-90ec-c8872cf95db6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.131770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-412ab5eb-8b9d-4895-92ac-d029bce288bb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (1d2b302e-0646-4d13-8be3-bb6737db4c30), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.163285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f2603cc-84f5-4819-9618-c28c2acbbdbe None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:58.170989 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (a001d522-44db-428e-aa7c-f3f5c380a450), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.171563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-412ab5eb-8b9d-4895-92ac-d029bce288bb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.175204 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-412ab5eb-8b9d-4895-92ac-d029bce288bb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/1d2b302e-0646-4d13-8be3-bb6737db4c30 HTTP/1.1" status: 204 len: 168 time: 0.3381817 Mar 24 02:13:58.176650 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412ab5eb-8b9d-4895-92ac-d029bce288bb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=1d2b302e-0646-4d13-8be3-bb6737db4c30,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:58.178977 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57482) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:58.191574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3f9b2f0f-a420-47f0-90ec-c8872cf95db6 None None] Port ace295fb-9814-42ee-8b9a-35af62ea0ae4 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:58.197882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-26f7b3fb-e399-4403-b5ff-31fc7651880f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (8d53dc7e-9e0e-47bc-973c-c591c033d653), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.198930 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-26f7b3fb-e399-4403-b5ff-31fc7651880f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (8d53dc7e-9e0e-47bc-973c-c591c033d653), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.251569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-e59a43f1-3687-45d3-b3b8-ffb16ee5c6c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet f2c288fe-54ac-4876-8b72-9e75353078e1 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:13:58.254956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e59a43f1-3687-45d3-b3b8-ffb16ee5c6c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (f2c288fe-54ac-4876-8b72-9e75353078e1), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.301610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e59a43f1-3687-45d3-b3b8-ffb16ee5c6c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (f2c288fe-54ac-4876-8b72-9e75353078e1), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.342224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.350393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=a001d522-44db-428e-aa7c-f3f5c380a450,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:58.352590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Router c4a3de90-537a-4022-b079-9feeedff6892 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:58.360870 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.361649 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.364892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-26f7b3fb-e399-4403-b5ff-31fc7651880f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (8d53dc7e-9e0e-47bc-973c-c591c033d653), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.378960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-26f7b3fb-e399-4403-b5ff-31fc7651880f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (8d53dc7e-9e0e-47bc-973c-c591c033d653), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.403053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e59a43f1-3687-45d3-b3b8-ffb16ee5c6c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (f2c288fe-54ac-4876-8b72-9e75353078e1), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.417024 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5b1d3a8b-891c-4d05-9c31-935acd8dd149 None None] Provisioning complete for port ace295fb-9814-42ee-8b9a-35af62ea0ae4 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:58.417889 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5b1d3a8b-891c-4d05-9c31-935acd8dd149 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.432277 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': '4cecb672-f3de-42ea-b8ba-4e9d580ce805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '39216f75-889f-4474-ad77-7887f16468aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:13:58.432634 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: 39216f75-889f-4474-ad77-7887f16468aa, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:13:58.460380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5b1d3a8b-891c-4d05-9c31-935acd8dd149 None None] Port ace295fb-9814-42ee-8b9a-35af62ea0ae4 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:13:58.485196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e59a43f1-3687-45d3-b3b8-ffb16ee5c6c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (f2c288fe-54ac-4876-8b72-9e75353078e1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.511843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e59a43f1-3687-45d3-b3b8-ffb16ee5c6c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=f2c288fe-54ac-4876-8b72-9e75353078e1,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:58.517575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e59a43f1-3687-45d3-b3b8-ffb16ee5c6c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.522039 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e59a43f1-3687-45d3-b3b8-ffb16ee5c6c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/f2c288fe-54ac-4876-8b72-9e75353078e1 HTTP/1.1" status: 204 len: 168 time: 0.3373795 Mar 24 02:13:58.524437 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57484) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:58.531872 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-26f7b3fb-e399-4403-b5ff-31fc7651880f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.536066 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-26f7b3fb-e399-4403-b5ff-31fc7651880f tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.7991724 Mar 24 02:13:58.547260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57486) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:58.571474 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-63bb8cbf-ce46-463e-bb00-2895794da042 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0423238 Mar 24 02:13:58.571675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57488) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:58.576835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:58.609454 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=ace295fb-9814-42ee-8b9a-35af62ea0ae4,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:13:58.631612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f1195f9-7086-4fff-b115-8f533dd127e8 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:13:58.675584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:58.680376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.682024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network 39216f75-889f-4474-ad77-7887f16468aa is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:13:58.701200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9f1195f9-7086-4fff-b115-8f533dd127e8 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:58.701725 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.704662 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f1e91a79-5530-4504-bb2d-b5d1233b616c tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (8d53dc7e-9e0e-47bc-973c-c591c033d653), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.785772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 39216f75-889f-4474-ad77-7887f16468aa) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:58.799284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:58.800129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.813272 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9f1195f9-7086-4fff-b115-8f533dd127e8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:58.822354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:58.822955 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55c61926-9eb1-47b4-bb12-0ef9efdb16a1 None None] Network 39216f75-889f-4474-ad77-7887f16468aa requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:58.826164 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 99f7ef54-5971-4750-bd3c-eb633e689cd2 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:13:58.830599 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-07b540c9-f10b-4bff-aa6c-dfc796cc8995 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 800 time: 1.9694679 Mar 24 02:13:58.833191 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57490) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:58.851237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:13:58.861584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:58.873210 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-642894d0-8373-420f-acfe-3260c71a8d9c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 6.3125229 Mar 24 02:13:58.875401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57492) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:58.881239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Sync routers for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:58.904746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:58.905378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:59.030486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:13:59.207040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:13:59.231044 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f1e91a79-5530-4504-bb2d-b5d1233b616c tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (8d53dc7e-9e0e-47bc-973c-c591c033d653), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.235024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f1e91a79-5530-4504-bb2d-b5d1233b616c tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (8d53dc7e-9e0e-47bc-973c-c591c033d653), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.241083 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-def14b8d-c2dc-4c73-a4f1-e4070c8152ff tempest-TestNetworkAdvancedServerOps-1843693347 tempest-TestNetworkAdvancedServerOps-1843693347-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=615b57fe01bd445f87fb9f1a86851430&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.3247511 Mar 24 02:13:59.242163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57496) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:59.307132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c660dd0-ead4-4bdd-9349-96daee80a9b5 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:13:59.331974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (39216f75-889f-4474-ad77-7887f16468aa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.376282 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f1e91a79-5530-4504-bb2d-b5d1233b616c tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (8d53dc7e-9e0e-47bc-973c-c591c033d653), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.376651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1e91a79-5530-4504-bb2d-b5d1233b616c tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 8d53dc7e-9e0e-47bc-973c-c591c033d653 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:13:59.390115 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f1e91a79-5530-4504-bb2d-b5d1233b616c tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.395701 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f1e91a79-5530-4504-bb2d-b5d1233b616c tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "DELETE /v2.0/routers/8d53dc7e-9e0e-47bc-973c-c591c033d653 HTTP/1.1" status: 204 len: 168 time: 0.8471358 Mar 24 02:13:59.396540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57498) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:59.399915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c56fe5d3-258c-4b20-a03f-6146a6669c85 None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:13:59.400289 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c56fe5d3-258c-4b20-a03f-6146a6669c85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.413677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-809c3152-ff53-44aa-a778-d621a772abf1 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Request body: {'router': {'name': 'tempest-router-97294304', 'distributed': False, 'admin_state_up': False, 'ha': False, 'project_id': '3116e0862cdc4bc1a1fdb36e4828baaa'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:59.470881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (a001d522-44db-428e-aa7c-f3f5c380a450), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.476221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-39216f75-889f-4474-ad77-7887f16468aa', 'network_id': '39216f75-889f-4474-ad77-7887f16468aa', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': 'a001d522-44db-428e-aa7c-f3f5c380a450'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:13:59.477141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.488651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1f9f708-0ad9-41bc-92c5-d8e91ebad270 tempest-TestNetworkAdvancedServerOps-1843693347 tempest-TestNetworkAdvancedServerOps-1843693347-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:59.490427 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b1f9f708-0ad9-41bc-92c5-d8e91ebad270 tempest-TestNetworkAdvancedServerOps-1843693347 tempest-TestNetworkAdvancedServerOps-1843693347-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2471011 Mar 24 02:13:59.493896 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-809c3152-ff53-44aa-a778-d621a772abf1 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.495080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-809c3152-ff53-44aa-a778-d621a772abf1 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.498321 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57500) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:59.510338 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router b8e596ba-618f-41f8-bbbe-bb5dd1173dcb is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:13:59.550934 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-14b96060-1f8b-4615-81b6-5b145ede40f4 tempest-TestNetworkAdvancedServerOps-1843693347 tempest-TestNetworkAdvancedServerOps-1843693347-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0479362 Mar 24 02:13:59.553859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57502) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:59.559128 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-460092765', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:59.711418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-809c3152-ff53-44aa-a778-d621a772abf1 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.726950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-809c3152-ff53-44aa-a778-d621a772abf1 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.732986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c56fe5d3-258c-4b20-a03f-6146a6669c85 None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:13:59.754113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:13:56Z', 'revision_number': 3, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:13:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:59.769018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-809c3152-ff53-44aa-a778-d621a772abf1 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.773056 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-809c3152-ff53-44aa-a778-d621a772abf1 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.3661649 Mar 24 02:13:59.773056 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57504) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:59.778437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Request body: {'router': {'distributed': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:13:59.780501 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Made reservation on behalf of 615b57fe01bd445f87fb9f1a86851430 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:13:59.782437 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.783943 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:13:59.790067 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Checking router: c4a3de90-537a-4022-b079-9feeedff6892 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:13:59.790419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Updating router c4a3de90-537a-4022-b079-9feeedff6892 port 276b4a0e-938f-4560-8acb-b1e286da1948 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:13:59.798631 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:13:59.812776 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d554ef5-176a-4f11-a9a3-2f1bdcaa3d6a None None] Sync routers for ids ['b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:13:59.826415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Allocated IP 172.20.0.3 (39216f75-889f-4474-ad77-7887f16468aa/a001d522-44db-428e-aa7c-f3f5c380a450/8868c1a5-3dc9-4e6d-8ca5-a74b623f994f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:13:59.833367 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d554ef5-176a-4f11-a9a3-2f1bdcaa3d6a None None] Routers {'b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:59.834018 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-2d554ef5-176a-4f11-a9a3-2f1bdcaa3d6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:59.872813 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9b183672-c12c-4279-8e06-cf3887559010 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/b8e596ba-618f-41f8-bbbe-bb5dd1173dcb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7922792 Mar 24 02:13:59.875948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57506) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:59.887347 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-2d554ef5-176a-4f11-a9a3-2f1bdcaa3d6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:59.901086 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d554ef5-176a-4f11-a9a3-2f1bdcaa3d6a None None] Routers {'b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:13:59.902074 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-2d554ef5-176a-4f11-a9a3-2f1bdcaa3d6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:13:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:59.951001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-adaf74f6-53fe-414b-84e6-9729bc43a018 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:13:59.955224 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-adaf74f6-53fe-414b-84e6-9729bc43a018 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports/ace295fb-9814-42ee-8b9a-35af62ea0ae4 HTTP/1.1" status: 200 len: 982 time: 0.0756900 Mar 24 02:13:59.955698 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-2d554ef5-176a-4f11-a9a3-2f1bdcaa3d6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:13:59.956459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57510) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:13:59.956655 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d554ef5-176a-4f11-a9a3-2f1bdcaa3d6a None None] The sync data for ids ['b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:13:59.985229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.106348 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7558cf7e-af08-4d6a-baec-320c3fa63d2d None None] Provisioning complete for port ace295fb-9814-42ee-8b9a-35af62ea0ae4 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:00.106909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7558cf7e-af08-4d6a-baec-320c3fa63d2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.219168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7558cf7e-af08-4d6a-baec-320c3fa63d2d None None] Port ace295fb-9814-42ee-8b9a-35af62ea0ae4 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:00.226577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Publish callbacks [] for port (8868c1a5-3dc9-4e6d-8ca5-a74b623f994f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.266129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (8868c1a5-3dc9-4e6d-8ca5-a74b623f994f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.336280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Network 39216f75-889f-4474-ad77-7887f16468aa is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:00.348680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:00.354576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Pushing event updated for resources: {'Port': ['ID=8868c1a5-3dc9-4e6d-8ca5-a74b623f994f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:00.359125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (a001d522-44db-428e-aa7c-f3f5c380a450), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.362950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:00.403053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=a001d522-44db-428e-aa7c-f3f5c380a450,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:00.465555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (39216f75-889f-4474-ad77-7887f16468aa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.467668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.468551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.488647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['39216f75-889f-4474-ad77-7887f16468aa']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:00.517897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4cecb672-f3de-42ea-b8ba-4e9d580ce805') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:00.518390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4cecb672-f3de-42ea-b8ba-4e9d580ce805') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:00.534878 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Attempting to bind port 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:00.535253 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Attempting to bind port 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '4cecb672-f3de-42ea-b8ba-4e9d580ce805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '39216f75-889f-4474-ad77-7887f16468aa'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:00.535663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Attempting to bind port 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f on network 39216f75-889f-4474-ad77-7887f16468aa {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:00.536950 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (4cecb672-f3de-42ea-b8ba-4e9d580ce805), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.550123 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-804057d0-da2f-4505-85e0-9b675cdd246f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.555811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Publish callbacks [] for port (276b4a0e-938f-4560-8acb-b1e286da1948), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.559423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4cecb672-f3de-42ea-b8ba-4e9d580ce805), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.567166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:00.567166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Checking segment: {'id': '4cecb672-f3de-42ea-b8ba-4e9d580ce805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '39216f75-889f-4474-ad77-7887f16468aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:00.567166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.567166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Bound using segment: {'id': '4cecb672-f3de-42ea-b8ba-4e9d580ce805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '39216f75-889f-4474-ad77-7887f16468aa'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:00.567166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Bound port: 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4cecb672-f3de-42ea-b8ba-4e9d580ce805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '39216f75-889f-4474-ad77-7887f16468aa'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:00.567166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8868c1a5-3dc9-4e6d-8ca5-a74b623f994f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.570357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 132 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:00.571563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (4cecb672-f3de-42ea-b8ba-4e9d580ce805), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.577229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.620922 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Get a provider driver handle based on the ha flag: False and distributed flag: True {{(pid=104036) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:160}} Mar 24 02:14:00.621341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Router 47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2 migrating from provider to provider. {{(pid=104036) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:167}} Mar 24 02:14:00.621785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.637568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.642809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.647197 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (44e52247-2dfd-4416-b8c9-7ab69363e1f2), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:00.651444 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:00.665662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.db.api [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Mar 24 02:14:00.665662 dv-neutron-834874-3-hyperv neutron-server[104037]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Mar 24 02:14:00.665662 dv-neutron-834874-3-hyperv neutron-server[104037]: [parameters: {'id': '39216f75-889f-4474-ad77-7887f16468aa'}] Mar 24 02:14:00.665662 dv-neutron-834874-3-hyperv neutron-server[104037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104037) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:14:00.666118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG oslo_db.api [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:14:00.675133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] For port 6098d2e0-efee-4758-80ea-dca48118ba4c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=6098d2e0-efee-4758-80ea-dca48118ba4c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:00.683895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Attempting to bind port 276b4a0e-938f-4560-8acb-b1e286da1948 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:00.684784 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Attempting to bind port 276b4a0e-938f-4560-8acb-b1e286da1948 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:00.685212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Attempting to bind port 276b4a0e-938f-4560-8acb-b1e286da1948 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:00.687090 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5edc608-15ea-47e6-960b-322498f46097 None None] Pushing event updated for resources: {'Port': ['ID=276b4a0e-938f-4560-8acb-b1e286da1948,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:00.711729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:00.712102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:00.712505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.712896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:00.713366 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Bound port: 276b4a0e-938f-4560-8acb-b1e286da1948, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:00.713874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.715671 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-225d2749-06ce-49b3-a27e-7ac38e693d7a None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:00.716398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-225d2749-06ce-49b3-a27e-7ac38e693d7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.743743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.755464 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.760420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.772187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] For port 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:00.778753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'Subnet': ['ID=44e52247-2dfd-4416-b8c9-7ab69363e1f2,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:00.795985 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.scheduler.l3_agent_scheduler [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] No L3 agents can host the router 47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2 Mar 24 02:14:00.800924 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] For port 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8868c1a5-3dc9-4e6d-8ca5-a74b623f994f,segment=NetworkSegment(4cecb672-f3de-42ea-b8ba-4e9d580ce805),segment_id=4cecb672-f3de-42ea-b8ba-4e9d580ce805)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:00.804821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Checking segment: {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:00.805279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Network hostable DHCP agents. Network: 1ff12164-ce98-442e-81ee-e22f78c3a0ff, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:00.825709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (8868c1a5-3dc9-4e6d-8ca5-a74b623f994f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.854284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (bf5b9324-e973-4fdb-838e-8de9265c4c30), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.871672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.882050 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] For port 276b4a0e-938f-4560-8acb-b1e286da1948, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:00.891229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] For port 276b4a0e-938f-4560-8acb-b1e286da1948, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=276b4a0e-938f-4560-8acb-b1e286da1948,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:00.897774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Network 1ff12164-ce98-442e-81ee-e22f78c3a0ff is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:00.905038 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.948004 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:00.948524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 1ff12164-ce98-442e-81ee-e22f78c3a0ff) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:00.948768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=6098d2e0-efee-4758-80ea-dca48118ba4c,revision_number=8']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:00.954268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:00.955417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.957245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:00.970912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Hosts for router 47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2: [] {{(pid=104036) _get_dvr_hosts_for_router /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:329}} Mar 24 02:14:00.975669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e183e1-ec89-4a61-a94a-e2c8e4d9cb14 None None] Pushing event updated for resources: {'Port': ['ID=8868c1a5-3dc9-4e6d-8ca5-a74b623f994f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:00.987872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:00.988469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:00.996700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=bf5b9324-e973-4fdb-838e-8de9265c4c30,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:01.008218 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cc86d902-920e-485c-a11a-2a268c269204 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 1.4499736 Mar 24 02:14:01.008218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Hosts for other DVR routers connected to router 47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2: set() {{(pid=104036) _get_other_dvr_hosts /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:346}} Mar 24 02:14:01.009484 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.010911 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3e068612-e1a7-42c5-89c6-c1550664c45d tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "PUT /v2.0/routers/47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2 HTTP/1.1" status: 200 len: 715 time: 1.2366710 Mar 24 02:14:01.011475 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57514) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:01.013139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57516) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:01.037483 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-369e9d74-f94a-4a00-ad20-0f75cca9b510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.4647899 Mar 24 02:14:01.041103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da42ff13-d5ea-4a5e-b102-669c6ff4d6fe None None] Network 1ff12164-ce98-442e-81ee-e22f78c3a0ff requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:01.041807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57518) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:01.046751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:01.082131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5add7f93-4a01-4e82-bc3b-f3511a2255bf None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:01.093074 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c236dda-2f7b-44c6-a6ff-00bfc79c50e3 None None] Network 39216f75-889f-4474-ad77-7887f16468aa requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:01.166580 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (39216f75-889f-4474-ad77-7887f16468aa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.187829 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f2d7296b-82cf-4a5e-a304-48c569c81761 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "GET /v2.0/routers/47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2 HTTP/1.1" status: 200 len: 715 time: 0.1732414 Mar 24 02:14:01.191439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57520) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:01.240706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port ace295fb-9814-42ee-8b9a-35af62ea0ae4 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:01.241593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.284447 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:01.287613 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.350212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-225d2749-06ce-49b3-a27e-7ac38e693d7a None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:01.377442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:01.378080 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:01.426010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.446084 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Deleting port 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:01.446308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (8868c1a5-3dc9-4e6d-8ca5-a74b623f994f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.454743 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-13aecd6d-efe6-42b3-b5eb-a5e6c9cb5ce0 tempest-RoutersTestDVR-1752682114 tempest-RoutersTestDVR-1752682114-project] 10.222.0.20 "GET /v2.0/routers/47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2 HTTP/1.1" status: 200 len: 681 time: 0.2620845 Mar 24 02:14:01.457361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57524) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:01.494037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for ace295fb-9814-42ee-8b9a-35af62ea0ae4 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:01.520416 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5edc608-15ea-47e6-960b-322498f46097 None None] Pushing event updated for resources: {'Port': ['ID=276b4a0e-938f-4560-8acb-b1e286da1948,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:01.573111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] For port 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8868c1a5-3dc9-4e6d-8ca5-a74b623f994f,segment=NetworkSegment(4cecb672-f3de-42ea-b8ba-4e9d580ce805),segment_id=4cecb672-f3de-42ea-b8ba-4e9d580ce805)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:01.573111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (8868c1a5-3dc9-4e6d-8ca5-a74b623f994f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.596309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:01.597160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.615699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b678de05-33f7-43ee-8247-094b11649908 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.625153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Calling delete_port for 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:01.646130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:01.820880 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b678de05-33f7-43ee-8247-094b11649908 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.848479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (e9a00e9f-3f7e-47d1-959f-59199b3253f0), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.874047 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b678de05-33f7-43ee-8247-094b11649908 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.892275 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (8868c1a5-3dc9-4e6d-8ca5-a74b623f994f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.896021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Allocated IP 172.20.0.2 (1ff12164-ce98-442e-81ee-e22f78c3a0ff/44e52247-2dfd-4416-b8c9-7ab69363e1f2/c463af66-3216-4df8-b1fe-f12f14f0aa63) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:01.916286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:01.941610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:01.945742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:01.946342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.951650 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ace295fb-9814-42ee-8b9a-35af62ea0ae4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:01.953267 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Port': ['ID=8868c1a5-3dc9-4e6d-8ca5-a74b623f994f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:01.958266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No DVR routers for this DVR port 8868c1a5-3dc9-4e6d-8ca5-a74b623f994f on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:02.009914 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.011983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b678de05-33f7-43ee-8247-094b11649908 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.012891 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b678de05-33f7-43ee-8247-094b11649908 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:14:02.017830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b678de05-33f7-43ee-8247-094b11649908 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.023329 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b678de05-33f7-43ee-8247-094b11649908 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "DELETE /v2.0/routers/47e4f8f1-5c7c-4ab8-a5d3-38d750571dd2 HTTP/1.1" status: 204 len: 168 time: 0.5639136 Mar 24 02:14:02.023329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57526) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:02.023789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=e9a00e9f-3f7e-47d1-959f-59199b3253f0,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:02.027928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=ace295fb-9814-42ee-8b9a-35af62ea0ae4,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:02.051994 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4b7c7da4-cb54-4ed4-ae20-9210495fd112 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Request body: {'router': {'name': 'tempest-router-972496484', 'distributed': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:02.066716 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:13:56Z', 'revision_number': 3, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:02.079214 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-986c1a02-eb98-4385-9b73-31c4f289651b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0336721 Mar 24 02:14:02.114026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57528) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:02.123531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de27026a-4efe-41b4-a812-7e4927e4c88d None None] The sync data for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv is: [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:13:56Z', 'revision_number': 3, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:02.131339 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:e8:7a:49', 'name': 'tempest-NetworksTestDHCPv6-1117311779'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:02.167808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b7c7da4-cb54-4ed4-ae20-9210495fd112 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (b7925cb9-2663-4b7c-a129-5983403c000c), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.167808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b7c7da4-cb54-4ed4-ae20-9210495fd112 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (b7925cb9-2663-4b7c-a129-5983403c000c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.229778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Publish callbacks [] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.242762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.272303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b7c7da4-cb54-4ed4-ae20-9210495fd112 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (b7925cb9-2663-4b7c-a129-5983403c000c), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.287963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b7c7da4-cb54-4ed4-ae20-9210495fd112 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (b7925cb9-2663-4b7c-a129-5983403c000c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.329058 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a528a11f-4a0d-46fd-87eb-c23c1670cee0 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:02.362341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b7c7da4-cb54-4ed4-ae20-9210495fd112 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.364299 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4b7c7da4-cb54-4ed4-ae20-9210495fd112 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 720 time: 0.3230965 Mar 24 02:14:02.366113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Network 1ff12164-ce98-442e-81ee-e22f78c3a0ff is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:02.369428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57530) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:02.414224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Pushing event updated for resources: {'Port': ['ID=c463af66-3216-4df8-b1fe-f12f14f0aa63,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:02.425726 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:02.430005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:02.443040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.477723 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fe5e4d6a-8f01-4f32-8f9d-c0083ee5305d None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:02.478104 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fe5e4d6a-8f01-4f32-8f9d-c0083ee5305d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.511608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6522e7f2-66d8-4207-967b-7c9c08f50d36 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (b7925cb9-2663-4b7c-a129-5983403c000c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.541496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (39216f75-889f-4474-ad77-7887f16468aa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.588595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['39216f75-889f-4474-ad77-7887f16468aa']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:02.616923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4cecb672-f3de-42ea-b8ba-4e9d580ce805') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:02.617223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4cecb672-f3de-42ea-b8ba-4e9d580ce805') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:02.628086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (4cecb672-f3de-42ea-b8ba-4e9d580ce805), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.641744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Attempting to bind port c463af66-3216-4df8-b1fe-f12f14f0aa63 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:02.642208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Attempting to bind port c463af66-3216-4df8-b1fe-f12f14f0aa63 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:02.642892 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Attempting to bind port c463af66-3216-4df8-b1fe-f12f14f0aa63 on network 1ff12164-ce98-442e-81ee-e22f78c3a0ff {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:02.648851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4cecb672-f3de-42ea-b8ba-4e9d580ce805), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.701927 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:02.702218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Checking segment: {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:02.702717 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.703181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Bound using segment: {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:02.703776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Bound port: c463af66-3216-4df8-b1fe-f12f14f0aa63, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:02.704331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.714934 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 132 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:02.715346 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (4cecb672-f3de-42ea-b8ba-4e9d580ce805), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:02.720558 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:02.734135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6098d2e0-efee-4758-80ea-dca48118ba4c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:02.777750 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fe5e4d6a-8f01-4f32-8f9d-c0083ee5305d None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:02.810744 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.873229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:02.873588 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.880393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] For port c463af66-3216-4df8-b1fe-f12f14f0aa63, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:02.882102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (39216f75-889f-4474-ad77-7887f16468aa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:02.936064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] For port c463af66-3216-4df8-b1fe-f12f14f0aa63, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c463af66-3216-4df8-b1fe-f12f14f0aa63,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:02.951381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.012773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d117355-04ae-4467-9346-217175dedef0 None None] Update dhcp port {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': 'bf5b9324-e973-4fdb-838e-8de9265c4c30', 'ip_address': '2001:db8::f816:3eff:fecf:3ee1'}, {'subnet_id': 'e9a00e9f-3f7e-47d1-959f-59199b3253f0'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': '6098d2e0-efee-4758-80ea-dca48118ba4c'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:14:03.039073 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.048097 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/39216f75-889f-4474-ad77-7887f16468aa HTTP/1.1" status: 204 len: 168 time: 4.2128723 Mar 24 02:14:03.067162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57532) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:03.079055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1039799157'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:03.085282 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac208ec-6697-4ac3-a75c-411e96c29962 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=39216f75-889f-4474-ad77-7887f16468aa,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:03.088253 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5d117355-04ae-4467-9346-217175dedef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.097282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59dca183-67c4-446b-a019-989a5d86bdc9 None None] Pushing event updated for resources: {'Port': ['ID=c463af66-3216-4df8-b1fe-f12f14f0aa63,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:03.128759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Allocated IP 172.20.0.1 (1ff12164-ce98-442e-81ee-e22f78c3a0ff/44e52247-2dfd-4416-b8c9-7ab69363e1f2/a241a0ee-a158-4025-8b7b-6e9767042270) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:03.140658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6522e7f2-66d8-4207-967b-7c9c08f50d36 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (b7925cb9-2663-4b7c-a129-5983403c000c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.148849 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6522e7f2-66d8-4207-967b-7c9c08f50d36 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router_controller (b7925cb9-2663-4b7c-a129-5983403c000c), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.187240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:03.230270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:03.237247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.257359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6522e7f2-66d8-4207-967b-7c9c08f50d36 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (b7925cb9-2663-4b7c-a129-5983403c000c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.257889 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6522e7f2-66d8-4207-967b-7c9c08f50d36 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Fanout notify agent at l3_agent the message router_deleted on router b7925cb9-2663-4b7c-a129-5983403c000c {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:14:03.263621 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6522e7f2-66d8-4207-967b-7c9c08f50d36 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.264763 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6522e7f2-66d8-4207-967b-7c9c08f50d36 tempest-RoutersTestDVR-177844952 tempest-RoutersTestDVR-177844952-project-admin] 10.222.0.20 "DELETE /v2.0/routers/b7925cb9-2663-4b7c-a129-5983403c000c HTTP/1.1" status: 204 len: 168 time: 0.8943534 Mar 24 02:14:03.266877 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:03.290585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router b8e596ba-618f-41f8-bbbe-bb5dd1173dcb has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:14:03.406109 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 125} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:03.409222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for port (a241a0ee-a158-4025-8b7b-6e9767042270), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.455336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.483310 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-5d117355-04ae-4467-9346-217175dedef0 None None] Allocated IP 172.20.0.2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/e9a00e9f-3f7e-47d1-959f-59199b3253f0/6098d2e0-efee-4758-80ea-dca48118ba4c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:03.524265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Network 1ff12164-ce98-442e-81ee-e22f78c3a0ff is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:03.536025 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:03.555260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b3f604d5-97ea-4b50-aa85-1d950f7c1c9a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.555892 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment b3f604d5-97ea-4b50-aa85-1d950f7c1c9a of type vlan for network 88d32be6-8a1c-4d27-89b3-fd9950d99483 Mar 24 02:14:03.564655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:03.618561 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'Port': ['ID=a241a0ee-a158-4025-8b7b-6e9767042270,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:03.636573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-5d117355-04ae-4467-9346-217175dedef0 None None] For port 6098d2e0-efee-4758-80ea-dca48118ba4c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=6098d2e0-efee-4758-80ea-dca48118ba4c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:03.649678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.652008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (c4a3de90-537a-4022-b079-9feeedff6892), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.666717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (88d32be6-8a1c-4d27-89b3-fd9950d99483), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.681956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5d117355-04ae-4467-9346-217175dedef0 None None] Publish callbacks [] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.690495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5d117355-04ae-4467-9346-217175dedef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.710621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:03.720368 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57538) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:03.722176 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c9514fae-45ed-4b60-a845-a40db48396e0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/b8e596ba-618f-41f8-bbbe-bb5dd1173dcb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7646844 Mar 24 02:14:03.733391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (88d32be6-8a1c-4d27-89b3-fd9950d99483), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.738992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:03.739585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.741793 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57540) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:03.785347 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d117355-04ae-4467-9346-217175dedef0 None None] Pushing event updated for resources: {'Port': ['ID=6098d2e0-efee-4758-80ea-dca48118ba4c,revision_number=9']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:03.788775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-421e4965-a1a2-494b-96e9-efc7abe955ec None None] Sync routers for ids ['b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:03.841610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 9336a83d-90d4-454f-9310-441a3b790ebb yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:03.861911 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:03.862298 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.7915511 Mar 24 02:14:03.865466 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-421e4965-a1a2-494b-96e9-efc7abe955ec None None] Routers {'b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:03.866096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-421e4965-a1a2-494b-96e9-efc7abe955ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:03.873433 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57544) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:03.880082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': '88d32be6-8a1c-4d27-89b3-fd9950d99483', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:03.904989 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-421e4965-a1a2-494b-96e9-efc7abe955ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:03.914398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-421e4965-a1a2-494b-96e9-efc7abe955ec None None] Routers {'b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:03.915347 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-421e4965-a1a2-494b-96e9-efc7abe955ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:03.927632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf86a7d-7c77-4151-aca9-f446c1693a9c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=88d32be6-8a1c-4d27-89b3-fd9950d99483,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:03.962044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 88d32be6-8a1c-4d27-89b3-fd9950d99483 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:04.009213 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-65120af6-2c18-4dd8-bf9a-c3e1d304fa85 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.019253 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-421e4965-a1a2-494b-96e9-efc7abe955ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:04.020149 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-421e4965-a1a2-494b-96e9-efc7abe955ec None None] The sync data for ids ['b8e596ba-618f-41f8-bbbe-bb5dd1173dcb'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:04.071167 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-b7f92746-90e5-4bb0-b6d9-1d3a4a9fa972 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] remove_router_interface failed (client error): The resource could not be found. Mar 24 02:14:04.076603 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b7f92746-90e5-4bb0-b6d9-1d3a4a9fa972 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/b8e596ba-618f-41f8-bbbe-bb5dd1173dcb/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.3544679 Mar 24 02:14:04.081073 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57546) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:04.122384 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fd08212e-10da-4b7b-91da-99dc8035fd37 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=b8e596ba-618f-41f8-bbbe-bb5dd1173dcb HTTP/1.1" status: 200 len: 205 time: 0.0398259 Mar 24 02:14:04.123697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57550) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:04.173668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.205173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:04.210061 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.286961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-737ac87d-8e75-4950-aa4e-d51637e9b585 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.340519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-65120af6-2c18-4dd8-bf9a-c3e1d304fa85 admin admin] Publish callbacks [] for security_group (c1b556e1-639d-4c08-aa22-093051ff914c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.352349 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-65120af6-2c18-4dd8-bf9a-c3e1d304fa85 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (c1b556e1-639d-4c08-aa22-093051ff914c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.417855 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 172.20.0.5 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/e9a00e9f-3f7e-47d1-959f-59199b3253f0/9336a83d-90d4-454f-9310-441a3b790ebb) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:04.430635 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-65120af6-2c18-4dd8-bf9a-c3e1d304fa85 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=3116e0862cdc4bc1a1fdb36e4828baaa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6765149 Mar 24 02:14:04.430744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57552) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:04.435716 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65120af6-2c18-4dd8-bf9a-c3e1d304fa85 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1b556e1-639d-4c08-aa22-093051ff914c,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:04.446948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fee8:7a49 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/bf5b9324-e973-4fdb-838e-8de9265c4c30/9336a83d-90d4-454f-9310-441a3b790ebb) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:04.520494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-989afd74-023f-4409-9ed0-7b8db8f97b78 None None] Network 1ff12164-ce98-442e-81ee-e22f78c3a0ff requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:04.584224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-248db41a-605e-4673-bf20-2adffb3f050d admin admin] Publish callbacks [] for security_group (c1b556e1-639d-4c08-aa22-093051ff914c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.619229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-737ac87d-8e75-4950-aa4e-d51637e9b585 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.624190 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-737ac87d-8e75-4950-aa4e-d51637e9b585 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.648665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5a139b8a-31d5-497c-9950-9c180c1e38e3 None None] Provisioning complete for port c463af66-3216-4df8-b1fe-f12f14f0aa63 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:04.649342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5a139b8a-31d5-497c-9950-9c180c1e38e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.662653 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-248db41a-605e-4673-bf20-2adffb3f050d admin admin] Publish callbacks [] for security_group (c1b556e1-639d-4c08-aa22-093051ff914c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.750730 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-737ac87d-8e75-4950-aa4e-d51637e9b585 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (b8e596ba-618f-41f8-bbbe-bb5dd1173dcb), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.751260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-737ac87d-8e75-4950-aa4e-d51637e9b585 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Fanout notify agent at l3_agent the message router_deleted on router b8e596ba-618f-41f8-bbbe-bb5dd1173dcb {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:14:04.758512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-737ac87d-8e75-4950-aa4e-d51637e9b585 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.762385 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-737ac87d-8e75-4950-aa4e-d51637e9b585 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/b8e596ba-618f-41f8-bbbe-bb5dd1173dcb HTTP/1.1" status: 204 len: 168 time: 0.5999467 Mar 24 02:14:04.762958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57554) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:04.812778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5a139b8a-31d5-497c-9950-9c180c1e38e3 None None] Current status of the port c463af66-3216-4df8-b1fe-f12f14f0aa63 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:04.813183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5a139b8a-31d5-497c-9950-9c180c1e38e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.848114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (6a055c46-d6bc-4261-80c7-ca6a1d86e1b3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.853650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-5a139b8a-31d5-497c-9950-9c180c1e38e3 None None] For port c463af66-3216-4df8-b1fe-f12f14f0aa63, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c463af66-3216-4df8-b1fe-f12f14f0aa63,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:04.859302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5a139b8a-31d5-497c-9950-9c180c1e38e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.922729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 276b4a0e-938f-4560-8acb-b1e286da1948 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:04.961718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a139b8a-31d5-497c-9950-9c180c1e38e3 None None] Pushing event updated for resources: {'Port': ['ID=c463af66-3216-4df8-b1fe-f12f14f0aa63,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:04.976207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (9336a83d-90d4-454f-9310-441a3b790ebb), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:04.992759 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9269c926-a2ae-45b1-b43c-6c1dc90233b4 None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:04.993368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9269c926-a2ae-45b1-b43c-6c1dc90233b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.003526 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=6a055c46-d6bc-4261-80c7-ca6a1d86e1b3,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:05.037360 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': 'b3f604d5-97ea-4b50-aa85-1d950f7c1c9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '88d32be6-8a1c-4d27-89b3-fd9950d99483'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:05.037754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: 88d32be6-8a1c-4d27-89b3-fd9950d99483, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:05.039701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 276b4a0e-938f-4560-8acb-b1e286da1948 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:05.040077 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.046755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-708d31c1-8757-4989-8b83-1640e39b5f38 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting subnet e0adc6a6-7058-4e9b-a2d4-16c1d9161eda {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:05.063253 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-708d31c1-8757-4989-8b83-1640e39b5f38 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (e0adc6a6-7058-4e9b-a2d4-16c1d9161eda), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.077915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (9336a83d-90d4-454f-9310-441a3b790ebb), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.085756 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network 88d32be6-8a1c-4d27-89b3-fd9950d99483 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:05.148212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 88d32be6-8a1c-4d27-89b3-fd9950d99483) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:05.156632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:05.157376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.166456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a671f78-d87b-44b5-a9d3-d07ece3b7469 None None] Network 88d32be6-8a1c-4d27-89b3-fd9950d99483 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:05.170401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-248db41a-605e-4673-bf20-2adffb3f050d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (c1b556e1-639d-4c08-aa22-093051ff914c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.173326 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-248db41a-605e-4673-bf20-2adffb3f050d admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.176260 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-248db41a-605e-4673-bf20-2adffb3f050d admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/c1b556e1-639d-4c08-aa22-093051ff914c HTTP/1.1" status: 204 len: 168 time: 0.7431042 Mar 24 02:14:05.176796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:05.188288 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9269c926-a2ae-45b1-b43c-6c1dc90233b4 None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:05.188640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:05.191275 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:05.196851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=9336a83d-90d4-454f-9310-441a3b790ebb,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:05.204145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-708d31c1-8757-4989-8b83-1640e39b5f38 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (e0adc6a6-7058-4e9b-a2d4-16c1d9161eda), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.230689 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-248db41a-605e-4673-bf20-2adffb3f050d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1b556e1-639d-4c08-aa22-093051ff914c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:05.264220 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for port (a241a0ee-a158-4025-8b7b-6e9767042270), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.277971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.298875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:05.299728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.319997 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-02eebd6d-a144-497c-92f0-e7f4beb28a5a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 1.4423170 Mar 24 02:14:05.321415 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57558) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:05.364029 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5f4b87db-fea5-4e59-a605-998d727e802b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 3.2488966 Mar 24 02:14:05.378786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57560) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:05.382758 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (c4a3de90-537a-4022-b079-9feeedff6892), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.465932 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 276b4a0e-938f-4560-8acb-b1e286da1948 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:05.466316 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.508863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f44fcc01-01b1-414c-b5c5-74be56aac254 None None] Provisioning complete for port a241a0ee-a158-4025-8b7b-6e9767042270 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:05.509239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f44fcc01-01b1-414c-b5c5-74be56aac254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.516346 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 276b4a0e-938f-4560-8acb-b1e286da1948, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=276b4a0e-938f-4560-8acb-b1e286da1948,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:05.541303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (88d32be6-8a1c-4d27-89b3-fd9950d99483), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.559573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.560361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c463af66-3216-4df8-b1fe-f12f14f0aa63 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:05.597559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7c6a190-ec62-4542-a1a6-24f276c32280 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-88d32be6-8a1c-4d27-89b3-fd9950d99483', 'network_id': '88d32be6-8a1c-4d27-89b3-fd9950d99483', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': '6a055c46-d6bc-4261-80c7-ca6a1d86e1b3'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:05.598427 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e7c6a190-ec62-4542-a1a6-24f276c32280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.673147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f44fcc01-01b1-414c-b5c5-74be56aac254 None None] Port a241a0ee-a158-4025-8b7b-6e9767042270 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:05.693813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'Port': ['ID=a241a0ee-a158-4025-8b7b-6e9767042270,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:05.708084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-708d31c1-8757-4989-8b83-1640e39b5f38 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (e0adc6a6-7058-4e9b-a2d4-16c1d9161eda), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.725076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (6a055c46-d6bc-4261-80c7-ca6a1d86e1b3), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.776684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=276b4a0e-938f-4560-8acb-b1e286da1948,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:05.784359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9b0d1dc-7829-434e-b153-cfae956897e9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:05.791872 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9b0d1dc-7829-434e-b153-cfae956897e9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:05.797003 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e9b0d1dc-7829-434e-b153-cfae956897e9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1863 time: 0.4120960 Mar 24 02:14:05.797661 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57564) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:05.798318 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57566) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:05.814103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f44fcc01-01b1-414c-b5c5-74be56aac254 None None] Provisioning complete for port c463af66-3216-4df8-b1fe-f12f14f0aa63 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:05.814477 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f44fcc01-01b1-414c-b5c5-74be56aac254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.826967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (6a055c46-d6bc-4261-80c7-ca6a1d86e1b3), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.848776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port c463af66-3216-4df8-b1fe-f12f14f0aa63 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:05.849216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.851647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8f71fe4b-2fdb-4e1a-b6c3-7d0e30b7a814 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server [None req-e7c6a190-ec62-4542-a1a6-24f276c32280 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 6a055c46-d6bc-4261-80c7-ca6a1d86e1b3: This subnet is being modified by another concurrent operation. Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 278, in create_dhcp_port Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:14:05.855655 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1504, in create_port Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1469, in _create_port_db Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1467, in create_port_db Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 691, in _ipam_get_subnets Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnet.lock_register( Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise exception Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 6a055c46-d6bc-4261-80c7-ca6a1d86e1b3: This subnet is being modified by another concurrent operation. Mar 24 02:14:05.859539 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Mar 24 02:14:05.865914 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=6a055c46-d6bc-4261-80c7-ca6a1d86e1b3,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:05.904983 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa43e3c3-459e-4f7b-a0a3-e43b7fc489ce None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:14:05.933520 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (88d32be6-8a1c-4d27-89b3-fd9950d99483), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.945987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8f71fe4b-2fdb-4e1a-b6c3-7d0e30b7a814 admin admin] Publish callbacks [] for security_group (9a5fe18f-a394-4883-8f24-24854b9bce77), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.955310 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8f71fe4b-2fdb-4e1a-b6c3-7d0e30b7a814 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (9a5fe18f-a394-4883-8f24-24854b9bce77), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.963607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['88d32be6-8a1c-4d27-89b3-fd9950d99483']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:05.973312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b3f604d5-97ea-4b50-aa85-1d950f7c1c9a') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:05.973748 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b3f604d5-97ea-4b50-aa85-1d950f7c1c9a') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:05.983607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (b3f604d5-97ea-4b50-aa85-1d950f7c1c9a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:05.992951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f71fe4b-2fdb-4e1a-b6c3-7d0e30b7a814 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a5fe18f-a394-4883-8f24-24854b9bce77,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:05.999043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b3f604d5-97ea-4b50-aa85-1d950f7c1c9a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.006978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 125 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:06.007334 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Network 1ff12164-ce98-442e-81ee-e22f78c3a0ff is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:06.007772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (b3f604d5-97ea-4b50-aa85-1d950f7c1c9a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:06.013349 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:06.017940 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-708d31c1-8757-4989-8b83-1640e39b5f38 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (e0adc6a6-7058-4e9b-a2d4-16c1d9161eda), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.056700 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f44fcc01-01b1-414c-b5c5-74be56aac254 None None] Current status of the port c463af66-3216-4df8-b1fe-f12f14f0aa63 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:06.064973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:06.070812 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708d31c1-8757-4989-8b83-1640e39b5f38 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Subnet': ['ID=e0adc6a6-7058-4e9b-a2d4-16c1d9161eda,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:06.081384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (88d32be6-8a1c-4d27-89b3-fd9950d99483), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.087389 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8f71fe4b-2fdb-4e1a-b6c3-7d0e30b7a814 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=a2b03005acbd456c8ca44d3e77c4bd5f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2802429 Mar 24 02:14:06.089149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57568) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:06.089522 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-708d31c1-8757-4989-8b83-1640e39b5f38 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.089756 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.092786 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-708d31c1-8757-4989-8b83-1640e39b5f38 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/e0adc6a6-7058-4e9b-a2d4-16c1d9161eda HTTP/1.1" status: 204 len: 168 time: 1.3172717 Mar 24 02:14:06.097588 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/88d32be6-8a1c-4d27-89b3-fd9950d99483 HTTP/1.1" status: 204 len: 168 time: 0.7708406 Mar 24 02:14:06.097588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57570) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:06.097865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port c463af66-3216-4df8-b1fe-f12f14f0aa63 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:06.099080 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6098d2e0-efee-4758-80ea-dca48118ba4c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:06.113807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57572) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:06.139947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1447339312'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:06.148101 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa43e3c3-459e-4f7b-a0a3-e43b7fc489ce None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:14:06.158210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec42b1a5-579e-4262-ad13-fc306381c1fb tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=88d32be6-8a1c-4d27-89b3-fd9950d99483,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:06.203038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-dae6412e-956f-48fa-8707-0974d3b8b044 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 9336a83d-90d4-454f-9310-441a3b790ebb {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:06.203669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dae6412e-956f-48fa-8707-0974d3b8b044 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9336a83d-90d4-454f-9310-441a3b790ebb), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.239061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:06.239448 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.242348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:06.247098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.250490 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c5b3da2a-3762-47a0-b5fb-985b20dcc120 None None] Provisioning complete for port a241a0ee-a158-4025-8b7b-6e9767042270 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:06.250889 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5b3da2a-3762-47a0-b5fb-985b20dcc120 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.264825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (99f7ef54-5971-4750-bd3c-eb633e689cd2), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.272456 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdb6de7a-ad9e-4148-a70f-494ea9eff294 admin admin] Publish callbacks [] for security_group (9a5fe18f-a394-4883-8f24-24854b9bce77), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.274004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Router c4a3de90-537a-4022-b079-9feeedff6892 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:14:06.301296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 105} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:06.332897 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c5b3da2a-3762-47a0-b5fb-985b20dcc120 None None] Port a241a0ee-a158-4025-8b7b-6e9767042270 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:06.334468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdb6de7a-ad9e-4148-a70f-494ea9eff294 admin admin] Publish callbacks [] for security_group (9a5fe18f-a394-4883-8f24-24854b9bce77), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.347681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (fdca7dc8-97cb-4ca5-aaaa-622168d92f9b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.348048 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment fdca7dc8-97cb-4ca5-aaaa-622168d92f9b of type vlan for network eab652b8-6872-4a43-a4d0-be7f3ca6aebd Mar 24 02:14:06.400645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c5b3da2a-3762-47a0-b5fb-985b20dcc120 None None] Provisioning complete for port 9336a83d-90d4-454f-9310-441a3b790ebb triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:06.401021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5b3da2a-3762-47a0-b5fb-985b20dcc120 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9336a83d-90d4-454f-9310-441a3b790ebb), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.422705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (eab652b8-6872-4a43-a4d0-be7f3ca6aebd), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.457480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 9f1195f9-7086-4fff-b115-8f533dd127e8 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:06.457767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.458195 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:06.472900 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdb6de7a-ad9e-4148-a70f-494ea9eff294 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (9a5fe18f-a394-4883-8f24-24854b9bce77), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.476433 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdb6de7a-ad9e-4148-a70f-494ea9eff294 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.480639 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fdb6de7a-ad9e-4148-a70f-494ea9eff294 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/9a5fe18f-a394-4883-8f24-24854b9bce77 HTTP/1.1" status: 204 len: 168 time: 0.3831141 Mar 24 02:14:06.480823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c5b3da2a-3762-47a0-b5fb-985b20dcc120 None None] Port 9336a83d-90d4-454f-9310-441a3b790ebb cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:06.503680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (eab652b8-6872-4a43-a4d0-be7f3ca6aebd), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.509059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:06.509688 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.548273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb6de7a-ad9e-4148-a70f-494ea9eff294 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a5fe18f-a394-4883-8f24-24854b9bce77,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:06.553879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34eebceb-9698-46b1-96ab-ca5c7861defd None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:14:06.594788 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.4601953 Mar 24 02:14:06.602475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57576) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:06.617432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': 'eab652b8-6872-4a43-a4d0-be7f3ca6aebd', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:06.635202 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75123376-37fb-4eba-89c6-5691e0a1d0f3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=eab652b8-6872-4a43-a4d0-be7f3ca6aebd,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:06.670304 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network eab652b8-6872-4a43-a4d0-be7f3ca6aebd details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:06.674510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port 9f1195f9-7086-4fff-b115-8f533dd127e8, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f1195f9-7086-4fff-b115-8f533dd127e8,segment=NetworkSegment(64361f9e-cc6b-4823-a7ba-4e9a794c3111),segment_id=64361f9e-cc6b-4823-a7ba-4e9a794c3111)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:06.674910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.696091 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 9f1195f9-7086-4fff-b115-8f533dd127e8 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:06.741174 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dae6412e-956f-48fa-8707-0974d3b8b044 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9336a83d-90d4-454f-9310-441a3b790ebb), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.745078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 276b4a0e-938f-4560-8acb-b1e286da1948 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:06.784220 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-dae6412e-956f-48fa-8707-0974d3b8b044 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 9336a83d-90d4-454f-9310-441a3b790ebb owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:06.808763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:06.812253 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.862754 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34eebceb-9698-46b1-96ab-ca5c7861defd None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:14:06.913333 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:06.919595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (9f1195f9-7086-4fff-b115-8f533dd127e8), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.935126 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Sync routers for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:06.937307 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ea0c0131-a815-4ed9-8977-dadad7924f6e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "PUT /v2.0/routers/c4a3de90-537a-4022-b079-9feeedff6892/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9248221 Mar 24 02:14:06.942325 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 276b4a0e-938f-4560-8acb-b1e286da1948 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:06.942729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:06.966086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=9f1195f9-7086-4fff-b115-8f533dd127e8,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:06.968120 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:06.968760 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:07.002579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No DVR routers for this DVR port 9f1195f9-7086-4fff-b115-8f533dd127e8 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:07.121710 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 276b4a0e-938f-4560-8acb-b1e286da1948 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:07.121710 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c463af66-3216-4df8-b1fe-f12f14f0aa63 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:07.177866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dae6412e-956f-48fa-8707-0974d3b8b044 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (9336a83d-90d4-454f-9310-441a3b790ebb), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.178573 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:07.223789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd68fc64-2094-4282-8fe0-fd2b7cebd381 None None] Network 88d32be6-8a1c-4d27-89b3-fd9950d99483 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:07.256468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (698d2aee-ded5-4443-87eb-b82ad96e1825), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.260319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b00f24bc-8bfe-4db7-a067-2120478c2659 None None] Network 99f7ef54-5971-4750-bd3c-eb633e689cd2 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:07.262809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae6412e-956f-48fa-8707-0974d3b8b044 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=9336a83d-90d4-454f-9310-441a3b790ebb,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:07.348819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd68fc64-2094-4282-8fe0-fd2b7cebd381 None None] Network 88d32be6-8a1c-4d27-89b3-fd9950d99483 could not be found, it might have been deleted concurrently. {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:196}} Mar 24 02:14:07.424176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port c463af66-3216-4df8-b1fe-f12f14f0aa63 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:07.424554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.467497 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dae6412e-956f-48fa-8707-0974d3b8b044 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.477009 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dae6412e-956f-48fa-8707-0974d3b8b044 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/9336a83d-90d4-454f-9310-441a3b790ebb HTTP/1.1" status: 204 len: 168 time: 1.6730924 Mar 24 02:14:07.481168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57612) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:07.544471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01d2a30c-e171-4e58-94b1-b6b1bbf427da None None] DHCP port deletion for 99f7ef54-5971-4750-bd3c-eb633e689cd2 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:07.561312 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-dd558213-b9b2-4bda-b2a3-47340d23c958 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1117352014&fields=id&tenant_id=615b57fe01bd445f87fb9f1a86851430 HTTP/1.1" status: 200 len: 267 time: 0.3080330 Mar 24 02:14:07.587887 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port c463af66-3216-4df8-b1fe-f12f14f0aa63 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:07.642471 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8e2c7fa-b939-40ea-a66d-944cc64df91c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:07.644890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8e2c7fa-b939-40ea-a66d-944cc64df91c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:07.647116 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8e2c7fa-b939-40ea-a66d-944cc64df91c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:07.657346 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57616) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:07.660291 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b8e2c7fa-b939-40ea-a66d-944cc64df91c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1778207 Mar 24 02:14:07.720574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4e60bd3d-916e-4bec-b3ed-b600ce737453 None None] Provisioning complete for port a241a0ee-a158-4025-8b7b-6e9767042270 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:07.721161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e60bd3d-916e-4bec-b3ed-b600ce737453 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.741782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57618) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:07.750406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (99f7ef54-5971-4750-bd3c-eb633e689cd2), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.771689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4e60bd3d-916e-4bec-b3ed-b600ce737453 None None] Port a241a0ee-a158-4025-8b7b-6e9767042270 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:07.775345 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a241a0ee-a158-4025-8b7b-6e9767042270', 'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'mac_address': 'fa:16:3e:d3:c7:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_interface', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:14:02Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 2, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'subnets': [{'id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:07.805853 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Checking router: c4a3de90-537a-4022-b079-9feeedff6892 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:14:07.806209 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Updating router c4a3de90-537a-4022-b079-9feeedff6892 port a241a0ee-a158-4025-8b7b-6e9767042270 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:14:07.835160 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.856556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairIpV6TestJSON-test-network-850320131'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:07.880261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Made reservation on behalf of 15c69ad0648c47419b3ead64ebe342de for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:07.884827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.899685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.988151 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for security_group (6b6f7dcf-25e8-45c1-92e4-b77ede483d77), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:07.992563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (6b6f7dcf-25e8-45c1-92e4-b77ede483d77), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.024240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 118} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:08.035777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6b6f7dcf-25e8-45c1-92e4-b77ede483d77,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:08.043087 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (8650870d-314b-4c16-82b0-643582c0d5e4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.043653 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Added segment 8650870d-314b-4c16-82b0-643582c0d5e4 of type vlan for network 0c765cab-bf54-40f0-922b-903bce6e75d2 Mar 24 02:14:08.069398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': 'fdca7dc8-97cb-4ca5-aaaa-622168d92f9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'eab652b8-6872-4a43-a4d0-be7f3ca6aebd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:08.070077 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: eab652b8-6872-4a43-a4d0-be7f3ca6aebd, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:08.088730 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (0c765cab-bf54-40f0-922b-903bce6e75d2), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.097710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=698d2aee-ded5-4443-87eb-b82ad96e1825,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:08.118146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (0c765cab-bf54-40f0-922b-903bce6e75d2), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.119217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['99f7ef54-5971-4750-bd3c-eb633e689cd2']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:08.123431 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:08.124018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.127351 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Publish callbacks [] for port (a241a0ee-a158-4025-8b7b-6e9767042270), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.134017 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.142924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '64361f9e-cc6b-4823-a7ba-4e9a794c3111') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:08.143289 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '64361f9e-cc6b-4823-a7ba-4e9a794c3111') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:08.182628 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Pushing event updated for resources: {'Port': ['ID=a241a0ee-a158-4025-8b7b-6e9767042270,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:08.182986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (64361f9e-cc6b-4823-a7ba-4e9a794c3111), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.190193 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 797 time: 0.4443846 Mar 24 02:14:08.190715 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.191063 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.191442 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57622) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:08.191749 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.192257 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.192740 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.193342 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.193756 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.194275 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.194711 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.195081 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.195483 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.195832 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.196164 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.196490 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.196668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'subnet': {'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:08.196810 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:08.202719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-304fd1eb-ceb8-4612-9eb0-94b3e6e24140 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet bf5b9324-e973-4fdb-838e-8de9265c4c30 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:08.205911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-304fd1eb-ceb8-4612-9eb0-94b3e6e24140 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (bf5b9324-e973-4fdb-838e-8de9265c4c30), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.252132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network eab652b8-6872-4a43-a4d0-be7f3ca6aebd is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:08.265975 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Attempting to bind port a241a0ee-a158-4025-8b7b-6e9767042270 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:08.266639 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Attempting to bind port a241a0ee-a158-4025-8b7b-6e9767042270 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:08.267188 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Attempting to bind port a241a0ee-a158-4025-8b7b-6e9767042270 on network 1ff12164-ce98-442e-81ee-e22f78c3a0ff {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:08.271981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, eab652b8-6872-4a43-a4d0-be7f3ca6aebd) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:08.274910 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:08.275514 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Checking segment: {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:08.276114 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.276654 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Bound using segment: {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:08.277281 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Bound port: a241a0ee-a158-4025-8b7b-6e9767042270, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:08.277866 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.282788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-304fd1eb-ceb8-4612-9eb0-94b3e6e24140 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (bf5b9324-e973-4fdb-838e-8de9265c4c30), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.283959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16038d0-40d4-4694-8f9a-cf2dc22fd880 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Network': ['ID=0c765cab-bf54-40f0-922b-903bce6e75d2,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:08.285692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (64361f9e-cc6b-4823-a7ba-4e9a794c3111), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.296180 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9a985bc-e558-4caf-bf8f-55a7b11aab93 None None] Network eab652b8-6872-4a43-a4d0-be7f3ca6aebd requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:08.302785 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-64aef6ca-aed2-4d8c-abee-93f8a6cb15d5 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:08.307649 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-64aef6ca-aed2-4d8c-abee-93f8a6cb15d5 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/networks?id=1ff12164-ce98-442e-81ee-e22f78c3a0ff HTTP/1.1" status: 200 len: 797 time: 0.6937754 Mar 24 02:14:08.330856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:08.331444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.348221 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Releasing vlan 106 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:08.348681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (64361f9e-cc6b-4823-a7ba-4e9a794c3111), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.360254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Made reservation on behalf of 15c69ad0648c47419b3ead64ebe342de for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:08.364570 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:08.367350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:08.370320 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] For port a241a0ee-a158-4025-8b7b-6e9767042270, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:08.372923 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.375258 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] For port a241a0ee-a158-4025-8b7b-6e9767042270, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a241a0ee-a158-4025-8b7b-6e9767042270,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:08.384147 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.453577 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:08.454499 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:08.495034 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-cda64929-5567-4643-a839-ae7cb59f0ad1 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/quotas/615b57fe01bd445f87fb9f1a86851430 HTTP/1.1" status: 200 len: 375 time: 0.1580729 Mar 24 02:14:08.498122 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0710497f-6854-4ce8-8336-1f039e89f9bd None None] Pushing event updated for resources: {'Port': ['ID=a241a0ee-a158-4025-8b7b-6e9767042270,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:08.501628 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a031b06c-ea3c-4f92-92ba-036648172cc9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.8936510 Mar 24 02:14:08.503469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57624) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:08.574958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (99f7ef54-5971-4750-bd3c-eb633e689cd2), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.603658 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:08.657706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.661356 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/networks/99f7ef54-5971-4750-bd3c-eb633e689cd2 HTTP/1.1" status: 204 len: 168 time: 2.5634208 Mar 24 02:14:08.672289 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57626) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:08.681560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2084671012'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:08.724068 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:08.729099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.738500 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a19bff-0d20-4277-9824-dfdbd4d9f87f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Network': ['ID=99f7ef54-5971-4750-bd3c-eb633e689cd2,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:08.747403 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f1195f9-7086-4fff-b115-8f533dd127e8 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:08.771176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-304fd1eb-ceb8-4612-9eb0-94b3e6e24140 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (bf5b9324-e973-4fdb-838e-8de9265c4c30), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.808802 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (eab652b8-6872-4a43-a4d0-be7f3ca6aebd), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.822167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 9f1195f9-7086-4fff-b115-8f533dd127e8 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:08.822167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f1195f9-7086-4fff-b115-8f533dd127e8 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:08.849424 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-7eab3e7f-1fbf-4f40-8880-bea28353a6e0 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=615b57fe01bd445f87fb9f1a86851430&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3446999 Mar 24 02:14:08.862799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 145} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:08.868418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (08fb8372-ea73-460b-891f-1f1021e06112), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.905301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-98550598-90a8-4601-bbc0-fbad66630661 None None] Provisioning complete for port a241a0ee-a158-4025-8b7b-6e9767042270 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:08.906096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-98550598-90a8-4601-bbc0-fbad66630661 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.934998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (698d2aee-ded5-4443-87eb-b82ad96e1825), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.974285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c54d2a8-8c9d-43a1-8889-b2cfab2a186d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-eab652b8-6872-4a43-a4d0-be7f3ca6aebd', 'network_id': 'eab652b8-6872-4a43-a4d0-be7f3ca6aebd', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': '698d2aee-ded5-4443-87eb-b82ad96e1825'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:08.975162 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2c54d2a8-8c9d-43a1-8889-b2cfab2a186d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.991126 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-99a01a71-295b-42a3-b4d2-114ce03dad45 service neutron] 10.222.0.20 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1181419 Mar 24 02:14:08.999025 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (fa1aac63-3aee-4ae3-aba1-dd462153e0e9), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:08.999716 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added segment fa1aac63-3aee-4ae3-aba1-dd462153e0e9 of type vlan for network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c Mar 24 02:14:09.000128 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a241a0ee-a158-4025-8b7b-6e9767042270', 'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'mac_address': 'fa:16:3e:d3:c7:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_interface', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:14:02Z', 'updated_at': '2022-03-24T02:14:08Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'subnets': [{'id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:09.013009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (698d2aee-ded5-4443-87eb-b82ad96e1825), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.046307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Subnet': ['ID=08fb8372-ea73-460b-891f-1f1021e06112,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:09.053143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Checking segment: {'id': '8650870d-314b-4c16-82b0-643582c0d5e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:09.053503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Network hostable DHCP agents. Network: 0c765cab-bf54-40f0-922b-903bce6e75d2, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:09.062086 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de9d89fd-5f13-45f6-87ed-57388af85f3d None None] The sync data for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv is: [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a241a0ee-a158-4025-8b7b-6e9767042270', 'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'mac_address': 'fa:16:3e:d3:c7:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_interface', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:14:02Z', 'updated_at': '2022-03-24T02:14:08Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'subnets': [{'id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:09.091067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=698d2aee-ded5-4443-87eb-b82ad96e1825,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:09.092106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-304fd1eb-ceb8-4612-9eb0-94b3e6e24140 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (bf5b9324-e973-4fdb-838e-8de9265c4c30), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.114095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-98550598-90a8-4601-bbc0-fbad66630661 None None] Current status of the port a241a0ee-a158-4025-8b7b-6e9767042270 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:09.114486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-98550598-90a8-4601-bbc0-fbad66630661 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.142143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (8c6458ba-91f2-43b8-accc-0d7da5b8ad8c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server [None req-2c54d2a8-8c9d-43a1-8889-b2cfab2a186d None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 698d2aee-ded5-4443-87eb-b82ad96e1825: This subnet is being modified by another concurrent operation. Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 278, in create_dhcp_port Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:14:09.155305 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1504, in create_port Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1469, in _create_port_db Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1467, in create_port_db Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 691, in _ipam_get_subnets Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnet.lock_register( Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise exception Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 698d2aee-ded5-4443-87eb-b82ad96e1825: This subnet is being modified by another concurrent operation. Mar 24 02:14:09.159524 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Mar 24 02:14:09.169938 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-304fd1eb-ceb8-4612-9eb0-94b3e6e24140 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.169938 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-304fd1eb-ceb8-4612-9eb0-94b3e6e24140 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/bf5b9324-e973-4fdb-838e-8de9265c4c30 HTTP/1.1" status: 204 len: 168 time: 1.4823375 Mar 24 02:14:09.169938 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-304fd1eb-ceb8-4612-9eb0-94b3e6e24140 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=bf5b9324-e973-4fdb-838e-8de9265c4c30,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:09.188714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57628) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:09.192645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eeacc60b-75ff-4791-89ad-7eb7a2e89a6c None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:09.231838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (eab652b8-6872-4a43-a4d0-be7f3ca6aebd), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.249970 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-98550598-90a8-4601-bbc0-fbad66630661 None None] For port a241a0ee-a158-4025-8b7b-6e9767042270, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a241a0ee-a158-4025-8b7b-6e9767042270,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:09.251157 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc331802-9b53-45e2-b544-62738951ac1e None None] Network eab652b8-6872-4a43-a4d0-be7f3ca6aebd requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:09.258932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eab652b8-6872-4a43-a4d0-be7f3ca6aebd']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:09.272155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-98550598-90a8-4601-bbc0-fbad66630661 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.272415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fdca7dc8-97cb-4ca5-aaaa-622168d92f9b') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:09.272536 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fdca7dc8-97cb-4ca5-aaaa-622168d92f9b') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:09.280401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (8c6458ba-91f2-43b8-accc-0d7da5b8ad8c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.285652 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (fdca7dc8-97cb-4ca5-aaaa-622168d92f9b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.286174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:09.286759 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.296705 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-8945e742-e3fd-4134-9d48-0aa22d9bc9f0 service neutron] 10.222.0.20 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2949727 Mar 24 02:14:09.316639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (fdca7dc8-97cb-4ca5-aaaa-622168d92f9b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.326397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-584fa945-42f8-4f96-bfa4-afadb492ed15 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet e9a00e9f-3f7e-47d1-959f-59199b3253f0 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:09.330131 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-584fa945-42f8-4f96-bfa4-afadb492ed15 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (e9a00e9f-3f7e-47d1-959f-59199b3253f0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.335650 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:09.349188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:09.350836 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (fdca7dc8-97cb-4ca5-aaaa-622168d92f9b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:09.362837 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:09.367996 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 0c765cab-bf54-40f0-922b-903bce6e75d2) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:09.387297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e153e9e5-877d-43d6-89bd-73a159d133a8 None None] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:09.433080 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.7565429 Mar 24 02:14:09.444942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-584fa945-42f8-4f96-bfa4-afadb492ed15 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (e9a00e9f-3f7e-47d1-959f-59199b3253f0), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.448035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57630) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:09.453077 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'subnet': {'network_id': '8c6458ba-91f2-43b8-accc-0d7da5b8ad8c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:09.476689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98550598-90a8-4601-bbc0-fbad66630661 None None] Pushing event updated for resources: {'Port': ['ID=a241a0ee-a158-4025-8b7b-6e9767042270,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:09.479283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:09.489286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.521866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (eab652b8-6872-4a43-a4d0-be7f3ca6aebd), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.548134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.556429 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/eab652b8-6872-4a43-a4d0-be7f3ca6aebd HTTP/1.1" status: 204 len: 168 time: 1.0418065 Mar 24 02:14:09.557939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8646a5a-d514-439e-a75b-6c7e5b7d3dfa tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=eab652b8-6872-4a43-a4d0-be7f3ca6aebd,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:09.565157 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-af2cd713-c9b5-4d4e-a5b4-03874b05e6eb tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.3700836 Mar 24 02:14:09.565157 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57636) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:09.569983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-2037643676'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:09.572921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57640) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:09.579569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'port': {'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-863604077'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:09.632418 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-0c765cab-bf54-40f0-922b-903bce6e75d2', 'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2', 'project_id': '15c69ad0648c47419b3ead64ebe342de', 'fixed_ips': [{'subnet_id': '08fb8372-ea73-460b-891f-1f1021e06112'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:09.633016 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8b2cba0c-815c-43d0-8230-9f7d4f66c733 req-b3bff444-3600-41a6-bbf0-6d641bd19f5c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 210 time: 0.0380392 Mar 24 02:14:09.634861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.647576 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b10e5317-2f0c-41f7-baa0-b118250f805c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Network': ['ID=8c6458ba-91f2-43b8-accc-0d7da5b8ad8c,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:09.673565 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:09.675218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:09.676830 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a1a185f3-9ed7-45dc-bcaf-e5b64d27fb48 None None] Provisioning complete for port a241a0ee-a158-4025-8b7b-6e9767042270 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:09.677920 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a1a185f3-9ed7-45dc-bcaf-e5b64d27fb48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.680769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.753763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:09.764268 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.789137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 111} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:09.805529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Made reservation on behalf of 15c69ad0648c47419b3ead64ebe342de for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:09.825064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.855606 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (49c43042-83a7-4e8d-8060-a84e1a7987bd), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:09.865187 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment 49c43042-83a7-4e8d-8060-a84e1a7987bd of type vlan for network 75eb7762-ad4e-477f-ba6a-5185ce3ac565 Mar 24 02:14:09.956336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] device_id is not set on port 00d8a992-8adf-4f43-babc-21b4ffd00c25 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:09.983846 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (75eb7762-ad4e-477f-ba6a-5185ce3ac565), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.059820 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-584fa945-42f8-4f96-bfa4-afadb492ed15 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (e9a00e9f-3f7e-47d1-959f-59199b3253f0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.121930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (71bcd0f2-d2a9-49de-abca-c367b71a913d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.127412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (75eb7762-ad4e-477f-ba6a-5185ce3ac565), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.140055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:10.140708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.247624 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.6829040 Mar 24 02:14:10.257540 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57648) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:10.278472 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Allocated IP 2001:db8::2 (0c765cab-bf54-40f0-922b-903bce6e75d2/08fb8372-ea73-460b-891f-1f1021e06112/09549143-6b71-4126-aca2-afdc3c7eeca9) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:10.280785 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-26c7e35a-ead1-4ae5-85ba-65a0251a5a3a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'New_network'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:10.296970 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a1a185f3-9ed7-45dc-bcaf-e5b64d27fb48 None None] Current status of the port a241a0ee-a158-4025-8b7b-6e9767042270 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:10.395531 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebb67a65-5762-410e-8b73-a19a7c0865ee tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=75eb7762-ad4e-477f-ba6a-5185ce3ac565,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:10.446162 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 75eb7762-ad4e-477f-ba6a-5185ce3ac565 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:10.460129 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Subnet': ['ID=71bcd0f2-d2a9-49de-abca-c367b71a913d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:10.589705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Checking segment: {'id': 'fa1aac63-3aee-4ae3-aba1-dd462153e0e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '8c6458ba-91f2-43b8-accc-0d7da5b8ad8c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:10.590369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network hostable DHCP agents. Network: 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:10.730712 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a241a0ee-a158-4025-8b7b-6e9767042270 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:10.752918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26c7e35a-ead1-4ae5-85ba-65a0251a5a3a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (75eb7762-ad4e-477f-ba6a-5185ce3ac565), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.783947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26c7e35a-ead1-4ae5-85ba-65a0251a5a3a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (75eb7762-ad4e-477f-ba6a-5185ce3ac565), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.798355 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Publish callbacks [] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.814043 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-71acf6a3-a663-4505-9cfc-ab0ed479a469 req-945ead94-6e1a-4a09-9635-9d4547132359 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 210 time: 0.0449703 Mar 24 02:14:10.821503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.829154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-584fa945-42f8-4f96-bfa4-afadb492ed15 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (e9a00e9f-3f7e-47d1-959f-59199b3253f0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.858277 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:10.873615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:10.880087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-26c7e35a-ead1-4ae5-85ba-65a0251a5a3a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network 75eb7762-ad4e-477f-ba6a-5185ce3ac565 is not hosted by any dhcp agent {{(pid=104037) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Mar 24 02:14:10.885011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26c7e35a-ead1-4ae5-85ba-65a0251a5a3a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:10.885623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26c7e35a-ead1-4ae5-85ba-65a0251a5a3a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.886932 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-26c7e35a-ead1-4ae5-85ba-65a0251a5a3a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "PUT /v2.0/networks/75eb7762-ad4e-477f-ba6a-5185ce3ac565 HTTP/1.1" status: 200 len: 723 time: 0.6269946 Mar 24 02:14:10.890691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57654) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:10.900155 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': '75eb7762-ad4e-477f-ba6a-5185ce3ac565', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:10.910448 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:10.935324 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-584fa945-42f8-4f96-bfa4-afadb492ed15 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:10.942676 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-584fa945-42f8-4f96-bfa4-afadb492ed15 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/e9a00e9f-3f7e-47d1-959f-59199b3253f0 HTTP/1.1" status: 204 len: 168 time: 1.7518129 Mar 24 02:14:10.943811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57656) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:10.947080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:10.965161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-584fa945-42f8-4f96-bfa4-afadb492ed15 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=e9a00e9f-3f7e-47d1-959f-59199b3253f0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:10.979877 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:10.984819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:10.986423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.023130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a700a20b-3038-4ece-9979-13c707001f77 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:11.026163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26c7e35a-ead1-4ae5-85ba-65a0251a5a3a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=75eb7762-ad4e-477f-ba6a-5185ce3ac565,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:11.026613 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07e20ae3-a3dd-43e0-aa98-7a0a05cb3a97 None None] Network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:11.042444 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-afdd84e9-7b1b-4b40-a5ed-2d20cb52946d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0864251 Mar 24 02:14:11.045828 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57658) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:11.049144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Allocated IP 2001:db8::2f1 (0c765cab-bf54-40f0-922b-903bce6e75d2/08fb8372-ea73-460b-891f-1f1021e06112/00d8a992-8adf-4f43-babc-21b4ffd00c25) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:11.054837 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:11.090991 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-47211c81-a039-44bc-8d83-08220ae0a4a2 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6418171 Mar 24 02:14:11.125397 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57660) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:11.136827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-f6c27e01-fdc8-4ad9-a3ad-1529182d8bb0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-2091788027', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:11.172416 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 75eb7762-ad4e-477f-ba6a-5185ce3ac565 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:11.214612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f6c27e01-fdc8-4ad9-a3ad-1529182d8bb0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (b7625b45-c8e2-4384-becd-84c71dc4e270), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.215644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f6c27e01-fdc8-4ad9-a3ad-1529182d8bb0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (b7625b45-c8e2-4384-becd-84c71dc4e270), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.290110 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Attempting to bind port 09549143-6b71-4126-aca2-afdc3c7eeca9 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:11.290983 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Attempting to bind port 09549143-6b71-4126-aca2-afdc3c7eeca9 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '8650870d-314b-4c16-82b0-643582c0d5e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:11.291361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Attempting to bind port 09549143-6b71-4126-aca2-afdc3c7eeca9 on network 0c765cab-bf54-40f0-922b-903bce6e75d2 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:11.325604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:11.325935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Checking segment: {'id': '8650870d-314b-4c16-82b0-643582c0d5e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:11.326432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.326758 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Bound using segment: {'id': '8650870d-314b-4c16-82b0-643582c0d5e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:11.327242 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Bound port: 09549143-6b71-4126-aca2-afdc3c7eeca9, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8650870d-314b-4c16-82b0-643582c0d5e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:11.327624 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.346746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Pushing event updated for resources: {'Port': ['ID=09549143-6b71-4126-aca2-afdc3c7eeca9,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:11.367664 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:11.377190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.394149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f6c27e01-fdc8-4ad9-a3ad-1529182d8bb0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (b7625b45-c8e2-4384-becd-84c71dc4e270), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.433379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] For port 09549143-6b71-4126-aca2-afdc3c7eeca9, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:11.438376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] For port 09549143-6b71-4126-aca2-afdc3c7eeca9, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=09549143-6b71-4126-aca2-afdc3c7eeca9,segment=NetworkSegment(8650870d-314b-4c16-82b0-643582c0d5e4),segment_id=8650870d-314b-4c16-82b0-643582c0d5e4)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:11.441515 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4e76743c-fb4c-4296-9267-c3d7fbb42ecb None None] Provisioning complete for port 6098d2e0-efee-4758-80ea-dca48118ba4c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:11.442058 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e76743c-fb4c-4296-9267-c3d7fbb42ecb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.445401 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a241a0ee-a158-4025-8b7b-6e9767042270 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:11.445801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.470742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f6c27e01-fdc8-4ad9-a3ad-1529182d8bb0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (b7625b45-c8e2-4384-becd-84c71dc4e270), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.485478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.502068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:11.505985 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.551519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-95a89f6b-c61f-4627-98cd-946a94544006 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:11.553719 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-95a89f6b-c61f-4627-98cd-946a94544006 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.30 "GET /v2.0/networks?id=1ff12164-ce98-442e-81ee-e22f78c3a0ff HTTP/1.1" status: 200 len: 797 time: 0.3965516 Mar 24 02:14:11.602275 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f6c27e01-fdc8-4ad9-a3ad-1529182d8bb0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.605926 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f6c27e01-fdc8-4ad9-a3ad-1529182d8bb0 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.4759190 Mar 24 02:14:11.608653 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57670) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:11.698651 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-8c6458ba-91f2-43b8-accc-0d7da5b8ad8c', 'network_id': '8c6458ba-91f2-43b8-accc-0d7da5b8ad8c', 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'fixed_ips': [{'subnet_id': '71bcd0f2-d2a9-49de-abca-c367b71a913d'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:11.699882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.740764 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for port (00d8a992-8adf-4f43-babc-21b4ffd00c25), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.772495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6bf7604-be84-4f0e-ac1d-e81aec68cf8a None None] Pushing event updated for resources: {'Port': ['ID=09549143-6b71-4126-aca2-afdc3c7eeca9,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:11.905189 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (00d8a992-8adf-4f43-babc-21b4ffd00c25), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:11.961004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (695c48a9-bfb3-4f02-8678-716854ae7fbb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.045455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a241a0ee-a158-4025-8b7b-6e9767042270 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:12.066156 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f06f2f7-4b56-4494-b46c-958c1a63a167 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:12.081153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=695c48a9-bfb3-4f02-8678-716854ae7fbb,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:12.130209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4e76743c-fb4c-4296-9267-c3d7fbb42ecb None None] Current status of the port 6098d2e0-efee-4758-80ea-dca48118ba4c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:12.143201 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:12.150433 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:12.157094 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Port': ['ID=00d8a992-8adf-4f43-babc-21b4ffd00c25,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:12.186834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:12.198442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Allocated IP 2001:db8::2 (8c6458ba-91f2-43b8-accc-0d7da5b8ad8c/71bcd0f2-d2a9-49de-abca-c367b71a913d/277a8700-f399-48aa-a949-2a59565bf02f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:12.206404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:12.207104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.236654 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-6b147c66-54bf-48be-abcb-dbb2ab7d08a3 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=615b57fe01bd445f87fb9f1a86851430 HTTP/1.1" status: 200 len: 380 time: 0.6699889 Mar 24 02:14:12.250220 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d1b720f5-ef67-478e-bf60-24574006b477 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.6762619 Mar 24 02:14:12.255619 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57674) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:12.260440 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'port': {'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-539304025', 'allowed_address_pairs': [{'ip_address': '2001:db8::2f1', 'mac_address': 'fa:16:3e:ed:14:3b'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:12.309159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'port': {'device_id': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'admin_state_up': True, 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'security_groups': ['b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:12.334349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3f06f2f7-4b56-4494-b46c-958c1a63a167 None None] Deleting port 6098d2e0-efee-4758-80ea-dca48118ba4c {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:12.340722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3f06f2f7-4b56-4494-b46c-958c1a63a167 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.358872 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-499c5930-6350-438a-b696-e9c04c923ee0 req-27109f96-b2b6-4d1c-a2d2-a00453f03553 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 210 time: 0.2556179 Mar 24 02:14:12.417436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': '49c43042-83a7-4e8d-8060-a84e1a7987bd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '75eb7762-ad4e-477f-ba6a-5185ce3ac565'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:12.417911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: 75eb7762-ad4e-477f-ba6a-5185ce3ac565, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:12.421672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3f06f2f7-4b56-4494-b46c-958c1a63a167 None None] For port 6098d2e0-efee-4758-80ea-dca48118ba4c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=6098d2e0-efee-4758-80ea-dca48118ba4c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:12.422096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3f06f2f7-4b56-4494-b46c-958c1a63a167 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.434678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3f06f2f7-4b56-4494-b46c-958c1a63a167 None None] Calling delete_port for 6098d2e0-efee-4758-80ea-dca48118ba4c owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:12.450907 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Made reservation on behalf of 15c69ad0648c47419b3ead64ebe342de for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:12.523441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3f06f2f7-4b56-4494-b46c-958c1a63a167 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (6098d2e0-efee-4758-80ea-dca48118ba4c), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.568919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.609426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] device_id is not set on port b712b98b-f420-4f15-af3e-0f2c5a0f99b5 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:12.627525 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f06f2f7-4b56-4494-b46c-958c1a63a167 None None] Pushing event deleted for resources: {'Port': ['ID=6098d2e0-efee-4758-80ea-dca48118ba4c,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:12.651127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fa2e4a-0302-4801-b0ad-db018f483ae9 req-e8fe7597-d310-46b0-a1b6-b9522165309f tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:12.659126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f06f2f7-4b56-4494-b46c-958c1a63a167 None None] No DVR routers for this DVR port 6098d2e0-efee-4758-80ea-dca48118ba4c on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:12.667254 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4fa2e4a-0302-4801-b0ad-db018f483ae9 req-e8fe7597-d310-46b0-a1b6-b9522165309f tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 946 time: 1.0006402 Mar 24 02:14:12.709297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 09549143-6b71-4126-aca2-afdc3c7eeca9 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:12.769840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Publish callbacks [] for port (277a8700-f399-48aa-a949-2a59565bf02f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.784995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (277a8700-f399-48aa-a949-2a59565bf02f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.799032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 09549143-6b71-4126-aca2-afdc3c7eeca9 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:12.799499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.807144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (4b356bbf-257f-4afc-b498-4e10c679cf12), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:12.820928 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Allocated IP 2001:db8::16f (0c765cab-bf54-40f0-922b-903bce6e75d2/08fb8372-ea73-460b-891f-1f1021e06112/b712b98b-f420-4f15-af3e-0f2c5a0f99b5) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:12.883690 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:12.895286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:12.915936 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:12.921268 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4fa2e4a-0302-4801-b0ad-db018f483ae9 req-9108bd72-5a48-45a7-906f-f8f085f2fed1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2102222 Mar 24 02:14:12.932374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:12.940366 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Pushing event updated for resources: {'Port': ['ID=277a8700-f399-48aa-a949-2a59565bf02f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:12.962028 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:12.991825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39e5bab8-571f-4849-896b-4903f35a5306 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:13.014052 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:13.014827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.018025 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Made reservation on behalf of 615b57fe01bd445f87fb9f1a86851430 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:13.022382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.044049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.134877 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=4b356bbf-257f-4afc-b498-4e10c679cf12,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:13.138491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network 75eb7762-ad4e-477f-ba6a-5185ce3ac565 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:13.143263 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Attempting to bind port 277a8700-f399-48aa-a949-2a59565bf02f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:13.144006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Attempting to bind port 277a8700-f399-48aa-a949-2a59565bf02f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'fa1aac63-3aee-4ae3-aba1-dd462153e0e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '8c6458ba-91f2-43b8-accc-0d7da5b8ad8c'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:13.144604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Attempting to bind port 277a8700-f399-48aa-a949-2a59565bf02f on network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:13.178481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 75eb7762-ad4e-477f-ba6a-5185ce3ac565) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:13.181061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for port (b712b98b-f420-4f15-af3e-0f2c5a0f99b5), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.189440 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:13.190048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.195119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:13.195852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Checking segment: {'id': 'fa1aac63-3aee-4ae3-aba1-dd462153e0e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '8c6458ba-91f2-43b8-accc-0d7da5b8ad8c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:13.196862 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4e2ae190-332f-4522-8c91-5015c6893c9d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1499441 Mar 24 02:14:13.197119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.197712 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Bound using segment: {'id': 'fa1aac63-3aee-4ae3-aba1-dd462153e0e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '8c6458ba-91f2-43b8-accc-0d7da5b8ad8c'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:13.198408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Bound port: 277a8700-f399-48aa-a949-2a59565bf02f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fa1aac63-3aee-4ae3-aba1-dd462153e0e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '8c6458ba-91f2-43b8-accc-0d7da5b8ad8c'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:13.199036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (277a8700-f399-48aa-a949-2a59565bf02f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.203285 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57676) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:13.228611 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cb0c1ec9-dcb5-49f5-bc26-d31d0ff4efce tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.3340065 Mar 24 02:14:13.230539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57678) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:13.235749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-87bdf1f9-67e0-4e29-b98b-98f1c9baaa8b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:13.235898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48fb6031-4f94-41b1-b092-8eddec2fe9fb None None] Network 75eb7762-ad4e-477f-ba6a-5185ce3ac565 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:13.243589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 09549143-6b71-4126-aca2-afdc3c7eeca9 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:13.260708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:13.267357 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.304888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b712b98b-f420-4f15-af3e-0f2c5a0f99b5), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.398009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:13.408995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:13.409666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 09549143-6b71-4126-aca2-afdc3c7eeca9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=09549143-6b71-4126-aca2-afdc3c7eeca9,segment=NetworkSegment(8650870d-314b-4c16-82b0-643582c0d5e4),segment_id=8650870d-314b-4c16-82b0-643582c0d5e4)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:13.419747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:13.423393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.434814 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:13.437196 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.451536 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Port': ['ID=b712b98b-f420-4f15-af3e-0f2c5a0f99b5,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:13.470706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05cac8c0-81da-4ed5-bdf6-29b78f93e05c None None] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:13.492272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-87bdf1f9-67e0-4e29-b98b-98f1c9baaa8b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-3298615'] for subnet (695c48a9-bfb3-4f02-8678-716854ae7fbb), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.506208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57682) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:13.510654 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fbc58009-16f4-47c8-bb4b-a5bbb5111565 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1007 time: 1.2420030 Mar 24 02:14:13.531855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '4b356bbf-257f-4afc-b498-4e10c679cf12'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:13.532749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.572164 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6098d2e0-efee-4758-80ea-dca48118ba4c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:13.609438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 6098d2e0-efee-4758-80ea-dca48118ba4c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:13.609802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6098d2e0-efee-4758-80ea-dca48118ba4c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:13.629247 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] For port 277a8700-f399-48aa-a949-2a59565bf02f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:13.661395 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2d1e0254-335f-4e4a-af6d-13dd5bd9f510 req-ef06cc87-3cba-4bd1-86db-aab0ce334eb8 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 210 time: 0.0765395 Mar 24 02:14:13.696656 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] For port 277a8700-f399-48aa-a949-2a59565bf02f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=277a8700-f399-48aa-a949-2a59565bf02f,segment=NetworkSegment(fa1aac63-3aee-4ae3-aba1-dd462153e0e9),segment_id=fa1aac63-3aee-4ae3-aba1-dd462153e0e9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:13.699577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-48070f3e-2241-4b65-8930-21d652687c9d None None] Provisioning complete for port 09549143-6b71-4126-aca2-afdc3c7eeca9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:13.699954 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-48070f3e-2241-4b65-8930-21d652687c9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.711355 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81b95bf9-5831-4243-8d34-1366752bdd9e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-75eb7762-ad4e-477f-ba6a-5185ce3ac565', 'network_id': '75eb7762-ad4e-477f-ba6a-5185ce3ac565', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': '695c48a9-bfb3-4f02-8678-716854ae7fbb'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:13.712255 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-81b95bf9-5831-4243-8d34-1366752bdd9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.721706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=09549143-6b71-4126-aca2-afdc3c7eeca9,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:13.735571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-87bdf1f9-67e0-4e29-b98b-98f1c9baaa8b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8790618889355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-8966603'] for subnet (695c48a9-bfb3-4f02-8678-716854ae7fbb), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.741402 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Allocated IP 172.20.0.7 (1ff12164-ce98-442e-81ee-e22f78c3a0ff/44e52247-2dfd-4416-b8c9-7ab69363e1f2/4716cbf2-4cfd-4eec-91c2-c814fff2a832) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:13.750546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-f4e0f76e-c358-440a-b39f-9914f1e8196b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:13.752060 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-f4e0f76e-c358-440a-b39f-9914f1e8196b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.30 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 946 time: 0.3948069 Mar 24 02:14:13.776331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87bdf1f9-67e0-4e29-b98b-98f1c9baaa8b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:13.776919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-87bdf1f9-67e0-4e29-b98b-98f1c9baaa8b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.780620 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-87bdf1f9-67e0-4e29-b98b-98f1c9baaa8b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "PUT /v2.0/subnets/695c48a9-bfb3-4f02-8678-716854ae7fbb HTTP/1.1" status: 200 len: 806 time: 0.5467041 Mar 24 02:14:13.782464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57684) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:13.790876 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (277a8700-f399-48aa-a949-2a59565bf02f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.823295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8360acde-ff36-491b-b230-e2a7516ab211 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:13.828683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8360acde-ff36-491b-b230-e2a7516ab211 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:13.834588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8360acde-ff36-491b-b230-e2a7516ab211 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:13.836270 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8360acde-ff36-491b-b230-e2a7516ab211 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2482 time: 0.2878628 Mar 24 02:14:13.865021 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57686) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:13.884385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87bdf1f9-67e0-4e29-b98b-98f1c9baaa8b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=695c48a9-bfb3-4f02-8678-716854ae7fbb,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:13.898668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:13.902078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:13.923828 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (75eb7762-ad4e-477f-ba6a-5185ce3ac565), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.012655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (695c48a9-bfb3-4f02-8678-716854ae7fbb), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.061751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 2001:db8::1 (8c6458ba-91f2-43b8-accc-0d7da5b8ad8c/71bcd0f2-d2a9-49de-abca-c367b71a913d/54614a41-47d8-4928-8bec-a178fd47cff8) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:14.096512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (695c48a9-bfb3-4f02-8678-716854ae7fbb), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.150644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=695c48a9-bfb3-4f02-8678-716854ae7fbb,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:14.211504 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (75eb7762-ad4e-477f-ba6a-5185ce3ac565), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.243766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7971b5a9-8997-4377-81e6-4ed2f6b674a4 None None] Pushing event updated for resources: {'Port': ['ID=277a8700-f399-48aa-a949-2a59565bf02f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:14.248915 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['75eb7762-ad4e-477f-ba6a-5185ce3ac565']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:14.267483 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '49c43042-83a7-4e8d-8060-a84e1a7987bd') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:14.267725 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '49c43042-83a7-4e8d-8060-a84e1a7987bd') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server [None req-81b95bf9-5831-4243-8d34-1366752bdd9e None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 695c48a9-bfb3-4f02-8678-716854ae7fbb: This subnet is being modified by another concurrent operation. Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 278, in create_dhcp_port Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:14:14.272188 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1504, in create_port Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1469, in _create_port_db Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1467, in create_port_db Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 691, in _ipam_get_subnets Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnet.lock_register( Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise exception Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 695c48a9-bfb3-4f02-8678-716854ae7fbb: This subnet is being modified by another concurrent operation. Mar 24 02:14:14.275827 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Mar 24 02:14:14.283063 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (49c43042-83a7-4e8d-8060-a84e1a7987bd), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.302109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Allocated IP 172.20.0.2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/4b356bbf-257f-4afc-b498-4e10c679cf12/38139c4e-e6f5-44ed-9b98-9e753276133f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:14.307818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (49c43042-83a7-4e8d-8060-a84e1a7987bd), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.308371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8aa541f-3945-4f5c-8918-515b9ede6835 None None] Network 75eb7762-ad4e-477f-ba6a-5185ce3ac565 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:14.321983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 111 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:14.322670 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (49c43042-83a7-4e8d-8060-a84e1a7987bd), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.398275 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-48070f3e-2241-4b65-8930-21d652687c9d None None] Current status of the port 09549143-6b71-4126-aca2-afdc3c7eeca9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:14.404519 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:14.410079 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (75eb7762-ad4e-477f-ba6a-5185ce3ac565), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.430367 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.435250 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/75eb7762-ad4e-477f-ba6a-5185ce3ac565 HTTP/1.1" status: 204 len: 168 time: 0.6506934 Mar 24 02:14:14.449746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57690) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:14.464341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e48d70-c53f-4f3f-9976-2c5ad3073778 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=75eb7762-ad4e-477f-ba6a-5185ce3ac565,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:14.499538 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-d619be67-c36d-4fb4-8c49-28815365c9bf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:14.500386 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d619be67-c36d-4fb4-8c49-28815365c9bf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:14.511929 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d619be67-c36d-4fb4-8c49-28815365c9bf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/75eb7762-ad4e-477f-ba6a-5185ce3ac565 HTTP/1.1" status: 404 len: 339 time: 0.0531800 Mar 24 02:14:14.512855 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57692) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:14.519212 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1713716920', 'description': 'd1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:14.542327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9339401-9365-4a1f-aef8-fd277dc0530e None None] Network 75eb7762-ad4e-477f-ba6a-5185ce3ac565 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:14.549506 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:14.555051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.604145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 122} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:14.639407 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (225c6f18-51d3-4a53-9749-7782002a0216), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.639762 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment 225c6f18-51d3-4a53-9749-7782002a0216 of type vlan for network e4f3a925-03b0-4923-8fec-591295c5e770 Mar 24 02:14:14.652996 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9339401-9365-4a1f-aef8-fd277dc0530e None None] Network 75eb7762-ad4e-477f-ba6a-5185ce3ac565 could not be found, it might have been deleted concurrently. {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:196}} Mar 24 02:14:14.685895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Publish callbacks [] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.696149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (e4f3a925-03b0-4923-8fec-591295c5e770), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.712472 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.753225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (e4f3a925-03b0-4923-8fec-591295c5e770), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.767792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:14.770794 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1600378'] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.793664 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Pushing event updated for resources: {'Port': ['ID=38139c4e-e6f5-44ed-9b98-9e753276133f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:14.801672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:14.803700 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:14.807544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:14.812998 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 09549143-6b71-4126-aca2-afdc3c7eeca9 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:14.850766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10c3a4fb-e6d0-4bf3-937a-fe3a9811c96c req-f024079a-af83-4ea0-b181-ecc671302c30 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:14.861614 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-10c3a4fb-e6d0-4bf3-937a-fe3a9811c96c req-f024079a-af83-4ea0-b181-ecc671302c30 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 946 time: 0.8017149 Mar 24 02:14:14.866588 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 0.3508103 Mar 24 02:14:14.869308 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57700) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:14.918768 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9c34ec34-8549-4c76-83fa-28253bd2d5b0 req-f6ad3b83-7b96-4654-87ce-7013027bb13f tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 210 time: 0.1231220 Mar 24 02:14:14.944486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Deleting port dba04693-4495-4586-b5e4-7de9e3b2abd3 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:14.944921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.958876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e67f09-5d92-4031-8551-23faf8f3f65e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=e4f3a925-03b0-4923-8fec-591295c5e770,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:14.971695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:14.980111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network e4f3a925-03b0-4923-8fec-591295c5e770 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:14.992894 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.003479 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cbac857-274d-47f3-8464-3c90ebd6fda1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:15.005039 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4cbac857-274d-47f3-8464-3c90ebd6fda1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/networks?id=e4f3a925-03b0-4923-8fec-591295c5e770 HTTP/1.1" status: 200 len: 761 time: 0.1346388 Mar 24 02:14:15.008328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57702) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:15.019119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5075e26e-1b12-49cf-8943-af5c504743e1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'description': 'd2'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:15.042769 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Attempting to bind port 38139c4e-e6f5-44ed-9b98-9e753276133f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:15.044438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Attempting to bind port 38139c4e-e6f5-44ed-9b98-9e753276133f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:15.045046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Attempting to bind port 38139c4e-e6f5-44ed-9b98-9e753276133f on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:15.048360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ea818258-0604-4783-a011-dadfbfe8686b None None] Provisioning complete for port b712b98b-f420-4f15-af3e-0f2c5a0f99b5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:15.055462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ea818258-0604-4783-a011-dadfbfe8686b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b712b98b-f420-4f15-af3e-0f2c5a0f99b5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.154128 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ea818258-0604-4783-a011-dadfbfe8686b None None] Port b712b98b-f420-4f15-af3e-0f2c5a0f99b5 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:15.156022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:15.156347 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:15.156783 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.157222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:15.157714 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Bound port: 38139c4e-e6f5-44ed-9b98-9e753276133f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:15.158100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.171419 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3726127d-5289-47ac-9a78-b9b13aae1710 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Deleting port b712b98b-f420-4f15-af3e-0f2c5a0f99b5 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:15.172082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3726127d-5289-47ac-9a78-b9b13aae1710 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b712b98b-f420-4f15-af3e-0f2c5a0f99b5), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.232381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 09549143-6b71-4126-aca2-afdc3c7eeca9 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:15.239183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.285239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5075e26e-1b12-49cf-8943-af5c504743e1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (e4f3a925-03b0-4923-8fec-591295c5e770), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.322474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5075e26e-1b12-49cf-8943-af5c504743e1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (e4f3a925-03b0-4923-8fec-591295c5e770), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.339082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-5075e26e-1b12-49cf-8943-af5c504743e1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network e4f3a925-03b0-4923-8fec-591295c5e770 is not hosted by any dhcp agent {{(pid=104036) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Mar 24 02:14:15.345656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5075e26e-1b12-49cf-8943-af5c504743e1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:15.346280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5075e26e-1b12-49cf-8943-af5c504743e1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.347029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ea818258-0604-4783-a011-dadfbfe8686b None None] Provisioning complete for port 09549143-6b71-4126-aca2-afdc3c7eeca9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:15.350814 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ea818258-0604-4783-a011-dadfbfe8686b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.350985 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5075e26e-1b12-49cf-8943-af5c504743e1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "PUT /v2.0/networks/e4f3a925-03b0-4923-8fec-591295c5e770 HTTP/1.1" status: 200 len: 758 time: 0.3353887 Mar 24 02:14:15.360264 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] For port dba04693-4495-4586-b5e4-7de9e3b2abd3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dba04693-4495-4586-b5e4-7de9e3b2abd3,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:15.360633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.369655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57706) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:15.396594 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.470504 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5075e26e-1b12-49cf-8943-af5c504743e1 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=e4f3a925-03b0-4923-8fec-591295c5e770,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:15.508032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network e4f3a925-03b0-4923-8fec-591295c5e770 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:15.532707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] For port 38139c4e-e6f5-44ed-9b98-9e753276133f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:15.569385 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 09549143-6b71-4126-aca2-afdc3c7eeca9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:15.570668 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 277a8700-f399-48aa-a949-2a59565bf02f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:15.583216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] For port 38139c4e-e6f5-44ed-9b98-9e753276133f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=38139c4e-e6f5-44ed-9b98-9e753276133f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:15.585731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (54614a41-47d8-4928-8bec-a178fd47cff8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.601199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3726127d-5289-47ac-9a78-b9b13aae1710 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b712b98b-f420-4f15-af3e-0f2c5a0f99b5), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.624869 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.661526 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-10c3a4fb-e6d0-4bf3-937a-fe3a9811c96c req-c6cc21b9-f0ba-4039-815b-dcef27c8cb6e tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7983036 Mar 24 02:14:15.677510 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60d3d4de-3913-4780-9f6f-fd82ee6e0d50 None None] Network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:15.744037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3726127d-5289-47ac-9a78-b9b13aae1710 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Calling delete_port for b712b98b-f420-4f15-af3e-0f2c5a0f99b5 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:15.790330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3af587-1e6e-4d39-8808-830fc4b0996e None None] Pushing event updated for resources: {'Port': ['ID=38139c4e-e6f5-44ed-9b98-9e753276133f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:15.795958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ea818258-0604-4783-a011-dadfbfe8686b None None] Current status of the port 09549143-6b71-4126-aca2-afdc3c7eeca9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:15.817409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 277a8700-f399-48aa-a949-2a59565bf02f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:15.818307 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (277a8700-f399-48aa-a949-2a59565bf02f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.840389 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Network 1ff12164-ce98-442e-81ee-e22f78c3a0ff is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:15.857684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ea818258-0604-4783-a011-dadfbfe8686b None None] Provisioning complete for port 00d8a992-8adf-4f43-babc-21b4ffd00c25 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:15.858064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ea818258-0604-4783-a011-dadfbfe8686b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (00d8a992-8adf-4f43-babc-21b4ffd00c25), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:15.869517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:15.893691 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:15.919142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'Port': ['ID=4716cbf2-4cfd-4eec-91c2-c814fff2a832,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:15.941873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ea818258-0604-4783-a011-dadfbfe8686b None None] Port 00d8a992-8adf-4f43-babc-21b4ffd00c25 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:16.016889 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 277a8700-f399-48aa-a949-2a59565bf02f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:16.017286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (277a8700-f399-48aa-a949-2a59565bf02f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.060249 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4897f7ee-50c9-4b08-b94f-c66fdd35d813 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:16.064279 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4897f7ee-50c9-4b08-b94f-c66fdd35d813 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/networks?id=e4f3a925-03b0-4923-8fec-591295c5e770 HTTP/1.1" status: 200 len: 761 time: 0.6827028 Mar 24 02:14:16.068996 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57712) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:16.069963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 277a8700-f399-48aa-a949-2a59565bf02f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=277a8700-f399-48aa-a949-2a59565bf02f,segment=NetworkSegment(fa1aac63-3aee-4ae3-aba1-dd462153e0e9),segment_id=fa1aac63-3aee-4ae3-aba1-dd462153e0e9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:16.074101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1864127112'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:16.081829 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (277a8700-f399-48aa-a949-2a59565bf02f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.110884 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:16.114450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.170688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0571dbb3-c589-42b1-8241-7fec23c2c820 None None] Provisioning complete for port b712b98b-f420-4f15-af3e-0f2c5a0f99b5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:16.171151 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0571dbb3-c589-42b1-8241-7fec23c2c820 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b712b98b-f420-4f15-af3e-0f2c5a0f99b5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.186499 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 109} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:16.216953 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (aec3db35-3aa5-4c62-8160-b3d6800301bd), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.217810 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment aec3db35-3aa5-4c62-8160-b3d6800301bd of type vlan for network 067f3f77-cb28-48ea-8053-0ed6e6e8b32d Mar 24 02:14:16.226637 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=277a8700-f399-48aa-a949-2a59565bf02f,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:16.236818 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0571dbb3-c589-42b1-8241-7fec23c2c820 None None] Port b712b98b-f420-4f15-af3e-0f2c5a0f99b5 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:16.255367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0571dbb3-c589-42b1-8241-7fec23c2c820 None None] Provisioning complete for port 277a8700-f399-48aa-a949-2a59565bf02f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:16.256241 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0571dbb3-c589-42b1-8241-7fec23c2c820 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (277a8700-f399-48aa-a949-2a59565bf02f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.279736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (067f3f77-cb28-48ea-8053-0ed6e6e8b32d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.299851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (54614a41-47d8-4928-8bec-a178fd47cff8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.319901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660f150d-2eb8-47fe-acff-b98996759641 req-630b968d-38b6-48c2-8ece-9c913c42ea5c tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:16.321554 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-660f150d-2eb8-47fe-acff-b98996759641 req-630b968d-38b6-48c2-8ece-9c913c42ea5c tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 945 time: 0.7800856 Mar 24 02:14:16.330283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (067f3f77-cb28-48ea-8053-0ed6e6e8b32d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.348152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:16.349852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.365192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0571dbb3-c589-42b1-8241-7fec23c2c820 None None] Current status of the port 277a8700-f399-48aa-a949-2a59565bf02f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:16.366258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:16.366945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.384741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0571dbb3-c589-42b1-8241-7fec23c2c820 None None] Provisioning complete for port 00d8a992-8adf-4f43-babc-21b4ffd00c25 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:16.385363 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0571dbb3-c589-42b1-8241-7fec23c2c820 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (00d8a992-8adf-4f43-babc-21b4ffd00c25), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.429137 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0571dbb3-c589-42b1-8241-7fec23c2c820 None None] Port 00d8a992-8adf-4f43-babc-21b4ffd00c25 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:16.454009 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.3814278 Mar 24 02:14:16.454212 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57714) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:16.459023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': '067f3f77-cb28-48ea-8053-0ed6e6e8b32d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:16.463744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad188c4e-46f3-43b7-8711-0b003d03bb27 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=067f3f77-cb28-48ea-8053-0ed6e6e8b32d,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:16.475462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 067f3f77-cb28-48ea-8053-0ed6e6e8b32d details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:16.483215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.483580 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (a4d631f5-1e36-4cb9-a3b6-9fa1737e7397), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.483895 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Floating IP a4d631f5-1e36-4cb9-a3b6-9fa1737e7397 disassociated. External IP: 172.26.2.66, port: dba04693-4495-4586-b5e4-7de9e3b2abd3. Mar 24 02:14:16.484237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Calling delete_port for dba04693-4495-4586-b5e4-7de9e3b2abd3 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:16.525234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:16.527563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:16.552233 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:16.553304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (b7625b45-c8e2-4384-becd-84c71dc4e270), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.558249 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-a6b239ec-044d-4e19-bab9-f68f1d09d61d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.2655697 Mar 24 02:14:16.583623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a9a1b5af-e94e-4b97-9c49-0b3749dc5ce1 None None] Provisioning complete for port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:16.584161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a9a1b5af-e94e-4b97-9c49-0b3749dc5ce1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.595799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:16.600284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.618077 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-660f150d-2eb8-47fe-acff-b98996759641 req-390f7ea0-d997-4dc8-9853-2f2ce2adc67b tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2235832 Mar 24 02:14:16.623329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Request body: {'port': {'device_id': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:16.679839 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a9a1b5af-e94e-4b97-9c49-0b3749dc5ce1 None None] Port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:16.718997 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a9a1b5af-e94e-4b97-9c49-0b3749dc5ce1 None None] Provisioning complete for port 277a8700-f399-48aa-a949-2a59565bf02f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:16.719423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a9a1b5af-e94e-4b97-9c49-0b3749dc5ce1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (277a8700-f399-48aa-a949-2a59565bf02f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.837549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=54614a41-47d8-4928-8bec-a178fd47cff8,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:16.888426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a9a1b5af-e94e-4b97-9c49-0b3749dc5ce1 None None] Current status of the port 277a8700-f399-48aa-a949-2a59565bf02f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:16.892111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 38139c4e-e6f5-44ed-9b98-9e753276133f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:16.923863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5898c2e4-62bb-4f57-9dd9-e7dab5d39d59 req-1f6a64d9-0430-4922-8a96-3d05197eb542 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:16.925474 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5898c2e4-62bb-4f57-9dd9-e7dab5d39d59 req-1f6a64d9-0430-4922-8a96-3d05197eb542 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 931 time: 0.8053384 Mar 24 02:14:16.934455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (fbf496ed-b988-4f8c-8df1-30398262abfc), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:16.967691 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 38139c4e-e6f5-44ed-9b98-9e753276133f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:16.968071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.008887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=fbf496ed-b988-4f8c-8df1-30398262abfc,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:17.024616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-aafb47f0-901a-41ce-b8cd-2359c4e6a440 None None] Provisioning complete for port 54614a41-47d8-4928-8bec-a178fd47cff8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:17.024994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aafb47f0-901a-41ce-b8cd-2359c4e6a440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (54614a41-47d8-4928-8bec-a178fd47cff8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.039639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': 'aec3db35-3aa5-4c62-8160-b3d6800301bd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '067f3f77-cb28-48ea-8053-0ed6e6e8b32d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:17.039984 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: 067f3f77-cb28-48ea-8053-0ed6e6e8b32d, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:17.059467 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network 067f3f77-cb28-48ea-8053-0ed6e6e8b32d is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:17.072487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 067f3f77-cb28-48ea-8053-0ed6e6e8b32d) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:17.081581 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:17.082179 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.094598 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6130cd11-126c-405e-a751-15b6888d3d08 None None] Network 067f3f77-cb28-48ea-8053-0ed6e6e8b32d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:17.100094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-aafb47f0-901a-41ce-b8cd-2359c4e6a440 None None] Port 54614a41-47d8-4928-8bec-a178fd47cff8 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:17.116923 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7f61e771-0c04-4af8-b961-e7d3579be025 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6615727 Mar 24 02:14:17.119320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57718) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:17.170590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 38139c4e-e6f5-44ed-9b98-9e753276133f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:17.171022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.204213 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3726127d-5289-47ac-9a78-b9b13aae1710 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (b712b98b-f420-4f15-af3e-0f2c5a0f99b5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.229787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 38139c4e-e6f5-44ed-9b98-9e753276133f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=38139c4e-e6f5-44ed-9b98-9e753276133f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:17.240314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.240314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 277a8700-f399-48aa-a949-2a59565bf02f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:17.271476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (54614a41-47d8-4928-8bec-a178fd47cff8), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.274226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.283143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d458a12-d934-40df-9b36-8e4a8d8ca03a req-449cfe00-49de-4c37-bf0e-3d6c3e27c13a tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:17.283379 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-5338cd6e-3868-484a-ac85-d6e6ab2ab9a6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:17.284919 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d458a12-d934-40df-9b36-8e4a8d8ca03a req-449cfe00-49de-4c37-bf0e-3d6c3e27c13a tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 946 time: 0.4509761 Mar 24 02:14:17.285057 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-5338cd6e-3868-484a-ac85-d6e6ab2ab9a6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.30 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 945 time: 0.1357837 Mar 24 02:14:17.291057 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (067f3f77-cb28-48ea-8053-0ed6e6e8b32d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.308377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:14:17.322023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3726127d-5289-47ac-9a78-b9b13aae1710 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event deleted for resources: {'Port': ['ID=b712b98b-f420-4f15-af3e-0f2c5a0f99b5,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:17.325643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=38139c4e-e6f5-44ed-9b98-9e753276133f,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:17.368915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe9d5e67-5de0-4b5e-8f35-5ff22a432a47 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-067f3f77-cb28-48ea-8053-0ed6e6e8b32d', 'network_id': '067f3f77-cb28-48ea-8053-0ed6e6e8b32d', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': 'fbf496ed-b988-4f8c-8df1-30398262abfc'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:17.369891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fe9d5e67-5de0-4b5e-8f35-5ff22a432a47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.387701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 277a8700-f399-48aa-a949-2a59565bf02f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:17.388129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (277a8700-f399-48aa-a949-2a59565bf02f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.426638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (fbf496ed-b988-4f8c-8df1-30398262abfc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.486684 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Deleting port 3f03ca03-be93-4662-af2b-73bbfc93a9da {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:17.487019 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.552958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 277a8700-f399-48aa-a949-2a59565bf02f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:17.556448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (fbf496ed-b988-4f8c-8df1-30398262abfc), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.573782 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fb0d2bfb-0a65-48c0-81c1-ca06e38ed467 None None] Provisioning complete for port 38139c4e-e6f5-44ed-9b98-9e753276133f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:17.574154 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fb0d2bfb-0a65-48c0-81c1-ca06e38ed467 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.595531 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=fbf496ed-b988-4f8c-8df1-30398262abfc,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:17.675960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] For port 3f03ca03-be93-4662-af2b-73bbfc93a9da, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=3f03ca03-be93-4662-af2b-73bbfc93a9da,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:17.676692 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.698246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (067f3f77-cb28-48ea-8053-0ed6e6e8b32d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server [None req-fe9d5e67-5de0-4b5e-8f35-5ff22a432a47 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet fbf496ed-b988-4f8c-8df1-30398262abfc: This subnet is being modified by another concurrent operation. Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 278, in create_dhcp_port Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:14:17.755868 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1504, in create_port Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1469, in _create_port_db Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1467, in create_port_db Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 691, in _ipam_get_subnets Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnet.lock_register( Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise exception Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet fbf496ed-b988-4f8c-8df1-30398262abfc: This subnet is being modified by another concurrent operation. Mar 24 02:14:17.760092 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Mar 24 02:14:17.774213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.30', 58695) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:17.832314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device dba04693-4495-4586-b5e4-7de9e3b2abd3 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:17.886032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fb0d2bfb-0a65-48c0-81c1-ca06e38ed467 None None] Current status of the port 38139c4e-e6f5-44ed-9b98-9e753276133f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:17.945576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c6e7797-fd8f-4ee6-b48f-17fea47f32ca None None] Network 067f3f77-cb28-48ea-8053-0ed6e6e8b32d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:17.962015 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5898c2e4-62bb-4f57-9dd9-e7dab5d39d59 req-58e66f9c-e264-4c88-b900-7f046eae14c5 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.9964581 Mar 24 02:14:18.047018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port dba04693-4495-4586-b5e4-7de9e3b2abd3 is: ACTIVE; New status is: DOWN {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:18.047018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.151496 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee2cfd56-cfb3-4e96-9693-350b2b5872f3 None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:14:18.216821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['067f3f77-cb28-48ea-8053-0ed6e6e8b32d']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:18.249351 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aec3db35-3aa5-4c62-8160-b3d6800301bd') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:18.249731 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aec3db35-3aa5-4c62-8160-b3d6800301bd') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:18.276495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3726127d-5289-47ac-9a78-b9b13aae1710 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.282244 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3726127d-5289-47ac-9a78-b9b13aae1710 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "DELETE /v2.0/ports/b712b98b-f420-4f15-af3e-0f2c5a0f99b5 HTTP/1.1" status: 204 len: 168 time: 4.4131668 Mar 24 02:14:18.291639 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee2cfd56-cfb3-4e96-9693-350b2b5872f3 None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:14:18.302298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57722) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:18.318555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (aec3db35-3aa5-4c62-8160-b3d6800301bd), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.334854 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-62b5d7eb-00a2-4000-9478-3df39081a54b service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.5565012 Mar 24 02:14:18.343216 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d458a12-d934-40df-9b36-8e4a8d8ca03a req-76110417-2f95-457b-9883-366e89decefc tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups?id=eef280c3-0009-459a-81fe-def34b7b79a0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 1.0289006 Mar 24 02:14:18.358744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (aec3db35-3aa5-4c62-8160-b3d6800301bd), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.369239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:18.369239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (aec3db35-3aa5-4c62-8160-b3d6800301bd), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:18.371773 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:18.394102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (dba04693-4495-4586-b5e4-7de9e3b2abd3), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.443829 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-655378ac-fc9f-4717-a33c-3c72be7bca92 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] GET failed (client error): The resource could not be found. Mar 24 02:14:18.448757 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-655378ac-fc9f-4717-a33c-3c72be7bca92 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "GET /v2.0/ports/b712b98b-f420-4f15-af3e-0f2c5a0f99b5 HTTP/1.1" status: 404 len: 333 time: 0.1317885 Mar 24 02:14:18.449752 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57724) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:18.456995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'port': {'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1802437811'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:18.540276 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0543eb40-2f5b-4e14-83fa-0508752f5bfd None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:14:18.542729 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Pushing event deleted for resources: {'Port': ['ID=dba04693-4495-4586-b5e4-7de9e3b2abd3,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:18.568536 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (067f3f77-cb28-48ea-8053-0ed6e6e8b32d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.574343 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ac7a8b9-4000-47ea-ac24-86567caea97f req-eb9f6844-1880-4c71-9eec-39cc60a84cfa tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:18.576035 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8ac7a8b9-4000-47ea-ac24-86567caea97f req-eb9f6844-1880-4c71-9eec-39cc60a84cfa tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 945 time: 0.4584723 Mar 24 02:14:18.609040 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.626570 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/067f3f77-cb28-48ea-8053-0ed6e6e8b32d HTTP/1.1" status: 204 len: 168 time: 1.5039103 Mar 24 02:14:18.628890 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57726) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:18.642224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33dd81a-52b9-4367-b127-f12af25a7ac8 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=067f3f77-cb28-48ea-8053-0ed6e6e8b32d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:18.660819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.662580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (68838617-65cc-46a4-a440-36592cc8777d), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.662881 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Floating IP 68838617-65cc-46a4-a440-36592cc8777d disassociated. External IP: 172.26.2.120, port: 3f03ca03-be93-4662-af2b-73bbfc93a9da. Mar 24 02:14:18.663349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Calling delete_port for 3f03ca03-be93-4662-af2b-73bbfc93a9da owned by compute:nova {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:18.683015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-bae27322-6d61-49e6-84d4-a39c872d8020 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:18.684526 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-bae27322-6d61-49e6-84d4-a39c872d8020 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 1130 time: 0.3013284 Mar 24 02:14:18.704969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4716cbf2-4cfd-4eec-91c2-c814fff2a832 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:14:18.715047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Publish callbacks [] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.715482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0543eb40-2f5b-4e14-83fa-0508752f5bfd None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:14:18.723316 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 38139c4e-e6f5-44ed-9b98-9e753276133f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:18.736640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Transition to ACTIVE for port object 4716cbf2-4cfd-4eec-91c2-c814fff2a832 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:14:18.835293 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Made reservation on behalf of 15c69ad0648c47419b3ead64ebe342de for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:18.838676 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.884097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] device_id is not set on port 066c6253-bc5e-4309-b9f1-d8aff6a73dc5 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:18.894799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-2014d5fb-84ad-4f7a-8a68-21cbb6f7372f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:18.896443 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-2014d5fb-84ad-4f7a-8a68-21cbb6f7372f service neutron] 10.222.0.30 "GET /v2.0/networks?id=597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 200 len: 913 time: 0.1633570 Mar 24 02:14:18.903118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.905783 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 38139c4e-e6f5-44ed-9b98-9e753276133f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:18.906255 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.918249 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:18.926888 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-d9fff343-3238-4c73-8b11-88451a282ab5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] GET failed (client error): The resource could not be found. Mar 24 02:14:18.932034 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d9fff343-3238-4c73-8b11-88451a282ab5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/subnets/fbf496ed-b988-4f8c-8df1-30398262abfc HTTP/1.1" status: 404 len: 337 time: 0.2880683 Mar 24 02:14:18.932756 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57728) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:19.066391 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-ef87e7b6-373c-44a5-9848-8590cde9718e service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 200 len: 1001 time: 0.1396453 Mar 24 02:14:19.109245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 38139c4e-e6f5-44ed-9b98-9e753276133f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:19.159354 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8ac7a8b9-4000-47ea-ac24-86567caea97f req-9367d440-6a32-4b84-8d12-2d5ecb5c50ed tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups?id=79e8d0c0-2674-47ef-8eea-b630f6955be7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5432153 Mar 24 02:14:19.165235 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (3f03ca03-be93-4662-af2b-73bbfc93a9da), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:19.234371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-86128557-fc7a-49f9-a024-bf66dd6dd10f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:19.235931 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-86128557-fc7a-49f9-a024-bf66dd6dd10f service neutron] 10.222.0.30 "GET /v2.0/subnets?id=56374a24-4e35-434f-b4b8-860ef8289893 HTTP/1.1" status: 200 len: 851 time: 0.1621540 Mar 24 02:14:19.253402 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-74f3ef16-a7d7-4388-b3f6-f1948c31bba5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:19.254112 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-74f3ef16-a7d7-4388-b3f6-f1948c31bba5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:19.256622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Allocated IP 2001:db8::72 (0c765cab-bf54-40f0-922b-903bce6e75d2/08fb8372-ea73-460b-891f-1f1021e06112/066c6253-bc5e-4309-b9f1-d8aff6a73dc5) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:19.257908 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-74f3ef16-a7d7-4388-b3f6-f1948c31bba5 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/067f3f77-cb28-48ea-8053-0ed6e6e8b32d HTTP/1.1" status: 404 len: 339 time: 0.1714027 Mar 24 02:14:19.264905 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Pushing event deleted for resources: {'Port': ['ID=3f03ca03-be93-4662-af2b-73bbfc93a9da,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:19.272609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57732) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:19.273117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (54614a41-47d8-4928-8bec-a178fd47cff8), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:19.318921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (54614a41-47d8-4928-8bec-a178fd47cff8), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:19.319798 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (b7625b45-c8e2-4384-becd-84c71dc4e270), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:19.355700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Pushing event updated for resources: {'Port': ['ID=4716cbf2-4cfd-4eec-91c2-c814fff2a832,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:19.456447 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ceb8a4-e018-49b9-a06d-1ba832f49f4f req-52c68ab1-0f3c-45dd-9596-e3d748fea7ff tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:19.458253 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49ceb8a4-e018-49b9-a06d-1ba832f49f4f req-52c68ab1-0f3c-45dd-9596-e3d748fea7ff tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 943 time: 0.3442905 Mar 24 02:14:19.600123 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0f6d3f63-546a-499f-942a-106dcecee9ee req-82c43bf1-9c94-4004-9a0b-95d13c0dd7fc tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 210 time: 0.1208951 Mar 24 02:14:19.605720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] For port 38139c4e-e6f5-44ed-9b98-9e753276133f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=38139c4e-e6f5-44ed-9b98-9e753276133f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:19.655357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:14:19.657813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=54614a41-47d8-4928-8bec-a178fd47cff8,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:19.665015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-2b5bfa71-c689-4521-b287-5cde5239c340 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:19.666627 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-2b5bfa71-c689-4521-b287-5cde5239c340 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=597625fc-4c02-4901-9b3e-46b781f61da1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.4187365 Mar 24 02:14:19.680063 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3fdc879-500b-496a-abd0-bd262c346741 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:19.684884 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e3fdc879-500b-496a-abd0-bd262c346741 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.4084973 Mar 24 02:14:19.691848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57736) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:19.694830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Attempting to bind port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:19.695260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Attempting to bind port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:19.695814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Attempting to bind port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 on network 1ff12164-ce98-442e-81ee-e22f78c3a0ff {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:19.760287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:19.766239 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49ceb8a4-e018-49b9-a06d-1ba832f49f4f req-58178394-b5ad-4b0f-a331-b3032d923154 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2579424 Mar 24 02:14:19.766961 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 on network 1ff12164-ce98-442e-81ee-e22f78c3a0ff not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:14:19.767367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Attempting to bind port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 on network 1ff12164-ce98-442e-81ee-e22f78c3a0ff {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:19.775170 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2af38be8-e746-44f0-b766-103a87092a57 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 207 time: 0.0812671 Mar 24 02:14:19.778975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:19.779595 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57738) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:19.794398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:19.794919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Checking segment: {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:19.795402 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Bound using segment: {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:19.795951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Bound port: 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b448347f-bded-4382-8e80-6253172a6577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:19.796550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:19.823705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:14:19.858982 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:20.131080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:20.148824 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-bb3da294-9aaa-45c6-b61f-813ce34c6d54 service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4660375 Mar 24 02:14:20.167085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2258a088-1f71-48ca-a7b2-ae748e682926 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:20.172540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2258a088-1f71-48ca-a7b2-ae748e682926 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:20.180567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2258a088-1f71-48ca-a7b2-ae748e682926 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:20.183793 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (583274b6-3d5a-4b07-8a2f-cd1764f06413), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:20.185833 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2258a088-1f71-48ca-a7b2-ae748e682926 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:20.187106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:20.192459 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2258a088-1f71-48ca-a7b2-ae748e682926 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2485 time: 0.4081390 Mar 24 02:14:20.200451 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57740) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:20.232797 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:20.249898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] Sync routers for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:20.274296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:20.275035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:20.374904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] No DVR routers for this DVR port 3f03ca03-be93-4662-af2b-73bbfc93a9da on host hv-neutron-8348 {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:20.432350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:20.432847 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=38139c4e-e6f5-44ed-9b98-9e753276133f,revision_number=5']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:20.437362 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.30 "DELETE /v2.0/ports/3f03ca03-be93-4662-af2b-73bbfc93a9da HTTP/1.1" status: 204 len: 173 time: 3.1435993 Mar 24 02:14:20.438343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65964499-8a52-4d24-90bb-505fb03cb88a', 'name': 'network-vif-deleted', 'tag': '3f03ca03-be93-4662-af2b-73bbfc93a9da'}] {{(pid=104036) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:14:20.440864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d6177697792ca3fff01bbfc58b3e16cb8a22905a2f74e66d9151ebb6b50c8f9c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-614ef75c-31a9-4ec0-9cea-ffb74f880c17" -d '{"events": [{"server_uuid": "65964499-8a52-4d24-90bb-505fb03cb88a", "name": "network-vif-deleted", "tag": "3f03ca03-be93-4662-af2b-73bbfc93a9da"}]}' {{(pid=104036) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:14:20.452119 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-3ebfb525-d794-4a9d-bd7d-52d6c09b9b85 req-63ee775d-6b4a-4df6-bd9f-247486ec139f service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2616301 Mar 24 02:14:20.468377 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:20.498330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:20.501775 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:20.599946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:14:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-badde35c-c3bb-4d96-8064-2682e507420c x-openstack-request-id: req-badde35c-c3bb-4d96-8064-2682e507420c {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:14:20.602844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "65964499-8a52-4d24-90bb-505fb03cb88a", "name": "network-vif-deleted", "tag": "3f03ca03-be93-4662-af2b-73bbfc93a9da", "status": "completed", "code": 200}]} {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:14:20.603122 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-badde35c-c3bb-4d96-8064-2682e507420c {{(pid=104036) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:14:20.603560 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.notifiers.nova [-] Nova event matching ['req-badde35c-c3bb-4d96-8064-2682e507420c'] response: {'server_uuid': '65964499-8a52-4d24-90bb-505fb03cb88a', 'name': 'network-vif-deleted', 'tag': '3f03ca03-be93-4662-af2b-73bbfc93a9da', 'status': 'completed', 'code': 200} Mar 24 02:14:20.639064 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:20.654039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:20.654876 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:20.657687 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcd9065a-d586-404c-a2c8-452f303bc067 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:20.680820 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Port': ['ID=066c6253-bc5e-4309-b9f1-d8aff6a73dc5,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:20.703801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:20.705423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:20.711456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:20.727542 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:20.728725 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:20.735520 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:20.744085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:20.762745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=583274b6-3d5a-4b07-8a2f-cd1764f06413,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:20.763521 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-baf128ad-bac9-400a-a8b2-0c76cef8d353 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.3126202 Mar 24 02:14:20.764178 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57748) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:20.767347 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a8ac5d21-5ae0-4d31-8420-8968eb9dcbae req-e6f38daa-ca01-4d7e-b44c-cf8ac9a1d6ee tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/ports?device_id=65964499-8a52-4d24-90bb-505fb03cb88a HTTP/1.1" status: 200 len: 210 time: 0.3697693 Mar 24 02:14:20.789077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-be61e605-b9f8-42d6-a0d8-def19778b81c tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::2f1', 'mac_address': 'fa:16:3e:ed:14:3b'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:20.871788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:20.886624 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 38139c4e-e6f5-44ed-9b98-9e753276133f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:21.038745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5da7596b-7dc0-4a8d-821f-a23eae983e82 None None] Provisioning complete for port 54614a41-47d8-4928-8bec-a178fd47cff8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:21.038745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5da7596b-7dc0-4a8d-821f-a23eae983e82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (54614a41-47d8-4928-8bec-a178fd47cff8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:21.079878 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5da7596b-7dc0-4a8d-821f-a23eae983e82 None None] Port 54614a41-47d8-4928-8bec-a178fd47cff8 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:21.190455 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-88097e9d-19b0-4ddd-84dd-80694f644c34 req-7ed57e70-259e-444b-a3fb-53c7bfa92afc tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 210 time: 0.4013317 Mar 24 02:14:21.198898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 38139c4e-e6f5-44ed-9b98-9e753276133f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:21.199657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:21.206420 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be61e605-b9f8-42d6-a0d8-def19778b81c tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:21.207313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Pushing event updated for resources: {'Port': ['ID=4716cbf2-4cfd-4eec-91c2-c814fff2a832,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:21.242902 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a5affb24-cc93-4e69-8e9d-43c230c864e7 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 574 time: 1.0330467 Mar 24 02:14:21.258991 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'c09745fa-b8dd-44bc-bd26-2ffd00f709e6', 'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'mac_address': 'fa:16:3e:82:8c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:05Z', 'updated_at': '2022-03-24T02:12:17Z', 'revision_number': 5, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'subnets': [{'id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:21.260903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:21.279105 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] Sync routers for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:21.291326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57752) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:21.296517 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:21.297144 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:21.323645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] Checking router: f52240e9-2e82-4113-abe0-f8b0dcb76cb1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:14:21.348553 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-aaf9c229-bce8-4f36-9a1c-26e0633269a2 None None] Provisioning complete for port 066c6253-bc5e-4309-b9f1-d8aff6a73dc5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:21.349457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aaf9c229-bce8-4f36-9a1c-26e0633269a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:21.363340 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-299d7c9d-e265-4310-9dc8-2dacaf0b6712 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 8.1588359 Mar 24 02:14:21.399852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:21.400483 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:21.537838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57754) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:21.562440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9664a662-0a22-46ca-80e9-373ef44aa7b6 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:21.568277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9664a662-0a22-46ca-80e9-373ef44aa7b6 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:21.574754 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9664a662-0a22-46ca-80e9-373ef44aa7b6 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1446 time: 0.2102034 Mar 24 02:14:21.575815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] No DVR routers for this DVR port dba04693-4495-4586-b5e4-7de9e3b2abd3 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:21.587835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:86:ad:5b', 'name': 'tempest-NetworksTestDHCPv6-694995397'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:21.591570 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:21.771749 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57756) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:21.775222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:21.789726 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-154b875e-655a-4daa-ac2c-b16ecec47661 req-5b939628-8909-498b-b73f-2d044bf1dab1 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.30 "DELETE /v2.0/ports/dba04693-4495-4586-b5e4-7de9e3b2abd3 HTTP/1.1" status: 204 len: 173 time: 8.0227859 Mar 24 02:14:21.791114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:21.791986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:21.793598 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-4c235f39-6e52-46bc-8ab7-0f15647b8f6f service neutron] 10.222.0.30 "PUT /v2.0/ports/4716cbf2-4cfd-4eec-91c2-c814fff2a832 HTTP/1.1" status: 200 len: 1093 time: 5.2023482 Mar 24 02:14:21.811689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:21.900969 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 3f03ca03-be93-4662-af2b-73bbfc93a9da no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:21.904313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'name': 'network-vif-deleted', 'tag': 'dba04693-4495-4586-b5e4-7de9e3b2abd3'}, {'name': 'network-changed', 'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:14:21.906757 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4711d4c3-d27b-45ed-b8d0-94881de7b33e" -d '{"events": [{"server_uuid": "bb0721bf-38c2-46f0-8650-43fce951aa0f", "name": "network-vif-deleted", "tag": "dba04693-4495-4586-b5e4-7de9e3b2abd3"}, {"name": "network-changed", "server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:14:21.999869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dfbbe41-4462-4ffe-b823-0d8c2b84bc84 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:22.005414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dfbbe41-4462-4ffe-b823-0d8c2b84bc84 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:22.013684 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7dfbbe41-4462-4ffe-b823-0d8c2b84bc84 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 403 time: 0.1887288 Mar 24 02:14:22.019770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:22.054887 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 3f03ca03-be93-4662-af2b-73bbfc93a9da {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:22.060265 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 3f03ca03-be93-4662-af2b-73bbfc93a9da not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:22.088008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-aaf9c229-bce8-4f36-9a1c-26e0633269a2 None None] Port 066c6253-bc5e-4309-b9f1-d8aff6a73dc5 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:22.112219 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '9b446767-9204-4d09-bff9-fa3a72e03482', 'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'mac_address': 'fa:16:3e:8d:f5:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:01Z', 'updated_at': '2022-03-24T02:12:09Z', 'revision_number': 5, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'subnets': [{'id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:22.136941 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57764) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:22.137611 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57766) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:22.167374 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] Checking router: 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:14:22.182269 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:22.183224 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:22.198272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Thu, 24 Mar 2022 02:14:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa259fb8-011a-475d-9672-e1d9382e46dd x-openstack-request-id: req-fa259fb8-011a-475d-9672-e1d9382e46dd {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:14:22.198966 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bb0721bf-38c2-46f0-8650-43fce951aa0f", "name": "network-vif-deleted", "tag": "dba04693-4495-4586-b5e4-7de9e3b2abd3", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:14:22.198966 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-fa259fb8-011a-475d-9672-e1d9382e46dd {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:14:22.199241 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fa259fb8-011a-475d-9672-e1d9382e46dd'] response: {'server_uuid': 'bb0721bf-38c2-46f0-8650-43fce951aa0f', 'name': 'network-vif-deleted', 'tag': 'dba04693-4495-4586-b5e4-7de9e3b2abd3', 'status': 'completed', 'code': 200} Mar 24 02:14:22.203724 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fa259fb8-011a-475d-9672-e1d9382e46dd'] response: {'name': 'network-changed', 'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'status': 'completed', 'code': 200} Mar 24 02:14:22.214884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb012a4-fbfd-4e4f-936a-83e499db260a req-87ee3443-cbe1-4918-af6a-e9594fe3f491 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:22.226537 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2fb012a4-fbfd-4e4f-936a-83e499db260a req-87ee3443-cbe1-4918-af6a-e9594fe3f491 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 943 time: 1.0968287 Mar 24 02:14:22.272864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:22.335565 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-19ca6593-c21b-48ec-99e5-e8816b1abe4c tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group (79e8d0c0-2674-47ef-8eea-b630f6955be7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:22.349171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port c2971a5e-67da-4438-8575-e5369dc52cca yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:22.367429 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-19ca6593-c21b-48ec-99e5-e8816b1abe4c tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group (79e8d0c0-2674-47ef-8eea-b630f6955be7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:22.449070 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 38139c4e-e6f5-44ed-9b98-9e753276133f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:22.452448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-19ca6593-c21b-48ec-99e5-e8816b1abe4c tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (79e8d0c0-2674-47ef-8eea-b630f6955be7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:22.457131 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-19ca6593-c21b-48ec-99e5-e8816b1abe4c tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:22.459960 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-19ca6593-c21b-48ec-99e5-e8816b1abe4c tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "DELETE /v2.0/security-groups/79e8d0c0-2674-47ef-8eea-b630f6955be7 HTTP/1.1" status: 204 len: 168 time: 0.3212965 Mar 24 02:14:22.464171 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:22.467015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'c09745fa-b8dd-44bc-bd26-2ffd00f709e6', 'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'mac_address': 'fa:16:3e:82:8c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:05Z', 'updated_at': '2022-03-24T02:12:17Z', 'revision_number': 5, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'subnets': [{'id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:22.475199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57770) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:22.504141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c9b5a54-d8ab-4fce-963c-357c393afc7b None None] The sync data for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv is: [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:08Z', 'revision_number': 4, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'c09745fa-b8dd-44bc-bd26-2ffd00f709e6', 'name': '', 'network_id': 'd91de7c3-7e46-4c9d-8b0a-c988de7fd81b', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'mac_address': 'fa:16:3e:82:8c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:05Z', 'updated_at': '2022-03-24T02:12:17Z', 'revision_number': 5, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'subnets': [{'id': '02cc6c6a-e353-4d82-9d85-3973d8220a39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:22.539060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19ca6593-c21b-48ec-99e5-e8816b1abe4c tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=79e8d0c0-2674-47ef-8eea-b630f6955be7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:22.554871 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-54ac5097-8b51-4add-8d7d-2990597be6b8 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] show failed (client error): The resource could not be found. Mar 24 02:14:22.556017 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-54ac5097-8b51-4add-8d7d-2990597be6b8 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "GET /v2.0/security-groups/79e8d0c0-2674-47ef-8eea-b630f6955be7 HTTP/1.1" status: 404 len: 347 time: 0.0792875 Mar 24 02:14:22.564674 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57772) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:22.600849 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ad92fd37-77fc-4a62-bea6-08b0e52c8f0a None None] Provisioning complete for port 38139c4e-e6f5-44ed-9b98-9e753276133f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:22.601223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ad92fd37-77fc-4a62-bea6-08b0e52c8f0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:22.637750 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2fb012a4-fbfd-4e4f-936a-83e499db260a req-a56e14be-14d0-4bcb-a54f-661caf5184f8 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4100733 Mar 24 02:14:22.639838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be61e605-b9f8-42d6-a0d8-def19778b81c tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:22.652264 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b728910f-d5c2-4f17-a414-dd7645ae45ba req-4362c2d6-fc79-45ce-9e1c-14869793d1c2 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb0721bf-38c2-46f0-8650-43fce951aa0f HTTP/1.1" status: 200 len: 210 time: 0.0782950 Mar 24 02:14:22.686435 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-5ff60358-ea85-43c9-966a-d99d50cde623 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:22.688266 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-5ff60358-ea85-43c9-966a-d99d50cde623 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=615b57fe01bd445f87fb9f1a86851430&device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 1127 time: 0.7784016 Mar 24 02:14:22.722412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21852e6b-15af-4801-93e0-818f26f4c3a3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:22.725419 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-21852e6b-15af-4801-93e0-818f26f4c3a3 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/networks/a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a HTTP/1.1" status: 200 len: 798 time: 0.5242116 Mar 24 02:14:22.729126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ad92fd37-77fc-4a62-bea6-08b0e52c8f0a None None] Current status of the port 38139c4e-e6f5-44ed-9b98-9e753276133f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:22.734406 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57774) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:22.744541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be61e605-b9f8-42d6-a0d8-def19778b81c tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:22.795819 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-8b1ebddd-5f8f-4f19-9661-955e06c17dc8 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832 HTTP/1.1" status: 200 len: 217 time: 0.0839462 Mar 24 02:14:22.827004 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router b7625b45-c8e2-4384-becd-84c71dc4e270 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:14:22.876373 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '9b446767-9204-4d09-bff9-fa3a72e03482', 'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'mac_address': 'fa:16:3e:8d:f5:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:01Z', 'updated_at': '2022-03-24T02:12:09Z', 'revision_number': 5, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'subnets': [{'id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:22.904838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-be61e605-b9f8-42d6-a0d8-def19778b81c tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] In _notify_port_updated(), no bound segment for port 066c6253-bc5e-4309-b9f1-d8aff6a73dc5 on network 0c765cab-bf54-40f0-922b-903bce6e75d2 {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:14:22.911218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be61e605-b9f8-42d6-a0d8-def19778b81c tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:22.912435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be61e605-b9f8-42d6-a0d8-def19778b81c tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:22.913787 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-be61e605-b9f8-42d6-a0d8-def19778b81c tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "PUT /v2.0/ports/066c6253-bc5e-4309-b9f1-d8aff6a73dc5 HTTP/1.1" status: 200 len: 1002 time: 2.1486161 Mar 24 02:14:22.917498 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b677b8c-09c2-45c8-b2d5-798cd87c89f2 None None] The sync data for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv is: [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:12:03Z', 'revision_number': 4, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '9b446767-9204-4d09-bff9-fa3a72e03482', 'name': '', 'network_id': 'c5ab8914-a9e8-4c4e-bd5d-f979c05148e6', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'mac_address': 'fa:16:3e:8d:f5:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:12:01Z', 'updated_at': '2022-03-24T02:12:09Z', 'revision_number': 5, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'subnets': [{'id': 'dfc73b89-587b-4f56-aa2b-706a8f904224', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:22.929864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57776) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:22.982960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be61e605-b9f8-42d6-a0d8-def19778b81c tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Port': ['ID=066c6253-bc5e-4309-b9f1-d8aff6a73dc5,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:23.010625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54b3ade7-8db7-4dc9-8a29-e2e3038ff963 None None] New status for floating IP 68838617-65cc-46a4-a440-36592cc8777d: DOWN {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:14:23.058110 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-402d013a-11a9-440e-93ac-8281f2068f07 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/networks/a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 314 time: 0.3198116 Mar 24 02:14:23.061384 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57778) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:23.103340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Deleting port 71b554a6-8cdd-48b9-9b30-c2360b15257b {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:23.103855 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (71b554a6-8cdd-48b9-9b30-c2360b15257b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.119493 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-ee2515f0-b1b0-496a-8771-40b7718a2546 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:23.120720 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-ee2515f0-b1b0-496a-8771-40b7718a2546 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=44e52247-2dfd-4416-b8c9-7ab69363e1f2 HTTP/1.1" status: 200 len: 834 time: 0.3129001 Mar 24 02:14:23.156499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 172.20.0.10 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/4b356bbf-257f-4afc-b498-4e10c679cf12/c2971a5e-67da-4438-8575-e5369dc52cca) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:23.186757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e95f04cb-d9cf-4803-a8a3-9241eac29327 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:23.189380 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e95f04cb-d9cf-4803-a8a3-9241eac29327 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/subnets/de633914-0d11-47c4-9878-19082d997ae6 HTTP/1.1" status: 200 len: 811 time: 0.1268489 Mar 24 02:14:23.193021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57780) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:23.283591 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (71b554a6-8cdd-48b9-9b30-c2360b15257b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.283591 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for floatingip (71b554a6-8cdd-48b9-9b30-c2360b15257b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.285586 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fe86:ad5b (6f3080fc-791f-4748-a0a2-9eff6ea2a609/583274b6-3d5a-4b07-8a2f-cd1764f06413/c2971a5e-67da-4438-8575-e5369dc52cca) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:23.306296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Calling delete_port for 71b554a6-8cdd-48b9-9b30-c2360b15257b owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:23.309949 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e39be86-8804-4289-a5e2-4a01dae098cc tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['shared'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:23.314916 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7e39be86-8804-4289-a5e2-4a01dae098cc tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "GET /v2.0/subnets/de633914-0d11-47c4-9878-19082d997ae6?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.1171958 Mar 24 02:14:23.315511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57784) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:23.322743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-603342730'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:23.361190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0104c8cb-caf4-4710-9f99-0b066295eb3a None None] Provisioning complete for port 066c6253-bc5e-4309-b9f1-d8aff6a73dc5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:23.362381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0104c8cb-caf4-4710-9f99-0b066295eb3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.379157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-90260f55-b1cd-467c-be58-3b63e8c732c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:23.381455 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-90260f55-b1cd-467c-be58-3b63e8c732c0 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1ff12164-ce98-442e-81ee-e22f78c3a0ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.2487524 Mar 24 02:14:23.382510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:23.396566 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64501689-e04c-416a-896c-1801e42928bc None None] Sync routers for ids ['b7625b45-c8e2-4384-becd-84c71dc4e270'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:23.400036 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6ec7eddb-90d7-4018-9eae-44e825e1d860 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/b7625b45-c8e2-4384-becd-84c71dc4e270/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.7878132 Mar 24 02:14:23.400621 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57786) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:23.409813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-2f74b311-aec1-4542-a43b-8a044040c091 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Deleting port 066c6253-bc5e-4309-b9f1-d8aff6a73dc5 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:23.410341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2f74b311-aec1-4542-a43b-8a044040c091 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.410482 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64501689-e04c-416a-896c-1801e42928bc None None] Routers {'b7625b45-c8e2-4384-becd-84c71dc4e270'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:23.411508 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-64501689-e04c-416a-896c-1801e42928bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b7625b45-c8e2-4384-becd-84c71dc4e270'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:23.412348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:23.416826 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.449468 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0104c8cb-caf4-4710-9f99-0b066295eb3a None None] Port 066c6253-bc5e-4309-b9f1-d8aff6a73dc5 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:23.478892 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dbc9973-7451-4cfe-96a4-9fe0060efaef None None] New status for floating IP a4d631f5-1e36-4cb9-a3b6-9fa1737e7397: DOWN {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:14:23.499822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58f60a0b-eb46-4aee-ad21-74e93f091177 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:23.503816 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-58f60a0b-eb46-4aee-ad21-74e93f091177 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports/54614a41-47d8-4928-8bec-a178fd47cff8 HTTP/1.1" status: 200 len: 911 time: 0.0990255 Mar 24 02:14:23.507292 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57788) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:23.519264 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-64501689-e04c-416a-896c-1801e42928bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:23.522609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 143} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:23.540028 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64501689-e04c-416a-896c-1801e42928bc None None] Routers {'b7625b45-c8e2-4384-becd-84c71dc4e270'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:23.540886 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-64501689-e04c-416a-896c-1801e42928bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b7625b45-c8e2-4384-becd-84c71dc4e270'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:23.584273 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-64501689-e04c-416a-896c-1801e42928bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:23.585232 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64501689-e04c-416a-896c-1801e42928bc None None] The sync data for ids ['b7625b45-c8e2-4384-becd-84c71dc4e270'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:23.600251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d347a249-2ad0-492e-87fb-174b9edfd016), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.600607 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Added segment d347a249-2ad0-492e-87fb-174b9edfd016 of type vlan for network 28032cb0-df23-4e8d-b984-c7b58574ba56 Mar 24 02:14:23.690210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (28032cb0-df23-4e8d-b984-c7b58574ba56), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.703355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2f74b311-aec1-4542-a43b-8a044040c091 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.749234 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (71b554a6-8cdd-48b9-9b30-c2360b15257b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.765225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (c2971a5e-67da-4438-8575-e5369dc52cca), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.779695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-2f74b311-aec1-4542-a43b-8a044040c091 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Calling delete_port for 066c6253-bc5e-4309-b9f1-d8aff6a73dc5 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:23.795745 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57796) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:23.852661 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Pushing event deleted for resources: {'Port': ['ID=71b554a6-8cdd-48b9-9b30-c2360b15257b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:23.861372 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-959df79b-0e21-4e8c-8fc0-b21cc80e1669 service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4726214 Mar 24 02:14:23.895959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (28032cb0-df23-4e8d-b984-c7b58574ba56), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.900992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:23.901602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:23.972021 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dae8b8e-3f86-450b-8287-68f258cbe165 req-c0a5a5a8-171e-4582-a3de-cb28f0915016 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:23.973598 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2dae8b8e-3f86-450b-8287-68f258cbe165 req-c0a5a5a8-171e-4582-a3de-cb28f0915016 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 943 time: 0.1877482 Mar 24 02:14:24.036036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (c2971a5e-67da-4438-8575-e5369dc52cca), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.042970 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.7242029 Mar 24 02:14:24.053405 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57798) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:24.064358 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'network_id': '28032cb0-df23-4e8d-b984-c7b58574ba56', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8'], 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:24.074061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16c866a9-58f8-40c4-88e9-7ccd36b68cd0 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group (eef280c3-0009-459a-81fe-def34b7b79a0), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.121036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acc6dbaf-4bc4-4416-88c5-607bcf2a5c3e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Network': ['ID=28032cb0-df23-4e8d-b984-c7b58574ba56,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:24.128839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:24.132419 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b602578-b263-4212-ae44-4a58ae65cd90 req-6a0870b7-8dec-4bf8-bd77-2fbb260b24b1 service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2315094 Mar 24 02:14:24.133681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 28032cb0-df23-4e8d-b984-c7b58574ba56 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:24.144432 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2dae8b8e-3f86-450b-8287-68f258cbe165 req-a68e4838-64b5-43c3-b175-13ade20d4a5f tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1591570 Mar 24 02:14:24.146928 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks [] for floatingip (68838617-65cc-46a4-a440-36592cc8777d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.149503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.162774 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1889f875-f418-4651-a5d7-ed70ded0b09e tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] 10.222.0.20 "DELETE /v2.0/floatingips/68838617-65cc-46a4-a440-36592cc8777d HTTP/1.1" status: 204 len: 168 time: 1.5880978 Mar 24 02:14:24.162774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57800) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:24.174032 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:24.179267 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:24.182288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=c2971a5e-67da-4438-8575-e5369dc52cca,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:24.206245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16c866a9-58f8-40c4-88e9-7ccd36b68cd0 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group (eef280c3-0009-459a-81fe-def34b7b79a0), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.279653 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:24.280323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.282903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2f74b311-aec1-4542-a43b-8a044040c091 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (066c6253-bc5e-4309-b9f1-d8aff6a73dc5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.325352 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f74b311-aec1-4542-a43b-8a044040c091 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event deleted for resources: {'Port': ['ID=066c6253-bc5e-4309-b9f1-d8aff6a73dc5,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:24.332077 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b8f517ba-ed60-4056-af61-5015f9192bb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 2.7504127 Mar 24 02:14:24.338148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57802) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:24.382683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-cc9394d5-a267-4f71-ae07-81e8f2926771 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:24.384348 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-cc9394d5-a267-4f71-ae07-81e8f2926771 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=615b57fe01bd445f87fb9f1a86851430&device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 1127 time: 0.1740816 Mar 24 02:14:24.611487 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ca7fa641-46e0-43c1-aa90-bffcf7cf36cb None None] Provisioning complete for port c2971a5e-67da-4438-8575-e5369dc52cca triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:24.612011 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ca7fa641-46e0-43c1-aa90-bffcf7cf36cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c2971a5e-67da-4438-8575-e5369dc52cca), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.638899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Made reservation on behalf of 91867543f6b84845b75f9ec75cf50f66 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:24.643622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.655552 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ca7fa641-46e0-43c1-aa90-bffcf7cf36cb None None] Port c2971a5e-67da-4438-8575-e5369dc52cca cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:24.721296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16c866a9-58f8-40c4-88e9-7ccd36b68cd0 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (eef280c3-0009-459a-81fe-def34b7b79a0), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.724706 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16c866a9-58f8-40c4-88e9-7ccd36b68cd0 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.725849 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-16c866a9-58f8-40c4-88e9-7ccd36b68cd0 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "DELETE /v2.0/security-groups/eef280c3-0009-459a-81fe-def34b7b79a0 HTTP/1.1" status: 204 len: 168 time: 0.9243901 Mar 24 02:14:24.729032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57804) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:24.787778 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Performing IP validity checks on allocation pools {{(pid=104036) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:322}} Mar 24 02:14:24.788283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking for overlaps among allocation pools and gateway ip {{(pid=104036) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:343}} Mar 24 02:14:24.835554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2f74b311-aec1-4542-a43b-8a044040c091 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:24.838978 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2f74b311-aec1-4542-a43b-8a044040c091 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "DELETE /v2.0/ports/066c6253-bc5e-4309-b9f1-d8aff6a73dc5 HTTP/1.1" status: 204 len: 168 time: 1.9051235 Mar 24 02:14:24.848676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26a90315-0564-4997-b3e4-1160a44bfa1c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:24.854016 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26a90315-0564-4997-b3e4-1160a44bfa1c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:24.855515 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16c866a9-58f8-40c4-88e9-7ccd36b68cd0 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=eef280c3-0009-459a-81fe-def34b7b79a0,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:24.855787 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-26a90315-0564-4997-b3e4-1160a44bfa1c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1863 time: 0.5165505 Mar 24 02:14:24.856140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57806) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:24.862252 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-8f527c1e-3aa4-4ceb-a2e2-707c388b794b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] show failed (client error): The resource could not be found. Mar 24 02:14:24.865835 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8f527c1e-3aa4-4ceb-a2e2-707c388b794b tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "GET /v2.0/security-groups/eef280c3-0009-459a-81fe-def34b7b79a0 HTTP/1.1" status: 404 len: 347 time: 0.1148593 Mar 24 02:14:24.865835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57808) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:24.880944 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57810) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:24.885144 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-276497d9-58b2-4444-a380-8e2800648d5a tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] GET failed (client error): The resource could not be found. Mar 24 02:14:24.886648 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-276497d9-58b2-4444-a380-8e2800648d5a tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "GET /v2.0/ports/066c6253-bc5e-4309-b9f1-d8aff6a73dc5 HTTP/1.1" status: 404 len: 333 time: 0.0278053 Mar 24 02:14:24.893829 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57812) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:24.899191 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'port': {'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-312823528'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:24.949339 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-4402977d-2575-48be-bfba-4be3bfba22fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:24.950845 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-4402977d-2575-48be-bfba-4be3bfba22fd service neutron] 10.222.0.30 "GET /v2.0/networks?id=1ff12164-ce98-442e-81ee-e22f78c3a0ff HTTP/1.1" status: 200 len: 898 time: 0.2450192 Mar 24 02:14:24.997844 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-79d00347-274a-4ed0-b58b-f3c58e747b73 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832 HTTP/1.1" status: 200 len: 217 time: 0.0377202 Mar 24 02:14:25.071216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-7acd9352-ab6f-48ef-8e1d-8c4f469022d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:25.072664 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-7acd9352-ab6f-48ef-8e1d-8c4f469022d5 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=44e52247-2dfd-4416-b8c9-7ab69363e1f2 HTTP/1.1" status: 200 len: 834 time: 0.0652177 Mar 24 02:14:25.089915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Made reservation on behalf of 15c69ad0648c47419b3ead64ebe342de for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:25.093678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.132011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] device_id is not set on port 469ba94a-6d8f-4a0e-bf40-2ea1e75328ee yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:25.157375 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (b7625b45-c8e2-4384-becd-84c71dc4e270), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.190273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-47e36e89-6744-46e5-988a-91cb4d33bdfe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:25.191829 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-47e36e89-6744-46e5-988a-91cb4d33bdfe service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1ff12164-ce98-442e-81ee-e22f78c3a0ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.1118512 Mar 24 02:14:25.382250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Allocated IP 2001:db8::326 (0c765cab-bf54-40f0-922b-903bce6e75d2/08fb8372-ea73-460b-891f-1f1021e06112/469ba94a-6d8f-4a0e-bf40-2ea1e75328ee) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:25.384301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-4143d128-b668-4e61-a80e-db96120cb49c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port c2971a5e-67da-4438-8575-e5369dc52cca {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:25.384702 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4143d128-b668-4e61-a80e-db96120cb49c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c2971a5e-67da-4438-8575-e5369dc52cca), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.388091 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Deleting port 5041086b-6410-4304-9895-38505ba6c5d7 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:25.388508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5041086b-6410-4304-9895-38505ba6c5d7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.392994 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (0180dcb3-067b-4e45-a75c-bef300d8b1c4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.394106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d286894-bef0-49d9-859e-9c645ff48fdf req-7ae0bfed-4bde-4f67-9405-7596d1e10151 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:25.395658 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7d286894-bef0-49d9-859e-9c645ff48fdf req-7ae0bfed-4bde-4f67-9405-7596d1e10151 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 943 time: 0.1826820 Mar 24 02:14:25.400194 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-6b9caed9-f04d-43a4-b72e-34b5e1f02e29 service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1984339 Mar 24 02:14:25.580805 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7d286894-bef0-49d9-859e-9c645ff48fdf req-d5a9fc1d-bfc7-4a2e-afad-56f741834889 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1762629 Mar 24 02:14:25.623210 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4711d4c3-d27b-45ed-b8d0-94881de7b33e req-256269e9-4fa2-445b-9fdf-009d9926ca2d service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2120783 Mar 24 02:14:25.659949 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.690508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=0180dcb3-067b-4e45-a75c-bef300d8b1c4,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:25.694785 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.730711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5041086b-6410-4304-9895-38505ba6c5d7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.731036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for floatingip (5041086b-6410-4304-9895-38505ba6c5d7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.733759 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:25.734244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4143d128-b668-4e61-a80e-db96120cb49c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c2971a5e-67da-4438-8575-e5369dc52cca), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.736884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:25.741144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:25.746312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:25.746943 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.764971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Port': ['ID=469ba94a-6d8f-4a0e-bf40-2ea1e75328ee,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:25.769195 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Checking segment: {'id': 'd347a249-2ad0-492e-87fb-174b9edfd016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '28032cb0-df23-4e8d-b984-c7b58574ba56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:25.769591 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network hostable DHCP agents. Network: 28032cb0-df23-4e8d-b984-c7b58574ba56, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:25.778634 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fa6accfc-5b6d-486b-ac61-47289c8f565d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 0.8809044 Mar 24 02:14:25.779084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Calling delete_port for 5041086b-6410-4304-9895-38505ba6c5d7 owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:25.779274 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57816) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:25.782159 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-4143d128-b668-4e61-a80e-db96120cb49c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for c2971a5e-67da-4438-8575-e5369dc52cca owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:25.784999 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4a9fb516-ace5-409c-bb11-b7f09d8e0687 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:ed:14:3b'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:25.950560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Network 28032cb0-df23-4e8d-b984-c7b58574ba56 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:25.953772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4a9fb516-ace5-409c-bb11-b7f09d8e0687 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.992023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-10761dac-d044-4eda-9f48-06743175ddd2 None None] Provisioning complete for port 469ba94a-6d8f-4a0e-bf40-2ea1e75328ee triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:25.992518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-10761dac-d044-4eda-9f48-06743175ddd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:25.994572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 28032cb0-df23-4e8d-b984-c7b58574ba56) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:26.003360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:26.003961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.019555 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9dc8825-2ed0-4367-8b32-a72173449864 None None] Network 28032cb0-df23-4e8d-b984-c7b58574ba56 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:26.069513 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-59850e5b-83dc-49c9-b2e7-fd9b723a79b9 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 872 time: 2.0102649 Mar 24 02:14:26.072687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57818) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:26.079327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a2803c11-0e87-4e21-bb9f-7960d9d46c0a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.2'}], 'dns_nameservers': ['7.8.8.8', '7.8.4.4'], 'gateway_ip': '172.20.0.2', 'enable_dhcp': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:26.081462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-10761dac-d044-4eda-9f48-06743175ddd2 None None] Port 469ba94a-6d8f-4a0e-bf40-2ea1e75328ee cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:26.123449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.139925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-28032cb0-df23-4e8d-b984-c7b58574ba56', 'network_id': '28032cb0-df23-4e8d-b984-c7b58574ba56', 'project_id': '91867543f6b84845b75f9ec75cf50f66', 'fixed_ips': [{'subnet_id': '0180dcb3-067b-4e45-a75c-bef300d8b1c4'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:26.141461 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.171456 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4a9fb516-ace5-409c-bb11-b7f09d8e0687 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.176835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4a9fb516-ace5-409c-bb11-b7f09d8e0687 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.213569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-4a9fb516-ace5-409c-bb11-b7f09d8e0687 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] In _notify_port_updated(), no bound segment for port 469ba94a-6d8f-4a0e-bf40-2ea1e75328ee on network 0c765cab-bf54-40f0-922b-903bce6e75d2 {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:14:26.221800 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a9fb516-ace5-409c-bb11-b7f09d8e0687 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:26.223491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4a9fb516-ace5-409c-bb11-b7f09d8e0687 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.229377 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4a9fb516-ace5-409c-bb11-b7f09d8e0687 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "PUT /v2.0/ports/469ba94a-6d8f-4a0e-bf40-2ea1e75328ee HTTP/1.1" status: 200 len: 1002 time: 0.4454393 Mar 24 02:14:26.230652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57820) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:26.282431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9fb516-ace5-409c-bb11-b7f09d8e0687 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Port': ['ID=469ba94a-6d8f-4a0e-bf40-2ea1e75328ee,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:26.311992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Allocated IP 172.20.0.3 (28032cb0-df23-4e8d-b984-c7b58574ba56/0180dcb3-067b-4e45-a75c-bef300d8b1c4/5beb91e1-43e5-49ea-85ba-0219d86cfb91) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:26.354237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-254ba5c7-4f19-4a0d-9bf0-cb885307655e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Deleting port 469ba94a-6d8f-4a0e-bf40-2ea1e75328ee {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:26.354734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-254ba5c7-4f19-4a0d-9bf0-cb885307655e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.457039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-254ba5c7-4f19-4a0d-9bf0-cb885307655e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.473163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-254ba5c7-4f19-4a0d-9bf0-cb885307655e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Calling delete_port for 469ba94a-6d8f-4a0e-bf40-2ea1e75328ee owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:26.481110 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Publish callbacks [] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.491047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.553909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Network 28032cb0-df23-4e8d-b984-c7b58574ba56 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:26.557145 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:26.560896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:26.591134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 54614a41-47d8-4928-8bec-a178fd47cff8 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:26.591761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (54614a41-47d8-4928-8bec-a178fd47cff8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.593691 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Pushing event updated for resources: {'Port': ['ID=5beb91e1-43e5-49ea-85ba-0219d86cfb91,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:26.631845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (5041086b-6410-4304-9895-38505ba6c5d7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.642291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Attempting to bind port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:26.642689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Attempting to bind port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'd347a249-2ad0-492e-87fb-174b9edfd016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '28032cb0-df23-4e8d-b984-c7b58574ba56'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:26.643052 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Attempting to bind port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 on network 28032cb0-df23-4e8d-b984-c7b58574ba56 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:26.644324 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-254ba5c7-4f19-4a0d-9bf0-cb885307655e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.652374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3b0351f3-5937-4294-9293-2096af315d7c None None] Provisioning complete for port 469ba94a-6d8f-4a0e-bf40-2ea1e75328ee triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:26.652764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3b0351f3-5937-4294-9293-2096af315d7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (469ba94a-6d8f-4a0e-bf40-2ea1e75328ee), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.654433 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:26.654938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Checking segment: {'id': 'd347a249-2ad0-492e-87fb-174b9edfd016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '28032cb0-df23-4e8d-b984-c7b58574ba56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:26.655222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.655618 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Bound using segment: {'id': 'd347a249-2ad0-492e-87fb-174b9edfd016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '28032cb0-df23-4e8d-b984-c7b58574ba56'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:26.656089 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Bound port: 5beb91e1-43e5-49ea-85ba-0219d86cfb91, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd347a249-2ad0-492e-87fb-174b9edfd016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '28032cb0-df23-4e8d-b984-c7b58574ba56'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:26.656463 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.686106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3b0351f3-5937-4294-9293-2096af315d7c None None] Port 469ba94a-6d8f-4a0e-bf40-2ea1e75328ee was deleted so its status cannot be updated. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:336}} Mar 24 02:14:26.713228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Pushing event deleted for resources: {'Port': ['ID=5041086b-6410-4304-9895-38505ba6c5d7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:26.730482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a2803c11-0e87-4e21-bb9f-7960d9d46c0a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-3298615'] for subnet (0180dcb3-067b-4e45-a75c-bef300d8b1c4), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.742104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-254ba5c7-4f19-4a0d-9bf0-cb885307655e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event deleted for resources: {'Port': ['ID=469ba94a-6d8f-4a0e-bf40-2ea1e75328ee,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:26.760596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-254ba5c7-4f19-4a0d-9bf0-cb885307655e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.766572 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-254ba5c7-4f19-4a0d-9bf0-cb885307655e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "DELETE /v2.0/ports/469ba94a-6d8f-4a0e-bf40-2ea1e75328ee HTTP/1.1" status: 204 len: 168 time: 0.5326228 Mar 24 02:14:26.767972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57824) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:26.778016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] For port 5beb91e1-43e5-49ea-85ba-0219d86cfb91, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:26.787925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] For port 5beb91e1-43e5-49ea-85ba-0219d86cfb91, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5beb91e1-43e5-49ea-85ba-0219d86cfb91,segment=NetworkSegment(d347a249-2ad0-492e-87fb-174b9edfd016),segment_id=d347a249-2ad0-492e-87fb-174b9edfd016)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:26.796095 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b9aa22c-ea5c-4889-abd5-a86f311c0894 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] GET failed (client error): The resource could not be found. Mar 24 02:14:26.796740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.797749 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1b9aa22c-ea5c-4889-abd5-a86f311c0894 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "GET /v2.0/ports/469ba94a-6d8f-4a0e-bf40-2ea1e75328ee HTTP/1.1" status: 404 len: 333 time: 0.0287666 Mar 24 02:14:26.801728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57826) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:26.806021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4143d128-b668-4e61-a80e-db96120cb49c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c2971a5e-67da-4438-8575-e5369dc52cca), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.807526 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'port': {'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1619548413'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:26.870730 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663c4f98-3be2-4759-88b6-59ca9e6b6744 None None] Pushing event updated for resources: {'Port': ['ID=5beb91e1-43e5-49ea-85ba-0219d86cfb91,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:26.883142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b18e810-7307-4582-b559-ac09b311ba32 req-bab3a4a7-e8c3-4db0-8f4c-ba6ac9871155 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:26.890669 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4b18e810-7307-4582-b559-ac09b311ba32 req-bab3a4a7-e8c3-4db0-8f4c-ba6ac9871155 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 943 time: 0.1680396 Mar 24 02:14:26.939593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4143d128-b668-4e61-a80e-db96120cb49c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=c2971a5e-67da-4438-8575-e5369dc52cca,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:26.970321 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (54614a41-47d8-4928-8bec-a178fd47cff8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:26.972097 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4b18e810-7307-4582-b559-ac09b311ba32 req-7f410fd0-749d-44f0-b4e3-8f56f24afb14 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0803962 Mar 24 02:14:27.006662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Made reservation on behalf of 15c69ad0648c47419b3ead64ebe342de for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:27.010422 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.018804 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks [] for floatingip (a4d631f5-1e36-4cb9-a3b6-9fa1737e7397), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.021418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.026854 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57828) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:27.027212 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fa4ccb7c-e4f5-4401-be77-c0a2bb19a7d6 tempest-ServersTestManualDisk-1453762280 tempest-ServersTestManualDisk-1453762280-project] 10.222.0.20 "DELETE /v2.0/floatingips/a4d631f5-1e36-4cb9-a3b6-9fa1737e7397 HTTP/1.1" status: 204 len: 168 time: 2.1407096 Mar 24 02:14:27.038151 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 54614a41-47d8-4928-8bec-a178fd47cff8 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:27.119987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] device_id is not set on port 289ea406-4837-4e56-ab10-f35d3e4e796d yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:27.331638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4143d128-b668-4e61-a80e-db96120cb49c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.335765 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4143d128-b668-4e61-a80e-db96120cb49c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/c2971a5e-67da-4438-8575-e5369dc52cca HTTP/1.1" status: 204 len: 168 time: 2.4629588 Mar 24 02:14:27.338812 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57830) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:27.366423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70001a04-404d-4581-ab18-e06a3c2fa8e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.380534 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Allocated IP 2001:db8::185 (0c765cab-bf54-40f0-922b-903bce6e75d2/08fb8372-ea73-460b-891f-1f1021e06112/289ea406-4837-4e56-ab10-f35d3e4e796d) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:27.392669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a2803c11-0e87-4e21-bb9f-7960d9d46c0a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8790618889355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-8966603'] for subnet (0180dcb3-067b-4e45-a75c-bef300d8b1c4), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.553557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2803c11-0e87-4e21-bb9f-7960d9d46c0a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:27.554163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a2803c11-0e87-4e21-bb9f-7960d9d46c0a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.558057 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a2803c11-0e87-4e21-bb9f-7960d9d46c0a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "PUT /v2.0/subnets/0180dcb3-067b-4e45-a75c-bef300d8b1c4 HTTP/1.1" status: 200 len: 877 time: 1.4805942 Mar 24 02:14:27.563541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-499daa96-c6f7-4463-9108-ed8cd2d44b47 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:27.564847 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-499daa96-c6f7-4463-9108-ed8cd2d44b47 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:27.566275 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-499daa96-c6f7-4463-9108-ed8cd2d44b47 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:27.567841 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-499daa96-c6f7-4463-9108-ed8cd2d44b47 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1908891 Mar 24 02:14:27.569988 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57832) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:27.570639 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57834) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:27.578448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2803c11-0e87-4e21-bb9f-7960d9d46c0a tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event updated for resources: {'Subnet': ['ID=0180dcb3-067b-4e45-a75c-bef300d8b1c4,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:27.665646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for port (289ea406-4837-4e56-ab10-f35d3e4e796d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.692214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-94bddadb-1634-43d5-9017-dc264522a82e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 4b356bbf-257f-4afc-b498-4e10c679cf12 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:27.697318 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94bddadb-1634-43d5-9017-dc264522a82e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (4b356bbf-257f-4afc-b498-4e10c679cf12), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.709398 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Deleting port c09745fa-b8dd-44bc-bd26-2ffd00f709e6 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:27.709961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.711359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (54614a41-47d8-4928-8bec-a178fd47cff8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.768211 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94bddadb-1634-43d5-9017-dc264522a82e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (4b356bbf-257f-4afc-b498-4e10c679cf12), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.798479 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=54614a41-47d8-4928-8bec-a178fd47cff8,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:27.825397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (289ea406-4837-4e56-ab10-f35d3e4e796d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.837660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 4716cbf2-4cfd-4eec-91c2-c814fff2a832 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:14:27.845301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] For port c09745fa-b8dd-44bc-bd26-2ffd00f709e6, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c09745fa-b8dd-44bc-bd26-2ffd00f709e6,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:27.845666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:27.860981 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Calling delete_port for c09745fa-b8dd-44bc-bd26-2ffd00f709e6 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:27.955005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Port': ['ID=289ea406-4837-4e56-ab10-f35d3e4e796d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:27.991377 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:28.022652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'port_id': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'mac_address': 'fa:16:3e:cc:67:4f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 131, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:14:28.027182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:28.052903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94bddadb-1634-43d5-9017-dc264522a82e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (4b356bbf-257f-4afc-b498-4e10c679cf12), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.066147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (28032cb0-df23-4e8d-b984-c7b58574ba56), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.130246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:28.130970 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.147894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:28.154029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94bddadb-1634-43d5-9017-dc264522a82e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (4b356bbf-257f-4afc-b498-4e10c679cf12), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.156270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:28.167489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:28.168149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.170408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4716cbf2-4cfd-4eec-91c2-c814fff2a832 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:14:28.231537 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:28.249476 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.254350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (b7625b45-c8e2-4384-becd-84c71dc4e270), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.262064 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94bddadb-1634-43d5-9017-dc264522a82e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=4b356bbf-257f-4afc-b498-4e10c679cf12,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:28.275781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.338380 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fa280eec-6de7-4c0d-b0fa-d13e70913d2e tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 1.5347779 Mar 24 02:14:28.347196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=4716cbf2-4cfd-4eec-91c2-c814fff2a832,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:28.350416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57838) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:28.352968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c33b85e-ada1-41eb-8806-d60216fec341 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:28.355520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-132313da-a55a-4670-8634-93d62b18d0e5 None None] Network 28032cb0-df23-4e8d-b984-c7b58574ba56 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:28.363027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'port': {'network_id': '0c765cab-bf54-40f0-922b-903bce6e75d2', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1635259598'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:28.382143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94bddadb-1634-43d5-9017-dc264522a82e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.385381 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-94bddadb-1634-43d5-9017-dc264522a82e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/4b356bbf-257f-4afc-b498-4e10c679cf12 HTTP/1.1" status: 204 len: 168 time: 0.8113136 Mar 24 02:14:28.388852 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57840) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:28.518965 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c09745fa-b8dd-44bc-bd26-2ffd00f709e6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.521801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-36014a90-61f7-4f3c-b00e-8546f2937f12 None None] Provisioning complete for port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:28.522331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-36014a90-61f7-4f3c-b00e-8546f2937f12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.624737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['4716cbf2-4cfd-4eec-91c2-c814fff2a832'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:14:28.630883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Pushing event deleted for resources: {'Port': ['ID=c09745fa-b8dd-44bc-bd26-2ffd00f709e6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:28.686020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Deleting port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:28.686366 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.786630 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd258f4f-abeb-4320-8772-f45275e7f16a req-70dd9091-4b91-42f9-9daf-45fbd03fbb77 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:28.794369 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dd258f4f-abeb-4320-8772-f45275e7f16a req-70dd9091-4b91-42f9-9daf-45fbd03fbb77 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 943 time: 0.6603549 Mar 24 02:14:28.838474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-d4088819-56ec-43fd-843f-ae92272f0f7d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 583274b6-3d5a-4b07-8a2f-cd1764f06413 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:28.848175 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5beb91e1-43e5-49ea-85ba-0219d86cfb91 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:28.870873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d4088819-56ec-43fd-843f-ae92272f0f7d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (583274b6-3d5a-4b07-8a2f-cd1764f06413), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.886500 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dd258f4f-abeb-4320-8772-f45275e7f16a req-6ec6e2f5-1fd6-4175-aed2-a4c0ad18140d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0908298 Mar 24 02:14:28.951951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-36014a90-61f7-4f3c-b00e-8546f2937f12 None None] Current status of the port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:28.952349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-36014a90-61f7-4f3c-b00e-8546f2937f12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.965352 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d4088819-56ec-43fd-843f-ae92272f0f7d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (583274b6-3d5a-4b07-8a2f-cd1764f06413), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:28.972646 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:28.973018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.022279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router b7625b45-c8e2-4384-becd-84c71dc4e270 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:14:29.065285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Made reservation on behalf of 15c69ad0648c47419b3ead64ebe342de for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:29.069284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.120191 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-36014a90-61f7-4f3c-b00e-8546f2937f12 None None] For port 5beb91e1-43e5-49ea-85ba-0219d86cfb91, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5beb91e1-43e5-49ea-85ba-0219d86cfb91,segment=NetworkSegment(d347a249-2ad0-492e-87fb-174b9edfd016),segment_id=d347a249-2ad0-492e-87fb-174b9edfd016)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:29.132665 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d4088819-56ec-43fd-843f-ae92272f0f7d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (583274b6-3d5a-4b07-8a2f-cd1764f06413), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.159732 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-36014a90-61f7-4f3c-b00e-8546f2937f12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.239198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] device_id is not set on port 988c1019-e7b0-49e0-8a94-6fb6d2aa345a yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:29.269850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:29.282150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Deleting port 9b446767-9204-4d09-bff9-fa3a72e03482 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:29.282644 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.288125 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3565bd58-dc6a-4ecc-8256-a1a335789f58 None None] Sync routers for ids ['b7625b45-c8e2-4384-becd-84c71dc4e270'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:29.298481 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3565bd58-dc6a-4ecc-8256-a1a335789f58 None None] Routers {'b7625b45-c8e2-4384-becd-84c71dc4e270'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:29.299358 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3565bd58-dc6a-4ecc-8256-a1a335789f58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b7625b45-c8e2-4384-becd-84c71dc4e270'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:29.307064 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2745da55-9f58-4752-82ad-07074899cfc6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/b7625b45-c8e2-4384-becd-84c71dc4e270/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7947831 Mar 24 02:14:29.315206 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57842) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:29.316616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d4088819-56ec-43fd-843f-ae92272f0f7d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (583274b6-3d5a-4b07-8a2f-cd1764f06413), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.328486 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] For port 5beb91e1-43e5-49ea-85ba-0219d86cfb91, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5beb91e1-43e5-49ea-85ba-0219d86cfb91,segment=NetworkSegment(d347a249-2ad0-492e-87fb-174b9edfd016),segment_id=d347a249-2ad0-492e-87fb-174b9edfd016)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:29.328762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.361616 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3565bd58-dc6a-4ecc-8256-a1a335789f58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:29.364416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Calling delete_port for 5beb91e1-43e5-49ea-85ba-0219d86cfb91 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:29.387784 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3565bd58-dc6a-4ecc-8256-a1a335789f58 None None] Routers {'b7625b45-c8e2-4384-becd-84c71dc4e270'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:29.389158 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3565bd58-dc6a-4ecc-8256-a1a335789f58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['b7625b45-c8e2-4384-becd-84c71dc4e270'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:29.415420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d4088819-56ec-43fd-843f-ae92272f0f7d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.418799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.420197 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d4088819-56ec-43fd-843f-ae92272f0f7d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/583274b6-3d5a-4b07-8a2f-cd1764f06413 HTTP/1.1" status: 204 len: 168 time: 1.0303457 Mar 24 02:14:29.425024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57844) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:29.442985 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27c6b44d-9f43-478f-8125-1e45b879b73b None None] Network 28032cb0-df23-4e8d-b984-c7b58574ba56 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:29.452375 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-aaf61ae3-912a-4ac4-a952-f1dddf7a3dbe tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=b7625b45-c8e2-4384-becd-84c71dc4e270 HTTP/1.1" status: 200 len: 205 time: 0.1235406 Mar 24 02:14:29.453487 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3565bd58-dc6a-4ecc-8256-a1a335789f58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:29.454342 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3565bd58-dc6a-4ecc-8256-a1a335789f58 None None] The sync data for ids ['b7625b45-c8e2-4384-becd-84c71dc4e270'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:29.457983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57846) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:29.458998 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4088819-56ec-43fd-843f-ae92272f0f7d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=583274b6-3d5a-4b07-8a2f-cd1764f06413,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:29.520346 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-57e74317-1acf-4e5f-b9d0-e702653356ad None None] Provisioning complete for port 289ea406-4837-4e56-ab10-f35d3e4e796d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:29.520778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-57e74317-1acf-4e5f-b9d0-e702653356ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (289ea406-4837-4e56-ab10-f35d3e4e796d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.551242 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-40113106-f16f-404e-9b26-797dbcb3e967 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1225798 Mar 24 02:14:29.554751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57848) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:29.569701 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:29.577961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:29.619217 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-57e74317-1acf-4e5f-b9d0-e702653356ad None None] Port 289ea406-4837-4e56-ab10-f35d3e4e796d cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:29.630580 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36014a90-61f7-4f3c-b00e-8546f2937f12 None None] Pushing event updated for resources: {'Port': ['ID=5beb91e1-43e5-49ea-85ba-0219d86cfb91,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:29.630998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Allocated IP 2001:db8::68 (0c765cab-bf54-40f0-922b-903bce6e75d2/08fb8372-ea73-460b-891f-1f1021e06112/988c1019-e7b0-49e0-8a94-6fb6d2aa345a) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:29.637724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4150a410-05e6-48ee-bbc1-e464ae3808f5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (b7625b45-c8e2-4384-becd-84c71dc4e270), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.673379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-57e74317-1acf-4e5f-b9d0-e702653356ad None None] Provisioning complete for port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:29.673786 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-57e74317-1acf-4e5f-b9d0-e702653356ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.766244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] For port 9b446767-9204-4d09-bff9-fa3a72e03482, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9b446767-9204-4d09-bff9-fa3a72e03482,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:29.766903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.800161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Calling delete_port for 9b446767-9204-4d09-bff9-fa3a72e03482 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:29.876195 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-57e74317-1acf-4e5f-b9d0-e702653356ad None None] Current status of the port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:29.888699 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:29.890950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (5beb91e1-43e5-49ea-85ba-0219d86cfb91), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.894395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:29.998985 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Port': ['ID=5beb91e1-43e5-49ea-85ba-0219d86cfb91,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:30.059245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad2bb9b9-b7c3-4e92-81d3-197f076923e3 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:30.061188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4150a410-05e6-48ee-bbc1-e464ae3808f5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (b7625b45-c8e2-4384-becd-84c71dc4e270), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.066709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4150a410-05e6-48ee-bbc1-e464ae3808f5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (b7625b45-c8e2-4384-becd-84c71dc4e270), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.088066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No DVR routers for this DVR port 5beb91e1-43e5-49ea-85ba-0219d86cfb91 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:30.160015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:14:30.165942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4150a410-05e6-48ee-bbc1-e464ae3808f5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (b7625b45-c8e2-4384-becd-84c71dc4e270), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.167241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4150a410-05e6-48ee-bbc1-e464ae3808f5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Fanout notify agent at l3_agent the message router_deleted on router b7625b45-c8e2-4384-becd-84c71dc4e270 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:14:30.187067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4150a410-05e6-48ee-bbc1-e464ae3808f5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.188610 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4150a410-05e6-48ee-bbc1-e464ae3808f5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/b7625b45-c8e2-4384-becd-84c71dc4e270 HTTP/1.1" status: 204 len: 168 time: 0.7273221 Mar 24 02:14:30.193375 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57852) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:30.211587 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89717ae5-f542-4375-910f-9d8f4c62fe5c None None] DHCP port deletion for 28032cb0-df23-4e8d-b984-c7b58574ba56 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:30.217834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (0180dcb3-067b-4e45-a75c-bef300d8b1c4), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.219055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b0b097a0-9166-4935-8861-5c2d21a8fe47 None None] Provisioning complete for port 38139c4e-e6f5-44ed-9b98-9e753276133f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:30.219503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0b097a0-9166-4935-8861-5c2d21a8fe47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.225838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for port (988c1019-e7b0-49e0-8a94-6fb6d2aa345a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.245054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b1212e-92fa-488f-b04e-b3f04ad1ffb9 req-7ef411fc-3178-41e4-8afe-a4832fa33f8f tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:30.251018 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-55b1212e-92fa-488f-b04e-b3f04ad1ffb9 req-7ef411fc-3178-41e4-8afe-a4832fa33f8f tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 944 time: 0.2657282 Mar 24 02:14:30.281482 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-f98fc163-3e43-41c6-beaa-7117b8cc1837 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting subnet 71bcd0f2-d2a9-49de-abca-c367b71a913d {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:30.313962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b0b097a0-9166-4935-8861-5c2d21a8fe47 None None] Current status of the port 38139c4e-e6f5-44ed-9b98-9e753276133f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:30.339615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cedfd2e1-d343-4946-a5f4-958cbff3fae8 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:30.339825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f98fc163-3e43-41c6-beaa-7117b8cc1837 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (71bcd0f2-d2a9-49de-abca-c367b71a913d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.384594 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-cedfd2e1-d343-4946-a5f4-958cbff3fae8 None None] Deleting port 38139c4e-e6f5-44ed-9b98-9e753276133f {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:30.384900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cedfd2e1-d343-4946-a5f4-958cbff3fae8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.400761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (988c1019-e7b0-49e0-8a94-6fb6d2aa345a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.413844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (0180dcb3-067b-4e45-a75c-bef300d8b1c4), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.439242 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-bc402fd4-98d8-467d-a8f4-cbd76cc20169 None None] Could not find standard attr ID for object 5beb91e1-43e5-49ea-85ba-0219d86cfb91. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:14:30.461979 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-cedfd2e1-d343-4946-a5f4-958cbff3fae8 None None] For port 38139c4e-e6f5-44ed-9b98-9e753276133f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=38139c4e-e6f5-44ed-9b98-9e753276133f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:30.462375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cedfd2e1-d343-4946-a5f4-958cbff3fae8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.472050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:30.482281 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-cedfd2e1-d343-4946-a5f4-958cbff3fae8 None None] Calling delete_port for 38139c4e-e6f5-44ed-9b98-9e753276133f owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:30.487319 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-eeec0208-ae17-4dba-8ab6-31637f778d55 admin admin] 10.222.0.20 "PUT /v2.0/routers/f52240e9-2e82-4113-abe0-f8b0dcb76cb1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3194077 Mar 24 02:14:30.487319 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=0180dcb3-067b-4e45-a75c-bef300d8b1c4,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:30.487676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f98fc163-3e43-41c6-beaa-7117b8cc1837 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (71bcd0f2-d2a9-49de-abca-c367b71a913d), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.493223 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:30.493703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d877ac6-7ed3-4ccf-b8f5-d3496f8ad49d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.494167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57854) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:30.532672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] Sync routers for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:30.534672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c516eae5-d4cd-4695-80c0-380d533eafa3 None None] Network 28032cb0-df23-4e8d-b984-c7b58574ba56 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:30.538507 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:30.557596 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-55b1212e-92fa-488f-b04e-b3f04ad1ffb9 req-2e77eec5-b7f3-4c44-8f83-5f3292bf2427 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3045585 Mar 24 02:14:30.592020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:30.601178 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:30.601844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.652251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Port': ['ID=988c1019-e7b0-49e0-8a94-6fb6d2aa345a,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:30.654199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:30.654856 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:30.699414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (28032cb0-df23-4e8d-b984-c7b58574ba56), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.718076 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7ab6bddf-8bd8-4e86-9b4c-fac301558e05 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.3647380 Mar 24 02:14:30.725934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57856) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:30.734274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c59feebd-0233-47bc-a47a-a126bd225414 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::2f1', 'mac_address': 'fa:16:3e:ed:14:3b'}, {'ip_address': '2001:db8::185', 'mac_address': 'fa:16:3e:df:57:8e'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:30.791389 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f98fc163-3e43-41c6-beaa-7117b8cc1837 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (71bcd0f2-d2a9-49de-abca-c367b71a913d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.806897 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa9fe85f-513f-42ad-9e38-fc31e2bd41d3 None None] DHCP port deletion for 28032cb0-df23-4e8d-b984-c7b58574ba56 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:30.827585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['28032cb0-df23-4e8d-b984-c7b58574ba56']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:30.830589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5beb91e1-43e5-49ea-85ba-0219d86cfb91 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:30.830589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cedfd2e1-d343-4946-a5f4-958cbff3fae8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (38139c4e-e6f5-44ed-9b98-9e753276133f), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.847269 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd347a249-2ad0-492e-87fb-174b9edfd016') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:30.848218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd347a249-2ad0-492e-87fb-174b9edfd016') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:30.858866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (d347a249-2ad0-492e-87fb-174b9edfd016), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.870201 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks [] for router (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.915293 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.916422 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 5beb91e1-43e5-49ea-85ba-0219d86cfb91 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:30.916987 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5beb91e1-43e5-49ea-85ba-0219d86cfb91 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:30.917419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 38139c4e-e6f5-44ed-9b98-9e753276133f no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:30.923913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (754231d8-1bfe-4921-87b1-acf5a6a33ff5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.924776 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d347a249-2ad0-492e-87fb-174b9edfd016), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.929301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cedfd2e1-d343-4946-a5f4-958cbff3fae8 None None] Pushing event deleted for resources: {'Port': ['ID=38139c4e-e6f5-44ed-9b98-9e753276133f,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:30.962197 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cedfd2e1-d343-4946-a5f4-958cbff3fae8 None None] No DVR routers for this DVR port 38139c4e-e6f5-44ed-9b98-9e753276133f on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:30.965969 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 38139c4e-e6f5-44ed-9b98-9e753276133f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:30.966319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 38139c4e-e6f5-44ed-9b98-9e753276133f not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:30.977764 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 143 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:30.978166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (d347a249-2ad0-492e-87fb-174b9edfd016), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:30.981375 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:31.009335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:31.034120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:31.035659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=754231d8-1bfe-4921-87b1-acf5a6a33ff5,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:31.038439 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:31.040899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f98fc163-3e43-41c6-beaa-7117b8cc1837 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (71bcd0f2-d2a9-49de-abca-c367b71a913d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.045371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:31.045954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.072506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df079f78-63c2-4900-8ad4-12f049f1d69b None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:14:31.097341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f98fc163-3e43-41c6-beaa-7117b8cc1837 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Subnet': ['ID=71bcd0f2-d2a9-49de-abca-c367b71a913d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:31.107686 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-25c68044-a2a1-47b4-b93c-56bbdb985b7f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5446448 Mar 24 02:14:31.108446 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (9b446767-9204-4d09-bff9-fa3a72e03482), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.113720 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57858) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:31.127834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:31.138768 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (28032cb0-df23-4e8d-b984-c7b58574ba56), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.158667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Pushing event deleted for resources: {'Port': ['ID=9b446767-9204-4d09-bff9-fa3a72e03482,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:31.165058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f98fc163-3e43-41c6-beaa-7117b8cc1837 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.169417 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f98fc163-3e43-41c6-beaa-7117b8cc1837 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/71bcd0f2-d2a9-49de-abca-c367b71a913d HTTP/1.1" status: 204 len: 168 time: 0.9736748 Mar 24 02:14:31.172791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57860) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:31.191757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.199786 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/28032cb0-df23-4e8d-b984-c7b58574ba56 HTTP/1.1" status: 204 len: 168 time: 3.6244626 Mar 24 02:14:31.199973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57862) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:31.223757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks [] for router_gateway (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.224031 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7292ca6d-df67-4a64-816f-2b7edd081282 None None] Provisioning complete for port 988c1019-e7b0-49e0-8a94-6fb6d2aa345a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:31.224125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7292ca6d-df67-4a64-816f-2b7edd081282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (988c1019-e7b0-49e0-8a94-6fb6d2aa345a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.227327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05089541-d548-4e7c-b6d6-fb32740cf9f2 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=28032cb0-df23-4e8d-b984-c7b58574ba56,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:31.302803 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-c625d38d-db2b-4095-b300-ba80e782995f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:31.303257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c625d38d-db2b-4095-b300-ba80e782995f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:31.306329 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c625d38d-db2b-4095-b300-ba80e782995f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/0180dcb3-067b-4e45-a75c-bef300d8b1c4 HTTP/1.1" status: 404 len: 337 time: 0.1057696 Mar 24 02:14:31.313598 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57864) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:31.331657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7292ca6d-df67-4a64-816f-2b7edd081282 None None] Port 988c1019-e7b0-49e0-8a94-6fb6d2aa345a cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:31.348854 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-cc64cf8d-3a70-4f54-b8b5-32602989840c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:31.349377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cc64cf8d-3a70-4f54-b8b5-32602989840c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:31.352492 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cc64cf8d-3a70-4f54-b8b5-32602989840c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/28032cb0-df23-4e8d-b984-c7b58574ba56 HTTP/1.1" status: 404 len: 339 time: 0.0381312 Mar 24 02:14:31.358215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57866) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:31.363881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df079f78-63c2-4900-8ad4-12f049f1d69b None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:14:31.372175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (8c6458ba-91f2-43b8-accc-0d7da5b8ad8c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.399374 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-134c8ab7-4094-4609-b259-7265d5caca2c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:31.399740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-134c8ab7-4094-4609-b259-7265d5caca2c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:31.404158 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-134c8ab7-4094-4609-b259-7265d5caca2c tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/fbf496ed-b988-4f8c-8df1-30398262abfc HTTP/1.1" status: 404 len: 337 time: 0.0451825 Mar 24 02:14:31.408205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57868) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:31.444657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:14:28Z', 'revision_number': 5, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:31.478988 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] Checking router: f52240e9-2e82-4113-abe0-f8b0dcb76cb1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:14:31.493527 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-7da1d82e-6bb1-4b85-bde0-c1f0b8d9df11 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:31.494049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7da1d82e-6bb1-4b85-bde0-c1f0b8d9df11 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:31.497160 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7da1d82e-6bb1-4b85-bde0-c1f0b8d9df11 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/067f3f77-cb28-48ea-8053-0ed6e6e8b32d HTTP/1.1" status: 404 len: 339 time: 0.0842853 Mar 24 02:14:31.500869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57870) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:31.502851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] Routers {'f52240e9-2e82-4113-abe0-f8b0dcb76cb1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:31.502851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:31.576552 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c59feebd-0233-47bc-a47a-a126bd225414 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (988c1019-e7b0-49e0-8a94-6fb6d2aa345a), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.638024 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (e4f3a925-03b0-4923-8fec-591295c5e770), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.660346 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.668897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 277a8700-f399-48aa-a949-2a59565bf02f {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:31.668897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (277a8700-f399-48aa-a949-2a59565bf02f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.686193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Deleting port 9a4b70bd-f398-49e6-9234-c79d598e3a65 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:31.686599 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.690311 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:31.693972 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.838447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] Set router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:31.883761 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 4716cbf2-4cfd-4eec-91c2-c814fff2a832 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:31.885769 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '754231d8-1bfe-4921-87b1-acf5a6a33ff5'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:31.886605 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.901591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port 277a8700-f399-48aa-a949-2a59565bf02f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=277a8700-f399-48aa-a949-2a59565bf02f,segment=NetworkSegment(fa1aac63-3aee-4ae3-aba1-dd462153e0e9),segment_id=fa1aac63-3aee-4ae3-aba1-dd462153e0e9)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:31.901954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (277a8700-f399-48aa-a949-2a59565bf02f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.920813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] For port 9a4b70bd-f398-49e6-9234-c79d598e3a65, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9a4b70bd-f398-49e6-9234-c79d598e3a65,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:31.921173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.929248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (e4f3a925-03b0-4923-8fec-591295c5e770), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:31.933113 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 277a8700-f399-48aa-a949-2a59565bf02f owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:31.953365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Calling delete_port for 9a4b70bd-f398-49e6-9234-c79d598e3a65 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:31.973658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e4f3a925-03b0-4923-8fec-591295c5e770']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:31.993040 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:14:32.021432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '225c6f18-51d3-4a53-9749-7782002a0216') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:32.021723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '225c6f18-51d3-4a53-9749-7782002a0216') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:32.032575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-427a471f-eee8-40a9-819f-447fa93b1851 req-a336d0e6-1aa9-4c4c-b445-34999e032006 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:32.034058 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-427a471f-eee8-40a9-819f-447fa93b1851 req-a336d0e6-1aa9-4c4c-b445-34999e032006 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 944 time: 0.2937126 Mar 24 02:14:32.037311 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c59feebd-0233-47bc-a47a-a126bd225414 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for port (988c1019-e7b0-49e0-8a94-6fb6d2aa345a), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.046775 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (225c6f18-51d3-4a53-9749-7782002a0216), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.055835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c59feebd-0233-47bc-a47a-a126bd225414 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (988c1019-e7b0-49e0-8a94-6fb6d2aa345a), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.108986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:14:32.124932 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:32.125317 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.128107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-c59feebd-0233-47bc-a47a-a126bd225414 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] In _notify_port_updated(), no bound segment for port 988c1019-e7b0-49e0-8a94-6fb6d2aa345a on network 0c765cab-bf54-40f0-922b-903bce6e75d2 {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:14:32.133385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c59feebd-0233-47bc-a47a-a126bd225414 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:32.134054 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c59feebd-0233-47bc-a47a-a126bd225414 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.138410 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c59feebd-0233-47bc-a47a-a126bd225414 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "PUT /v2.0/ports/988c1019-e7b0-49e0-8a94-6fb6d2aa345a HTTP/1.1" status: 200 len: 1067 time: 1.4111307 Mar 24 02:14:32.141743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57874) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:32.228570 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c59feebd-0233-47bc-a47a-a126bd225414 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event updated for resources: {'Port': ['ID=988c1019-e7b0-49e0-8a94-6fb6d2aa345a,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:32.239179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Allocated IP 172.20.0.2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/754231d8-1bfe-4921-87b1-acf5a6a33ff5/9f223764-0161-4947-8a29-5b59e494c11a) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:32.351616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:14:28Z', 'revision_number': 5, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:32.410572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bd14e3b-21b3-4d70-8b4f-8c235c54ee93 None None] The sync data for ids ['f52240e9-2e82-4113-abe0-f8b0dcb76cb1'] in dv-neutron-834874-3-hyperv is: [{'id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'name': 'tempest-ServersTestJSON-1627273874-router', 'tenant_id': '70b00ff8787a4049967d01e358be86c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100'}], 'enable_snat': True}, 'gw_port_id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:14:28Z', 'revision_number': 5, 'project_id': '70b00ff8787a4049967d01e358be86c2', 'gw_port': {'id': '9a4b70bd-f398-49e6-9234-c79d598e3a65', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:51:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f52240e9-2e82-4113-abe0-f8b0dcb76cb1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:32.411912 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:32.412309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.417133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (225c6f18-51d3-4a53-9749-7782002a0216), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.426443 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (9a4b70bd-f398-49e6-9234-c79d598e3a65), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.478971 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.492940 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Pushing event deleted for resources: {'Port': ['ID=9a4b70bd-f398-49e6-9234-c79d598e3a65,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:32.493502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 122 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:32.494224 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (225c6f18-51d3-4a53-9749-7782002a0216), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:32.501171 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:32.503476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3502e19c-98aa-40ab-ab3c-24e89703d696 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Deleting port 988c1019-e7b0-49e0-8a94-6fb6d2aa345a {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:32.503476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3502e19c-98aa-40ab-ab3c-24e89703d696 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (988c1019-e7b0-49e0-8a94-6fb6d2aa345a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.516144 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Publish callbacks [] for port (9f223764-0161-4947-8a29-5b59e494c11a), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.523179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:14:32.525855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de6a7490-6f95-48b5-baa4-2a00ba97477a" -d '{"events": [{"server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "name": "network-vif-plugged", "status": "completed", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:14:32.532293 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (9f223764-0161-4947-8a29-5b59e494c11a), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.545662 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:32.570446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.591270 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:14:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f9d255b-ae58-4459-aedd-d0821bc41c61 x-openstack-request-id: req-7f9d255b-ae58-4459-aedd-d0821bc41c61 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:14:32.591599 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "name": "network-vif-plugged", "status": "completed", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:14:32.591855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-7f9d255b-ae58-4459-aedd-d0821bc41c61 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:14:32.592429 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7f9d255b-ae58-4459-aedd-d0821bc41c61'] response: {'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'code': 200} Mar 24 02:14:32.594586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:32.599128 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:32.601254 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Pushing event updated for resources: {'Port': ['ID=9f223764-0161-4947-8a29-5b59e494c11a,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:32.603590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:32.615047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (277a8700-f399-48aa-a949-2a59565bf02f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.691553 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-427a471f-eee8-40a9-819f-447fa93b1851 req-2e11b15a-df10-4177-b9ff-a59cb14c7ec5 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6364741 Mar 24 02:14:32.707129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:14:32.711445 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=277a8700-f399-48aa-a949-2a59565bf02f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:32.724036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No DVR routers for this DVR port 277a8700-f399-48aa-a949-2a59565bf02f on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:32.732865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=4716cbf2-4cfd-4eec-91c2-c814fff2a832,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:32.733090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (e4f3a925-03b0-4923-8fec-591295c5e770), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.743583 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.762733 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Attempting to bind port 9f223764-0161-4947-8a29-5b59e494c11a on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:32.763235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Attempting to bind port 9f223764-0161-4947-8a29-5b59e494c11a by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:32.763604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Attempting to bind port 9f223764-0161-4947-8a29-5b59e494c11a on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:32.778115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.778576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:32.778966 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:32.779863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.780871 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:32.781478 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/e4f3a925-03b0-4923-8fec-591295c5e770 HTTP/1.1" status: 204 len: 168 time: 1.2781878 Mar 24 02:14:32.784340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Bound port: 9f223764-0161-4947-8a29-5b59e494c11a, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:32.785029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9f223764-0161-4947-8a29-5b59e494c11a), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.810893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57878) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:32.827956 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3502e19c-98aa-40ab-ab3c-24e89703d696 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (988c1019-e7b0-49e0-8a94-6fb6d2aa345a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.873396 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-3c57f924-4cd2-49da-89cf-3e5f895b6f1f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:32.873864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3c57f924-4cd2-49da-89cf-3e5f895b6f1f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:32.877933 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3c57f924-4cd2-49da-89cf-3e5f895b6f1f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/695c48a9-bfb3-4f02-8678-716854ae7fbb HTTP/1.1" status: 404 len: 337 time: 0.0639186 Mar 24 02:14:32.893497 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8af96203-3ff6-4539-86e9-76007060f1cf tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=e4f3a925-03b0-4923-8fec-591295c5e770,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:32.899174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] For port 9f223764-0161-4947-8a29-5b59e494c11a, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:32.904054 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] For port 9f223764-0161-4947-8a29-5b59e494c11a, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f223764-0161-4947-8a29-5b59e494c11a,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:32.913896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9f223764-0161-4947-8a29-5b59e494c11a), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:32.919906 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57882) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:32.973898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3502e19c-98aa-40ab-ab3c-24e89703d696 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Calling delete_port for 988c1019-e7b0-49e0-8a94-6fb6d2aa345a owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:32.991596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:14:33.001106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (8c6458ba-91f2-43b8-accc-0d7da5b8ad8c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.009450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c09745fa-b8dd-44bc-bd26-2ffd00f709e6 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:33.045583 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-1c81aba9-531c-41fe-a8b1-0962eff80fa7 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.046113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1c81aba9-531c-41fe-a8b1-0962eff80fa7 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.046708 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: c09745fa-b8dd-44bc-bd26-2ffd00f709e6 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:33.047056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c09745fa-b8dd-44bc-bd26-2ffd00f709e6 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:33.050591 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1c81aba9-531c-41fe-a8b1-0962eff80fa7 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/75eb7762-ad4e-477f-ba6a-5185ce3ac565 HTTP/1.1" status: 404 len: 339 time: 0.1267467 Mar 24 02:14:33.050777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8c6458ba-91f2-43b8-accc-0d7da5b8ad8c']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:33.053606 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57884) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.055107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.063148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea794e4-a7fc-4b01-9ea8-9ecc56854700 req-2879bb5f-92f5-4c7d-ad9c-8032aae22c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:33.064837 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cea794e4-a7fc-4b01-9ea8-9ecc56854700 req-2879bb5f-92f5-4c7d-ad9c-8032aae22c06 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 1129 time: 0.2130570 Mar 24 02:14:33.070633 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks [] for router_controller (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.080861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e5baf2b-c94b-412c-a490-edda0e1897cc None None] Pushing event updated for resources: {'Port': ['ID=9f223764-0161-4947-8a29-5b59e494c11a,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:33.148176 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-3af61452-0c73-46d6-bc82-9ca9491bf42e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.148792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3af61452-0c73-46d6-bc82-9ca9491bf42e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.151692 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3af61452-0c73-46d6-bc82-9ca9491bf42e tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/698d2aee-ded5-4443-87eb-b82ad96e1825 HTTP/1.1" status: 404 len: 337 time: 0.0927055 Mar 24 02:14:33.158159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57886) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.165658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fa1aac63-3aee-4ae3-aba1-dd462153e0e9') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:33.165658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fa1aac63-3aee-4ae3-aba1-dd462153e0e9') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:33.192011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (fa1aac63-3aee-4ae3-aba1-dd462153e0e9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.211542 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-341ad6a3-cf69-4d1c-bdb3-eda0e6b14269 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.212069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-341ad6a3-cf69-4d1c-bdb3-eda0e6b14269 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.215159 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-341ad6a3-cf69-4d1c-bdb3-eda0e6b14269 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/eab652b8-6872-4a43-a4d0-be7f3ca6aebd HTTP/1.1" status: 404 len: 339 time: 0.0515461 Mar 24 02:14:33.226285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57888) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.295750 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cea794e4-a7fc-4b01-9ea8-9ecc56854700 req-b26d5e3f-67a5-42bc-ad87-85d9b9e402a9 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1736538 Mar 24 02:14:33.296096 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-394a05fc-7011-4da4-81dc-bffbc3a41842 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.296556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-394a05fc-7011-4da4-81dc-bffbc3a41842 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.299658 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-394a05fc-7011-4da4-81dc-bffbc3a41842 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/6a055c46-d6bc-4261-80c7-ca6a1d86e1b3 HTTP/1.1" status: 404 len: 337 time: 0.0723367 Mar 24 02:14:33.303867 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57890) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.315294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (fa1aac63-3aee-4ae3-aba1-dd462153e0e9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.316278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (f52240e9-2e82-4113-abe0-f8b0dcb76cb1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.316840 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Fanout notify agent at l3_agent the message router_deleted on router f52240e9-2e82-4113-abe0-f8b0dcb76cb1 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:14:33.325653 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.329398 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-41374e46-f2c2-4f53-8614-95570ea0b3ea admin admin] 10.222.0.20 "DELETE /v2.0/routers/f52240e9-2e82-4113-abe0-f8b0dcb76cb1 HTTP/1.1" status: 204 len: 168 time: 2.8340704 Mar 24 02:14:33.330611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57892) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.340023 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-49b10c19-c803-4bc5-bf18-5f93ca3ecbae tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.340554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-49b10c19-c803-4bc5-bf18-5f93ca3ecbae tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.343722 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-49b10c19-c803-4bc5-bf18-5f93ca3ecbae tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/88d32be6-8a1c-4d27-89b3-fd9950d99483 HTTP/1.1" status: 404 len: 339 time: 0.0387092 Mar 24 02:14:33.348329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57894) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.349906 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Releasing vlan 145 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:33.350587 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (fa1aac63-3aee-4ae3-aba1-dd462153e0e9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:33.378302 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:33.392214 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9f223764-0161-4947-8a29-5b59e494c11a), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.450911 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-6adad0de-6a52-482a-91cc-41fbbe735597 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.451372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6adad0de-6a52-482a-91cc-41fbbe735597 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.454460 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6adad0de-6a52-482a-91cc-41fbbe735597 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/a001d522-44db-428e-aa7c-f3f5c380a450 HTTP/1.1" status: 404 len: 337 time: 0.0832844 Mar 24 02:14:33.462937 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57896) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.464540 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:33.477926 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] Sync routers for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:33.478479 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b2cad084-3e92-4b84-8f0b-31f9f53f2207 admin admin] 10.222.0.20 "PUT /v2.0/routers/2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4502752 Mar 24 02:14:33.481237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57898) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.496483 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:33.497110 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:33.499501 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-6c14b2bd-794a-4d17-9923-15aa34facd8f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.500147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6c14b2bd-794a-4d17-9923-15aa34facd8f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.503580 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6c14b2bd-794a-4d17-9923-15aa34facd8f tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/39216f75-889f-4474-ad77-7887f16468aa HTTP/1.1" status: 404 len: 339 time: 0.0276906 Mar 24 02:14:33.504720 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3502e19c-98aa-40ab-ab3c-24e89703d696 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (988c1019-e7b0-49e0-8a94-6fb6d2aa345a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.506599 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57900) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.532371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-b7449069-038a-42e5-b4dd-ce7626d995ac admin admin] Deleting subnet 02cc6c6a-e353-4d82-9d85-3973d8220a39 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:33.565641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7449069-038a-42e5-b4dd-ce7626d995ac admin admin] Publish callbacks [] for subnet (02cc6c6a-e353-4d82-9d85-3973d8220a39), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.585097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3502e19c-98aa-40ab-ab3c-24e89703d696 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event deleted for resources: {'Port': ['ID=988c1019-e7b0-49e0-8a94-6fb6d2aa345a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:33.587320 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-42047e06-3d43-47e0-a74a-73b3a261bd0b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.588049 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-42047e06-3d43-47e0-a74a-73b3a261bd0b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.591615 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-42047e06-3d43-47e0-a74a-73b3a261bd0b tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/e2334f57-37b4-42cc-8409-be8c2d837f6d HTTP/1.1" status: 404 len: 337 time: 0.0814309 Mar 24 02:14:33.595761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57902) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.615732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (8c6458ba-91f2-43b8-accc-0d7da5b8ad8c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.640237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.643358 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/networks/8c6458ba-91f2-43b8-accc-0d7da5b8ad8c HTTP/1.1" status: 204 len: 168 time: 2.4693692 Mar 24 02:14:33.644461 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-316f9129-cfc3-4487-91cc-dc7efeef5a6d tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.647453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-316f9129-cfc3-4487-91cc-dc7efeef5a6d tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.650652 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-316f9129-cfc3-4487-91cc-dc7efeef5a6d tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/5efe4cb6-b6db-4464-8dbd-f168e295408e HTTP/1.1" status: 404 len: 339 time: 0.0505073 Mar 24 02:14:33.650652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57904) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.660649 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7449069-038a-42e5-b4dd-ce7626d995ac admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (02cc6c6a-e353-4d82-9d85-3973d8220a39), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.665589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57906) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.666623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-893474792', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:33.672871 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:33.693778 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7344823-a874-4ab7-956d-030fc156c266 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Network': ['ID=8c6458ba-91f2-43b8-accc-0d7da5b8ad8c,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:33.712421 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-4f3939e1-bc88-41b5-ab78-9c6bdf58dd57 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.713163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4f3939e1-bc88-41b5-ab78-9c6bdf58dd57 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.717370 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.717525 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4f3939e1-bc88-41b5-ab78-9c6bdf58dd57 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/5502286a-a0a7-45cd-a920-a7677d14542e HTTP/1.1" status: 404 len: 337 time: 0.0507393 Mar 24 02:14:33.722725 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57910) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.770240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks [] for router (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.785418 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-686b1d61-af40-435b-b599-ae7177d0cbed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:33.786859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-686b1d61-af40-435b-b599-ae7177d0cbed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:33.790088 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-686b1d61-af40-435b-b599-ae7177d0cbed tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/ae635ae4-cdbd-40ef-9e49-21e17f06f1ca HTTP/1.1" status: 404 len: 339 time: 0.0625446 Mar 24 02:14:33.794576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57912) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:33.827595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (2e755dda-98d1-4713-a810-541b5f12235b), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.828598 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (2e755dda-98d1-4713-a810-541b5f12235b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:33.928725 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:14:30Z', 'revision_number': 5, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:33.961715 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] Checking router: 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:14:33.978944 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] Routers {'2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:33.979931 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:34.000587 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (2e755dda-98d1-4713-a810-541b5f12235b), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.121046 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-83ca6fea-3445-4519-9a44-d0d3992116e7 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:34.121046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-83ca6fea-3445-4519-9a44-d0d3992116e7 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:34.121359 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] Set router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:34.121444 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-83ca6fea-3445-4519-9a44-d0d3992116e7 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/723c7a3c-1afc-42c9-9487-e1f0431035c7 HTTP/1.1" status: 404 len: 337 time: 0.3220792 Mar 24 02:14:34.125906 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57914) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:34.147661 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] For port 9f223764-0161-4947-8a29-5b59e494c11a, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f223764-0161-4947-8a29-5b59e494c11a,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:34.173091 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa934c47-4a69-44e8-bf0b-6428ff1d2f3b req-f2a8068b-6332-42d8-b4f4-de67f2c992b7 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:34.174729 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa934c47-4a69-44e8-bf0b-6428ff1d2f3b req-f2a8068b-6332-42d8-b4f4-de67f2c992b7 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.3611603 Mar 24 02:14:34.176739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7449069-038a-42e5-b4dd-ce7626d995ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (02cc6c6a-e353-4d82-9d85-3973d8220a39), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.187693 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (9f223764-0161-4947-8a29-5b59e494c11a), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.195890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (9f223764-0161-4947-8a29-5b59e494c11a), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.202897 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-0af15420-4acf-4dbd-bf23-3bc3d4afe7df tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:34.203420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0af15420-4acf-4dbd-bf23-3bc3d4afe7df tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:34.207428 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0af15420-4acf-4dbd-bf23-3bc3d4afe7df tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/1c5346a8-419f-4cf9-b148-63a16b6321b0 HTTP/1.1" status: 404 len: 339 time: 0.0751517 Mar 24 02:14:34.262639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57916) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:34.263292 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=9f223764-0161-4947-8a29-5b59e494c11a,revision_number=4']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:34.294487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (48ad07a8-5051-44bb-8ca6-f43ab79b2221), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.297614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_gateway (2e755dda-98d1-4713-a810-541b5f12235b), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.303679 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-a685b586-7943-4b77-b7e5-c06e4fd78f61 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:34.304276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a685b586-7943-4b77-b7e5-c06e4fd78f61 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:34.307145 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a685b586-7943-4b77-b7e5-c06e4fd78f61 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/f84a6fc8-df97-4505-81dd-32693a6871dc HTTP/1.1" status: 404 len: 337 time: 0.0409744 Mar 24 02:14:34.323508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57918) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:34.365007 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:14:30Z', 'revision_number': 5, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:34.365192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4de149a0-d615-435b-8d14-63333e3864af None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:34.382881 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:34.403570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks [] for router_gateway (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.404631 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60614ec0-e700-4377-b1f2-847ace5d9d88 None None] The sync data for ids ['2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c'] in dv-neutron-834874-3-hyperv is: [{'id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'name': 'tempest-ServersTestManualDisk-666298631-router', 'tenant_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59'}], 'enable_snat': True}, 'gw_port_id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:53Z', 'updated_at': '2022-03-24T02:14:30Z', 'revision_number': 5, 'project_id': 'd597f5a6c32e40b9b8f2e09949c6fcfd', 'gw_port': {'id': '4c6d0a24-5d23-4334-adb5-b107b1a904a9', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:55Z', 'updated_at': '2022-03-24T02:12:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:34.405664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:34.413813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:34.414417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.428670 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-c46152c6-361b-4566-adb7-4d3388b53ef0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:34.429226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c46152c6-361b-4566-adb7-4d3388b53ef0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:34.434744 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c46152c6-361b-4566-adb7-4d3388b53ef0 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/d5dd9df3-1b8f-4413-b8c5-20ddecbe71de HTTP/1.1" status: 404 len: 339 time: 0.1057091 Mar 24 02:14:34.452660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=48ad07a8-5051-44bb-8ca6-f43ab79b2221,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:34.459042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57920) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:34.481359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3502e19c-98aa-40ab-ab3c-24e89703d696 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.489055 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3502e19c-98aa-40ab-ab3c-24e89703d696 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "DELETE /v2.0/ports/988c1019-e7b0-49e0-8a94-6fb6d2aa345a HTTP/1.1" status: 204 len: 168 time: 2.3095312 Mar 24 02:14:34.491634 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57922) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:34.499064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcb090f5-e643-4ac9-b038-d2e00f4f6e6f None None] Network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:34.511857 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6dd7dced-94ff-4237-94f2-f357a820c231 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 3.3936079 Mar 24 02:14:34.512903 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57924) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:34.520745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcb090f5-e643-4ac9-b038-d2e00f4f6e6f None None] Network 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c could not be found, it might have been deleted concurrently. {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:196}} Mar 24 02:14:34.551085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7e2ab0c2-d345-43f2-bfc6-d6b8f0600db6 None None] Provisioning complete for port 9f223764-0161-4947-8a29-5b59e494c11a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:34.552919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e2ab0c2-d345-43f2-bfc6-d6b8f0600db6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f223764-0161-4947-8a29-5b59e494c11a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.583765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:4e:54:42', 'name': 'tempest-NetworksTestDHCPv6-1437631518'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:34.603055 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-01357437-13d3-4125-986a-7057006d4c0d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] GET failed (client error): The resource could not be found. Mar 24 02:14:34.608159 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-01357437-13d3-4125-986a-7057006d4c0d tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "GET /v2.0/ports/988c1019-e7b0-49e0-8a94-6fb6d2aa345a HTTP/1.1" status: 404 len: 333 time: 0.1152961 Mar 24 02:14:34.609141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57926) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:34.682617 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa934c47-4a69-44e8-bf0b-6428ff1d2f3b req-606c1a75-421d-4df1-88f5-02e84969d404 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3770599 Mar 24 02:14:34.736608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-330d9dc5-eb10-439c-b268-299a95f868b4 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Deleting subnet de633914-0d11-47c4-9878-19082d997ae6 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:34.738934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7e2ab0c2-d345-43f2-bfc6-d6b8f0600db6 None None] Current status of the port 9f223764-0161-4947-8a29-5b59e494c11a is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:34.740150 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e2ab0c2-d345-43f2-bfc6-d6b8f0600db6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9f223764-0161-4947-8a29-5b59e494c11a), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.763625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-330d9dc5-eb10-439c-b268-299a95f868b4 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (de633914-0d11-47c4-9878-19082d997ae6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.788748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ec42651-f285-4565-a71e-43feb9e85f84 None None] DHCP port deletion for 8c6458ba-91f2-43b8-accc-0d7da5b8ad8c request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:34.823074 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7e2ab0c2-d345-43f2-bfc6-d6b8f0600db6 None None] For port 9f223764-0161-4947-8a29-5b59e494c11a, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f223764-0161-4947-8a29-5b59e494c11a,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:34.835909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e2ab0c2-d345-43f2-bfc6-d6b8f0600db6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9f223764-0161-4947-8a29-5b59e494c11a), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.868366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7449069-038a-42e5-b4dd-ce7626d995ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (02cc6c6a-e353-4d82-9d85-3973d8220a39), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.925606 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e2ab0c2-d345-43f2-bfc6-d6b8f0600db6 None None] Pushing event updated for resources: {'Port': ['ID=9f223764-0161-4947-8a29-5b59e494c11a,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:34.969700 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f223764-0161-4947-8a29-5b59e494c11a up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:34.987104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1e6afc7a-5dcd-4606-8b0f-b76e816ce271 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Deleting port 289ea406-4837-4e56-ab10-f35d3e4e796d {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:34.987453 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e6afc7a-5dcd-4606-8b0f-b76e816ce271 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (289ea406-4837-4e56-ab10-f35d3e4e796d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:34.989988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7449069-038a-42e5-b4dd-ce7626d995ac admin admin] Pushing event deleted for resources: {'Subnet': ['ID=02cc6c6a-e353-4d82-9d85-3973d8220a39,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:35.001883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-330d9dc5-eb10-439c-b268-299a95f868b4 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (de633914-0d11-47c4-9878-19082d997ae6), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.008530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:35.050043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8a80ca9-8e6a-42f4-b3bc-0697f51a19f4 None None] Network d91de7c3-7e46-4c9d-8b0a-c988de7fd81b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:35.096777 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8316744f-0a98-4b9c-bbdd-6d7be580b910 None None] Could not find standard attr ID for object 988c1019-e7b0-49e0-8a94-6fb6d2aa345a. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:14:35.117125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-330d9dc5-eb10-439c-b268-299a95f868b4 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (de633914-0d11-47c4-9878-19082d997ae6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.153099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7449069-038a-42e5-b4dd-ce7626d995ac admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.158619 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b7449069-038a-42e5-b4dd-ce7626d995ac admin admin] 10.222.0.20 "DELETE /v2.0/subnets/02cc6c6a-e353-4d82-9d85-3973d8220a39 HTTP/1.1" status: 204 len: 168 time: 1.8231666 Mar 24 02:14:35.161240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57930) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:35.190824 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Deleting port 4c6d0a24-5d23-4334-adb5-b107b1a904a9 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:35.191166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.236284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9f223764-0161-4947-8a29-5b59e494c11a triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:35.236922 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f223764-0161-4947-8a29-5b59e494c11a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.275884 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e6afc7a-5dcd-4606-8b0f-b76e816ce271 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (289ea406-4837-4e56-ab10-f35d3e4e796d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.297550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1e6afc7a-5dcd-4606-8b0f-b76e816ce271 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Calling delete_port for 289ea406-4837-4e56-ab10-f35d3e4e796d owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:35.326247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.358010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-330d9dc5-eb10-439c-b268-299a95f868b4 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (de633914-0d11-47c4-9878-19082d997ae6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.385586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (d91de7c3-7e46-4c9d-8b0a-c988de7fd81b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.404567 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9f223764-0161-4947-8a29-5b59e494c11a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:35.417600 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port d9d25a9e-67a1-47ec-a4b7-732509df5486 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:35.421983 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9a4b70bd-f398-49e6-9234-c79d598e3a65 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:35.433352 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330d9dc5-eb10-439c-b268-299a95f868b4 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Subnet': ['ID=de633914-0d11-47c4-9878-19082d997ae6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:35.435778 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-330d9dc5-eb10-439c-b268-299a95f868b4 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.441864 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-330d9dc5-eb10-439c-b268-299a95f868b4 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/subnets/de633914-0d11-47c4-9878-19082d997ae6 HTTP/1.1" status: 204 len: 168 time: 0.9816782 Mar 24 02:14:35.444878 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] For port 4c6d0a24-5d23-4334-adb5-b107b1a904a9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4c6d0a24-5d23-4334-adb5-b107b1a904a9,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:35.445250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.449048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57932) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:35.452490 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aec44df5-4f2d-43bd-9425-b4cd20b33946 None None] DHCP port deletion for d91de7c3-7e46-4c9d-8b0a-c988de7fd81b request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:35.454604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7814e16-e716-4178-b103-b278b70c5f1e None None] Network a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:35.457306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 9a4b70bd-f398-49e6-9234-c79d598e3a65 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:35.457653 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9a4b70bd-f398-49e6-9234-c79d598e3a65 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:35.458780 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9b446767-9204-4d09-bff9-fa3a72e03482 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:35.480023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 9b446767-9204-4d09-bff9-fa3a72e03482 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:35.480678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9b446767-9204-4d09-bff9-fa3a72e03482 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:35.481268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 277a8700-f399-48aa-a949-2a59565bf02f no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:35.522894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Calling delete_port for 4c6d0a24-5d23-4334-adb5-b107b1a904a9 owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:35.562752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_gateway (2e755dda-98d1-4713-a810-541b5f12235b), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.566224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 277a8700-f399-48aa-a949-2a59565bf02f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:35.566798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 277a8700-f399-48aa-a949-2a59565bf02f not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:35.617214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.627811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-aec44df5-4f2d-43bd-9425-b4cd20b33946 None None] Deleting port f46e5e98-2578-4507-9699-7abe2faddbac {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:35.628532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aec44df5-4f2d-43bd-9425-b4cd20b33946 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.769780 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-aec44df5-4f2d-43bd-9425-b4cd20b33946 None None] For port f46e5e98-2578-4507-9699-7abe2faddbac, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f46e5e98-2578-4507-9699-7abe2faddbac,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:35.770473 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aec44df5-4f2d-43bd-9425-b4cd20b33946 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.800291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1c7bfc8-fa40-4e4b-8663-16432b86bedc None None] DHCP port deletion for a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:35.822120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.831300 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-aec44df5-4f2d-43bd-9425-b4cd20b33946 None None] Calling delete_port for f46e5e98-2578-4507-9699-7abe2faddbac owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:35.834469 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff8efa0e-4921-4626-a4b1-fdc29d4f13e9 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:35.884170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 172.26.2.81 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/07b66e7c-044a-4bf5-ac89-e025f4b672c5) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:35.896287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 172.20.0.7 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/754231d8-1bfe-4921-87b1-acf5a6a33ff5/d9d25a9e-67a1-47ec-a4b7-732509df5486) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:35.899119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Deleting port f46e5e98-2578-4507-9699-7abe2faddbac {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:35.899521 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:35.921993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fe4e:5442 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/48ad07a8-5051-44bb-8ca6-f43ab79b2221/d9d25a9e-67a1-47ec-a4b7-732509df5486) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:35.954721 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e6afc7a-5dcd-4606-8b0f-b76e816ce271 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (289ea406-4837-4e56-ab10-f35d3e4e796d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.035246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e6afc7a-5dcd-4606-8b0f-b76e816ce271 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event deleted for resources: {'Port': ['ID=289ea406-4837-4e56-ab10-f35d3e4e796d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:36.053528 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (4c6d0a24-5d23-4334-adb5-b107b1a904a9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.073087 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] For port f46e5e98-2578-4507-9699-7abe2faddbac, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f46e5e98-2578-4507-9699-7abe2faddbac,segment=NetworkSegment(fadaf792-3bdd-4a39-9224-2e6bc940be47),segment_id=fadaf792-3bdd-4a39-9224-2e6bc940be47)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:36.073346 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.097490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a96489ea-ffd6-4ffb-b2a5-093754a0d5c4 req-7438146d-b9b3-4df5-9255-cb8b00352c66 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:36.100150 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a96489ea-ffd6-4ffb-b2a5-093754a0d5c4 req-7438146d-b9b3-4df5-9255-cb8b00352c66 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.2710733 Mar 24 02:14:36.130803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Calling delete_port for f46e5e98-2578-4507-9699-7abe2faddbac owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:36.137051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e6afc7a-5dcd-4606-8b0f-b76e816ce271 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.142940 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1e6afc7a-5dcd-4606-8b0f-b76e816ce271 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "DELETE /v2.0/ports/289ea406-4837-4e56-ab10-f35d3e4e796d HTTP/1.1" status: 204 len: 168 time: 1.5110161 Mar 24 02:14:36.147387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57940) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:36.190981 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5a80f2b5-d588-4fca-9fea-88add5328e9c None None] Provisioning complete for port 9f223764-0161-4947-8a29-5b59e494c11a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:36.191361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5a80f2b5-d588-4fca-9fea-88add5328e9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f223764-0161-4947-8a29-5b59e494c11a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.323340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c1c7bfc8-fa40-4e4b-8663-16432b86bedc None None] Deleting port 234134f6-92b3-4f3b-83e2-0e33e1c8439f {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:36.323871 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c1c7bfc8-fa40-4e4b-8663-16432b86bedc None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.325747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (d9d25a9e-67a1-47ec-a4b7-732509df5486), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.370408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Deleting port 234134f6-92b3-4f3b-83e2-0e33e1c8439f {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:36.370788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.404974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aec44df5-4f2d-43bd-9425-b4cd20b33946 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.420099 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d9d25a9e-67a1-47ec-a4b7-732509df5486), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.461424 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aec44df5-4f2d-43bd-9425-b4cd20b33946 None None] Pushing event deleted for resources: {'Port': ['ID=f46e5e98-2578-4507-9699-7abe2faddbac,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:36.465304 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c1c7bfc8-fa40-4e4b-8663-16432b86bedc None None] For port 234134f6-92b3-4f3b-83e2-0e33e1c8439f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=234134f6-92b3-4f3b-83e2-0e33e1c8439f,segment=NetworkSegment(314ce7c4-6689-4197-9105-543740a0d3ef),segment_id=314ce7c4-6689-4197-9105-543740a0d3ef)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:36.466256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c1c7bfc8-fa40-4e4b-8663-16432b86bedc None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.468697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aec44df5-4f2d-43bd-9425-b4cd20b33946 None None] No DVR routers for this DVR port f46e5e98-2578-4507-9699-7abe2faddbac on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:36.478695 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5a80f2b5-d588-4fca-9fea-88add5328e9c None None] Current status of the port 9f223764-0161-4947-8a29-5b59e494c11a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:36.491117 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:36.492273 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c1c7bfc8-fa40-4e4b-8663-16432b86bedc None None] Calling delete_port for 234134f6-92b3-4f3b-83e2-0e33e1c8439f owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:36.505202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:36.516385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:36.571343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] For port 234134f6-92b3-4f3b-83e2-0e33e1c8439f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=234134f6-92b3-4f3b-83e2-0e33e1c8439f,segment=NetworkSegment(314ce7c4-6689-4197-9105-543740a0d3ef),segment_id=314ce7c4-6689-4197-9105-543740a0d3ef)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:36.571723 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.574588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (07b66e7c-044a-4bf5-ac89-e025f4b672c5), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.593267 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Calling delete_port for 234134f6-92b3-4f3b-83e2-0e33e1c8439f owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:36.595990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=d9d25a9e-67a1-47ec-a4b7-732509df5486,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:36.606887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (f46e5e98-2578-4507-9699-7abe2faddbac), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.608540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c1c7bfc8-fa40-4e4b-8663-16432b86bedc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.622138 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-8c526a69-2a3c-4496-a3d3-eabdb4327092 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] GET failed (client error): The resource could not be found. Mar 24 02:14:36.623660 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8c526a69-2a3c-4496-a3d3-eabdb4327092 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "GET /v2.0/ports/289ea406-4837-4e56-ab10-f35d3e4e796d HTTP/1.1" status: 404 len: 333 time: 0.4729974 Mar 24 02:14:36.636745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Pushing event deleted for resources: {'Port': ['ID=4c6d0a24-5d23-4334-adb5-b107b1a904a9,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:36.645241 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c7bfc8-fa40-4e4b-8663-16432b86bedc None None] Pushing event deleted for resources: {'Port': ['ID=234134f6-92b3-4f3b-83e2-0e33e1c8439f,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:36.649607 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1c7bfc8-fa40-4e4b-8663-16432b86bedc None None] No DVR routers for this DVR port 234134f6-92b3-4f3b-83e2-0e33e1c8439f on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:36.671629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57942) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:36.679938 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Pushing event deleted for resources: {'Port': ['ID=f46e5e98-2578-4507-9699-7abe2faddbac,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:36.689206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:36.690037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.719609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f223764-0161-4947-8a29-5b59e494c11a up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:36.734934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] No DVR routers for this DVR port f46e5e98-2578-4507-9699-7abe2faddbac on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:36.782479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9f223764-0161-4947-8a29-5b59e494c11a triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:36.783025 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f223764-0161-4947-8a29-5b59e494c11a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.804865 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a96489ea-ffd6-4ffb-b2a5-093754a0d5c4 req-e7506970-6645-459e-84f6-0e1555605a96 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6552658 Mar 24 02:14:36.831805 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-37364514-6b26-476f-8f62-5cdb29439406 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 2.2548368 Mar 24 02:14:36.853409 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57944) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:36.854937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a79b58-e08b-4362-9216-681db7e376b2 req-8f90d665-5bd2-4177-898e-ce8a340cc8e0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:36.857295 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-71a79b58-e08b-4362-9216-681db7e376b2 req-8f90d665-5bd2-4177-898e-ce8a340cc8e0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2804818 Mar 24 02:14:36.868598 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-294c0154-04da-4f04-a432-125111d217cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:36.870502 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-294c0154-04da-4f04-a432-125111d217cd service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 1130 time: 0.3225150 Mar 24 02:14:36.897956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9f223764-0161-4947-8a29-5b59e494c11a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:36.900969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.935999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (d91de7c3-7e46-4c9d-8b0a-c988de7fd81b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.940982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8305987d-d164-49dc-b84f-8d84e8f66d46 None None] Provisioning complete for port 9f223764-0161-4947-8a29-5b59e494c11a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:36.941426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8305987d-d164-49dc-b84f-8d84e8f66d46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f223764-0161-4947-8a29-5b59e494c11a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:36.974135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f46e5e98-2578-4507-9699-7abe2faddbac no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:36.987261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d91de7c3-7e46-4c9d-8b0a-c988de7fd81b']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:36.999846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: f46e5e98-2578-4507-9699-7abe2faddbac {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:37.000283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f46e5e98-2578-4507-9699-7abe2faddbac not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:37.000770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 234134f6-92b3-4f3b-83e2-0e33e1c8439f no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:37.009226 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ff33bf1-7f0b-45e6-bcb9-eed0ef7083b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:37.015659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ff33bf1-7f0b-45e6-bcb9-eed0ef7083b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:37.017529 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9ff33bf1-7f0b-45e6-bcb9-eed0ef7083b6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1863 time: 0.1631436 Mar 24 02:14:37.020391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (234134f6-92b3-4f3b-83e2-0e33e1c8439f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.024305 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fadaf792-3bdd-4a39-9224-2e6bc940be47') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:37.024682 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fadaf792-3bdd-4a39-9224-2e6bc940be47') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:37.026243 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57948) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:37.030772 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 234134f6-92b3-4f3b-83e2-0e33e1c8439f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:37.031190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 234134f6-92b3-4f3b-83e2-0e33e1c8439f not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:37.086485 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Port': ['ID=234134f6-92b3-4f3b-83e2-0e33e1c8439f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:37.101736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8305987d-d164-49dc-b84f-8d84e8f66d46 None None] Current status of the port 9f223764-0161-4947-8a29-5b59e494c11a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:37.110489 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] No DVR routers for this DVR port 234134f6-92b3-4f3b-83e2-0e33e1c8439f on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:37.112978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (fadaf792-3bdd-4a39-9224-2e6bc940be47), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.164658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (fadaf792-3bdd-4a39-9224-2e6bc940be47), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.200402 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (07b66e7c-044a-4bf5-ac89-e025f4b672c5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.214416 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.219760 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-71a79b58-e08b-4362-9216-681db7e376b2 req-9f588dfc-5a26-4bdb-a5e9-2fd6e9a98504 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3463714 Mar 24 02:14:37.221718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks [] for router_controller (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.228525 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-b922c9ca-1ced-44c9-addd-31a94da61ac4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:37.229974 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-b922c9ca-1ced-44c9-addd-31a94da61ac4 service neutron] 10.222.0.30 "GET /v2.0/networks?id=597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 200 len: 913 time: 0.3238723 Mar 24 02:14:37.233592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Releasing vlan 116 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:37.234002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (fadaf792-3bdd-4a39-9224-2e6bc940be47), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:37.235899 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:37.300265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.313409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:37.322851 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (d91de7c3-7e46-4c9d-8b0a-c988de7fd81b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.326842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4a6ced04-1620-409f-8f3c-beccad6cb582 None None] Provisioning complete for port d9d25a9e-67a1-47ec-a4b7-732509df5486 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:37.327216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a6ced04-1620-409f-8f3c-beccad6cb582 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d9d25a9e-67a1-47ec-a4b7-732509df5486), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.333534 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:37.336061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.345566 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] 10.222.0.20 "DELETE /v2.0/networks/d91de7c3-7e46-4c9d-8b0a-c988de7fd81b HTTP/1.1" status: 204 len: 168 time: 2.1768541 Mar 24 02:14:37.361390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:37.364001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:37.373129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4a6ced04-1620-409f-8f3c-beccad6cb582 None None] Port d9d25a9e-67a1-47ec-a4b7-732509df5486 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:37.386771 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '314ce7c4-6689-4197-9105-543740a0d3ef') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:37.387224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '314ce7c4-6689-4197-9105-543740a0d3ef') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:37.389930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4293d04c-94e8-4625-b8bc-2da10a9fcead req-90d229c0-d629-4912-b837-46fbce3e5128 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:37.390975 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4293d04c-94e8-4625-b8bc-2da10a9fcead req-90d229c0-d629-4912-b837-46fbce3e5128 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.4654081 Mar 24 02:14:37.391608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.392164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:14:37.396607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.400914 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dc3bdd80-a165-4ab9-aee4-b463b5711ffa admin admin] 10.222.0.20 "DELETE /v2.0/routers/2ea97c67-8a79-423a-9c3e-0ac8a6a5c55c HTTP/1.1" status: 204 len: 168 time: 3.9129496 Mar 24 02:14:37.401122 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8592d3-4795-4fd4-bc91-f99148aa59d0 admin admin] Pushing event deleted for resources: {'Network': ['ID=d91de7c3-7e46-4c9d-8b0a-c988de7fd81b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:37.402187 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57952) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:37.410340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (314ce7c4-6689-4197-9105-543740a0d3ef), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.431821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=07b66e7c-044a-4bf5-ac89-e025f4b672c5,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:37.436858 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ed9f607f-f455-4c7a-96fe-4975e2978865 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Deleting port 00d8a992-8adf-4f43-babc-21b4ffd00c25 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:37.437201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed9f607f-f455-4c7a-96fe-4975e2978865 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (00d8a992-8adf-4f43-babc-21b4ffd00c25), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.445402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a8417c76-7529-4e17-a0a8-a5198133a7ef tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port d9d25a9e-67a1-47ec-a4b7-732509df5486 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:37.445662 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8417c76-7529-4e17-a0a8-a5198133a7ef tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d9d25a9e-67a1-47ec-a4b7-732509df5486), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.467401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (314ce7c4-6689-4197-9105-543740a0d3ef), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.512478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Releasing vlan 124 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:37.512877 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (314ce7c4-6689-4197-9105-543740a0d3ef), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:37.517619 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:37.525493 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-b1bbf801-ffa7-45ba-8d3a-cbfd3afd0a0c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 200 len: 1001 time: 0.2680581 Mar 24 02:14:37.592871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-2cc1e563-bb6b-4f11-8bb3-20ac06846552 admin admin] Deleting subnet dfc73b89-587b-4f56-aa2b-706a8f904224 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:37.607637 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cc1e563-bb6b-4f11-8bb3-20ac06846552 admin admin] Publish callbacks [] for subnet (dfc73b89-587b-4f56-aa2b-706a8f904224), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.659573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.669125 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4293d04c-94e8-4625-b8bc-2da10a9fcead req-9f80993b-0f7a-4896-a88c-68cf0e2e43d1 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2653477 Mar 24 02:14:37.682066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57954) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:37.683879 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8417c76-7529-4e17-a0a8-a5198133a7ef tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d9d25a9e-67a1-47ec-a4b7-732509df5486), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.687053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.690444 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] 10.222.0.20 "DELETE /v2.0/networks/a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a HTTP/1.1" status: 204 len: 168 time: 2.2417364 Mar 24 02:14:37.699964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57958) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:37.722738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cc1e563-bb6b-4f11-8bb3-20ac06846552 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (dfc73b89-587b-4f56-aa2b-706a8f904224), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.748657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-683ced20-0052-4cc3-b058-db0ed67a0b54 tempest-NetworksTest-1120000147 tempest-NetworksTest-1120000147-project] Pushing event deleted for resources: {'Network': ['ID=a5cb81fa-2f1b-4a13-ab0e-72b716d0ad4a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:37.750681 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a8417c76-7529-4e17-a0a8-a5198133a7ef tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for d9d25a9e-67a1-47ec-a4b7-732509df5486 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:37.762426 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-1d351d92-54f1-48a8-a2f0-dd5054e0deb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:37.763938 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-1d351d92-54f1-48a8-a2f0-dd5054e0deb7 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=56374a24-4e35-434f-b4b8-860ef8289893 HTTP/1.1" status: 200 len: 851 time: 0.2294555 Mar 24 02:14:37.772610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed9f607f-f455-4c7a-96fe-4975e2978865 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (00d8a992-8adf-4f43-babc-21b4ffd00c25), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.827149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ed9f607f-f455-4c7a-96fe-4975e2978865 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Calling delete_port for 00d8a992-8adf-4f43-babc-21b4ffd00c25 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:37.831240 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0eb9b22f-663a-4eb6-8b47-b6abd734f8de admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=70b00ff8787a4049967d01e358be86c2&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1365681 Mar 24 02:14:37.835827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57960) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:37.888030 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d84102df-84bd-468a-a802-7a61ee59edee tempest-TestNetworkAdvancedServerOps-1843693347 tempest-TestNetworkAdvancedServerOps-1843693347-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:37.892204 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d84102df-84bd-468a-a802-7a61ee59edee tempest-TestNetworkAdvancedServerOps-1843693347 tempest-TestNetworkAdvancedServerOps-1843693347-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 1124 time: 0.1873300 Mar 24 02:14:37.898681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 57964) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:37.929717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cc1e563-bb6b-4f11-8bb3-20ac06846552 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (dfc73b89-587b-4f56-aa2b-706a8f904224), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.943952 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'fixed_ip_address': '172.20.0.7'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:37.971032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bf6a10a-d5ee-4989-9341-534540135e06 admin admin] Publish callbacks [] for security_group (a125387d-092c-4cad-8cbe-d55230c2b87b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:37.994217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-c301d079-7fe5-42c1-8a3f-34f6db44aa63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:37.995781 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-c301d079-7fe5-42c1-8a3f-34f6db44aa63 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=597625fc-4c02-4901-9b3e-46b781f61da1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.2203505 Mar 24 02:14:38.027512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57966) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:38.048467 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bf6a10a-d5ee-4989-9341-534540135e06 admin admin] Publish callbacks [] for security_group (a125387d-092c-4cad-8cbe-d55230c2b87b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.092257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.128932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cc1e563-bb6b-4f11-8bb3-20ac06846552 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (dfc73b89-587b-4f56-aa2b-706a8f904224), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.179577 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cc1e563-bb6b-4f11-8bb3-20ac06846552 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dfc73b89-587b-4f56-aa2b-706a8f904224,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:38.192178 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cc1e563-bb6b-4f11-8bb3-20ac06846552 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.196902 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2cc1e563-bb6b-4f11-8bb3-20ac06846552 admin admin] 10.222.0.20 "DELETE /v2.0/subnets/dfc73b89-587b-4f56-aa2b-706a8f904224 HTTP/1.1" status: 204 len: 168 time: 0.7934167 Mar 24 02:14:38.199483 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bf6a10a-d5ee-4989-9341-534540135e06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a125387d-092c-4cad-8cbe-d55230c2b87b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.202678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d0636e8-3b4c-45b6-a195-1d1b887680fd None None] Network c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:38.203170 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bf6a10a-d5ee-4989-9341-534540135e06 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.206413 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5bf6a10a-d5ee-4989-9341-534540135e06 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/a125387d-092c-4cad-8cbe-d55230c2b87b HTTP/1.1" status: 204 len: 168 time: 0.3673570 Mar 24 02:14:38.206413 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8417c76-7529-4e17-a0a8-a5198133a7ef tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d9d25a9e-67a1-47ec-a4b7-732509df5486), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.207306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57970) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:38.275708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_gateway (2e755dda-98d1-4713-a810-541b5f12235b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.393209 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-a8a38c00-75ec-48b0-b78d-20a0deb37191 service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3867552 Mar 24 02:14:38.492616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95137870-4139-4976-94ce-e63d5ff2e988 None None] DHCP port deletion for c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:38.560559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-95137870-4139-4976-94ce-e63d5ff2e988 None None] Deleting port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:38.560938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-95137870-4139-4976-94ce-e63d5ff2e988 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.591688 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bf6a10a-d5ee-4989-9341-534540135e06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a125387d-092c-4cad-8cbe-d55230c2b87b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:38.602773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8417c76-7529-4e17-a0a8-a5198133a7ef tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=d9d25a9e-67a1-47ec-a4b7-732509df5486,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:38.714503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a1ab4cc2-ad21-4d40-97af-535f80fe85f7 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:38.717935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-95137870-4139-4976-94ce-e63d5ff2e988 None None] For port a1ab4cc2-ad21-4d40-97af-535f80fe85f7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a1ab4cc2-ad21-4d40-97af-535f80fe85f7,segment=NetworkSegment(0315a2ce-6d94-400b-b5e9-b545de04ccbc),segment_id=0315a2ce-6d94-400b-b5e9-b545de04ccbc)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:38.718345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-95137870-4139-4976-94ce-e63d5ff2e988 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.764562 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-95137870-4139-4976-94ce-e63d5ff2e988 None None] Calling delete_port for a1ab4cc2-ad21-4d40-97af-535f80fe85f7 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:38.780981 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8417c76-7529-4e17-a0a8-a5198133a7ef tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.785098 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a8417c76-7529-4e17-a0a8-a5198133a7ef tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/d9d25a9e-67a1-47ec-a4b7-732509df5486 HTTP/1.1" status: 204 len: 168 time: 1.7255452 Mar 24 02:14:38.811216 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5069275b-ed4e-4529-a11f-922cdf8f3bb3 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=91867543f6b84845b75f9ec75cf50f66&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7760239 Mar 24 02:14:38.814815 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (c5ab8914-a9e8-4c4e-bd5d-f979c05148e6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.816959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57986) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:38.818045 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57988) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:38.950213 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-95137870-4139-4976-94ce-e63d5ff2e988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:38.984244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed9f607f-f455-4c7a-96fe-4975e2978865 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (00d8a992-8adf-4f43-babc-21b4ffd00c25), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.005486 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db497f37-6e72-4f5b-b7ab-6856c22836e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:39.007250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db497f37-6e72-4f5b-b7ab-6856c22836e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:39.009451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db497f37-6e72-4f5b-b7ab-6856c22836e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:39.011096 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-db497f37-6e72-4f5b-b7ab-6856c22836e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1918736 Mar 24 02:14:39.018036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 57994) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:39.023590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Deleting port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:39.023590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.033600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95137870-4139-4976-94ce-e63d5ff2e988 None None] Pushing event deleted for resources: {'Port': ['ID=a1ab4cc2-ad21-4d40-97af-535f80fe85f7,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:39.038168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 is: ACTIVE; New status is: DOWN {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:39.038795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.042450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95137870-4139-4976-94ce-e63d5ff2e988 None None] No DVR routers for this DVR port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:39.052173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed9f607f-f455-4c7a-96fe-4975e2978865 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event deleted for resources: {'Port': ['ID=00d8a992-8adf-4f43-babc-21b4ffd00c25,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:39.069881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b93cc1d-fbf1-405f-9df1-aa566ce6e626 req-f5e59108-a138-49c3-9573-e58ed77951fd tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:39.076579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1b93cc1d-fbf1-405f-9df1-aa566ce6e626 req-f5e59108-a138-49c3-9573-e58ed77951fd tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.6920025 Mar 24 02:14:39.107662 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4c6d0a24-5d23-4334-adb5-b107b1a904a9 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:39.113562 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] For port a1ab4cc2-ad21-4d40-97af-535f80fe85f7, host dv-neutron-834874-3-hyperv, got binding levels [] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:39.114103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.139795 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Calling delete_port for a1ab4cc2-ad21-4d40-97af-535f80fe85f7 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:39.141495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 4c6d0a24-5d23-4334-adb5-b107b1a904a9 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:39.141846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4c6d0a24-5d23-4334-adb5-b107b1a904a9 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:39.144340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 was not found and therefore no delete operation was performed {{(pid=104036) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:571}} Mar 24 02:14:39.148273 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-687646c5-7e0d-4bda-857c-af6cffca8776 admin admin] Publish callbacks [] for security_group (d083b7f5-3ecb-4127-8d86-2c5de1725211), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.150633 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a1ab4cc2-ad21-4d40-97af-535f80fe85f7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.197191 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e495f527-007d-4df3-98e0-16ba5508bf52 req-ae511b66-7fba-4c0f-9122-da68ed61c41c service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7431185 Mar 24 02:14:39.203742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ed9f607f-f455-4c7a-96fe-4975e2978865 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.210442 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ed9f607f-f455-4c7a-96fe-4975e2978865 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "DELETE /v2.0/ports/00d8a992-8adf-4f43-babc-21b4ffd00c25 HTTP/1.1" status: 204 len: 168 time: 2.5363169 Mar 24 02:14:39.214014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58000) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:39.243571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Pushing event deleted for resources: {'Port': ['ID=a1ab4cc2-ad21-4d40-97af-535f80fe85f7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:39.249914 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-703d1fe8-299d-4b73-9c36-4843b3186ac9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 48ad07a8-5051-44bb-8ca6-f43ab79b2221 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:39.265701 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-703d1fe8-299d-4b73-9c36-4843b3186ac9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (48ad07a8-5051-44bb-8ca6-f43ab79b2221), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.292753 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.297249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] No DVR routers for this DVR port a1ab4cc2-ad21-4d40-97af-535f80fe85f7 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:39.319819 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1b93cc1d-fbf1-405f-9df1-aa566ce6e626 req-c4a69633-22ac-4e16-8e51-ff95973505e7 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2422791 Mar 24 02:14:39.344925 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-687646c5-7e0d-4bda-857c-af6cffca8776 admin admin] Publish callbacks [] for security_group (d083b7f5-3ecb-4127-8d86-2c5de1725211), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.395536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-ae9ad8d4-4667-4bd5-928f-3b1f873ab1ea tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Deleting subnet 08fb8372-ea73-460b-891f-1f1021e06112 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:39.415922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9ad8d4-4667-4bd5-928f-3b1f873ab1ea tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for subnet (08fb8372-ea73-460b-891f-1f1021e06112), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.417063 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-703d1fe8-299d-4b73-9c36-4843b3186ac9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (48ad07a8-5051-44bb-8ca6-f43ab79b2221), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.423047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (2e755dda-98d1-4713-a810-541b5f12235b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.456789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (c5ab8914-a9e8-4c4e-bd5d-f979c05148e6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.491255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c5ab8914-a9e8-4c4e-bd5d-f979c05148e6']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:39.516579 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0315a2ce-6d94-400b-b5e9-b545de04ccbc') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:39.516955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0315a2ce-6d94-400b-b5e9-b545de04ccbc') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:39.555708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (0315a2ce-6d94-400b-b5e9-b545de04ccbc), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.567136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-687646c5-7e0d-4bda-857c-af6cffca8776 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d083b7f5-3ecb-4127-8d86-2c5de1725211), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.570290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-687646c5-7e0d-4bda-857c-af6cffca8776 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.573836 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-687646c5-7e0d-4bda-857c-af6cffca8776 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/d083b7f5-3ecb-4127-8d86-2c5de1725211 HTTP/1.1" status: 204 len: 168 time: 0.7511032 Mar 24 02:14:39.575413 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9ad8d4-4667-4bd5-928f-3b1f873ab1ea tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (08fb8372-ea73-460b-891f-1f1021e06112), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.584647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0315a2ce-6d94-400b-b5e9-b545de04ccbc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.597875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-687646c5-7e0d-4bda-857c-af6cffca8776 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d083b7f5-3ecb-4127-8d86-2c5de1725211,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:39.605034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Releasing vlan 146 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:39.605411 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (0315a2ce-6d94-400b-b5e9-b545de04ccbc), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.608524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-703d1fe8-299d-4b73-9c36-4843b3186ac9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (48ad07a8-5051-44bb-8ca6-f43ab79b2221), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:39.611736 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:39.659498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Allocated IP 172.26.2.214 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/98bd286a-e648-4aac-a38e-985c626523ae) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:39.717097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (c5ab8914-a9e8-4c4e-bd5d-f979c05148e6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.724477 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.732307 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] 10.222.0.20 "DELETE /v2.0/networks/c5ab8914-a9e8-4c4e-bd5d-f979c05148e6 HTTP/1.1" status: 204 len: 168 time: 1.5218363 Mar 24 02:14:39.749446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5510c815-60ac-41af-ab87-74ad0b93e8c7 admin admin] Pushing event deleted for resources: {'Network': ['ID=c5ab8914-a9e8-4c4e-bd5d-f979c05148e6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:39.764444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-703d1fe8-299d-4b73-9c36-4843b3186ac9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (48ad07a8-5051-44bb-8ca6-f43ab79b2221), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.784451 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9ad8d4-4667-4bd5-928f-3b1f873ab1ea tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (08fb8372-ea73-460b-891f-1f1021e06112), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.804684 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-703d1fe8-299d-4b73-9c36-4843b3186ac9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=48ad07a8-5051-44bb-8ca6-f43ab79b2221,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:39.822509 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-703d1fe8-299d-4b73-9c36-4843b3186ac9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.825146 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2de30d34-5b23-468b-847a-a27b406f5e73 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:39.832024 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-703d1fe8-299d-4b73-9c36-4843b3186ac9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/48ad07a8-5051-44bb-8ca6-f43ab79b2221 HTTP/1.1" status: 204 len: 168 time: 0.6848807 Mar 24 02:14:39.835717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58014) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:39.910816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router 2e755dda-98d1-4713-a810-541b5f12235b is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:14:39.934780 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58018) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:39.954116 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for port (98bd286a-e648-4aac-a38e-985c626523ae), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:39.972021 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9ad8d4-4667-4bd5-928f-3b1f873ab1ea tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (08fb8372-ea73-460b-891f-1f1021e06112), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.009719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-fcc1c9b5-95d5-4de9-b187-cfc49a4dd815 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 754231d8-1bfe-4921-87b1-acf5a6a33ff5 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:40.032303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fcc1c9b5-95d5-4de9-b187-cfc49a4dd815 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (754231d8-1bfe-4921-87b1-acf5a6a33ff5), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.093700 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c0cb3059-5c39-4d49-9c09-9e9ca1bc6439 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=d597f5a6c32e40b9b8f2e09949c6fcfd&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1588252 Mar 24 02:14:40.098278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58022) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:40.142088 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fcc1c9b5-95d5-4de9-b187-cfc49a4dd815 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (754231d8-1bfe-4921-87b1-acf5a6a33ff5), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.167904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9ad8d4-4667-4bd5-928f-3b1f873ab1ea tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event deleted for resources: {'Subnet': ['ID=08fb8372-ea73-460b-891f-1f1021e06112,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:40.170945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae9ad8d4-4667-4bd5-928f-3b1f873ab1ea tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.174361 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ae9ad8d4-4667-4bd5-928f-3b1f873ab1ea tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "DELETE /v2.0/subnets/08fb8372-ea73-460b-891f-1f1021e06112 HTTP/1.1" status: 204 len: 168 time: 0.9576199 Mar 24 02:14:40.180922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58030) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:40.184833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed2466ad-c7ba-4d35-91c1-32f01fddcd67 None None] Network 0c765cab-bf54-40f0-922b-903bce6e75d2 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:40.222218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9d482ecb-62ce-4a53-80c4-9757cbc9cc99 admin admin] Publish callbacks [] for security_group (dcd060eb-a52a-41a0-bd4b-b844070b56c8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.249135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9d482ecb-62ce-4a53-80c4-9757cbc9cc99 admin admin] Publish callbacks [] for security_group (dcd060eb-a52a-41a0-bd4b-b844070b56c8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.328328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (0c765cab-bf54-40f0-922b-903bce6e75d2), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.336616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (98bd286a-e648-4aac-a38e-985c626523ae), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.399594 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:40.405205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:40.424693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:40.429108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39d18d33-6757-4e47-b4f2-4e0f43d3d925 None None] Sync routers for ids ['2e755dda-98d1-4713-a810-541b5f12235b'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:40.430217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fcc1c9b5-95d5-4de9-b187-cfc49a4dd815 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (754231d8-1bfe-4921-87b1-acf5a6a33ff5), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.451723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:40.474549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39d18d33-6757-4e47-b4f2-4e0f43d3d925 None None] Routers {'2e755dda-98d1-4713-a810-541b5f12235b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:40.475369 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-39d18d33-6757-4e47-b4f2-4e0f43d3d925 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2e755dda-98d1-4713-a810-541b5f12235b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:40.498474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9d482ecb-62ce-4a53-80c4-9757cbc9cc99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (dcd060eb-a52a-41a0-bd4b-b844070b56c8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.502803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9d482ecb-62ce-4a53-80c4-9757cbc9cc99 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.512070 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9d482ecb-62ce-4a53-80c4-9757cbc9cc99 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/dcd060eb-a52a-41a0-bd4b-b844070b56c8 HTTP/1.1" status: 204 len: 168 time: 0.4118550 Mar 24 02:14:40.523486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'Port': ['ID=98bd286a-e648-4aac-a38e-985c626523ae,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:40.556783 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d482ecb-62ce-4a53-80c4-9757cbc9cc99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcd060eb-a52a-41a0-bd4b-b844070b56c8,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:40.570782 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f29e93ef-3ad1-4c5a-80e2-433f4cd0a158 None None] DHCP port deletion for 0c765cab-bf54-40f0-922b-903bce6e75d2 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:40.574677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-39d18d33-6757-4e47-b4f2-4e0f43d3d925 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:40.575201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.579393 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-52742bd5-0e14-4d34-8352-7604e9e7f28e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 882 time: 6.9160690 Mar 24 02:14:40.583719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58042) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:40.623387 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fcc1c9b5-95d5-4de9-b187-cfc49a4dd815 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (754231d8-1bfe-4921-87b1-acf5a6a33ff5), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.629095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39d18d33-6757-4e47-b4f2-4e0f43d3d925 None None] Routers {'2e755dda-98d1-4713-a810-541b5f12235b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:40.630480 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-39d18d33-6757-4e47-b4f2-4e0f43d3d925 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2e755dda-98d1-4713-a810-541b5f12235b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:40.684138 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcc1c9b5-95d5-4de9-b187-cfc49a4dd815 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=754231d8-1bfe-4921-87b1-acf5a6a33ff5,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:40.722958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-39d18d33-6757-4e47-b4f2-4e0f43d3d925 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:40.723770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fcc1c9b5-95d5-4de9-b187-cfc49a4dd815 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.728732 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39d18d33-6757-4e47-b4f2-4e0f43d3d925 None None] The sync data for ids ['2e755dda-98d1-4713-a810-541b5f12235b'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:40.740845 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fcc1c9b5-95d5-4de9-b187-cfc49a4dd815 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/754231d8-1bfe-4921-87b1-acf5a6a33ff5 HTTP/1.1" status: 204 len: 168 time: 0.8989618 Mar 24 02:14:40.743820 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58048) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:40.786554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 09549143-6b71-4126-aca2-afdc3c7eeca9 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:40.834133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5e1e7e-a8d9-4636-80d0-948bbf47ff14 req-33587c09-4ba7-4914-b702-676ed0049db8 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:40.835685 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f5e1e7e-a8d9-4636-80d0-948bbf47ff14 req-33587c09-4ba7-4914-b702-676ed0049db8 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3318315 Mar 24 02:14:40.861752 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1dd11b6b-0afa-4698-850b-04db1269ddb5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1054745 Mar 24 02:14:40.862581 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58052) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:40.903284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Deleting port 09549143-6b71-4126-aca2-afdc3c7eeca9 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:40.903512 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.914750 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f29e93ef-3ad1-4c5a-80e2-433f4cd0a158 None None] Deleting port 09549143-6b71-4126-aca2-afdc3c7eeca9 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:40.915472 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f29e93ef-3ad1-4c5a-80e2-433f4cd0a158 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:40.973910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf272a37-0606-40d7-98bb-c8e401524380 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:40.977346 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cf272a37-0606-40d7-98bb-c8e401524380 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1122770 Mar 24 02:14:40.979439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58056) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.081170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f29e93ef-3ad1-4c5a-80e2-433f4cd0a158 None None] For port 09549143-6b71-4126-aca2-afdc3c7eeca9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=09549143-6b71-4126-aca2-afdc3c7eeca9,segment=NetworkSegment(8650870d-314b-4c16-82b0-643582c0d5e4),segment_id=8650870d-314b-4c16-82b0-643582c0d5e4)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:41.081890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f29e93ef-3ad1-4c5a-80e2-433f4cd0a158 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.093179 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-561a46c1-3dbc-4c74-8a3e-2e4e490f5908 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/routers/2e755dda-98d1-4713-a810-541b5f12235b HTTP/1.1" status: 200 len: 883 time: 0.5067651 Mar 24 02:14:41.093851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58060) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.097694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eecc0cdb-cc5e-4674-a582-9e2bd394be09 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:41.102795 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-eecc0cdb-cc5e-4674-a582-9e2bd394be09 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1197646 Mar 24 02:14:41.103359 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 09549143-6b71-4126-aca2-afdc3c7eeca9 is: ACTIVE; New status is: DOWN {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:41.103850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58062) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.104641 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.109770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f29e93ef-3ad1-4c5a-80e2-433f4cd0a158 None None] Calling delete_port for 09549143-6b71-4126-aca2-afdc3c7eeca9 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:41.128094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f90fe5f5-00d2-4066-ac5e-420461dd6457 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:41.172740 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6e33bed7-1257-4826-8959-11c2a86e5762 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0587597 Mar 24 02:14:41.180734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58068) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.186875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-00ab4c84-acd5-4e60-9ad9-bc7af0a36ba1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:41.254404 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] For port 09549143-6b71-4126-aca2-afdc3c7eeca9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=09549143-6b71-4126-aca2-afdc3c7eeca9,segment=NetworkSegment(8650870d-314b-4c16-82b0-643582c0d5e4),segment_id=8650870d-314b-4c16-82b0-643582c0d5e4)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:41.255632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.274802 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f5e1e7e-a8d9-4636-80d0-948bbf47ff14 req-a82ab09d-d8b1-4eb5-8f5a-bb400b7c102d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4280961 Mar 24 02:14:41.303242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Calling delete_port for 09549143-6b71-4126-aca2-afdc3c7eeca9 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:41.305958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00ab4c84-acd5-4e60-9ad9-bc7af0a36ba1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:41.311708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-00ab4c84-acd5-4e60-9ad9-bc7af0a36ba1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.313587 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-00ab4c84-acd5-4e60-9ad9-bc7af0a36ba1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:14:41.316860 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-00ab4c84-acd5-4e60-9ad9-bc7af0a36ba1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:41.355979 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-00ab4c84-acd5-4e60-9ad9-bc7af0a36ba1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.1740251 Mar 24 02:14:41.356777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58076) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.366146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-cff9e199-510d-4eec-aa93-6290fb1babd6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'slaac'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:41.373927 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f29e93ef-3ad1-4c5a-80e2-433f4cd0a158 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.418540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f29e93ef-3ad1-4c5a-80e2-433f4cd0a158 None None] Pushing event deleted for resources: {'Port': ['ID=09549143-6b71-4126-aca2-afdc3c7eeca9,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:41.494309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f29e93ef-3ad1-4c5a-80e2-433f4cd0a158 None None] No DVR routers for this DVR port 09549143-6b71-4126-aca2-afdc3c7eeca9 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:41.507368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3741bf43-f132-44ae-bd27-7152938d1a8f None None] Provisioning complete for port 9f223764-0161-4947-8a29-5b59e494c11a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:41.508017 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3741bf43-f132-44ae-bd27-7152938d1a8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9f223764-0161-4947-8a29-5b59e494c11a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.573332 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cff9e199-510d-4eec-aa93-6290fb1babd6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:41.576949 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cff9e199-510d-4eec-aa93-6290fb1babd6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.582660 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-cff9e199-510d-4eec-aa93-6290fb1babd6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:14:41.584210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cff9e199-510d-4eec-aa93-6290fb1babd6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:41.615922 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cff9e199-510d-4eec-aa93-6290fb1babd6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.2571144 Mar 24 02:14:41.619666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58082) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.630461 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3741bf43-f132-44ae-bd27-7152938d1a8f None None] Current status of the port 9f223764-0161-4947-8a29-5b59e494c11a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:41.631880 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a82e2681-1c4e-4978-9537-01d4ab4b2959 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:41.668970 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3e27619-15f7-483b-a589-74b3fe85b625 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:41.709842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58086) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.744136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a82e2681-1c4e-4978-9537-01d4ab4b2959 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:41.748544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a82e2681-1c4e-4978-9537-01d4ab4b2959 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.750247 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-a82e2681-1c4e-4978-9537-01d4ab4b2959 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:14:41.750917 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a82e2681-1c4e-4978-9537-01d4ab4b2959 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:41.772086 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a82e2681-1c4e-4978-9537-01d4ab4b2959 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.1500700 Mar 24 02:14:41.774815 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58090) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.780980 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9855157c-71cd-4246-b71d-a7b507670f2c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:41.797062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a3e27619-15f7-483b-a589-74b3fe85b625 None None] Deleting port 9f223764-0161-4947-8a29-5b59e494c11a {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:41.797062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a3e27619-15f7-483b-a589-74b3fe85b625 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9f223764-0161-4947-8a29-5b59e494c11a), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.884175 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58092) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.920041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9855157c-71cd-4246-b71d-a7b507670f2c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:41.925800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9855157c-71cd-4246-b71d-a7b507670f2c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.929606 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-9855157c-71cd-4246-b71d-a7b507670f2c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:14:41.930206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9855157c-71cd-4246-b71d-a7b507670f2c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:41.947033 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a3e27619-15f7-483b-a589-74b3fe85b625 None None] For port 9f223764-0161-4947-8a29-5b59e494c11a, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9f223764-0161-4947-8a29-5b59e494c11a,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:41.947622 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a3e27619-15f7-483b-a589-74b3fe85b625 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9f223764-0161-4947-8a29-5b59e494c11a), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:41.954719 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9855157c-71cd-4246-b71d-a7b507670f2c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.1780760 Mar 24 02:14:41.957332 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58098) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:41.966364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6ea8e762-d49c-45d7-bd97-b1f3aaaac4e2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'slaac'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:42.045210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (09549143-6b71-4126-aca2-afdc3c7eeca9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.070537 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] No DVR routers for this DVR port 09549143-6b71-4126-aca2-afdc3c7eeca9 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:42.086071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Request body: {'network': {'name': 'tempest-TagsExtTest-test-network-1145674443'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:42.120013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event deleted for resources: {'Port': ['ID=09549143-6b71-4126-aca2-afdc3c7eeca9,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:42.127429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for floatingip (93b3d5f4-3404-4069-ba69-76c7b29011a1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.138484 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9cf92c7a-57d1-4d06-a4ae-bc67903e5ee9 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Request body: {'quota': {'network': 2}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:42.143534 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ea8e762-d49c-45d7-bd97-b1f3aaaac4e2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:42.149428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ea8e762-d49c-45d7-bd97-b1f3aaaac4e2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.150827 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-6ea8e762-d49c-45d7-bd97-b1f3aaaac4e2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:14:42.151265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6ea8e762-d49c-45d7-bd97-b1f3aaaac4e2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:42.159252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Made reservation on behalf of 30ab9ea00c694b8587d9c5e75dd43927 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:42.162993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.181226 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a3e27619-15f7-483b-a589-74b3fe85b625 None None] Calling delete_port for 9f223764-0161-4947-8a29-5b59e494c11a owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:42.182422 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.202033 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9cf92c7a-57d1-4d06-a4ae-bc67903e5ee9 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] 10.222.0.20 "PUT /v2.0/quotas/93f4b5591d7e4c31ab5671191dfc2c10 HTTP/1.1" status: 200 len: 368 time: 0.4910619 Mar 24 02:14:42.202846 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58104) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:42.210104 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6ea8e762-d49c-45d7-bd97-b1f3aaaac4e2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.2500525 Mar 24 02:14:42.214527 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Request body: {'network': {'project_id': '93f4b5591d7e4c31ab5671191dfc2c10'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:42.219617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58106) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:42.231545 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7e162402-4d57-40f6-bec3-f2c7a906452a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:42.272551 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a3e27619-15f7-483b-a589-74b3fe85b625 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (9f223764-0161-4947-8a29-5b59e494c11a), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.279937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (0c765cab-bf54-40f0-922b-903bce6e75d2), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.300146 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3e27619-15f7-483b-a589-74b3fe85b625 None None] Pushing event deleted for resources: {'Port': ['ID=9f223764-0161-4947-8a29-5b59e494c11a,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:42.308186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3e27619-15f7-483b-a589-74b3fe85b625 None None] No DVR routers for this DVR port 9f223764-0161-4947-8a29-5b59e494c11a on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:42.310972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0c765cab-bf54-40f0-922b-903bce6e75d2']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:42.342637 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8650870d-314b-4c16-82b0-643582c0d5e4') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:42.343010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8650870d-314b-4c16-82b0-643582c0d5e4') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:42.343734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Made reservation on behalf of 93f4b5591d7e4c31ab5671191dfc2c10 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:42.345868 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.364839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.374563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (8650870d-314b-4c16-82b0-643582c0d5e4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.435647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (8650870d-314b-4c16-82b0-643582c0d5e4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.446453 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9c8701d0-8e08-4cc6-92af-7503216acccb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 886 time: 1.3366299 Mar 24 02:14:42.450205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58112) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:42.458899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b1c531b1-427a-4118-a855-565de68c839c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'name': 'updatedtempest-RoutersIpV6Test-router-893474792'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:42.497963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Releasing vlan 118 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:42.498741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (8650870d-314b-4c16-82b0-643582c0d5e4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:42.501939 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:42.504470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e162402-4d57-40f6-bec3-f2c7a906452a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:42.513691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e162402-4d57-40f6-bec3-f2c7a906452a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.515633 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-7e162402-4d57-40f6-bec3-f2c7a906452a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:14:42.516919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7e162402-4d57-40f6-bec3-f2c7a906452a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:42.549650 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks [] for security_group (3c646dae-51b4-4761-92e5-3405e4e54dbb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.569882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (98bd286a-e648-4aac-a38e-985c626523ae), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.589299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for security_group (90161421-056e-4af0-ae7b-a103b04404c7), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.595092 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (3c646dae-51b4-4761-92e5-3405e4e54dbb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.605186 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (90161421-056e-4af0-ae7b-a103b04404c7), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.640591 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7e162402-4d57-40f6-bec3-f2c7a906452a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.4183402 Mar 24 02:14:42.642715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58116) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:42.655993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 136} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:42.658781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 121} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:42.661054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (0c765cab-bf54-40f0-922b-903bce6e75d2), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.665949 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c646dae-51b4-4761-92e5-3405e4e54dbb,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:42.671879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.677666 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] 10.222.0.20 "DELETE /v2.0/networks/0c765cab-bf54-40f0-922b-903bce6e75d2 HTTP/1.1" status: 204 len: 168 time: 2.4926362 Mar 24 02:14:42.685274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (687125c9-8f8a-4041-affa-704bac11a802), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.685795 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Added segment 687125c9-8f8a-4041-affa-704bac11a802 of type vlan for network 8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3 Mar 24 02:14:42.691075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f223764-0161-4947-8a29-5b59e494c11a no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:42.698348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (ed7e0ac9-0d10-429d-a503-0bac03239347), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.698751 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Added segment ed7e0ac9-0d10-429d-a503-0bac03239347 of type vlan for network 2d226bac-d4ff-471e-bc00-d4e71858b25f Mar 24 02:14:42.704652 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cedf2c58-5a83-42e7-9c14-4ae19d99e6b3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0605950 Mar 24 02:14:42.711668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58122) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:42.730634 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daf604e5-2b88-493b-9852-7393cccbadc3 tempest-AllowedAddressPairIpV6TestJSON-1094050410 tempest-AllowedAddressPairIpV6TestJSON-1094050410-project] Pushing event deleted for resources: {'Network': ['ID=0c765cab-bf54-40f0-922b-903bce6e75d2,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:42.733142 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 9f223764-0161-4947-8a29-5b59e494c11a {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:42.733559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9f223764-0161-4947-8a29-5b59e494c11a not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:42.793744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Pushing event updated for resources: {'SecurityGroup': ['ID=90161421-056e-4af0-ae7b-a103b04404c7,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:42.819976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.822974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (2d226bac-d4ff-471e-bc00-d4e71858b25f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.858237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-084d9f7e-2878-4798-9f93-eb2dd380c26b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:42.859756 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-084d9f7e-2878-4798-9f93-eb2dd380c26b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1471233 Mar 24 02:14:42.870231 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58128) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:42.910803 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-139bbbc4-4682-492a-9673-510b7eb699cd tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0393524 Mar 24 02:14:42.915786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58132) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:42.921166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.922366 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:42.923028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.928489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:42.930142 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (2d226bac-d4ff-471e-bc00-d4e71858b25f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:42.935232 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:42.935879 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.016190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58134) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:43.025993 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.1405005 Mar 24 02:14:43.029705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58138) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:43.036931 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.8312213 Mar 24 02:14:43.037532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58140) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:43.047611 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Request body: {'network': {'project_id': '93f4b5591d7e4c31ab5671191dfc2c10'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:43.048663 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Request body: {'subnet': {'network_id': '2d226bac-d4ff-471e-bc00-d4e71858b25f', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:43.063596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d4864f-ac05-4861-87c9-c41f194d9086 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Pushing event updated for resources: {'Network': ['ID=8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:43.078441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:43.120136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Made reservation on behalf of 93f4b5591d7e4c31ab5671191dfc2c10 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:43.122434 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.161650 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 138} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:43.170809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (2b306361-373d-4008-a346-f889c0c76713), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.171151 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Added segment 2b306361-373d-4008-a346-f889c0c76713 of type vlan for network 17d27b7c-8032-49a7-abfa-674493d89595 Mar 24 02:14:43.181739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bfe97c1-3168-4217-8564-7dad304bd731 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Pushing event updated for resources: {'Network': ['ID=2d226bac-d4ff-471e-bc00-d4e71858b25f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:43.205087 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 2d226bac-d4ff-471e-bc00-d4e71858b25f details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:43.222441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for port (98bd286a-e648-4aac-a38e-985c626523ae), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.255474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (98bd286a-e648-4aac-a38e-985c626523ae), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.262291 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (17d27b7c-8032-49a7-abfa-674493d89595), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.271610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:43.274992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.285997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58146) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:43.302704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (17d27b7c-8032-49a7-abfa-674493d89595), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.305153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:43.306002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.379038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeIpV6Test-838320434', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:43.388367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Made reservation on behalf of 30ab9ea00c694b8587d9c5e75dd43927 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:43.389396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Pushing event updated for resources: {'Network': ['ID=17d27b7c-8032-49a7-abfa-674493d89595,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:43.393885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.401382 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 17d27b7c-8032-49a7-abfa-674493d89595 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:43.407262 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2eb039c8-afc4-4fea-8ea3-c06d2dad3b51 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.3636742 Mar 24 02:14:43.410112 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58150) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:43.415276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4466fc68-75c5-426e-ac06-3ecbc321d467 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Request body: {'network': {'project_id': '93f4b5591d7e4c31ab5671191dfc2c10'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:43.419412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Made reservation on behalf of 0687ce7315324aa98ef0443253966691 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:43.421663 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.436000 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.437558 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-4466fc68-75c5-426e-ac06-3ecbc321d467 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Mar 24 02:14:43.438268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4466fc68-75c5-426e-ac06-3ecbc321d467 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:43.442183 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4466fc68-75c5-426e-ac06-3ecbc321d467 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 409 len: 310 time: 0.0282896 Mar 24 02:14:43.446479 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58152) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:43.511089 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7860b81d-dd07-43b7-922c-5b0813c5ca9e tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=93f4b5591d7e4c31ab5671191dfc2c10&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0607288 Mar 24 02:14:43.511315 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58154) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:43.576381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event updated for resources: {'Port': ['ID=98bd286a-e648-4aac-a38e-985c626523ae,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:43.587363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks [] for security_group (03dd94b8-677f-48e2-948c-a9019a08fe59), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.592498 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0607599-6fbd-41fc-a7f0-e56754200a79 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks [] for security_group (3c646dae-51b4-4761-92e5-3405e4e54dbb), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.594946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (03dd94b8-677f-48e2-948c-a9019a08fe59), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.606532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] device_id is not set on port 9a4116a8-d3b2-4c6d-a75d-d92501855d60 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:43.645930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (93b3d5f4-3404-4069-ba69-76c7b29011a1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.650128 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0607599-6fbd-41fc-a7f0-e56754200a79 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks [] for security_group (3c646dae-51b4-4761-92e5-3405e4e54dbb), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.711554 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03dd94b8-677f-48e2-948c-a9019a08fe59,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:43.727736 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-88788bf4-87b5-47f3-9708-12ca5da88ca1 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=15c69ad0648c47419b3ead64ebe342de&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7046168 Mar 24 02:14:43.728118 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58156) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:43.813240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1c531b1-427a-4118-a855-565de68c839c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (2e755dda-98d1-4713-a810-541b5f12235b), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.834790 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Allocated IP 172.26.2.246 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/9a4116a8-d3b2-4c6d-a75d-d92501855d60) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:43.836884 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-38f35f11-23b3-4e0b-b04f-93ad9f7e7e6f admin admin] Publish callbacks [] for security_group (6b6f7dcf-25e8-45c1-92e4-b77ede483d77), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.838403 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0607599-6fbd-41fc-a7f0-e56754200a79 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (3c646dae-51b4-4761-92e5-3405e4e54dbb), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.840929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c0607599-6fbd-41fc-a7f0-e56754200a79 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.842071 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c0607599-6fbd-41fc-a7f0-e56754200a79 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] 10.222.0.20 "DELETE /v2.0/security-groups/3c646dae-51b4-4761-92e5-3405e4e54dbb HTTP/1.1" status: 204 len: 168 time: 0.3299117 Mar 24 02:14:43.849657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58158) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:43.877458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1c531b1-427a-4118-a855-565de68c839c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (2e755dda-98d1-4713-a810-541b5f12235b), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:43.896820 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Floating IP 93b3d5f4-3404-4069-ba69-76c7b29011a1 associated. External IP: 172.26.2.214, port: 4716cbf2-4cfd-4eec-91c2-c814fff2a832. Mar 24 02:14:43.918096 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0607599-6fbd-41fc-a7f0-e56754200a79 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c646dae-51b4-4761-92e5-3405e4e54dbb,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:43.938261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-38f35f11-23b3-4e0b-b04f-93ad9f7e7e6f admin admin] Publish callbacks [] for security_group (6b6f7dcf-25e8-45c1-92e4-b77ede483d77), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.041376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (17d27b7c-8032-49a7-abfa-674493d89595), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.113090 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-38f35f11-23b3-4e0b-b04f-93ad9f7e7e6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (6b6f7dcf-25e8-45c1-92e4-b77ede483d77), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.115608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-38f35f11-23b3-4e0b-b04f-93ad9f7e7e6f admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.116744 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-38f35f11-23b3-4e0b-b04f-93ad9f7e7e6f admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/6b6f7dcf-25e8-45c1-92e4-b77ede483d77 HTTP/1.1" status: 204 len: 168 time: 0.3878329 Mar 24 02:14:44.146485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (3a5facc4-fdf7-4c83-b38e-71e5119554fa), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.165180 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f35f11-23b3-4e0b-b04f-93ad9f7e7e6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b6f7dcf-25e8-45c1-92e4-b77ede483d77,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:44.176866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks [] for port (9a4116a8-d3b2-4c6d-a75d-d92501855d60), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.184589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (17d27b7c-8032-49a7-abfa-674493d89595), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.215812 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['17d27b7c-8032-49a7-abfa-674493d89595']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:44.233814 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2b306361-373d-4008-a346-f889c0c76713') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:44.234902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2b306361-373d-4008-a346-f889c0c76713') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:44.245761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (2b306361-373d-4008-a346-f889c0c76713), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.264557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (2b306361-373d-4008-a346-f889c0c76713), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.269542 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (9a4116a8-d3b2-4c6d-a75d-d92501855d60), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.276763 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:44.277153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (2b306361-373d-4008-a346-f889c0c76713), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: /opt/stack/neutron/neutron/extensions/quotasv2.py:141: UserWarning: Neutron quota engine will require "--force" parameter to set a quota limit without checking the resource usage. Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: warnings.warn('Neutron quota engine will require "--force" ' Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:44.280310 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:44.287316 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Pushing event updated for resources: {'Subnet': ['ID=3a5facc4-fdf7-4c83-b38e-71e5119554fa,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:44.295342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1c531b1-427a-4118-a855-565de68c839c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router 2e755dda-98d1-4713-a810-541b5f12235b has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:14:44.354011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:44.362697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:44.370215 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:44.376554 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (17d27b7c-8032-49a7-abfa-674493d89595), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.400147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Pushing event updated for resources: {'Port': ['ID=9a4116a8-d3b2-4c6d-a75d-d92501855d60,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:44.407916 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.413799 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] 10.222.0.20 "DELETE /v2.0/networks/17d27b7c-8032-49a7-abfa-674493d89595 HTTP/1.1" status: 204 len: 168 time: 0.5601964 Mar 24 02:14:44.416782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58168) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:44.436791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1f46441-0fbb-45d4-a2a0-966d1061ac02 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Pushing event deleted for resources: {'Network': ['ID=17d27b7c-8032-49a7-abfa-674493d89595,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:44.487892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:44.488370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.513343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.523894 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7360afc8-3fc2-4c6c-8610-bdb997840182 tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1036 time: 1.2341664 Mar 24 02:14:44.524664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58174) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:44.529132 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.246'}]}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:44.607883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (59af6cc6-1525-4caa-9515-2ecdc76c695f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.608909 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (59af6cc6-1525-4caa-9515-2ecdc76c695f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.632284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.687355 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:44.698258 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks [] for router_controller (59af6cc6-1525-4caa-9515-2ecdc76c695f), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.700392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '687125c9-8f8a-4041-affa-704bac11a802') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:44.700698 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '687125c9-8f8a-4041-affa-704bac11a802') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:44.712416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (687125c9-8f8a-4041-affa-704bac11a802), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.746928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:14:44.754955 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (333a8308-f430-48a8-ae89-0cc14a94dd36), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.787382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (687125c9-8f8a-4041-affa-704bac11a802), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.794834 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Checking segment: {'id': 'ed7e0ac9-0d10-429d-a503-0bac03239347', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '2d226bac-d4ff-471e-bc00-d4e71858b25f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:44.795474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Network hostable DHCP agents. Network: 2d226bac-d4ff-471e-bc00-d4e71858b25f, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:44.828821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Releasing vlan 136 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:44.829469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (687125c9-8f8a-4041-affa-704bac11a802), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:44.831360 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:44.906792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks [] for router_gateway (59af6cc6-1525-4caa-9515-2ecdc76c695f), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.911239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.917250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58184) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:44.944067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:44.961559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:44.965483 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:44.966422 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:44.981447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac492680-f34a-4592-8859-95abd99a151c None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:44.997444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=333a8308-f430-48a8-ae89-0cc14a94dd36,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:45.011185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Network 2d226bac-d4ff-471e-bc00-d4e71858b25f is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:45.030375 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e903827e-0546-4fbc-a621-55b10edca87a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.1114032 Mar 24 02:14:45.039467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58188) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:45.047650 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:69:b6:ef', 'name': 'tempest-NetworksTestDHCPv6-1032473983'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:45.055229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 2d226bac-d4ff-471e-bc00-d4e71858b25f) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:45.059811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:45.060401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.067647 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1e4607a-b1e0-4273-8855-90e580f0ce24 None None] Network 2d226bac-d4ff-471e-bc00-d4e71858b25f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:45.069741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Router c4a3de90-537a-4022-b079-9feeedff6892 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:14:45.149730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1c531b1-427a-4118-a855-565de68c839c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:45.157575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1c531b1-427a-4118-a855-565de68c839c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.160997 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b1c531b1-427a-4118-a855-565de68c839c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/2e755dda-98d1-4713-a810-541b5f12235b HTTP/1.1" status: 200 len: 890 time: 2.7056286 Mar 24 02:14:45.171986 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6b01827-75b1-4d9b-8228-ea4a5aec3ac6 None None] Sync routers for ids ['2e755dda-98d1-4713-a810-541b5f12235b'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:45.190423 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6b01827-75b1-4d9b-8228-ea4a5aec3ac6 None None] Routers {'2e755dda-98d1-4713-a810-541b5f12235b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:45.191555 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-d6b01827-75b1-4d9b-8228-ea4a5aec3ac6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2e755dda-98d1-4713-a810-541b5f12235b'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:45.214683 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58190) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:45.220300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-test-network-1523894188'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:45.231236 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7087b133-0c97-4de0-b72f-e353de2a15f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1968575 Mar 24 02:14:45.233213 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-d6b01827-75b1-4d9b-8228-ea4a5aec3ac6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:45.233832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.236744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '333a8308-f430-48a8-ae89-0cc14a94dd36'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:45.237748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.243778 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58192) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:45.245590 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6b01827-75b1-4d9b-8228-ea4a5aec3ac6 None None] Routers {'2e755dda-98d1-4713-a810-541b5f12235b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:45.246763 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-d6b01827-75b1-4d9b-8228-ea4a5aec3ac6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2e755dda-98d1-4713-a810-541b5f12235b'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:45.256371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Request body: {'port': {'network_id': '2d226bac-d4ff-471e-bc00-d4e71858b25f', 'name': 'tempest-TagsExtTest-1602249019'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:45.334992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.339252 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] 10.222.0.20 "DELETE /v2.0/networks/8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3 HTTP/1.1" status: 204 len: 168 time: 0.9134917 Mar 24 02:14:45.354069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:45.411989 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-d6b01827-75b1-4d9b-8228-ea4a5aec3ac6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:45.412867 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6b01827-75b1-4d9b-8228-ea4a5aec3ac6 None None] The sync data for ids ['2e755dda-98d1-4713-a810-541b5f12235b'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:45.424068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-2d226bac-d4ff-471e-bc00-d4e71858b25f', 'network_id': '2d226bac-d4ff-471e-bc00-d4e71858b25f', 'project_id': '30ab9ea00c694b8587d9c5e75dd43927', 'fixed_ips': [{'subnet_id': '3a5facc4-fdf7-4c83-b38e-71e5119554fa'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:45.426543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.433450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ac2cbd9-b412-416e-bfcd-69dd841f7c14 tempest-QuotasNegativeTest-1455270750 tempest-QuotasNegativeTest-1455270750-project-admin] Pushing event deleted for resources: {'Network': ['ID=8d87fd4e-f8a5-44f3-a5b2-5fc87cabddd3,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:45.448898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Allocated IP 2001:db8::f816:3eff:feaa:694b (6f3080fc-791f-4748-a0a2-9eff6ea2a609/333a8308-f430-48a8-ae89-0cc14a94dd36/c6f71525-107b-485e-9ded-7aef3375957f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:45.453106 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:45.456336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.492537 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.504520 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:45.523363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.558990 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.559612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] Sync routers for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:45.597489 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7ac804fb-e498-4da7-9176-ec3c828bf356 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/routers/2e755dda-98d1-4713-a810-541b5f12235b HTTP/1.1" status: 200 len: 890 time: 0.3646774 Mar 24 02:14:45.598744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58196) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:45.624244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port ab72154d-c672-43d2-a5d3-dee78afb9ec3 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:45.646861 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-68cf4c33-0e96-495e-a5b7-1958640d7e4d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=2e755dda-98d1-4713-a810-541b5f12235b HTTP/1.1" status: 200 len: 205 time: 0.0399451 Mar 24 02:14:45.648532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:45.649396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:45.651608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Made reservation on behalf of 30ab9ea00c694b8587d9c5e75dd43927 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:45.655417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.658122 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58198) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:45.723116 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2612f119-db89-461d-8bad-0bf7fe378470 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 7.7831130 Mar 24 02:14:45.726594 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:14:45.729778 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a2863ae-6121-475d-a139-7ef0f8cc42d3" -d '{"events": [{"name": "network-changed", "server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:14:45.797826 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:14:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-707c9351-9e75-462c-b6f6-87ff1a496058 x-openstack-request-id: req-707c9351-9e75-462c-b6f6-87ff1a496058 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:14:45.798115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:14:45.798369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-707c9351-9e75-462c-b6f6-87ff1a496058 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:14:45.798746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (b88d7f80-95c2-4f3a-adb9-951914dba4ae), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.799236 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-707c9351-9e75-462c-b6f6-87ff1a496058'] response: {'name': 'network-changed', 'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'status': 'completed', 'code': 200} Mar 24 02:14:45.803396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] device_id is not set on port fd481460-0ec4-4fb5-8f6d-7cd94f9a7629 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:45.820298 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b88d7f80-95c2-4f3a-adb9-951914dba4ae), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:45.840698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Allocated IP 172.20.0.2 (2d226bac-d4ff-471e-bc00-d4e71858b25f/3a5facc4-fdf7-4c83-b38e-71e5119554fa/73059fbd-c506-4972-b84b-84e574b09293) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:45.907557 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc826dc-b6a8-4163-867e-0226bf6495e2 req-f05db134-e9dc-4ed0-b77f-e31cd9066bd9 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:45.908048 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4dc826dc-b6a8-4163-867e-0226bf6495e2 req-f05db134-e9dc-4ed0-b77f-e31cd9066bd9 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.1248949 Mar 24 02:14:45.917821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 139} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:45.918266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-13484146-b84b-4462-ab77-3065cb09e52b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:45.919924 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-13484146-b84b-4462-ab77-3065cb09e52b service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=615b57fe01bd445f87fb9f1a86851430&device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 1129 time: 0.0976121 Mar 24 02:14:45.966119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:46.014010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (cb1f6bda-0ce9-4c9a-968a-d29295cb534c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.014497 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Added segment cb1f6bda-0ce9-4c9a-968a-d29295cb534c of type vlan for network c8466e8e-4c16-4f91-aa0d-8651c7d4116a Mar 24 02:14:46.015850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b88d7f80-95c2-4f3a-adb9-951914dba4ae,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:46.050324 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Publish callbacks [] for port (c6f71525-107b-485e-9ded-7aef3375957f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.057295 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4dc826dc-b6a8-4163-867e-0226bf6495e2 req-6bbcbf97-7f92-4688-b4dd-945859265c64 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1426756 Mar 24 02:14:46.093599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58208) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:46.103830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (2e755dda-98d1-4713-a810-541b5f12235b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.137506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (c6f71525-107b-485e-9ded-7aef3375957f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.145927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-901d2644-a60c-4200-b4c3-2adda501738e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:46.147722 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-901d2644-a60c-4200-b4c3-2adda501738e service neutron] 10.222.0.30 "GET /v2.0/networks?id=1ff12164-ce98-442e-81ee-e22f78c3a0ff HTTP/1.1" status: 200 len: 898 time: 0.2140040 Mar 24 02:14:46.151768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58210) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:46.166596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (c8466e8e-4c16-4f91-aa0d-8651c7d4116a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.208398 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks [] for router_gateway (59af6cc6-1525-4caa-9515-2ecdc76c695f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.210812 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:46.224145 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:46.229256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fe69:b6ef (6f3080fc-791f-4748-a0a2-9eff6ea2a609/333a8308-f430-48a8-ae89-0cc14a94dd36/ab72154d-c672-43d2-a5d3-dee78afb9ec3) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:46.252756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.259704 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-33532fc5-dfec-41e4-b13d-fa735ecd7f29 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/floatingips/93b3d5f4-3404-4069-ba69-76c7b29011a1 HTTP/1.1" status: 200 len: 991 time: 0.1637654 Mar 24 02:14:46.266372 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (c8466e8e-4c16-4f91-aa0d-8651c7d4116a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.272334 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:46.272786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.283144 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:46.284590 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-bd2db6cb-6dff-40dc-97a9-f9cac89a2b8a service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832 HTTP/1.1" status: 200 len: 999 time: 0.1219666 Mar 24 02:14:46.341240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Publish callbacks [] for port (73059fbd-c506-4972-b84b-84e574b09293), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.350892 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Pushing event updated for resources: {'Port': ['ID=c6f71525-107b-485e-9ded-7aef3375957f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:46.366038 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (73059fbd-c506-4972-b84b-84e574b09293), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.366255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9413667c-c9b1-4f57-aabf-f6f786a05ee2 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.381174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Attempting to bind port c6f71525-107b-485e-9ded-7aef3375957f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:46.381541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Attempting to bind port c6f71525-107b-485e-9ded-7aef3375957f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:46.381971 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Attempting to bind port c6f71525-107b-485e-9ded-7aef3375957f on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:46.417046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:46.417488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:46.417824 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.418221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:46.418738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Bound port: c6f71525-107b-485e-9ded-7aef3375957f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:46.419111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c6f71525-107b-485e-9ded-7aef3375957f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.443736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-1b18daf8-977d-46e9-a43e-adc68304bd51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:46.445159 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-1b18daf8-977d-46e9-a43e-adc68304bd51 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=44e52247-2dfd-4416-b8c9-7ab69363e1f2 HTTP/1.1" status: 200 len: 834 time: 0.1485534 Mar 24 02:14:46.479084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_gateway (2e755dda-98d1-4713-a810-541b5f12235b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.505575 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 1.5845995 Mar 24 02:14:46.508965 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58214) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:46.519905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'name': 'tempest-PortsTestJSON-2004913401'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:46.528162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Allocated IP 172.20.0.7 (2d226bac-d4ff-471e-bc00-d4e71858b25f/3a5facc4-fdf7-4c83-b38e-71e5119554fa/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:46.601434 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4335293d-e7c1-4924-937b-57884974d9e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Network': ['ID=c8466e8e-4c16-4f91-aa0d-8651c7d4116a,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:46.626697 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (ab72154d-c672-43d2-a5d3-dee78afb9ec3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.635454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Network 2d226bac-d4ff-471e-bc00-d4e71858b25f is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:46.637557 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:46.650629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:46.663752 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Pushing event updated for resources: {'Port': ['ID=73059fbd-c506-4972-b84b-84e574b09293,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:46.667317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-fa60bfb0-b783-476d-8c04-bdcd32c12f6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:46.667844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:46.668766 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-fa60bfb0-b783-476d-8c04-bdcd32c12f6e service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1ff12164-ce98-442e-81ee-e22f78c3a0ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.2157552 Mar 24 02:14:46.670654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9413667c-c9b1-4f57-aabf-f6f786a05ee2 admin admin] Publish callbacks [] for security_group (793d7c80-1f86-4cc9-8925-a8451d2a53ae), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.690189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9413667c-c9b1-4f57-aabf-f6f786a05ee2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (793d7c80-1f86-4cc9-8925-a8451d2a53ae), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.766854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 07b66e7c-044a-4bf5-ac89-e025f4b672c5 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:46.767633 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (07b66e7c-044a-4bf5-ac89-e025f4b672c5), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.772416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks [] for router (59af6cc6-1525-4caa-9515-2ecdc76c695f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.799054 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9413667c-c9b1-4f57-aabf-f6f786a05ee2 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=4b6f8a5a2b8f4db9b7545c49bb592c45&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6444480 Mar 24 02:14:46.800121 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:46.804291 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.823069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58216) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:46.843382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ab72154d-c672-43d2-a5d3-dee78afb9ec3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.856442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] For port c6f71525-107b-485e-9ded-7aef3375957f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:46.863242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9413667c-c9b1-4f57-aabf-f6f786a05ee2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=793d7c80-1f86-4cc9-8925-a8451d2a53ae,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:46.869640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Attempting to bind port 73059fbd-c506-4972-b84b-84e574b09293 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:46.870268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Attempting to bind port 73059fbd-c506-4972-b84b-84e574b09293 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'ed7e0ac9-0d10-429d-a503-0bac03239347', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '2d226bac-d4ff-471e-bc00-d4e71858b25f'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:46.870816 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Attempting to bind port 73059fbd-c506-4972-b84b-84e574b09293 on network 2d226bac-d4ff-471e-bc00-d4e71858b25f {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:46.899544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] For port c6f71525-107b-485e-9ded-7aef3375957f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c6f71525-107b-485e-9ded-7aef3375957f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:46.903637 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:46.904003 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Checking segment: {'id': 'ed7e0ac9-0d10-429d-a503-0bac03239347', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '2d226bac-d4ff-471e-bc00-d4e71858b25f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:46.904655 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.905197 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Bound using segment: {'id': 'ed7e0ac9-0d10-429d-a503-0bac03239347', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '2d226bac-d4ff-471e-bc00-d4e71858b25f'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:46.905817 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Bound port: 73059fbd-c506-4972-b84b-84e574b09293, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed7e0ac9-0d10-429d-a503-0bac03239347', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '2d226bac-d4ff-471e-bc00-d4e71858b25f'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:46.906203 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (73059fbd-c506-4972-b84b-84e574b09293), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.919404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c6f71525-107b-485e-9ded-7aef3375957f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:46.932619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port fb6aa634-7dc1-40b2-a10c-14a092dbd732 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:46.959980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:46.978147 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-c5f4ff44-97c6-4efd-87f6-845da844a448 service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2997732 Mar 24 02:14:46.979075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:46.982044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:46.987476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:46.988085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.031118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=ab72154d-c672-43d2-a5d3-dee78afb9ec3,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:47.033029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6185a631-1d3a-4c31-a2ae-1e2708ae1337 None None] Pushing event updated for resources: {'Port': ['ID=c6f71525-107b-485e-9ded-7aef3375957f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:47.042938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] For port 73059fbd-c506-4972-b84b-84e574b09293, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:47.048436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] For port 73059fbd-c506-4972-b84b-84e574b09293, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=73059fbd-c506-4972-b84b-84e574b09293,segment=NetworkSegment(ed7e0ac9-0d10-429d-a503-0bac03239347),segment_id=ed7e0ac9-0d10-429d-a503-0bac03239347)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:47.054255 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '93b3d5f4-3404-4069-ba69-76c7b29011a1', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'floating_ip_address': '172.26.2.214', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'port_id': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'mac_address': 'fa:16:3e:cc:67:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:14:41Z', 'updated_at': '2022-03-24T02:14:41Z', 'revision_number': 0, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a241a0ee-a158-4025-8b7b-6e9767042270', 'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'mac_address': 'fa:16:3e:d3:c7:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_interface', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:14:02Z', 'updated_at': '2022-03-24T02:14:09Z', 'revision_number': 5, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'subnets': [{'id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:47.088683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (73059fbd-c506-4972-b84b-84e574b09293), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.092640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] Checking router: c4a3de90-537a-4022-b079-9feeedff6892 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:14:47.142772 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:47.143690 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:47.146833 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1ebe99f1-0bd0-4690-8a9b-e20473982b3d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 2.1035001 Mar 24 02:14:47.150039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58218) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:47.185725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e124f74-3c3d-4b04-acb8-fdab79bb4a1d admin admin] Publish callbacks [] for security_group (793d7c80-1f86-4cc9-8925-a8451d2a53ae), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.239760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edcb4589-99e8-4e0b-ae1c-1a69a9b260fe None None] Pushing event updated for resources: {'Port': ['ID=73059fbd-c506-4972-b84b-84e574b09293,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:47.267839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58220) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:47.307464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:14:47.361966 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e124f74-3c3d-4b04-acb8-fdab79bb4a1d admin admin] Publish callbacks [] for security_group (793d7c80-1f86-4cc9-8925-a8451d2a53ae), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.422498 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a2863ae-6121-475d-a139-7ef0f8cc42d3 req-9cfa205b-7464-4451-9cad-cc0b6f9d0a80 service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4312923 Mar 24 02:14:47.493305 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for port (fd481460-0ec4-4fb5-8f6d-7cd94f9a7629), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.505098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bb50aec-84b0-4e38-a1e7-285179fe655b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:47.505551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (07b66e7c-044a-4bf5-ac89-e025f4b672c5), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.508874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (59af6cc6-1525-4caa-9515-2ecdc76c695f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.510554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bb50aec-84b0-4e38-a1e7-285179fe655b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:47.512071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks [] for router_controller (59af6cc6-1525-4caa-9515-2ecdc76c695f), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.512230 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8bb50aec-84b0-4e38-a1e7-285179fe655b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.3564081 Mar 24 02:14:47.524274 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58222) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:47.556610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.563249 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-852cbbae-23d4-4822-b17e-bc5117f725ef tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/floatingips/93b3d5f4-3404-4069-ba69-76c7b29011a1 HTTP/1.1" status: 200 len: 991 time: 0.2773883 Mar 24 02:14:47.591363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 07b66e7c-044a-4bf5-ac89-e025f4b672c5 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:47.614177 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (59af6cc6-1525-4caa-9515-2ecdc76c695f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.617440 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 59af6cc6-1525-4caa-9515-2ecdc76c695f {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:14:47.683696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.695707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e124f74-3c3d-4b04-acb8-fdab79bb4a1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (793d7c80-1f86-4cc9-8925-a8451d2a53ae), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.698885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e124f74-3c3d-4b04-acb8-fdab79bb4a1d admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.703125 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7e124f74-3c3d-4b04-acb8-fdab79bb4a1d admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/793d7c80-1f86-4cc9-8925-a8451d2a53ae HTTP/1.1" status: 204 len: 168 time: 0.8758044 Mar 24 02:14:47.717202 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] create failed (client error): There was a conflict when trying to complete your request. Mar 24 02:14:47.718283 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9ac219cb-f48a-4ba3-8298-8fa8e8308f8d tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 3.1931198 Mar 24 02:14:47.722989 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58226) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:47.726276 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '93b3d5f4-3404-4069-ba69-76c7b29011a1', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'floating_ip_address': '172.26.2.214', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'port_id': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'mac_address': 'fa:16:3e:cc:67:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:14:41Z', 'updated_at': '2022-03-24T02:14:41Z', 'revision_number': 0, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a241a0ee-a158-4025-8b7b-6e9767042270', 'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'mac_address': 'fa:16:3e:d3:c7:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_interface', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:14:02Z', 'updated_at': '2022-03-24T02:14:09Z', 'revision_number': 5, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'subnets': [{'id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:47.747467 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (fd481460-0ec4-4fb5-8f6d-7cd94f9a7629), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.759488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e124f74-3c3d-4b04-acb8-fdab79bb4a1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=793d7c80-1f86-4cc9-8925-a8451d2a53ae,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:47.804872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9be43dd0-6e99-49f6-97fc-08bf5c8c9f46 None None] The sync data for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv is: [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '93b3d5f4-3404-4069-ba69-76c7b29011a1', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'floating_ip_address': '172.26.2.214', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'port_id': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'mac_address': 'fa:16:3e:cc:67:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:14:41Z', 'updated_at': '2022-03-24T02:14:41Z', 'revision_number': 0, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a241a0ee-a158-4025-8b7b-6e9767042270', 'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'mac_address': 'fa:16:3e:d3:c7:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_interface', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:14:02Z', 'updated_at': '2022-03-24T02:14:09Z', 'revision_number': 5, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'subnets': [{'id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:47.819393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=fb6aa634-7dc1-40b2-a10c-14a092dbd732,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:47.861895 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-24a80c4e-0153-45a6-b6b9-e48791623d61 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port ab72154d-c672-43d2-a5d3-dee78afb9ec3 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:47.862239 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-24a80c4e-0153-45a6-b6b9-e48791623d61 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ab72154d-c672-43d2-a5d3-dee78afb9ec3), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:47.914183 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Network 2d226bac-d4ff-471e-bc00-d4e71858b25f is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:47.925083 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:47.931693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Checking segment: {'id': 'cb1f6bda-0ce9-4c9a-968a-d29295cb534c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:47.932454 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network hostable DHCP agents. Network: c8466e8e-4c16-4f91-aa0d-8651c7d4116a, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:47.936210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:47.942843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Pushing event updated for resources: {'Port': ['ID=fd481460-0ec4-4fb5-8f6d-7cd94f9a7629,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:47.978737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:47.994675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, c8466e8e-4c16-4f91-aa0d-8651c7d4116a) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:48.005055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:48.006366 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f534eb16-8b2a-4c99-ab90-46ae8fe10671 None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:48.010458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:48.011104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.031479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-24a80c4e-0153-45a6-b6b9-e48791623d61 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ab72154d-c672-43d2-a5d3-dee78afb9ec3), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.047216 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:48.047866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.050647 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a1b2a15d-cd00-45b8-bdb0-d76f59f3c189 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 1.5387805 Mar 24 02:14:48.053144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-24a80c4e-0153-45a6-b6b9-e48791623d61 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for ab72154d-c672-43d2-a5d3-dee78afb9ec3 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:48.054676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58230) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:48.062939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1682607866'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:48.074746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-8e05f62b-eb41-496c-9629-84edea96a67a tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Deleting port 9a4116a8-d3b2-4c6d-a75d-d92501855d60 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:48.075080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e05f62b-eb41-496c-9629-84edea96a67a tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9a4116a8-d3b2-4c6d-a75d-d92501855d60), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.090810 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (07b66e7c-044a-4bf5-ac89-e025f4b672c5), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.100165 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3ec5e9b4-d9c6-4088-bba9-3351c09b9729 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 2.8483686 Mar 24 02:14:48.100743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58232) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:48.129350 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:48.139363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2326b201-ceaf-4ba7-986b-b283627739ee tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Request body: {'router': {'name': 'tempest-TagsExtTest-router-1243869031', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:48.139891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.180830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 103} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:48.182640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=07b66e7c-044a-4bf5-ac89-e025f4b672c5,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:48.210058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (331207a5-3685-47a7-ba98-e241e71d5a84), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.210659 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Added segment 331207a5-3685-47a7-ba98-e241e71d5a84 of type vlan for network 9762f111-81a2-4c7f-877e-e19aafce2651 Mar 24 02:14:48.228192 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58234) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:48.286924 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-15985d95-0bd8-4eb4-b170-a1ffd0aad458 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.288997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2326b201-ceaf-4ba7-986b-b283627739ee tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (c1552e39-333b-4715-a11d-0de0485b308c), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.290023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2326b201-ceaf-4ba7-986b-b283627739ee tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (c1552e39-333b-4715-a11d-0de0485b308c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.293485 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f817ffe-5c5a-40e9-998e-3d45f89fb9e3 None None] New status for floating IP 93b3d5f4-3404-4069-ba69-76c7b29011a1: ACTIVE {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:14:48.300568 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (9762f111-81a2-4c7f-877e-e19aafce2651), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.349525 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e05f62b-eb41-496c-9629-84edea96a67a tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9a4116a8-d3b2-4c6d-a75d-d92501855d60), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.374420 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (2e755dda-98d1-4713-a810-541b5f12235b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.377380 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-8e05f62b-eb41-496c-9629-84edea96a67a tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Calling delete_port for 9a4116a8-d3b2-4c6d-a75d-d92501855d60 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:48.385622 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (9762f111-81a2-4c7f-877e-e19aafce2651), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.392667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:48.393319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.484145 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.4279077 Mar 24 02:14:48.487276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58236) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:48.495833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'ports': [{'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a'}, {'network_id': '9762f111-81a2-4c7f-877e-e19aafce2651'}]} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:48.496151 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:48.496629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': '9762f111-81a2-4c7f-877e-e19aafce2651'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:48.538237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2326b201-ceaf-4ba7-986b-b283627739ee tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for router_controller (c1552e39-333b-4715-a11d-0de0485b308c), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.554640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6be00cf-b90b-4198-856d-2ef267b4ff88 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Network': ['ID=9762f111-81a2-4c7f-877e-e19aafce2651,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:48.565757 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-24a80c4e-0153-45a6-b6b9-e48791623d61 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ab72154d-c672-43d2-a5d3-dee78afb9ec3), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.573661 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58238) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:48.581165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 9762f111-81a2-4c7f-877e-e19aafce2651 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:48.601061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2326b201-ceaf-4ba7-986b-b283627739ee tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (c1552e39-333b-4715-a11d-0de0485b308c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.653742 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0aebee6f-673c-40d0-8f52-ae80c6bea767 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/floatingips/93b3d5f4-3404-4069-ba69-76c7b29011a1 HTTP/1.1" status: 200 len: 993 time: 0.0733256 Mar 24 02:14:48.655402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (2e755dda-98d1-4713-a810-541b5f12235b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.671566 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (2e755dda-98d1-4713-a810-541b5f12235b), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.690362 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24a80c4e-0153-45a6-b6b9-e48791623d61 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=ab72154d-c672-43d2-a5d3-dee78afb9ec3,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:48.740356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2326b201-ceaf-4ba7-986b-b283627739ee tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.741607 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2326b201-ceaf-4ba7-986b-b283627739ee tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.6132369 Mar 24 02:14:48.743905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-24a80c4e-0153-45a6-b6b9-e48791623d61 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.749306 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-24a80c4e-0153-45a6-b6b9-e48791623d61 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/ab72154d-c672-43d2-a5d3-dee78afb9ec3 HTTP/1.1" status: 204 len: 168 time: 1.2246170 Mar 24 02:14:48.754952 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58240) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:48.755308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58242) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:48.761197 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-9189f48f-91eb-4bcd-8569-d395242a49da tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Request body: {'subnetpool': {'name': 'tempest-TagsExtTest-Subnetpool-1884774739', 'prefixes': ['172.20.0.0/16']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:48.794264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-87417da9-c6e7-45ad-919e-0e374730d230 None None] Provisioning complete for port c6f71525-107b-485e-9ded-7aef3375957f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:48.794687 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87417da9-c6e7-45ad-919e-0e374730d230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c6f71525-107b-485e-9ded-7aef3375957f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.884864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 73059fbd-c506-4972-b84b-84e574b09293 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:48.891733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (2e755dda-98d1-4713-a810-541b5f12235b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.892555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Fanout notify agent at l3_agent the message router_deleted on router 2e755dda-98d1-4713-a810-541b5f12235b {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:14:48.911391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d12c4fed-3ddf-4c29-823a-36a66c3f4422 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:48.912833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d12c4fed-3ddf-4c29-823a-36a66c3f4422 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:48.912950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.916990 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5aa81c75-2cf4-4ad3-aa71-bd715afb9e79 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/2e755dda-98d1-4713-a810-541b5f12235b HTTP/1.1" status: 204 len: 168 time: 3.2519062 Mar 24 02:14:48.917142 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d12c4fed-3ddf-4c29-823a-36a66c3f4422 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1457 time: 0.1482189 Mar 24 02:14:48.918135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58244) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:48.918664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58246) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:48.925672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-590205856'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:48.970749 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 2} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:48.971268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-15985d95-0bd8-4eb4-b170-a1ffd0aad458 admin admin] Publish callbacks [] for security_group (1b9f7a01-b7d5-4cc5-9ab2-35af81d88ef2), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.975912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:48.996061 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.011601 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-15985d95-0bd8-4eb4-b170-a1ffd0aad458 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1b9f7a01-b7d5-4cc5-9ab2-35af81d88ef2), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.013702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9189f48f-91eb-4bcd-8569-d395242a49da tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for subnetpool (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.018077 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9189f48f-91eb-4bcd-8569-d395242a49da tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 748 time: 0.2586875 Mar 24 02:14:49.021355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58248) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:49.026119 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-d1399bde-18b1-488f-8aad-540f3e804dac tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa', 'tempest-TagsExtTest-Tag-1326243842') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:49.081567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:49.085903 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.100075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 73059fbd-c506-4972-b84b-84e574b09293 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:49.100802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (73059fbd-c506-4972-b84b-84e574b09293), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.109783 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-15985d95-0bd8-4eb4-b170-a1ffd0aad458 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=b2d95ded799e416b88ab4e8c35137623&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8805571 Mar 24 02:14:49.113878 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2052e0f-81d2-412c-8cc8-1435a113b939 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 333a8308-f430-48a8-ae89-0cc14a94dd36 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:49.118868 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58250) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:49.120930 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15985d95-0bd8-4eb4-b170-a1ffd0aad458 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b9f7a01-b7d5-4cc5-9ab2-35af81d88ef2,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:49.150986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-87417da9-c6e7-45ad-919e-0e374730d230 None None] Current status of the port c6f71525-107b-485e-9ded-7aef3375957f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:49.151773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87417da9-c6e7-45ad-919e-0e374730d230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c6f71525-107b-485e-9ded-7aef3375957f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.175102 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e05f62b-eb41-496c-9629-84edea96a67a tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (9a4116a8-d3b2-4c6d-a75d-d92501855d60), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.185611 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2052e0f-81d2-412c-8cc8-1435a113b939 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (333a8308-f430-48a8-ae89-0cc14a94dd36), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.215891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-87417da9-c6e7-45ad-919e-0e374730d230 None None] For port c6f71525-107b-485e-9ded-7aef3375957f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c6f71525-107b-485e-9ded-7aef3375957f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:49.252333 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87417da9-c6e7-45ad-919e-0e374730d230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c6f71525-107b-485e-9ded-7aef3375957f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.275735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e05f62b-eb41-496c-9629-84edea96a67a tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Pushing event deleted for resources: {'Port': ['ID=9a4116a8-d3b2-4c6d-a75d-d92501855d60,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:49.299274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 128} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:49.305568 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:49.323844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 73059fbd-c506-4972-b84b-84e574b09293 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:49.324594 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (73059fbd-c506-4972-b84b-84e574b09293), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.344155 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d1399bde-18b1-488f-8aad-540f3e804dac tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags/tempest-TagsExtTest-Tag-1326243842 HTTP/1.1" status: 201 len: 201 time: 0.3217278 Mar 24 02:14:49.347855 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58252) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:49.355581 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-09387360-c1bf-41b5-964b-1adc7ed2214f tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629', 'tempest-TagsExtTest-Tag-752420016') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:49.368728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2052e0f-81d2-412c-8cc8-1435a113b939 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (333a8308-f430-48a8-ae89-0cc14a94dd36), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.372493 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (7c9caef7-9e27-4e66-816e-a8c02d3397bc), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.372839 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added segment 7c9caef7-9e27-4e66-816e-a8c02d3397bc of type vlan for network ab372b63-e00c-4c6b-960a-f947e3e6d92b Mar 24 02:14:49.400274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d30a5c7e-48ec-41ec-8ec8-615ebdcf4b0d None None] Could not find standard attr ID for object ab72154d-c672-43d2-a5d3-dee78afb9ec3. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:14:49.406205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87417da9-c6e7-45ad-919e-0e374730d230 None None] Pushing event updated for resources: {'Port': ['ID=c6f71525-107b-485e-9ded-7aef3375957f,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:49.428278 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 73059fbd-c506-4972-b84b-84e574b09293, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=73059fbd-c506-4972-b84b-84e574b09293,segment=NetworkSegment(ed7e0ac9-0d10-429d-a503-0bac03239347),segment_id=ed7e0ac9-0d10-429d-a503-0bac03239347)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:49.434110 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (73059fbd-c506-4972-b84b-84e574b09293), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.435368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c6f71525-107b-485e-9ded-7aef3375957f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:49.493975 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b3d2fa3-569d-4adf-9948-cff2e4da07d6 None None] Network 2d226bac-d4ff-471e-bc00-d4e71858b25f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:49.495032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cdbdabf0-edfb-4725-8fde-6fc690515349 admin admin] Publish callbacks [] for security_group (1b9f7a01-b7d5-4cc5-9ab2-35af81d88ef2), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.513677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.552544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e05f62b-eb41-496c-9629-84edea96a67a tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.559636 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8e05f62b-eb41-496c-9629-84edea96a67a tempest-RoutersAdminNegativeIpV6Test-1018047260 tempest-RoutersAdminNegativeIpV6Test-1018047260-project-admin] 10.222.0.20 "DELETE /v2.0/ports/9a4116a8-d3b2-4c6d-a75d-d92501855d60 HTTP/1.1" status: 204 len: 168 time: 1.8308871 Mar 24 02:14:49.574259 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (ab372b63-e00c-4c6b-960a-f947e3e6d92b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.610214 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=73059fbd-c506-4972-b84b-84e574b09293,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:49.614581 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-09387360-c1bf-41b5-964b-1adc7ed2214f tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags/tempest-TagsExtTest-Tag-752420016 HTTP/1.1" status: 201 len: 201 time: 0.2628639 Mar 24 02:14:49.617872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 2f685718-2698-4ea4-8033-f21e5bf4823a yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:49.621061 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58256) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:49.630393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-fda099d4-87ea-403c-bc1a-c554925f92cc tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c', 'tempest-TagsExtTest-Tag-186590081') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:49.636292 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2052e0f-81d2-412c-8cc8-1435a113b939 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (333a8308-f430-48a8-ae89-0cc14a94dd36), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.639522 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7485902f-7ee7-476c-8856-2c5d97affbe2 None None] Provisioning complete for port 73059fbd-c506-4972-b84b-84e574b09293 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:49.639893 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7485902f-7ee7-476c-8856-2c5d97affbe2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (73059fbd-c506-4972-b84b-84e574b09293), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.693873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (ab372b63-e00c-4c6b-960a-f947e3e6d92b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.700099 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:49.700786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.728444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port c6f71525-107b-485e-9ded-7aef3375957f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:49.729051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c6f71525-107b-485e-9ded-7aef3375957f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.779647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cdbdabf0-edfb-4725-8fde-6fc690515349 admin admin] Publish callbacks [] for security_group (1b9f7a01-b7d5-4cc5-9ab2-35af81d88ef2), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.787068 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fda099d4-87ea-403c-bc1a-c554925f92cc tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags/tempest-TagsExtTest-Tag-186590081 HTTP/1.1" status: 201 len: 201 time: 0.1622915 Mar 24 02:14:49.787737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58258) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:49.803544 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-998f7345-bf74-4915-8bdf-2524bb3b3b4c tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb', 'tempest-TagsExtTest-Tag-834279067') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:49.820236 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.8991156 Mar 24 02:14:49.832581 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58262) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:49.851896 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'subnet': {'network_id': 'ab372b63-e00c-4c6b-960a-f947e3e6d92b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:49.858465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037e06ec-54a3-46d2-83b3-6d60052f0479 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Network': ['ID=ab372b63-e00c-4c6b-960a-f947e3e6d92b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:49.886024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2052e0f-81d2-412c-8cc8-1435a113b939 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (333a8308-f430-48a8-ae89-0cc14a94dd36), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.888564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (2f685718-2698-4ea4-8033-f21e5bf4823a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.911505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network ab372b63-e00c-4c6b-960a-f947e3e6d92b details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:49.935033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58264) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:49.939554 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d2052e0f-81d2-412c-8cc8-1435a113b939 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.943297 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d2052e0f-81d2-412c-8cc8-1435a113b939 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/333a8308-f430-48a8-ae89-0cc14a94dd36 HTTP/1.1" status: 204 len: 168 time: 1.0235295 Mar 24 02:14:49.948335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58266) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:49.951995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:49.973270 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2052e0f-81d2-412c-8cc8-1435a113b939 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=333a8308-f430-48a8-ae89-0cc14a94dd36,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:50.008053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cdbdabf0-edfb-4725-8fde-6fc690515349 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1b9f7a01-b7d5-4cc5-9ab2-35af81d88ef2), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.010834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cdbdabf0-edfb-4725-8fde-6fc690515349 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.012031 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cdbdabf0-edfb-4725-8fde-6fc690515349 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/1b9f7a01-b7d5-4cc5-9ab2-35af81d88ef2 HTTP/1.1" status: 204 len: 168 time: 0.8920970 Mar 24 02:14:50.030981 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:50.034840 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.039961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdbdabf0-edfb-4725-8fde-6fc690515349 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b9f7a01-b7d5-4cc5-9ab2-35af81d88ef2,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:50.064221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8815e2a3-8f52-47b0-844a-3567979f8a61 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:50.324790 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7485902f-7ee7-476c-8856-2c5d97affbe2 None None] Current status of the port 73059fbd-c506-4972-b84b-84e574b09293 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:50.329746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (8f09cd00-d5bb-4486-93b9-502ef7b01957), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.383955 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port c6f71525-107b-485e-9ded-7aef3375957f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:50.407208 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Subnet': ['ID=8f09cd00-d5bb-4486-93b9-502ef7b01957,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:50.431398 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8c9adc6c-6ec5-4b7e-9952-779754de03ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.4814684 Mar 24 02:14:50.434427 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58274) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:50.448941 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0df35b45-bd03-4cb7-8d12-f82c9184b983 None None] Provisioning complete for port 73059fbd-c506-4972-b84b-84e574b09293 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:50.450203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:50.450406 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0df35b45-bd03-4cb7-8d12-f82c9184b983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (73059fbd-c506-4972-b84b-84e574b09293), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.459161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Checking segment: {'id': '7c9caef7-9e27-4e66-816e-a8c02d3397bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'ab372b63-e00c-4c6b-960a-f947e3e6d92b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:50.459910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network hostable DHCP agents. Network: ab372b63-e00c-4c6b-960a-f947e3e6d92b, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:50.479033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:50.491776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:50.494383 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:50.495341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (2f685718-2698-4ea4-8033-f21e5bf4823a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.518131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8408ffe-175d-4e90-b956-754eb0eb1de0 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:50.528199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-10f177d4-5ca7-4656-b6bb-d7d32417ea13 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.547037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network ab372b63-e00c-4c6b-960a-f947e3e6d92b is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:50.574320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, ab372b63-e00c-4c6b-960a-f947e3e6d92b) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:50.593235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:50.596275 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:50.597061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.625361 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d8671d2e-5134-42b6-b60a-481e69a5b7e1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7879972 Mar 24 02:14:50.627877 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58280) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:50.633118 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5081ee08-616b-4560-a531-e4f4eeb23e19 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-807763146', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:50.636945 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-693dd521-59d2-4944-894a-0100b0df8697 None None] Network ab372b63-e00c-4c6b-960a-f947e3e6d92b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:50.679743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5081ee08-616b-4560-a531-e4f4eeb23e19 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (3aca5599-104a-44a7-bb92-9274c219499f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.680937 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5081ee08-616b-4560-a531-e4f4eeb23e19 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (3aca5599-104a-44a7-bb92-9274c219499f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.684637 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=2f685718-2698-4ea4-8033-f21e5bf4823a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:50.698593 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-998f7345-bf74-4915-8bdf-2524bb3b3b4c tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags/tempest-TagsExtTest-Tag-834279067 HTTP/1.1" status: 201 len: 201 time: 0.9059737 Mar 24 02:14:50.704685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58284) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:50.715214 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0df35b45-bd03-4cb7-8d12-f82c9184b983 None None] Current status of the port 73059fbd-c506-4972-b84b-84e574b09293 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:50.716431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-a6ef5fd0-dca0-4437-87b4-bdec2cda8a9b tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:50.732512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 73059fbd-c506-4972-b84b-84e574b09293 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:50.758298 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:50.762379 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.788131 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5081ee08-616b-4560-a531-e4f4eeb23e19 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (3aca5599-104a-44a7-bb92-9274c219499f), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.806429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0df35b45-bd03-4cb7-8d12-f82c9184b983 None None] Provisioning complete for port fd481460-0ec4-4fb5-8f6d-7cd94f9a7629 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:50.806978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Checking segment: {'id': '331207a5-3685-47a7-ba98-e241e71d5a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '9762f111-81a2-4c7f-877e-e19aafce2651'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:50.807191 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0df35b45-bd03-4cb7-8d12-f82c9184b983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fd481460-0ec4-4fb5-8f6d-7cd94f9a7629), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.807635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network hostable DHCP agents. Network: 9762f111-81a2-4c7f-877e-e19aafce2651, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:50.846359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5081ee08-616b-4560-a531-e4f4eeb23e19 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (3aca5599-104a-44a7-bb92-9274c219499f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.874824 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 9762f111-81a2-4c7f-877e-e19aafce2651 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:50.883612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-10f177d4-5ca7-4656-b6bb-d7d32417ea13 admin admin] Publish callbacks [] for security_group (39fe64b5-a672-48fc-91b2-964927540fcc), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.890798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0df35b45-bd03-4cb7-8d12-f82c9184b983 None None] Port fd481460-0ec4-4fb5-8f6d-7cd94f9a7629 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:50.894891 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a6ef5fd0-dca0-4437-87b4-bdec2cda8a9b tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags HTTP/1.1" status: 200 len: 241 time: 0.1829770 Mar 24 02:14:50.895051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e8408ffe-175d-4e90-b956-754eb0eb1de0 None None] Deleting port c6f71525-107b-485e-9ded-7aef3375957f {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:50.895138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-10f177d4-5ca7-4656-b6bb-d7d32417ea13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (39fe64b5-a672-48fc-91b2-964927540fcc), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.895761 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e8408ffe-175d-4e90-b956-754eb0eb1de0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c6f71525-107b-485e-9ded-7aef3375957f), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.898779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58288) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:50.899029 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5081ee08-616b-4560-a531-e4f4eeb23e19 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.900851 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5081ee08-616b-4560-a531-e4f4eeb23e19 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.2718396 Mar 24 02:14:50.904709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58290) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:50.913306 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-b6d3a593-4352-46d5-8605-4c325dc76502 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa', 'tempest-TagsExtTest-Tag-1326243842') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:50.928605 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 9762f111-81a2-4c7f-877e-e19aafce2651) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:50.933232 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:50.937457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-ab372b63-e00c-4c6b-960a-f947e3e6d92b', 'network_id': 'ab372b63-e00c-4c6b-960a-f947e3e6d92b', 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'fixed_ips': [{'subnet_id': '8f09cd00-d5bb-4486-93b9-502ef7b01957'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:50.938972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.939440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:50.945141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:50.945830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:50.950573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3537b0d-001e-4f84-81e3-0cbbccaadac4 None None] Network 9762f111-81a2-4c7f-877e-e19aafce2651 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:51.009091 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f177d4-5ca7-4656-b6bb-d7d32417ea13 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39fe64b5-a672-48fc-91b2-964927540fcc,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:51.015866 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 73059fbd-c506-4972-b84b-84e574b09293 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:51.016471 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-10f177d4-5ca7-4656-b6bb-d7d32417ea13 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=a9d98bd462d24211a75a6ac6531f2ef0&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0797873 Mar 24 02:14:51.016654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (73059fbd-c506-4972-b84b-84e574b09293), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.025625 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-563b6260-e8ad-4540-be85-d5032e137e8c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 2.5336838 Mar 24 02:14:51.027727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58296) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:51.028082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58298) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:51.079981 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e8408ffe-175d-4e90-b956-754eb0eb1de0 None None] For port c6f71525-107b-485e-9ded-7aef3375957f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c6f71525-107b-485e-9ded-7aef3375957f,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:51.080379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e8408ffe-175d-4e90-b956-754eb0eb1de0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c6f71525-107b-485e-9ded-7aef3375957f), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.175489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e8408ffe-175d-4e90-b956-754eb0eb1de0 None None] Calling delete_port for c6f71525-107b-485e-9ded-7aef3375957f owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:51.182587 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b6d3a593-4352-46d5-8605-4c325dc76502 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags/tempest-TagsExtTest-Tag-1326243842 HTTP/1.1" status: 204 len: 168 time: 0.2813632 Mar 24 02:14:51.187338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58304) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:51.193960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-a789a014-8512-45d1-9cd8-cb1eff1ac9f6 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa', 'tempest-TagsExtTest-Tag-1326243842') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:51.198045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-205c3de7-cd21-4773-92cf-987dfdc675a8 None None] Provisioning complete for port fd481460-0ec4-4fb5-8f6d-7cd94f9a7629 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:51.198415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-205c3de7-cd21-4773-92cf-987dfdc675a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fd481460-0ec4-4fb5-8f6d-7cd94f9a7629), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.256715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-28477f64-aac3-4f93-b65a-a4d5ee84a583 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 2f685718-2698-4ea4-8033-f21e5bf4823a {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:51.257570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-28477f64-aac3-4f93-b65a-a4d5ee84a583 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2f685718-2698-4ea4-8033-f21e5bf4823a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-21a13bbd-58d2-45c0-bb7f-2a8b41b681b6 admin admin] Publish callbacks [] for security_group (39fe64b5-a672-48fc-91b2-964927540fcc), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.292163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-21a13bbd-58d2-45c0-bb7f-2a8b41b681b6 admin admin] Publish callbacks [] for security_group (39fe64b5-a672-48fc-91b2-964927540fcc), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.331751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-205c3de7-cd21-4773-92cf-987dfdc675a8 None None] Port fd481460-0ec4-4fb5-8f6d-7cd94f9a7629 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:51.384889 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Allocated IP 2001:db8::2 (ab372b63-e00c-4c6b-960a-f947e3e6d92b/8f09cd00-d5bb-4486-93b9-502ef7b01957/97bd1dc6-1eff-4e82-b2e6-8901925388ce) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:51.409914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 73059fbd-c506-4972-b84b-84e574b09293 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:51.434933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e8408ffe-175d-4e90-b956-754eb0eb1de0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (c6f71525-107b-485e-9ded-7aef3375957f), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.461594 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-28477f64-aac3-4f93-b65a-a4d5ee84a583 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2f685718-2698-4ea4-8033-f21e5bf4823a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.481003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-28477f64-aac3-4f93-b65a-a4d5ee84a583 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 2f685718-2698-4ea4-8033-f21e5bf4823a owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:51.495777 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c6f71525-107b-485e-9ded-7aef3375957f no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:51.510306 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-21a13bbd-58d2-45c0-bb7f-2a8b41b681b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (39fe64b5-a672-48fc-91b2-964927540fcc), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.513777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-21a13bbd-58d2-45c0-bb7f-2a8b41b681b6 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.515696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:14:51.518629 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-21a13bbd-58d2-45c0-bb7f-2a8b41b681b6 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/39fe64b5-a672-48fc-91b2-964927540fcc HTTP/1.1" status: 204 len: 168 time: 0.4896114 Mar 24 02:14:51.522262 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (0b178503-60ea-4883-ac4c-105d039d9afe), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.536399 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: c6f71525-107b-485e-9ded-7aef3375957f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:51.536797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c6f71525-107b-485e-9ded-7aef3375957f not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:51.561178 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8408ffe-175d-4e90-b956-754eb0eb1de0 None None] Pushing event deleted for resources: {'Port': ['ID=c6f71525-107b-485e-9ded-7aef3375957f,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:51.571064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8408ffe-175d-4e90-b956-754eb0eb1de0 None None] No DVR routers for this DVR port c6f71525-107b-485e-9ded-7aef3375957f on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:51.612696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a13bbd-58d2-45c0-bb7f-2a8b41b681b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39fe64b5-a672-48fc-91b2-964927540fcc,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:51.621900 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a789a014-8512-45d1-9cd8-cb1eff1ac9f6 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags/tempest-TagsExtTest-Tag-1326243842 HTTP/1.1" status: 204 len: 168 time: 0.4309661 Mar 24 02:14:51.622486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58314) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:51.626472 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:51.628839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-c6334674-9bf6-4090-a359-cbc9c20e49ab tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:51.637303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:51.648671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:51.649775 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.653435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=0b178503-60ea-4883-ac4c-105d039d9afe,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:51.656976 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19734f29-be3f-4e87-8bfa-7be60848bc0c None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:51.678126 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.705617 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b4d45c34-05c5-4233-80d7-cd4a58f59418 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2695479 Mar 24 02:14:51.714378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58318) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:51.738021 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:42:c6:e0', 'name': 'tempest-NetworksTestDHCPv6-1406876297'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:51.798144 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '0b178503-60ea-4883-ac4c-105d039d9afe'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:51.799182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.885235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:51.913501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Publish callbacks [] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.927158 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:51.986974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.011460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 3030d1ef-8c17-4020-9651-c6125e86ac97 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:52.023321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Network ab372b63-e00c-4c6b-960a-f947e3e6d92b is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:52.028130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:52.034200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:52.060647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58324) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.061331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Pushing event updated for resources: {'Port': ['ID=97bd1dc6-1eff-4e82-b2e6-8901925388ce,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:52.084896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Allocated IP 2001:db8::f816:3eff:fe43:f182 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/0b178503-60ea-4883-ac4c-105d039d9afe/ec36aa8f-10c0-4732-813a-3eed2b360fc7) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:52.102409 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c6334674-9bf6-4090-a359-cbc9c20e49ab tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags HTTP/1.1" status: 200 len: 205 time: 0.4788969 Mar 24 02:14:52.105131 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58328) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.110470 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-b2a0b388-6f18-47b7-bd8d-b300abe9e6b3 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:52.127549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Attempting to bind port 97bd1dc6-1eff-4e82-b2e6-8901925388ce on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:52.128003 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Attempting to bind port 97bd1dc6-1eff-4e82-b2e6-8901925388ce by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '7c9caef7-9e27-4e66-816e-a8c02d3397bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'ab372b63-e00c-4c6b-960a-f947e3e6d92b'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:52.128352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Attempting to bind port 97bd1dc6-1eff-4e82-b2e6-8901925388ce on network ab372b63-e00c-4c6b-960a-f947e3e6d92b {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:52.133191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 2001:db8::1 (ab372b63-e00c-4c6b-960a-f947e3e6d92b/8f09cd00-d5bb-4486-93b9-502ef7b01957/6f8aeb54-4d58-499c-9345-67f7d932f632) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:52.174762 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-15b15750-8d80-4aa9-a913-c775a88face4 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=0687ce7315324aa98ef0443253966691&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1125488 Mar 24 02:14:52.178377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-28477f64-aac3-4f93-b65a-a4d5ee84a583 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (2f685718-2698-4ea4-8033-f21e5bf4823a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.179663 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58330) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.216028 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28477f64-aac3-4f93-b65a-a4d5ee84a583 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=2f685718-2698-4ea4-8033-f21e5bf4823a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:52.236878 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-28477f64-aac3-4f93-b65a-a4d5ee84a583 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.240503 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-28477f64-aac3-4f93-b65a-a4d5ee84a583 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/2f685718-2698-4ea4-8033-f21e5bf4823a HTTP/1.1" status: 204 len: 168 time: 1.2102957 Mar 24 02:14:52.243066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58334) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.248055 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b2a0b388-6f18-47b7-bd8d-b300abe9e6b3 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags HTTP/1.1" status: 200 len: 240 time: 0.1415730 Mar 24 02:14:52.250542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58336) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.254979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-84ae3a56-29de-432c-96e9-36b19db4c972 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629', 'tempest-TagsExtTest-Tag-752420016') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:52.310699 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-84ae3a56-29de-432c-96e9-36b19db4c972 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags/tempest-TagsExtTest-Tag-752420016 HTTP/1.1" status: 204 len: 168 time: 0.0589728 Mar 24 02:14:52.312946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58338) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.318260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-565b6180-8a92-45aa-8efb-e84ab48269e6 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629', 'tempest-TagsExtTest-Tag-752420016') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:52.326371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:52.326881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Checking segment: {'id': '7c9caef7-9e27-4e66-816e-a8c02d3397bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'ab372b63-e00c-4c6b-960a-f947e3e6d92b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:52.327361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.327832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Bound using segment: {'id': '7c9caef7-9e27-4e66-816e-a8c02d3397bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'ab372b63-e00c-4c6b-960a-f947e3e6d92b'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:52.328391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Bound port: 97bd1dc6-1eff-4e82-b2e6-8901925388ce, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c9caef7-9e27-4e66-816e-a8c02d3397bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'ab372b63-e00c-4c6b-960a-f947e3e6d92b'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:52.328847 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.399436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58340) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.403121 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-565b6180-8a92-45aa-8efb-e84ab48269e6 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags/tempest-TagsExtTest-Tag-752420016 HTTP/1.1" status: 204 len: 168 time: 0.0889974 Mar 24 02:14:52.407462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58342) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.413085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-f41f27f3-04b8-448f-a703-210bd59bfd01 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:52.460395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-077653fe-8403-4db7-960f-0d8934357adb None None] For port 97bd1dc6-1eff-4e82-b2e6-8901925388ce, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:52.478832 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f41f27f3-04b8-448f-a703-210bd59bfd01 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags HTTP/1.1" status: 200 len: 205 time: 0.0695651 Mar 24 02:14:52.480174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-077653fe-8403-4db7-960f-0d8934357adb None None] For port 97bd1dc6-1eff-4e82-b2e6-8901925388ce, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=97bd1dc6-1eff-4e82-b2e6-8901925388ce,segment=NetworkSegment(7c9caef7-9e27-4e66-816e-a8c02d3397bc),segment_id=7c9caef7-9e27-4e66-816e-a8c02d3397bc)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:52.481074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58346) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.486927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-0e20578c-210c-4218-83e2-080e89e0902d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:52.495075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.502322 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Publish callbacks [] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.532646 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.560721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'network': {'name': 'tempest-RoutersAdminTest-1404633449', 'router:external': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:52.569255 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:52.572250 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:52.576236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:52.579502 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-077653fe-8403-4db7-960f-0d8934357adb None None] Pushing event updated for resources: {'Port': ['ID=97bd1dc6-1eff-4e82-b2e6-8901925388ce,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:52.663464 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Made reservation on behalf of 65b8f224365f41ae9e617e104bd7afce for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:52.665830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.680498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.686932 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fe42:c6e0 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/0b178503-60ea-4883-ac4c-105d039d9afe/3030d1ef-8c17-4020-9651-c6125e86ac97) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:52.687183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Pushing event updated for resources: {'Port': ['ID=ec36aa8f-10c0-4732-813a-3eed2b360fc7,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:52.695319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Attempting to bind port ec36aa8f-10c0-4732-813a-3eed2b360fc7 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:52.695691 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Attempting to bind port ec36aa8f-10c0-4732-813a-3eed2b360fc7 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:52.696059 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Attempting to bind port ec36aa8f-10c0-4732-813a-3eed2b360fc7 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:52.702685 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:52.703094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:52.703429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.704190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:52.704691 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Bound port: ec36aa8f-10c0-4732-813a-3eed2b360fc7, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:52.705207 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.728279 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0e20578c-210c-4218-83e2-080e89e0902d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags HTTP/1.1" status: 200 len: 240 time: 0.2459702 Mar 24 02:14:52.734400 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58348) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.739742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-5892c8a6-2fe8-4c37-b446-e03af670155a tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c', 'tempest-TagsExtTest-Tag-186590081') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:52.794463 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] For port ec36aa8f-10c0-4732-813a-3eed2b360fc7, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:52.804625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] For port ec36aa8f-10c0-4732-813a-3eed2b360fc7, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ec36aa8f-10c0-4732-813a-3eed2b360fc7,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:52.829450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.852439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b5c68ee3-d368-4ed7-8281-5fb49f7891cd admin admin] Publish callbacks [] for security_group (03dd94b8-677f-48e2-948c-a9019a08fe59), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.914324 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc120e97-7e28-47cf-aa62-1e48c65240f3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:52.920728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc120e97-7e28-47cf-aa62-1e48c65240f3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:52.924510 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cc120e97-7e28-47cf-aa62-1e48c65240f3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1452 time: 0.6800041 Mar 24 02:14:52.925291 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58350) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:52.925500 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b276a9-c0d4-4ea4-ab4c-656dac59e4b1 None None] Pushing event updated for resources: {'Port': ['ID=ec36aa8f-10c0-4732-813a-3eed2b360fc7,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:52.927569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b5c68ee3-d368-4ed7-8281-5fb49f7891cd admin admin] Publish callbacks [] for security_group (03dd94b8-677f-48e2-948c-a9019a08fe59), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.939760 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.965103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for security_group (59a1a59a-a7f3-46ca-b9b1-639140d57896), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:52.979265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (59a1a59a-a7f3-46ca-b9b1-639140d57896), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.015280 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5892c8a6-2fe8-4c37-b446-e03af670155a tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags/tempest-TagsExtTest-Tag-186590081 HTTP/1.1" status: 204 len: 168 time: 0.2795532 Mar 24 02:14:53.021641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58352) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:53.031200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-d6f11f67-f5c2-49b6-99ad-28098bbee297 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c', 'tempest-TagsExtTest-Tag-186590081') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:53.051382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 120} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:53.089047 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.103381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59a1a59a-a7f3-46ca-b9b1-639140d57896,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:53.124311 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b5c68ee3-d368-4ed7-8281-5fb49f7891cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (03dd94b8-677f-48e2-948c-a9019a08fe59), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.126902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b5c68ee3-d368-4ed7-8281-5fb49f7891cd admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.128059 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b5c68ee3-d368-4ed7-8281-5fb49f7891cd admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/03dd94b8-677f-48e2-948c-a9019a08fe59 HTTP/1.1" status: 204 len: 168 time: 0.9472003 Mar 24 02:14:53.168907 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c68ee3-d368-4ed7-8281-5fb49f7891cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03dd94b8-677f-48e2-948c-a9019a08fe59,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:53.188974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (f272c462-0e9b-4ad2-95d2-28368d50be16), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.189786 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Added segment f272c462-0e9b-4ad2-95d2-28368d50be16 of type vlan for network b76374f6-b383-4550-bd17-a0e476586959 Mar 24 02:14:53.193830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (3030d1ef-8c17-4020-9651-c6125e86ac97), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.212229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:53.212560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.218772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network ab372b63-e00c-4c6b-960a-f947e3e6d92b is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:53.237011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=6f8aeb54-4d58-499c-9345-67f7d932f632,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:53.241524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:53.244719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:53.245314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (3aca5599-104a-44a7-bb92-9274c219499f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.322458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (b76374f6-b383-4550-bd17-a0e476586959), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.331030 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3030d1ef-8c17-4020-9651-c6125e86ac97), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.383350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.384577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:53.396049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:53.405320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:53.417347 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:53.422439 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:53.423457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.458035 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 1.7255116 Mar 24 02:14:53.458859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58358) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:53.472562 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ccacf6-cd88-45e7-b644-c706b1d9e75a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=3030d1ef-8c17-4020-9651-c6125e86ac97,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:53.508398 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d6f11f67-f5c2-49b6-99ad-28098bbee297 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags/tempest-TagsExtTest-Tag-186590081 HTTP/1.1" status: 204 len: 168 time: 0.4819224 Mar 24 02:14:53.510860 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (b76374f6-b383-4550-bd17-a0e476586959), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.511863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:53.512443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.524896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58360) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:53.555819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.560800 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-cfd0822d-934e-49b3-aed0-194ddfab2ff4 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:53.565817 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 871 time: 1.1648045 Mar 24 02:14:53.570636 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58362) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:53.579882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'subnet': {'network_id': 'b76374f6-b383-4550-bd17-a0e476586959', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:53.639084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.655336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Made reservation on behalf of 65b8f224365f41ae9e617e104bd7afce for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:53.657746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.733577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12f7529d-f3cc-438d-a141-5541350a6b38 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event updated for resources: {'Network': ['ID=b76374f6-b383-4550-bd17-a0e476586959,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:53.748878 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network b76374f6-b383-4550-bd17-a0e476586959 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:53.766099 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:53.772779 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b HTTP/1.1" status: 204 len: 168 time: 0.8309679 Mar 24 02:14:53.773512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58370) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:53.779298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf60e2b5-d09e-4500-b7e1-78917e9ab61b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:53.782588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf60e2b5-d09e-4500-b7e1-78917e9ab61b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:53.787470 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cf60e2b5-d09e-4500-b7e1-78917e9ab61b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.3218327 Mar 24 02:14:53.788138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58374) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:53.798048 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cfd0822d-934e-49b3-aed0-194ddfab2ff4 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags HTTP/1.1" status: 200 len: 205 time: 0.2606492 Mar 24 02:14:53.800311 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58376) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:53.811690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:53.827001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-7d700af7-15f8-47ce-98f3-e699cc992954 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:53.903065 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.903399 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.905966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.906308 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.906686 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.907033 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.907363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.907692 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.908189 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.908612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.908889 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.909356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.909684 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.910008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.910690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-430afb6a-2634-47c3-bfaa-8d64c6cb1fa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:53.930241 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7d700af7-15f8-47ce-98f3-e699cc992954 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags HTTP/1.1" status: 200 len: 240 time: 0.1287444 Mar 24 02:14:53.931883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58378) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:53.956854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-316ba499-9648-4615-a773-05bc8afb707f tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb', 'tempest-TagsExtTest-Tag-834279067') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:53.973139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 3030d1ef-8c17-4020-9651-c6125e86ac97 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:53.974242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3030d1ef-8c17-4020-9651-c6125e86ac97), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.108318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55ea0711-7cca-4450-ac7b-a0e4aa9169e1 None None] Network ab372b63-e00c-4c6b-960a-f947e3e6d92b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:54.119543 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3030d1ef-8c17-4020-9651-c6125e86ac97), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.140895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d27ab18-867b-4916-92d0-b6ae43c08b40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:54.146631 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6d27ab18-867b-4916-92d0-b6ae43c08b40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.3321583 Mar 24 02:14:54.146762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58386) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.156526 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 3030d1ef-8c17-4020-9651-c6125e86ac97 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:54.194611 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-316ba499-9648-4615-a773-05bc8afb707f tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags/tempest-TagsExtTest-Tag-834279067 HTTP/1.1" status: 204 len: 168 time: 0.2576699 Mar 24 02:14:54.200119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58390) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.204687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-0f72129d-9680-4b07-a3b0-6971d5c9a430 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb', 'tempest-TagsExtTest-Tag-834279067') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:54.237735 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Provisioning complete for port 97bd1dc6-1eff-4e82-b2e6-8901925388ce triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:54.238235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.345221 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0f72129d-9680-4b07-a3b0-6971d5c9a430 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags/tempest-TagsExtTest-Tag-834279067 HTTP/1.1" status: 204 len: 168 time: 0.1440666 Mar 24 02:14:54.349041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58392) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.349376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58394) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.360336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.365268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Current status of the port 97bd1dc6-1eff-4e82-b2e6-8901925388ce is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:54.365731 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.375900 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-36447381-7217-4fa3-b221-59f2467dcada tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:54.412628 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] For port 97bd1dc6-1eff-4e82-b2e6-8901925388ce, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=97bd1dc6-1eff-4e82-b2e6-8901925388ce,segment=NetworkSegment(7c9caef7-9e27-4e66-816e-a8c02d3397bc),segment_id=7c9caef7-9e27-4e66-816e-a8c02d3397bc)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:54.421297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.421606 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.422425 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (3aca5599-104a-44a7-bb92-9274c219499f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.433602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3030d1ef-8c17-4020-9651-c6125e86ac97), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.447161 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-494d8f97-6c49-43b9-8d75-96b68e2c71f3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:14:54.449154 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-494d8f97-6c49-43b9-8d75-96b68e2c71f3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/2f685718-2698-4ea4-8033-f21e5bf4823a HTTP/1.1" status: 404 len: 333 time: 0.3017309 Mar 24 02:14:54.458065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58398) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.499434 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=6f8aeb54-4d58-499c-9345-67f7d932f632,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:54.525988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=3030d1ef-8c17-4020-9651-c6125e86ac97,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:54.537131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Pushing event updated for resources: {'Port': ['ID=97bd1dc6-1eff-4e82-b2e6-8901925388ce,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:54.552359 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.552708 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.553246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.553635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.553970 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.554298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.554714 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.555045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.555385 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.555712 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.556050 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.556390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.556711 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.557096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.557419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-956fb134-f517-495d-83ff-8dd21ef66f18 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.567793 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-36447381-7217-4fa3-b221-59f2467dcada tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags HTTP/1.1" status: 200 len: 205 time: 0.2156878 Mar 24 02:14:54.571712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58400) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.577350 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-c20b7ec3-5cfb-4d07-9bbb-b229397ddccc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:14:54.578730 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c20b7ec3-5cfb-4d07-9bbb-b229397ddccc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/5f6121f7-6d7e-46ce-a410-c4f7d2b45a0b HTTP/1.1" status: 404 len: 333 time: 0.1172254 Mar 24 02:14:54.580586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Request body: {'network': {'name': 'tempest-FloatingIPNegativeTestJSON-test-network-1558950538'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:54.582651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-72203e65-0cc5-4349-88fc-685a1af79157 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:54.587312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.587659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.588007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.588352 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.588779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.589118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.589623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.589970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.590303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.590659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.590991 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.591319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.591646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.592438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.592772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:14:54.594481 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5a12c1f2-dd53-4000-aea8-27ee7d88f175 None None] Provisioning complete for port ec36aa8f-10c0-4732-813a-3eed2b360fc7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:54.595045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5a12c1f2-dd53-4000-aea8-27ee7d88f175 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.595645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58402) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.701441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5a12c1f2-dd53-4000-aea8-27ee7d88f175 None None] Current status of the port ec36aa8f-10c0-4732-813a-3eed2b360fc7 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:54.703680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5a12c1f2-dd53-4000-aea8-27ee7d88f175 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.755238 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (9762f111-81a2-4c7f-877e-e19aafce2651), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.762882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.763027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Made reservation on behalf of 64fcebf53303474789f3b0a392800f49 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:54.766300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.768825 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e1e7aaa2-387c-4559-981b-29aa3d279f23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/3030d1ef-8c17-4020-9651-c6125e86ac97 HTTP/1.1" status: 204 len: 168 time: 0.9795821 Mar 24 02:14:54.773407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58404) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.778640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-5a12c1f2-dd53-4000-aea8-27ee7d88f175 None None] For port ec36aa8f-10c0-4732-813a-3eed2b360fc7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ec36aa8f-10c0-4732-813a-3eed2b360fc7,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:54.785454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5a12c1f2-dd53-4000-aea8-27ee7d88f175 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.805025 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network ab372b63-e00c-4c6b-960a-f947e3e6d92b is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:54.807827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:54.809909 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.854377 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a12c1f2-dd53-4000-aea8-27ee7d88f175 None None] Pushing event updated for resources: {'Port': ['ID=ec36aa8f-10c0-4732-813a-3eed2b360fc7,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:54.884641 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-72203e65-0cc5-4349-88fc-685a1af79157 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags HTTP/1.1" status: 204 len: 168 time: 0.3087595 Mar 24 02:14:54.893155 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db670afa-ab4b-4cd3-9981-c3b776b6388b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:54.894927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db670afa-ab4b-4cd3-9981-c3b776b6388b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:54.902015 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-db670afa-ab4b-4cd3-9981-c3b776b6388b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1276507 Mar 24 02:14:54.902811 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58406) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.903143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58408) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:54.923497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-353adc7b-f2b1-4683-b842-19528fb27104 None None] Provisioning complete for port 97bd1dc6-1eff-4e82-b2e6-8901925388ce triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:54.924005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-353adc7b-f2b1-4683-b842-19528fb27104 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:54.967353 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-dddcad0a-54db-4160-8bd8-39ec90ecc73f tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:54.973318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 97bd1dc6-1eff-4e82-b2e6-8901925388ce up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:55.000291 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-c60059d3-01ee-42dc-b9a1-5bc50d0c171e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 0b178503-60ea-4883-ac4c-105d039d9afe {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:55.012178 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c60059d3-01ee-42dc-b9a1-5bc50d0c171e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (0b178503-60ea-4883-ac4c-105d039d9afe), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.050154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (9762f111-81a2-4c7f-877e-e19aafce2651), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.077768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9762f111-81a2-4c7f-877e-e19aafce2651']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:55.090152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '331207a5-3685-47a7-ba98-e241e71d5a84') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:55.091185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '331207a5-3685-47a7-ba98-e241e71d5a84') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:55.095355 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 97bd1dc6-1eff-4e82-b2e6-8901925388ce triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:55.095740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.100156 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-353adc7b-f2b1-4683-b842-19528fb27104 None None] Current status of the port 97bd1dc6-1eff-4e82-b2e6-8901925388ce is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:55.104262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (331207a5-3685-47a7-ba98-e241e71d5a84), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.118636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (331207a5-3685-47a7-ba98-e241e71d5a84), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.130765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Releasing vlan 103 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:14:55.131476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (331207a5-3685-47a7-ba98-e241e71d5a84), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:14:55.142379 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:14:55.158420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-353adc7b-f2b1-4683-b842-19528fb27104 None None] Provisioning complete for port 6f8aeb54-4d58-499c-9345-67f7d932f632 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:55.158846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-353adc7b-f2b1-4683-b842-19528fb27104 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.207324 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-353adc7b-f2b1-4683-b842-19528fb27104 None None] Port 6f8aeb54-4d58-499c-9345-67f7d932f632 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:55.220322 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c60059d3-01ee-42dc-b9a1-5bc50d0c171e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (0b178503-60ea-4883-ac4c-105d039d9afe), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.240331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (9762f111-81a2-4c7f-877e-e19aafce2651), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.248446 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.254172 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/networks/9762f111-81a2-4c7f-877e-e19aafce2651 HTTP/1.1" status: 204 len: 168 time: 0.6403377 Mar 24 02:14:55.257849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58410) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:55.263945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1819161857'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:55.289385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5c50737-56ac-403f-8145-8d0e6b085b1a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Network': ['ID=9762f111-81a2-4c7f-877e-e19aafce2651,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:55.296811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 97bd1dc6-1eff-4e82-b2e6-8901925388ce is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:55.299076 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ec36aa8f-10c0-4732-813a-3eed2b360fc7 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:55.316352 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:55.320982 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.349535 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-285ae7c1-04a5-45bf-be16-98b4876750d9 None None] Could not find standard attr ID for object 3030d1ef-8c17-4020-9651-c6125e86ac97. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:14:55.352795 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 137} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:55.365028 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1cdaa2a8-ca3b-4c35-a022-821fd466d793), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.365375 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Added segment 1cdaa2a8-ca3b-4c35-a022-821fd466d793 of type vlan for network 4d590aa3-17ed-49de-b656-2cf56cf2a079 Mar 24 02:14:55.370145 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-285ae7c1-04a5-45bf-be16-98b4876750d9 None None] Provisioning complete for port 6f8aeb54-4d58-499c-9345-67f7d932f632 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:55.370531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-285ae7c1-04a5-45bf-be16-98b4876750d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.380200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c60059d3-01ee-42dc-b9a1-5bc50d0c171e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (0b178503-60ea-4883-ac4c-105d039d9afe), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.413661 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (4d590aa3-17ed-49de-b656-2cf56cf2a079), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.416074 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-285ae7c1-04a5-45bf-be16-98b4876750d9 None None] Port 6f8aeb54-4d58-499c-9345-67f7d932f632 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:55.421674 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ec36aa8f-10c0-4732-813a-3eed2b360fc7 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:55.422055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.459683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (4d590aa3-17ed-49de-b656-2cf56cf2a079), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.465761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:55.466496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.472704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for security_group (f0f8a87f-9bfa-4e4c-85f6-1a241311675d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.477678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c60059d3-01ee-42dc-b9a1-5bc50d0c171e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (0b178503-60ea-4883-ac4c-105d039d9afe), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.515377 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ec36aa8f-10c0-4732-813a-3eed2b360fc7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:55.526637 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2682457 Mar 24 02:14:55.529480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58412) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:55.530480 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f0f8a87f-9bfa-4e4c-85f6-1a241311675d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.538646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': '4d590aa3-17ed-49de-b656-2cf56cf2a079', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.2', 'end': '172.20.0.14'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:55.557082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:14:55.557943 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (8ca3c91b-2add-4279-a908-10cba8e1fd3a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.573416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c60059d3-01ee-42dc-b9a1-5bc50d0c171e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=0b178503-60ea-4883-ac4c-105d039d9afe,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:55.589533 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d6ddc8a-7cda-4802-87b5-2e110b2d405f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Network': ['ID=4d590aa3-17ed-49de-b656-2cf56cf2a079,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:55.590391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-375dd961-7620-410c-a52b-b4b745ceadcc None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:55.605526 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c60059d3-01ee-42dc-b9a1-5bc50d0c171e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.611214 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c60059d3-01ee-42dc-b9a1-5bc50d0c171e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/0b178503-60ea-4883-ac4c-105d039d9afe HTTP/1.1" status: 204 len: 168 time: 0.7028592 Mar 24 02:14:55.611391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 4d590aa3-17ed-49de-b656-2cf56cf2a079 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:55.612830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58414) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:55.619387 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 106} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:14:55.653828 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dddcad0a-54db-4160-8bd8-39ec90ecc73f tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags HTTP/1.1" status: 204 len: 168 time: 0.7489479 Mar 24 02:14:55.658018 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58416) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:55.662423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (825566a2-a114-400b-b59a-dc08809da829), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.662792 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Added segment 825566a2-a114-400b-b59a-dc08809da829 of type vlan for network 865b7da0-660b-4753-ad39-55ce579ff27d Mar 24 02:14:55.666694 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a011f129-28ae-47dd-823d-44d709e662a4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0505266 Mar 24 02:14:55.667732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-8f76120c-de61-4cc5-b81f-de053c7ffa6c tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:55.670491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58418) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:55.700907 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f0f8a87f-9bfa-4e4c-85f6-1a241311675d,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:55.714480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:55.718857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.722508 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9b10d971-5537-43d8-87a1-aec669403ea3 None None] Provisioning complete for port 6f8aeb54-4d58-499c-9345-67f7d932f632 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:55.727595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9b10d971-5537-43d8-87a1-aec669403ea3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.758625 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router 3aca5599-104a-44a7-bb92-9274c219499f is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:14:55.782575 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event updated for resources: {'Subnet': ['ID=8ca3c91b-2add-4279-a908-10cba8e1fd3a,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:55.786318 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (865b7da0-660b-4753-ad39-55ce579ff27d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.797474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.ipam_backend_mixin [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Performing IP validity checks on allocation pools {{(pid=104037) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:322}} Mar 24 02:14:55.798380 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.ipam_backend_mixin [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Checking for overlaps among allocation pools and gateway ip {{(pid=104037) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:343}} Mar 24 02:14:55.799663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9b10d971-5537-43d8-87a1-aec669403ea3 None None] Port 6f8aeb54-4d58-499c-9345-67f7d932f632 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:14:55.809140 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8f76120c-de61-4cc5-b81f-de053c7ffa6c tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags HTTP/1.1" status: 204 len: 168 time: 0.1448901 Mar 24 02:14:55.811263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58420) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:55.814369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-427bbdf7-74ec-4793-8e70-431ed6b672f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:55.823557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Checking segment: {'id': 'f272c462-0e9b-4ad2-95d2-28368d50be16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'b76374f6-b383-4550-bd17-a0e476586959'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:55.823898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Network hostable DHCP agents. Network: b76374f6-b383-4550-bd17-a0e476586959, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:55.905107 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef33efe2-be31-405f-895f-1d3e54a17f9e None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:14:55.958674 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ef33efe2-be31-405f-895f-1d3e54a17f9e None None] Deleting port ec36aa8f-10c0-4732-813a-3eed2b360fc7 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:55.959130 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-427bbdf7-74ec-4793-8e70-431ed6b672f5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags HTTP/1.1" status: 204 len: 168 time: 0.1485960 Mar 24 02:14:55.963688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef33efe2-be31-405f-895f-1d3e54a17f9e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:55.964877 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58422) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:55.970891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-6f6987e1-f11d-4e25-9b07-aaa49f4a56c4 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa', 'tempest-TagsExtTest-Tag-180109688') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:56.012886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (a049e775-8bc9-44df-b042-a5520ee089cd), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.037222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ef33efe2-be31-405f-895f-1d3e54a17f9e None None] For port ec36aa8f-10c0-4732-813a-3eed2b360fc7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ec36aa8f-10c0-4732-813a-3eed2b360fc7,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:56.037607 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef33efe2-be31-405f-895f-1d3e54a17f9e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.053760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ef33efe2-be31-405f-895f-1d3e54a17f9e None None] Calling delete_port for ec36aa8f-10c0-4732-813a-3eed2b360fc7 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:56.077086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=a049e775-8bc9-44df-b042-a5520ee089cd,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:56.103660 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Checking segment: {'id': '1cdaa2a8-ca3b-4c35-a022-821fd466d793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '4d590aa3-17ed-49de-b656-2cf56cf2a079'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:56.103894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network hostable DHCP agents. Network: 4d590aa3-17ed-49de-b656-2cf56cf2a079, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:56.131647 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6f6987e1-f11d-4e25-9b07-aaa49f4a56c4 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags/tempest-TagsExtTest-Tag-180109688 HTTP/1.1" status: 201 len: 201 time: 0.1658163 Mar 24 02:14:56.134267 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58424) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.144552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-48a36d08-f842-4ead-9fc2-3ce8109c35f6 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629', 'tempest-TagsExtTest-Tag-1986622513') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:56.146185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef33efe2-be31-405f-895f-1d3e54a17f9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (ec36aa8f-10c0-4732-813a-3eed2b360fc7), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.150319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 4d590aa3-17ed-49de-b656-2cf56cf2a079 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:56.177337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef33efe2-be31-405f-895f-1d3e54a17f9e None None] Pushing event deleted for resources: {'Port': ['ID=ec36aa8f-10c0-4732-813a-3eed2b360fc7,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:56.180027 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 4d590aa3-17ed-49de-b656-2cf56cf2a079) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:56.183287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (865b7da0-660b-4753-ad39-55ce579ff27d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.186224 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:56.187081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.188415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:56.189023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.196231 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a66c7d67-34c8-4755-9638-0b3534cd11eb None None] Network 4d590aa3-17ed-49de-b656-2cf56cf2a079 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:56.204600 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f411749d-f331-4137-82da-816019cadd94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:56.206182 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f411749d-f331-4137-82da-816019cadd94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.5315208 Mar 24 02:14:56.209766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58426) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.216656 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef33efe2-be31-405f-895f-1d3e54a17f9e None None] No DVR routers for this DVR port ec36aa8f-10c0-4732-813a-3eed2b360fc7 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:14:56.230334 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7221c0c6-9d74-493b-869a-7fd7cb833f0f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6996863 Mar 24 02:14:56.234304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58428) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.239299 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': '4d590aa3-17ed-49de-b656-2cf56cf2a079', 'name': 'tempest-PortsTestJSON-800373284'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:56.266103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Network b76374f6-b383-4550-bd17-a0e476586959 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:56.288268 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.9378664 Mar 24 02:14:56.290406 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58430) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.300935 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Request body: {'subnet': {'network_id': '865b7da0-660b-4753-ad39-55ce579ff27d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:56.304262 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, b76374f6-b383-4550-bd17-a0e476586959) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:56.323990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-294a44a9-addd-492c-920f-d004ac53f012 None None] Network b76374f6-b383-4550-bd17-a0e476586959 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:56.325347 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:56.325483 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.329999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:14:56.342108 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-48a36d08-f842-4ead-9fc2-3ce8109c35f6 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags/tempest-TagsExtTest-Tag-1986622513 HTTP/1.1" status: 201 len: 201 time: 0.2038746 Mar 24 02:14:56.346563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58432) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.350620 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c24f329a-c052-4667-939b-80bea9e1ac43 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:56.354613 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c24f329a-c052-4667-939b-80bea9e1ac43 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1407044 Mar 24 02:14:56.360150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-24fdd87a-279e-41d3-9746-f062bbf21e54 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c', 'tempest-TagsExtTest-Tag-561595891') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:56.361625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58434) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.366870 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4004c2bd-46a3-4c8c-a6fa-2a30fac39227 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/3aca5599-104a-44a7-bb92-9274c219499f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4611933 Mar 24 02:14:56.373788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9dfca7c-15c8-4aa9-9283-a92e21774afb tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event updated for resources: {'Network': ['ID=865b7da0-660b-4753-ad39-55ce579ff27d,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:56.375821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58436) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.378757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0a8a969-3926-45ff-a056-7b1ea05f6404 None None] Sync routers for ids ['3aca5599-104a-44a7-bb92-9274c219499f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:14:56.391957 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-4d590aa3-17ed-49de-b656-2cf56cf2a079', 'network_id': '4d590aa3-17ed-49de-b656-2cf56cf2a079', 'project_id': '59047855c41744dd95105383d31cd553', 'fixed_ips': [{'subnet_id': 'a049e775-8bc9-44df-b042-a5520ee089cd'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:56.392866 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.403794 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 865b7da0-660b-4753-ad39-55ce579ff27d details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:14:56.435429 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-79c25ee2-4825-4d64-86e3-f458fe8c385b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.8599627 Mar 24 02:14:56.437328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58438) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.441933 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminTest-1432441407', 'network_id': 'b76374f6-b383-4550-bd17-a0e476586959'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:56.446713 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fa46a1ed-4f18-4a87-8073-5011a8e2a34c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0823171 Mar 24 02:14:56.450113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58440) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.454718 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'slaac'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:56.468388 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0a8a969-3926-45ff-a056-7b1ea05f6404 None None] Routers {'3aca5599-104a-44a7-bb92-9274c219499f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:56.468738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b0a8a969-3926-45ff-a056-7b1ea05f6404 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['3aca5599-104a-44a7-bb92-9274c219499f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:56.513247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-743ec2c8-23bb-4723-b2bb-7cbc21b2be45 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:56.517469 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-743ec2c8-23bb-4723-b2bb-7cbc21b2be45 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports/6f8aeb54-4d58-499c-9345-67f7d932f632 HTTP/1.1" status: 200 len: 911 time: 0.1326106 Mar 24 02:14:56.524860 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58442) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:56.533556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b0a8a969-3926-45ff-a056-7b1ea05f6404 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:56.545435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3da34b07-74ad-4b46-9527-cb3ee951381d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '8f09cd00-d5bb-4486-93b9-502ef7b01957'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:56.588969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Made reservation on behalf of 64fcebf53303474789f3b0a392800f49 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:56.592317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.599166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Made reservation on behalf of 65b8f224365f41ae9e617e104bd7afce for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:56.601473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.626960 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0a8a969-3926-45ff-a056-7b1ea05f6404 None None] Routers {'3aca5599-104a-44a7-bb92-9274c219499f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:14:56.627646 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b0a8a969-3926-45ff-a056-7b1ea05f6404 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:14:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['3aca5599-104a-44a7-bb92-9274c219499f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:56.673737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36458a5c-e126-4bd5-8953-71cc5ac7c640 None None] Network b76374f6-b383-4550-bd17-a0e476586959 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:56.679764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b0a8a969-3926-45ff-a056-7b1ea05f6404 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:56.680428 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0a8a969-3926-45ff-a056-7b1ea05f6404 None None] The sync data for ids ['3aca5599-104a-44a7-bb92-9274c219499f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:14:56.720450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ec36aa8f-10c0-4732-813a-3eed2b360fc7 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:14:56.732750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] device_id is not set on port b600f993-46e1-45fa-ad1d-264209782f76 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:56.789101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:56.792651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:56.919360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: ec36aa8f-10c0-4732-813a-3eed2b360fc7 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:14:56.919360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ec36aa8f-10c0-4732-813a-3eed2b360fc7 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:14:56.964399 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Allocated IP 172.20.0.2 (4d590aa3-17ed-49de-b656-2cf56cf2a079/a049e775-8bc9-44df-b042-a5520ee089cd/f8da8312-2fea-4b05-89d6-e61fb72426e0) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:56.987326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:56.991717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.013874 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port ed9f204a-67eb-414a-bb92-388c2c4319b9 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:57.048996 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Allocated IP 172.20.0.5 (b76374f6-b383-4550-bd17-a0e476586959/8ca3c91b-2add-4279-a908-10cba8e1fd3a/b600f993-46e1-45fa-ad1d-264209782f76) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:57.077564 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-24fdd87a-279e-41d3-9746-f062bbf21e54 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags/tempest-TagsExtTest-Tag-561595891 HTTP/1.1" status: 201 len: 201 time: 0.7290761 Mar 24 02:14:57.080699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58444) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:57.131524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-36b0ba01-98c7-48b6-926e-356658e6c78a tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb', 'tempest-TagsExtTest-Tag-1889524117') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:57.138137 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Publish callbacks [] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.140211 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3da34b07-74ad-4b46-9527-cb3ee951381d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.144588 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.185387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Network 4d590aa3-17ed-49de-b656-2cf56cf2a079 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:57.189540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:57.195671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (f0610870-6f1c-4e3c-b816-4ab5a7015c57), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.196059 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:57.203474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Pushing event updated for resources: {'Port': ['ID=f8da8312-2fea-4b05-89d6-e61fb72426e0,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:57.216181 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.8 (4d590aa3-17ed-49de-b656-2cf56cf2a079/a049e775-8bc9-44df-b042-a5520ee089cd/ed9f204a-67eb-414a-bb92-388c2c4319b9) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:57.262461 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Attempting to bind port f8da8312-2fea-4b05-89d6-e61fb72426e0 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:57.263252 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Attempting to bind port f8da8312-2fea-4b05-89d6-e61fb72426e0 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '1cdaa2a8-ca3b-4c35-a022-821fd466d793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '4d590aa3-17ed-49de-b656-2cf56cf2a079'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:57.263616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Attempting to bind port f8da8312-2fea-4b05-89d6-e61fb72426e0 on network 4d590aa3-17ed-49de-b656-2cf56cf2a079 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:57.269062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:57.269432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Checking segment: {'id': '1cdaa2a8-ca3b-4c35-a022-821fd466d793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '4d590aa3-17ed-49de-b656-2cf56cf2a079'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:57.269828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.270295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Bound using segment: {'id': '1cdaa2a8-ca3b-4c35-a022-821fd466d793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '4d590aa3-17ed-49de-b656-2cf56cf2a079'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:57.271273 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Bound port: f8da8312-2fea-4b05-89d6-e61fb72426e0, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1cdaa2a8-ca3b-4c35-a022-821fd466d793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '4d590aa3-17ed-49de-b656-2cf56cf2a079'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:57.271648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.344606 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] For port f8da8312-2fea-4b05-89d6-e61fb72426e0, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:57.362626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] For port f8da8312-2fea-4b05-89d6-e61fb72426e0, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8da8312-2fea-4b05-89d6-e61fb72426e0,segment=NetworkSegment(1cdaa2a8-ca3b-4c35-a022-821fd466d793),segment_id=1cdaa2a8-ca3b-4c35-a022-821fd466d793)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:57.366338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bda3ea5a-e321-476c-8e79-dca32fa25b33 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.371078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.387381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (ed9f204a-67eb-414a-bb92-388c2c4319b9), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.431325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ed9f204a-67eb-414a-bb92-388c2c4319b9), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.443140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7714b1-1531-44ab-9d73-9224e4dba531 None None] Pushing event updated for resources: {'Port': ['ID=f8da8312-2fea-4b05-89d6-e61fb72426e0,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:57.466877 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event updated for resources: {'Subnet': ['ID=f0610870-6f1c-4e3c-b816-4ab5a7015c57,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:57.483478 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-36b0ba01-98c7-48b6-926e-356658e6c78a tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags/tempest-TagsExtTest-Tag-1889524117 HTTP/1.1" status: 201 len: 201 time: 0.3789287 Mar 24 02:14:57.486715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58446) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:57.496969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-02be73da-9b0b-4d1a-9329-02aedc5cb837 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa', {'tags': ['tempest-TagsExtTest-Tag-31833390', 'tempest-TagsExtTest-Tag-1689019189', 'tempest-TagsExtTest-Tag-2105161906']}) {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:57.533379 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 4d590aa3-17ed-49de-b656-2cf56cf2a079 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:57.547714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:57.550661 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:57.559140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Checking segment: {'id': '825566a2-a114-400b-b59a-dc08809da829', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '865b7da0-660b-4753-ad39-55ce579ff27d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:57.559381 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Network hostable DHCP agents. Network: 865b7da0-660b-4753-ad39-55ce579ff27d, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:14:57.586683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=ed9f204a-67eb-414a-bb92-388c2c4319b9,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:57.619631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:57.620277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.641828 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for port (b600f993-46e1-45fa-ad1d-264209782f76), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.660194 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-02be73da-9b0b-4d1a-9329-02aedc5cb837 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags HTTP/1.1" status: 200 len: 316 time: 0.1720130 Mar 24 02:14:57.666574 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c2a62e0b-9970-4b14-97fb-bab84f0508a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 1.4304862 Mar 24 02:14:57.666574 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58448) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:57.668535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58450) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:57.678510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Network 865b7da0-660b-4753-ad39-55ce579ff27d is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:14:57.678809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-c17b77cb-57f7-4eea-9a92-9699517f70d6 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:57.709958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:14:57.739789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (3e091aad-ca94-44cc-bb67-8b401bbd94fd), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.760567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 865b7da0-660b-4753-ad39-55ce579ff27d) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:57.770291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c518e3c-6fca-47ae-8ffe-00ede2b32217 None None] Network 865b7da0-660b-4753-ad39-55ce579ff27d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:57.805069 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:57.806312 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.823904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b831d978-7a1a-465e-b49a-92b6bdd2b00e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port ed9f204a-67eb-414a-bb92-388c2c4319b9 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:57.824297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b831d978-7a1a-465e-b49a-92b6bdd2b00e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ed9f204a-67eb-414a-bb92-388c2c4319b9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.831073 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:57.845707 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:57.858214 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:57.858835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.864029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-febf9f5b-7829-46cb-a151-a015e99e135b None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:57.865917 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c17b77cb-57f7-4eea-9a92-9699517f70d6 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags HTTP/1.1" status: 204 len: 168 time: 0.1985071 Mar 24 02:14:57.868602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58452) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:57.877558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-1cd5689b-e0dc-4622-b5ee-adecc46759a5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa', 'tempest-TagsExtTest-Tag-31833390') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:57.907704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=3e091aad-ca94-44cc-bb67-8b401bbd94fd,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:57.915877 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ef785c58-9e30-4744-a017-eb6cd5616407 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6224632 Mar 24 02:14:57.919692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58454) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:57.923690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b600f993-46e1-45fa-ad1d-264209782f76), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:57.925076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-55002f6b-91e4-40dc-b1b8-325730b0de80 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Request body: {'router': {'name': 'tempest-FloatingIPNegativeTestJSON-router-525123499', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:57.970224 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-08f2b46f-1853-41be-ba99-c2c515130f33 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 824 time: 1.5167546 Mar 24 02:14:57.971563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58456) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:57.980436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:7f:63:10', 'name': 'tempest-NetworksTestDHCPv6-1398990330'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:14:57.993364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Network b76374f6-b383-4550-bd17-a0e476586959 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:57.999481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:58.003769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event updated for resources: {'Port': ['ID=b600f993-46e1-45fa-ad1d-264209782f76,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:58.008220 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:58.018670 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-865b7da0-660b-4753-ad39-55ce579ff27d', 'network_id': '865b7da0-660b-4753-ad39-55ce579ff27d', 'project_id': '64fcebf53303474789f3b0a392800f49', 'fixed_ips': [{'subnet_id': 'f0610870-6f1c-4e3c-b816-4ab5a7015c57'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:58.019525 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.041109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '3e091aad-ca94-44cc-bb67-8b401bbd94fd'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:14:58.041951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.068978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:58.069599 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.073732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b831d978-7a1a-465e-b49a-92b6bdd2b00e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ed9f204a-67eb-414a-bb92-388c2c4319b9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.084979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55002f6b-91e4-40dc-b1b8-325730b0de80 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (678fbccb-a396-494b-8300-3227f087f043), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.086020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55002f6b-91e4-40dc-b1b8-325730b0de80 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (678fbccb-a396-494b-8300-3227f087f043), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.094509 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3da34b07-74ad-4b46-9527-cb3ee951381d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.107382 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9f06a8f9-6a72-48d2-8cc2-408e68e42942 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1023 time: 1.6669497 Mar 24 02:14:58.108238 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58458) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:58.112607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b831d978-7a1a-465e-b49a-92b6bdd2b00e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for ed9f204a-67eb-414a-bb92-388c2c4319b9 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:58.119380 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3da34b07-74ad-4b46-9527-cb3ee951381d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.127450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3da34b07-74ad-4b46-9527-cb3ee951381d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:58.128348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3da34b07-74ad-4b46-9527-cb3ee951381d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.132118 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3da34b07-74ad-4b46-9527-cb3ee951381d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/ports/6f8aeb54-4d58-499c-9345-67f7d932f632 HTTP/1.1" status: 200 len: 911 time: 1.5955126 Mar 24 02:14:58.137744 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58460) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:58.148135 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:14:58.156560 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-1cd5689b-e0dc-4622-b5ee-adecc46759a5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:14:58.157577 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1cd5689b-e0dc-4622-b5ee-adecc46759a5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags/tempest-TagsExtTest-Tag-31833390 HTTP/1.1" status: 404 len: 327 time: 0.2877743 Mar 24 02:14:58.165745 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58462) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:58.176029 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-8f5ea07b-f738-48ce-bada-5f3fad420719 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa', 'tempest-TagsExtTest-Tag-1689019189') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:58.285254 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Allocated IP 172.20.0.2 (865b7da0-660b-4753-ad39-55ce579ff27d/f0610870-6f1c-4e3c-b816-4ab5a7015c57/d5b5a62a-862a-4c47-a76b-7176b3707e7c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:58.288001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Allocated IP 2001:db8::f816:3eff:fe85:50b4 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/3e091aad-ca94-44cc-bb67-8b401bbd94fd/2513840b-7a6d-4cfd-833c-8ae6b27de92e) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:58.307540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da34b07-74ad-4b46-9527-cb3ee951381d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=6f8aeb54-4d58-499c-9345-67f7d932f632,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:58.352744 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-8f5ea07b-f738-48ce-bada-5f3fad420719 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:14:58.358400 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8f5ea07b-f738-48ce-bada-5f3fad420719 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags/tempest-TagsExtTest-Tag-1689019189 HTTP/1.1" status: 404 len: 329 time: 0.1838746 Mar 24 02:14:58.358813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55002f6b-91e4-40dc-b1b8-325730b0de80 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for router_controller (678fbccb-a396-494b-8300-3227f087f043), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.359297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58464) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:58.361480 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-246ffc78-e3bf-4b35-b361-a44d1670e78a tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa', 'tempest-TagsExtTest-Tag-2105161906') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:58.376534 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55002f6b-91e4-40dc-b1b8-325730b0de80 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (678fbccb-a396-494b-8300-3227f087f043), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.388371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-4078d04e-358d-4f82-b16c-3295f07b18fa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Deleting port b600f993-46e1-45fa-ad1d-264209782f76 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:58.388371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4078d04e-358d-4f82-b16c-3295f07b18fa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b600f993-46e1-45fa-ad1d-264209782f76), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.452314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55002f6b-91e4-40dc-b1b8-325730b0de80 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.453751 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-55002f6b-91e4-40dc-b1b8-325730b0de80 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 714 time: 0.5323508 Mar 24 02:14:58.471460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58466) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:58.501850 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.589167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Publish callbacks [] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.592332 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 5dc45d46-65cf-4fb0-857d-c9895c778f96 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:14:58.615706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.622327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Publish callbacks [] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.665181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Network 865b7da0-660b-4753-ad39-55ce579ff27d is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:58.667139 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.682352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:58.695459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:58.728740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Pushing event updated for resources: {'Port': ['ID=d5b5a62a-862a-4c47-a76b-7176b3707e7c,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:58.758719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b831d978-7a1a-465e-b49a-92b6bdd2b00e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ed9f204a-67eb-414a-bb92-388c2c4319b9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.792366 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:58.795974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8da8312-2fea-4b05-89d6-e61fb72426e0 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:14:58.825967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b831d978-7a1a-465e-b49a-92b6bdd2b00e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=ed9f204a-67eb-414a-bb92-388c2c4319b9,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:58.870365 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Pushing event updated for resources: {'Port': ['ID=2513840b-7a6d-4cfd-833c-8ae6b27de92e,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:58.873495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:58.900887 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:58.924092 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Attempting to bind port d5b5a62a-862a-4c47-a76b-7176b3707e7c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:58.924457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Attempting to bind port d5b5a62a-862a-4c47-a76b-7176b3707e7c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '825566a2-a114-400b-b59a-dc08809da829', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '865b7da0-660b-4753-ad39-55ce579ff27d'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:58.924801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Attempting to bind port d5b5a62a-862a-4c47-a76b-7176b3707e7c on network 865b7da0-660b-4753-ad39-55ce579ff27d {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:58.934242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fe7f:6310 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/3e091aad-ca94-44cc-bb67-8b401bbd94fd/5dc45d46-65cf-4fb0-857d-c9895c778f96) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:14:58.940152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:58.940152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Checking segment: {'id': '825566a2-a114-400b-b59a-dc08809da829', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '865b7da0-660b-4753-ad39-55ce579ff27d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:58.940890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.941331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Bound using segment: {'id': '825566a2-a114-400b-b59a-dc08809da829', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '865b7da0-660b-4753-ad39-55ce579ff27d'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:58.941963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Bound port: d5b5a62a-862a-4c47-a76b-7176b3707e7c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '825566a2-a114-400b-b59a-dc08809da829', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '865b7da0-660b-4753-ad39-55ce579ff27d'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:58.942311 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.995240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b831d978-7a1a-465e-b49a-92b6bdd2b00e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.996608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4078d04e-358d-4f82-b16c-3295f07b18fa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b600f993-46e1-45fa-ad1d-264209782f76), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:58.998706 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b831d978-7a1a-465e-b49a-92b6bdd2b00e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/ed9f204a-67eb-414a-bb92-388c2c4319b9 HTTP/1.1" status: 204 len: 168 time: 1.3292942 Mar 24 02:14:59.001115 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2679b01-791c-457c-a876-8847a5f6b7ad None None] Network 4d590aa3-17ed-49de-b656-2cf56cf2a079 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:14:59.002948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58468) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:59.021113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-4078d04e-358d-4f82-b16c-3295f07b18fa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Calling delete_port for b600f993-46e1-45fa-ad1d-264209782f76 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:14:59.048416 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f8da8312-2fea-4b05-89d6-e61fb72426e0 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:59.049043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.066019 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-246ffc78-e3bf-4b35-b361-a44d1670e78a tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:14:59.067046 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-246ffc78-e3bf-4b35-b361-a44d1670e78a tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags/tempest-TagsExtTest-Tag-2105161906 HTTP/1.1" status: 404 len: 329 time: 0.7087579 Mar 24 02:14:59.080247 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-15fc1e7b-5527-468f-9a77-d62ff1728f3a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:14:59.080849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-15fc1e7b-5527-468f-9a77-d62ff1728f3a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:14:59.084468 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-15fc1e7b-5527-468f-9a77-d62ff1728f3a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/ed9f204a-67eb-414a-bb92-388c2c4319b9 HTTP/1.1" status: 404 len: 333 time: 0.0803945 Mar 24 02:14:59.096228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58470) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:59.096790 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58472) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:59.099953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Attempting to bind port 2513840b-7a6d-4cfd-833c-8ae6b27de92e on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:14:59.100308 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Attempting to bind port 2513840b-7a6d-4cfd-833c-8ae6b27de92e by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:14:59.100843 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Attempting to bind port 2513840b-7a6d-4cfd-833c-8ae6b27de92e on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:14:59.101944 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-001ab8c5-8702-444d-8db0-2c1f3b81cd2e tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629', {'tags': ['tempest-TagsExtTest-Tag-212276262', 'tempest-TagsExtTest-Tag-1048912772', 'tempest-TagsExtTest-Tag-2053625089']}) {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:59.137017 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:14:59.137384 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:14:59.137965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.138505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:14:59.139156 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Bound port: 2513840b-7a6d-4cfd-833c-8ae6b27de92e, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:14:59.139527 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.180305 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (3aca5599-104a-44a7-bb92-9274c219499f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.192898 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-90a77cad-23a5-48ba-abfc-6f5613d0e559 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:14:59.194328 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-90a77cad-23a5-48ba-abfc-6f5613d0e559 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/ed9f204a-67eb-414a-bb92-388c2c4319b9 HTTP/1.1" status: 404 len: 333 time: 0.0899408 Mar 24 02:14:59.199884 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58474) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:59.205071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b453c522-0d84-4dcf-8495-1e8f4ba95896 None None] Provisioning complete for port f8da8312-2fea-4b05-89d6-e61fb72426e0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:14:59.205942 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b453c522-0d84-4dcf-8495-1e8f4ba95896 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.227887 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] For port d5b5a62a-862a-4c47-a76b-7176b3707e7c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:59.262561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (5dc45d46-65cf-4fb0-857d-c9895c778f96), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.335299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-dd951a64-1b1f-4e1b-99b3-6627bd13e0e1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet a049e775-8bc9-44df-b042-a5520ee089cd {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:14:59.351990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dd951a64-1b1f-4e1b-99b3-6627bd13e0e1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (a049e775-8bc9-44df-b042-a5520ee089cd), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.358730 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-001ab8c5-8702-444d-8db0-2c1f3b81cd2e tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags HTTP/1.1" status: 200 len: 317 time: 0.2583079 Mar 24 02:14:59.363911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58476) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:59.369821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-312a1308-3ef1-43d9-84ce-a3960efa753b tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:59.372677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5dc45d46-65cf-4fb0-857d-c9895c778f96), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.407077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.439245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] For port d5b5a62a-862a-4c47-a76b-7176b3707e7c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d5b5a62a-862a-4c47-a76b-7176b3707e7c,segment=NetworkSegment(825566a2-a114-400b-b59a-dc08809da829),segment_id=825566a2-a114-400b-b59a-dc08809da829)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:59.454085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dd951a64-1b1f-4e1b-99b3-6627bd13e0e1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (a049e775-8bc9-44df-b042-a5520ee089cd), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.482926 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:14:59.484651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=5dc45d46-65cf-4fb0-857d-c9895c778f96,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:59.493209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:14:59.495106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.498818 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:14:59.504084 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:59.505216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.543425 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3061006c-e761-447b-8c54-46e32895cf37 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 1.5683901 Mar 24 02:14:59.543661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f8da8312-2fea-4b05-89d6-e61fb72426e0 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:59.543661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.544809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58478) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:59.549825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] For port 2513840b-7a6d-4cfd-833c-8ae6b27de92e, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:14:59.574354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4078d04e-358d-4f82-b16c-3295f07b18fa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b600f993-46e1-45fa-ad1d-264209782f76), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.591781 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] For port 2513840b-7a6d-4cfd-833c-8ae6b27de92e, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2513840b-7a6d-4cfd-833c-8ae6b27de92e,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:14:59.612824 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-312a1308-3ef1-43d9-84ce-a3960efa753b tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags HTTP/1.1" status: 204 len: 168 time: 0.2448587 Mar 24 02:14:59.613064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.613913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58480) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:59.622166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-69080b6b-688d-4be8-96c9-2d876da3a887 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629', 'tempest-TagsExtTest-Tag-212276262') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:59.668154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4078d04e-358d-4f82-b16c-3295f07b18fa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event deleted for resources: {'Port': ['ID=b600f993-46e1-45fa-ad1d-264209782f76,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:59.671770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port f8da8312-2fea-4b05-89d6-e61fb72426e0, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8da8312-2fea-4b05-89d6-e61fb72426e0,segment=NetworkSegment(1cdaa2a8-ca3b-4c35-a022-821fd466d793),segment_id=1cdaa2a8-ca3b-4c35-a022-821fd466d793)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:14:59.673094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa18ac10-157f-4645-ae87-0c21247394cf None None] Pushing event updated for resources: {'Port': ['ID=d5b5a62a-862a-4c47-a76b-7176b3707e7c,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:59.685475 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.729160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7260904-9aff-442d-a93a-4dfda094881c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:59.737706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7260904-9aff-442d-a93a-4dfda094881c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:14:59.743149 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a7260904-9aff-442d-a93a-4dfda094881c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.1959291 Mar 24 02:14:59.745559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58482) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:59.792229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b453c522-0d84-4dcf-8495-1e8f4ba95896 None None] Current status of the port f8da8312-2fea-4b05-89d6-e61fb72426e0 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:14:59.793037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b453c522-0d84-4dcf-8495-1e8f4ba95896 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.804963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e186c73-8b11-43b4-b187-b11a1daa0c51 None None] Pushing event updated for resources: {'Port': ['ID=2513840b-7a6d-4cfd-833c-8ae6b27de92e,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:14:59.854359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dd951a64-1b1f-4e1b-99b3-6627bd13e0e1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (a049e775-8bc9-44df-b042-a5520ee089cd), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.903005 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-69080b6b-688d-4be8-96c9-2d876da3a887 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:14:59.904311 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-69080b6b-688d-4be8-96c9-2d876da3a887 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags/tempest-TagsExtTest-Tag-212276262 HTTP/1.1" status: 404 len: 328 time: 0.2897372 Mar 24 02:14:59.908337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 6f8aeb54-4d58-499c-9345-67f7d932f632 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:14:59.908961 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:14:59.913095 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58484) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:14:59.930228 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-ce7f0f58-0857-404a-afb1-d8ae586bb6ed tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629', 'tempest-TagsExtTest-Tag-1048912772') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:14:59.958455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=f8da8312-2fea-4b05-89d6-e61fb72426e0,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:00.001648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dd951a64-1b1f-4e1b-99b3-6627bd13e0e1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (a049e775-8bc9-44df-b042-a5520ee089cd), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.009638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4078d04e-358d-4f82-b16c-3295f07b18fa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.013284 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4078d04e-358d-4f82-b16c-3295f07b18fa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "DELETE /v2.0/ports/b600f993-46e1-45fa-ad1d-264209782f76 HTTP/1.1" status: 204 len: 168 time: 1.9046013 Mar 24 02:15:00.020268 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58486) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:00.027406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'b76374f6-b383-4550-bd17-a0e476586959', 'external_fixed_ips': [{'subnet_id': '8ca3c91b-2add-4279-a908-10cba8e1fd3a', 'ip_address': '172.20.0.5'}]}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:00.076254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd951a64-1b1f-4e1b-99b3-6627bd13e0e1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=a049e775-8bc9-44df-b042-a5520ee089cd,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:00.084462 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dd951a64-1b1f-4e1b-99b3-6627bd13e0e1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.085598 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-b453c522-0d84-4dcf-8495-1e8f4ba95896 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:15:00.086081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-b453c522-0d84-4dcf-8495-1e8f4ba95896 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:15:00.091105 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dd951a64-1b1f-4e1b-99b3-6627bd13e0e1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/a049e775-8bc9-44df-b042-a5520ee089cd HTTP/1.1" status: 204 len: 168 time: 0.8875914 Mar 24 02:15:00.095333 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58488) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:00.131509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c7a4ba30-0252-4e4b-b121-5fea7de0e2a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 5dc45d46-65cf-4fb0-857d-c9895c778f96 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:00.132624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7a4ba30-0252-4e4b-b121-5fea7de0e2a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5dc45d46-65cf-4fb0-857d-c9895c778f96), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.169398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45475eff-f7fb-4ad6-afff-ea043c9a3782 None None] Network 4d590aa3-17ed-49de-b656-2cf56cf2a079 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:00.198553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Allocated IP 172.20.0.1 (865b7da0-660b-4753-ad39-55ce579ff27d/f0610870-6f1c-4e3c-b816-4ab5a7015c57/843012a6-d00d-477a-8a59-ac34faaf055b) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:00.209574 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (8c66df04-ea2e-4348-b7a8-b59203f4446e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.214467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (8c66df04-ea2e-4348-b7a8-b59203f4446e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.225368 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.230739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (4d590aa3-17ed-49de-b656-2cf56cf2a079), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.261614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 6f8aeb54-4d58-499c-9345-67f7d932f632 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:00.293814 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-ce7f0f58-0857-404a-afb1-d8ae586bb6ed tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:15:00.295224 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ce7f0f58-0857-404a-afb1-d8ae586bb6ed tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags/tempest-TagsExtTest-Tag-1048912772 HTTP/1.1" status: 404 len: 329 time: 0.3801632 Mar 24 02:15:00.303563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58490) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:00.312565 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-9da89ec5-2c2b-4d0c-bd9d-2973138fbd96 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629', 'tempest-TagsExtTest-Tag-2053625089') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:00.402781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_controller (8c66df04-ea2e-4348-b7a8-b59203f4446e), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.404842 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7a4ba30-0252-4e4b-b121-5fea7de0e2a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5dc45d46-65cf-4fb0-857d-c9895c778f96), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.429927 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec2bf660-17b7-4c57-8862-b53a0fefe330 None None] DHCP port deletion for 4d590aa3-17ed-49de-b656-2cf56cf2a079 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:00.437515 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for port (843012a6-d00d-477a-8a59-ac34faaf055b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.455833 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-9da89ec5-2c2b-4d0c-bd9d-2973138fbd96 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:15:00.459039 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9da89ec5-2c2b-4d0c-bd9d-2973138fbd96 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags/tempest-TagsExtTest-Tag-2053625089 HTTP/1.1" status: 404 len: 329 time: 0.1501920 Mar 24 02:15:00.460335 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58492) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:00.467252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-252867c9-788f-4a44-9f76-aa79903c1183 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c', {'tags': ['tempest-TagsExtTest-Tag-733838570', 'tempest-TagsExtTest-Tag-989824660', 'tempest-TagsExtTest-Tag-1016718862']}) {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:00.492420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c7a4ba30-0252-4e4b-b121-5fea7de0e2a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 5dc45d46-65cf-4fb0-857d-c9895c778f96 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:00.507296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c13db3ca-f1aa-4a13-9fa9-6e4a7559474c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.507837 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port f8da8312-2fea-4b05-89d6-e61fb72426e0 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:00.508184 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.533267 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ec2bf660-17b7-4c57-8862-b53a0fefe330 None None] Deleting port f8da8312-2fea-4b05-89d6-e61fb72426e0 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:00.533641 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ec2bf660-17b7-4c57-8862-b53a0fefe330 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.626869 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ec2bf660-17b7-4c57-8862-b53a0fefe330 None None] For port f8da8312-2fea-4b05-89d6-e61fb72426e0, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8da8312-2fea-4b05-89d6-e61fb72426e0,segment=NetworkSegment(1cdaa2a8-ca3b-4c35-a022-821fd466d793),segment_id=1cdaa2a8-ca3b-4c35-a022-821fd466d793)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:00.627726 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ec2bf660-17b7-4c57-8862-b53a0fefe330 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.635854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] For port f8da8312-2fea-4b05-89d6-e61fb72426e0, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8da8312-2fea-4b05-89d6-e61fb72426e0,segment=NetworkSegment(1cdaa2a8-ca3b-4c35-a022-821fd466d793),segment_id=1cdaa2a8-ca3b-4c35-a022-821fd466d793)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:00.636214 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.640429 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-252867c9-788f-4a44-9f76-aa79903c1183 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags HTTP/1.1" status: 200 len: 316 time: 0.1790767 Mar 24 02:15:00.647167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58494) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:00.649623 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (843012a6-d00d-477a-8a59-ac34faaf055b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.654295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-69498790-fa20-4081-96e4-4a04c26a2b14 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:00.658182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ec2bf660-17b7-4c57-8862-b53a0fefe330 None None] Calling delete_port for f8da8312-2fea-4b05-89d6-e61fb72426e0 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:00.671497 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for f8da8312-2fea-4b05-89d6-e61fb72426e0 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:00.685311 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (8c66df04-ea2e-4348-b7a8-b59203f4446e), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.733566 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b453c522-0d84-4dcf-8495-1e8f4ba95896 None None] Current status of the port f8da8312-2fea-4b05-89d6-e61fb72426e0 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:00.749835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Network 865b7da0-660b-4753-ad39-55ce579ff27d is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:00.791390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ec2bf660-17b7-4c57-8862-b53a0fefe330 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.822736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:00.822736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:00.837685 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec2bf660-17b7-4c57-8862-b53a0fefe330 None None] Pushing event deleted for resources: {'Port': ['ID=f8da8312-2fea-4b05-89d6-e61fb72426e0,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:00.865909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-45aeed52-c6e5-4e83-b5d7-e0812522cd68 None None] Could not find standard attr ID for object f8da8312-2fea-4b05-89d6-e61fb72426e0. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:00.870793 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec2bf660-17b7-4c57-8862-b53a0fefe330 None None] No DVR routers for this DVR port f8da8312-2fea-4b05-89d6-e61fb72426e0 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:00.881185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.906103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2513840b-7a6d-4cfd-833c-8ae6b27de92e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:00.958999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event updated for resources: {'Port': ['ID=843012a6-d00d-477a-8a59-ac34faaf055b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:00.980993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 2513840b-7a6d-4cfd-833c-8ae6b27de92e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:00.984342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:00.995709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (678fbccb-a396-494b-8300-3227f087f043), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.082231 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-69498790-fa20-4081-96e4-4a04c26a2b14 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags HTTP/1.1" status: 204 len: 168 time: 0.4313695 Mar 24 02:15:01.082231 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (f8da8312-2fea-4b05-89d6-e61fb72426e0), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.085783 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58496) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:01.093001 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-8908ef38-f84a-4e25-8e43-654a1e876d37 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c', 'tempest-TagsExtTest-Tag-733838570') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:01.101887 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2513840b-7a6d-4cfd-833c-8ae6b27de92e is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:01.102535 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.142937 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 2513840b-7a6d-4cfd-833c-8ae6b27de92e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2513840b-7a6d-4cfd-833c-8ae6b27de92e,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:01.149145 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.151028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d5b5a62a-862a-4c47-a76b-7176b3707e7c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:01.184483 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=f8da8312-2fea-4b05-89d6-e61fb72426e0,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:01.229714 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No DVR routers for this DVR port f8da8312-2fea-4b05-89d6-e61fb72426e0 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:01.267448 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=2513840b-7a6d-4cfd-833c-8ae6b27de92e,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:01.282556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d5b5a62a-862a-4c47-a76b-7176b3707e7c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:01.282919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.343206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (4d590aa3-17ed-49de-b656-2cf56cf2a079), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.349686 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (6f8aeb54-4d58-499c-9345-67f7d932f632), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.382277 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4d590aa3-17ed-49de-b656-2cf56cf2a079']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:01.390472 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d5b5a62a-862a-4c47-a76b-7176b3707e7c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:01.390910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.394447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1cdaa2a8-ca3b-4c35-a022-821fd466d793') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:01.394708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1cdaa2a8-ca3b-4c35-a022-821fd466d793') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:01.403063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=6f8aeb54-4d58-499c-9345-67f7d932f632,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:01.405933 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7a4ba30-0252-4e4b-b121-5fea7de0e2a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5dc45d46-65cf-4fb0-857d-c9895c778f96), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.432565 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (1cdaa2a8-ca3b-4c35-a022-821fd466d793), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.458759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1cdaa2a8-ca3b-4c35-a022-821fd466d793), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.464246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d5b5a62a-862a-4c47-a76b-7176b3707e7c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d5b5a62a-862a-4c47-a76b-7176b3707e7c,segment=NetworkSegment(825566a2-a114-400b-b59a-dc08809da829),segment_id=825566a2-a114-400b-b59a-dc08809da829)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:01.469219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.469433 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a4ba30-0252-4e4b-b121-5fea7de0e2a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=5dc45d46-65cf-4fb0-857d-c9895c778f96,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:01.486770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Releasing vlan 137 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:15:01.487176 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (1cdaa2a8-ca3b-4c35-a022-821fd466d793), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.538803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d5b5a62a-862a-4c47-a76b-7176b3707e7c,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:15:01.544971 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:15:01.572303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8da8312-2fea-4b05-89d6-e61fb72426e0 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:01.590254 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-8908ef38-f84a-4e25-8e43-654a1e876d37 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:15:01.594819 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8908ef38-f84a-4e25-8e43-654a1e876d37 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags/tempest-TagsExtTest-Tag-733838570 HTTP/1.1" status: 404 len: 328 time: 0.5034547 Mar 24 02:15:01.599588 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58498) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:01.610105 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: f8da8312-2fea-4b05-89d6-e61fb72426e0 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:01.611506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8da8312-2fea-4b05-89d6-e61fb72426e0 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:01.612124 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-f63a291b-83b6-4761-9d24-8acdb17b6999 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c', 'tempest-TagsExtTest-Tag-989824660') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:01.642083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7a4ba30-0252-4e4b-b121-5fea7de0e2a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.645708 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c7a4ba30-0252-4e4b-b121-5fea7de0e2a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/5dc45d46-65cf-4fb0-857d-c9895c778f96 HTTP/1.1" status: 204 len: 168 time: 1.9006350 Mar 24 02:15:01.653168 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58500) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:01.700736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (3aca5599-104a-44a7-bb92-9274c219499f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.711228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3d37c9b2-c77c-4e96-b189-bc4f67d9b9e1 None None] Provisioning complete for port 2513840b-7a6d-4cfd-833c-8ae6b27de92e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:01.711638 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3d37c9b2-c77c-4e96-b189-bc4f67d9b9e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:01.853169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9800cab-6b8d-4267-ad4a-9bfd087da3e9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:01.855962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9800cab-6b8d-4267-ad4a-9bfd087da3e9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:01.859281 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d9800cab-6b8d-4267-ad4a-9bfd087da3e9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1454 time: 0.2028255 Mar 24 02:15:01.861056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3d37c9b2-c77c-4e96-b189-bc4f67d9b9e1 None None] Current status of the port 2513840b-7a6d-4cfd-833c-8ae6b27de92e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:01.863382 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f78fba81-79fc-49c2-9b91-e35fb1801ea4 None None] Network 865b7da0-660b-4753-ad39-55ce579ff27d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:01.866302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58502) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:01.993109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f5fe6952-da76-49fa-af55-bc46a2d2d99b None None] Provisioning complete for port d5b5a62a-862a-4c47-a76b-7176b3707e7c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:01.993858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f5fe6952-da76-49fa-af55-bc46a2d2d99b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.041356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (4d590aa3-17ed-49de-b656-2cf56cf2a079), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.054961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.061537 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/networks/4d590aa3-17ed-49de-b656-2cf56cf2a079 HTTP/1.1" status: 204 len: 168 time: 1.9615307 Mar 24 02:15:02.071278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58504) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:02.078463 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-299508886'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:02.081707 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b843cb-c120-44dc-b160-0d2b3c21cb0d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Network': ['ID=4d590aa3-17ed-49de-b656-2cf56cf2a079,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:02.099888 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f5fe6952-da76-49fa-af55-bc46a2d2d99b None None] Current status of the port d5b5a62a-862a-4c47-a76b-7176b3707e7c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:02.140646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (843012a6-d00d-477a-8a59-ac34faaf055b), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.147843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-8c48f62f-0c71-4094-aa91-84913f2e7caf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 3e091aad-ca94-44cc-bb67-8b401bbd94fd {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:02.158910 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-f63a291b-83b6-4761-9d24-8acdb17b6999 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:15:02.159486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8c48f62f-0c71-4094-aa91-84913f2e7caf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (3e091aad-ca94-44cc-bb67-8b401bbd94fd), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.163757 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f63a291b-83b6-4761-9d24-8acdb17b6999 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags/tempest-TagsExtTest-Tag-989824660 HTTP/1.1" status: 404 len: 328 time: 0.5627716 Mar 24 02:15:02.164652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58506) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:02.168456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:02.171964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.181709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-4932dc2d-b1f2-4214-ba25-74747c5e41a5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c', 'tempest-TagsExtTest-Tag-1016718862') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:02.214772 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-75f9a766-fd6f-4f5f-bfde-3475edf0ce34 None None] Could not find standard attr ID for object 5dc45d46-65cf-4fb0-857d-c9895c778f96. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:02.269270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (8c66df04-ea2e-4348-b7a8-b59203f4446e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.279555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 105} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:02.319193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (8e190789-98fa-4cc3-9981-803d5127bf6d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.319541 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Added segment 8e190789-98fa-4cc3-9981-803d5127bf6d of type vlan for network 45362ce7-a285-4da1-9701-694b323ee056 Mar 24 02:15:02.323508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router 3aca5599-104a-44a7-bb92-9274c219499f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:02.332219 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.349460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8c48f62f-0c71-4094-aa91-84913f2e7caf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (3e091aad-ca94-44cc-bb67-8b401bbd94fd), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.385614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (45362ce7-a285-4da1-9701-694b323ee056), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.392468 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.436247 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ef9dc438-d8f9-4cf2-b17f-9d165e3771ec None None] Provisioning complete for port d5b5a62a-862a-4c47-a76b-7176b3707e7c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:02.438045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef9dc438-d8f9-4cf2-b17f-9d165e3771ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.478402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (45362ce7-a285-4da1-9701-694b323ee056), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.487136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:02.487776 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.538507 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ef9dc438-d8f9-4cf2-b17f-9d165e3771ec None None] Current status of the port d5b5a62a-862a-4c47-a76b-7176b3707e7c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:02.551129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ef9dc438-d8f9-4cf2-b17f-9d165e3771ec None None] Provisioning complete for port 843012a6-d00d-477a-8a59-ac34faaf055b triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:02.551915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef9dc438-d8f9-4cf2-b17f-9d165e3771ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (843012a6-d00d-477a-8a59-ac34faaf055b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.576569 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.5041902 Mar 24 02:15:02.583707 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58508) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:02.588975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': '45362ce7-a285-4da1-9701-694b323ee056', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:02.599538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ef9dc438-d8f9-4cf2-b17f-9d165e3771ec None None] Port 843012a6-d00d-477a-8a59-ac34faaf055b cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:02.672999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2513840b-7a6d-4cfd-833c-8ae6b27de92e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:02.682494 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb010559-036b-4555-82e9-824730c275d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Network': ['ID=45362ce7-a285-4da1-9701-694b323ee056,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:02.721213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for port (843012a6-d00d-477a-8a59-ac34faaf055b), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.731153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 45362ce7-a285-4da1-9701-694b323ee056 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:02.733198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (843012a6-d00d-477a-8a59-ac34faaf055b), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.744591 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-4932dc2d-b1f2-4214-ba25-74747c5e41a5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:15:02.748480 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4932dc2d-b1f2-4214-ba25-74747c5e41a5 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags/tempest-TagsExtTest-Tag-1016718862 HTTP/1.1" status: 404 len: 329 time: 0.5706320 Mar 24 02:15:02.749051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58510) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:02.764421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:02.767818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.781098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-82707bb1-4931-4e4b-9965-93f6fe22d773 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb', {'tags': ['tempest-TagsExtTest-Tag-271276484', 'tempest-TagsExtTest-Tag-146972426', 'tempest-TagsExtTest-Tag-341530566']}) {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:02.794567 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b566e873-ec2e-4347-8ef3-599f114b7f18 None None] Provisioning complete for port 843012a6-d00d-477a-8a59-ac34faaf055b triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:02.795449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b566e873-ec2e-4347-8ef3-599f114b7f18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (843012a6-d00d-477a-8a59-ac34faaf055b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.817171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:02.822736 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-aaa8ded4-87c4-47a7-b529-9b5044ee13e4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/3aca5599-104a-44a7-bb92-9274c219499f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6840024 Mar 24 02:15:02.830153 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21c1cbc5-34fb-4270-8b94-0235367deba8 None None] Sync routers for ids ['3aca5599-104a-44a7-bb92-9274c219499f'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:02.837722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 2513840b-7a6d-4cfd-833c-8ae6b27de92e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:02.838096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.839125 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58512) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:02.840062 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21c1cbc5-34fb-4270-8b94-0235367deba8 None None] Routers {'3aca5599-104a-44a7-bb92-9274c219499f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:02.841585 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-21c1cbc5-34fb-4270-8b94-0235367deba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['3aca5599-104a-44a7-bb92-9274c219499f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:02.872090 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b566e873-ec2e-4347-8ef3-599f114b7f18 None None] Port 843012a6-d00d-477a-8a59-ac34faaf055b cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:02.888767 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-21c1cbc5-34fb-4270-8b94-0235367deba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:02.889016 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8f214be9-95a0-4de7-a0a3-8732d1d8f8c7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=3aca5599-104a-44a7-bb92-9274c219499f HTTP/1.1" status: 200 len: 205 time: 0.0468533 Mar 24 02:15:02.898954 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21c1cbc5-34fb-4270-8b94-0235367deba8 None None] Routers {'3aca5599-104a-44a7-bb92-9274c219499f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:02.899821 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-21c1cbc5-34fb-4270-8b94-0235367deba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['3aca5599-104a-44a7-bb92-9274c219499f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:02.901921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58514) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:02.910691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (678fbccb-a396-494b-8300-3227f087f043), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.916874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event updated for resources: {'Port': ['ID=843012a6-d00d-477a-8a59-ac34faaf055b,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:02.944273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8c48f62f-0c71-4094-aa91-84913f2e7caf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (3e091aad-ca94-44cc-bb67-8b401bbd94fd), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:02.945470 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-21c1cbc5-34fb-4270-8b94-0235367deba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:02.946327 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21c1cbc5-34fb-4270-8b94-0235367deba8 None None] The sync data for ids ['3aca5599-104a-44a7-bb92-9274c219499f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:02.949836 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2513840b-7a6d-4cfd-833c-8ae6b27de92e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:02.951186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d5b5a62a-862a-4c47-a76b-7176b3707e7c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:02.973993 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Allocated IP 172.20.0.5 (b76374f6-b383-4550-bd17-a0e476586959/8ca3c91b-2add-4279-a908-10cba8e1fd3a/2f062d24-adc3-4651-9895-52fcff291849) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:02.998230 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-82707bb1-4931-4e4b-9965-93f6fe22d773 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "PUT /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags HTTP/1.1" status: 200 len: 315 time: 0.2213314 Mar 24 02:15:03.003363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58516) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:03.003714 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d5b5a62a-862a-4c47-a76b-7176b3707e7c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:03.004164 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.010122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-62acaf07-8041-4533-8aca-373a8ebdbe5e tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:03.060488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8baf1f2-0dca-4b12-bf07-91ae2f99e403 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (3aca5599-104a-44a7-bb92-9274c219499f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.102478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d5b5a62a-862a-4c47-a76b-7176b3707e7c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:03.113921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8c48f62f-0c71-4094-aa91-84913f2e7caf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (3e091aad-ca94-44cc-bb67-8b401bbd94fd), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.156390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c48f62f-0c71-4094-aa91-84913f2e7caf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=3e091aad-ca94-44cc-bb67-8b401bbd94fd,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:03.168252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8c48f62f-0c71-4094-aa91-84913f2e7caf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.173864 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8c48f62f-0c71-4094-aa91-84913f2e7caf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/3e091aad-ca94-44cc-bb67-8b401bbd94fd HTTP/1.1" status: 204 len: 168 time: 1.3005161 Mar 24 02:15:03.173864 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-62acaf07-8041-4533-8aca-373a8ebdbe5e tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags HTTP/1.1" status: 204 len: 168 time: 0.1664820 Mar 24 02:15:03.174729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c405adf7-4fad-44c7-a195-3fcc1b07c8b7 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:03.176033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58518) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:03.176405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58520) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:03.186228 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-6e5b50af-3027-486b-9ffa-d88a178722e9 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb', 'tempest-TagsExtTest-Tag-271276484') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:03.240744 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7c1f2bb2-59d3-4d03-ae97-ce07764ca382 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0605772 Mar 24 02:15:03.245169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for port (2f062d24-adc3-4651-9895-52fcff291849), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.246308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58522) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:03.251157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:03.317894 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-6e5b50af-3027-486b-9ffa-d88a178722e9 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:15:03.321264 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6e5b50af-3027-486b-9ffa-d88a178722e9 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags/tempest-TagsExtTest-Tag-271276484 HTTP/1.1" status: 404 len: 328 time: 0.1363974 Mar 24 02:15:03.321460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8baf1f2-0dca-4b12-bf07-91ae2f99e403 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (3aca5599-104a-44a7-bb92-9274c219499f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.322166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Network 865b7da0-660b-4753-ad39-55ce579ff27d is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:03.322951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58524) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:03.324056 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8baf1f2-0dca-4b12-bf07-91ae2f99e403 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (3aca5599-104a-44a7-bb92-9274c219499f), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.333616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-30747333-a6cd-4940-be4c-8b03ce9daa49 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb', 'tempest-TagsExtTest-Tag-146972426') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:03.339786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:03.372062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (2f062d24-adc3-4651-9895-52fcff291849), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.376039 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f01577fa-347f-47b1-973c-a5dd02b89f66 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:03.380158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:03.383632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.465312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Network b76374f6-b383-4550-bd17-a0e476586959 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:03.470195 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8baf1f2-0dca-4b12-bf07-91ae2f99e403 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (3aca5599-104a-44a7-bb92-9274c219499f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.470858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8baf1f2-0dca-4b12-bf07-91ae2f99e403 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Fanout notify agent at l3_agent the message router_deleted on router 3aca5599-104a-44a7-bb92-9274c219499f {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:15:03.471995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:03.478221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f01577fa-347f-47b1-973c-a5dd02b89f66 None None] Deleting port 2513840b-7a6d-4cfd-833c-8ae6b27de92e {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:03.479036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f01577fa-347f-47b1-973c-a5dd02b89f66 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.480425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:03.512494 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8baf1f2-0dca-4b12-bf07-91ae2f99e403 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.513608 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a8baf1f2-0dca-4b12-bf07-91ae2f99e403 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/3aca5599-104a-44a7-bb92-9274c219499f HTTP/1.1" status: 204 len: 168 time: 0.6107128 Mar 24 02:15:03.517063 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-30747333-a6cd-4940-be4c-8b03ce9daa49 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:15:03.517250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event updated for resources: {'Port': ['ID=2f062d24-adc3-4651-9895-52fcff291849,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:03.518095 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-30747333-a6cd-4940-be4c-8b03ce9daa49 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags/tempest-TagsExtTest-Tag-146972426 HTTP/1.1" status: 404 len: 328 time: 0.1891971 Mar 24 02:15:03.519158 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (16dd5a29-c454-424a-849c-aefd975b27bd), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.521739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58526) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:03.521739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58528) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:03.553169 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-53612f2a-6b0a-4466-8e64-3cb2f56794d4 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb', 'tempest-TagsExtTest-Tag-341530566') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:03.581236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f01577fa-347f-47b1-973c-a5dd02b89f66 None None] For port 2513840b-7a6d-4cfd-833c-8ae6b27de92e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2513840b-7a6d-4cfd-833c-8ae6b27de92e,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:03.581990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f01577fa-347f-47b1-973c-a5dd02b89f66 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.609084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f01577fa-347f-47b1-973c-a5dd02b89f66 None None] Calling delete_port for 2513840b-7a6d-4cfd-833c-8ae6b27de92e owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:03.680781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=16dd5a29-c454-424a-849c-aefd975b27bd,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:03.689336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-31f7ed7a-735c-4954-bea1-88338b57f900 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting subnet 8f09cd00-d5bb-4486-93b9-502ef7b01957 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:03.691745 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-53612f2a-6b0a-4466-8e64-3cb2f56794d4 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] show failed (client error): The resource could not be found. Mar 24 02:15:03.696387 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-53612f2a-6b0a-4466-8e64-3cb2f56794d4 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags/tempest-TagsExtTest-Tag-341530566 HTTP/1.1" status: 404 len: 328 time: 0.1443138 Mar 24 02:15:03.698731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58530) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:03.703044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-ff638ee2-acab-45b4-9cb9-8e20eac69788 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '2f3dec41-c0d7-466b-9528-7c678bf536bb') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:03.704502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31f7ed7a-735c-4954-bea1-88338b57f900 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (8f09cd00-d5bb-4486-93b9-502ef7b01957), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.750217 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.755549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Checking segment: {'id': '8e190789-98fa-4cc3-9981-803d5127bf6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '45362ce7-a285-4da1-9701-694b323ee056'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:03.755926 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network hostable DHCP agents. Network: 45362ce7-a285-4da1-9701-694b323ee056, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:03.760947 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c01ce0c3-d70c-4283-873b-bffa9e1c3ab8 None None] Provisioning complete for port 843012a6-d00d-477a-8a59-ac34faaf055b triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:03.761460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c01ce0c3-d70c-4283-873b-bffa9e1c3ab8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (843012a6-d00d-477a-8a59-ac34faaf055b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.772412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31f7ed7a-735c-4954-bea1-88338b57f900 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (8f09cd00-d5bb-4486-93b9-502ef7b01957), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.790390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f01577fa-347f-47b1-973c-a5dd02b89f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (2513840b-7a6d-4cfd-833c-8ae6b27de92e), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.819574 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 45362ce7-a285-4da1-9701-694b323ee056 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:03.821734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Router 678fbccb-a396-494b-8300-3227f087f043 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:15:03.836857 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f01577fa-347f-47b1-973c-a5dd02b89f66 None None] No DVR routers for this DVR port 2513840b-7a6d-4cfd-833c-8ae6b27de92e on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:03.836857 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f01577fa-347f-47b1-973c-a5dd02b89f66 None None] Pushing event deleted for resources: {'Port': ['ID=2513840b-7a6d-4cfd-833c-8ae6b27de92e,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:03.847667 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ff638ee2-acab-45b4-9cb9-8e20eac69788 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb/tags HTTP/1.1" status: 204 len: 168 time: 0.1460085 Mar 24 02:15:03.848726 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c01ce0c3-d70c-4283-873b-bffa9e1c3ab8 None None] Port 843012a6-d00d-477a-8a59-ac34faaf055b cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:03.852085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58532) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:03.862668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-814daeef-b3ca-40dc-af57-dc65e23803ef tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'c1552e39-333b-4715-a11d-0de0485b308c') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:03.899150 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 45362ce7-a285-4da1-9701-694b323ee056) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:03.912323 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56189c80-c25b-4b80-9898-69e0c4217ac7 None None] Network 45362ce7-a285-4da1-9701-694b323ee056 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:03.931354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:15:03.934468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (6d5bc392-754c-4d1a-b6fb-be5a9dd1e536), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.939992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (8c66df04-ea2e-4348-b7a8-b59203f4446e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:03.974373 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:03.975001 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.026360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-45362ce7-a285-4da1-9701-694b323ee056', 'network_id': '45362ce7-a285-4da1-9701-694b323ee056', 'project_id': '59047855c41744dd95105383d31cd553', 'fixed_ips': [{'subnet_id': '16dd5a29-c454-424a-849c-aefd975b27bd'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:04.027888 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.040081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:04.050223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:04.058915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:04.059708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.065074 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abdd9d1c-9d5e-486a-846c-3d9bd5de2a91 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:04.069158 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6ff76d61-6652-4d19-90d1-6e71f1d97526 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4843557 Mar 24 02:15:04.072573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58534) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:04.077635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': '45362ce7-a285-4da1-9701-694b323ee056', 'security_groups': [], 'name': 'tempest-PortsTestJSON-1918788643'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:04.080619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=6d5bc392-754c-4d1a-b6fb-be5a9dd1e536,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:04.105919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31f7ed7a-735c-4954-bea1-88338b57f900 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (8f09cd00-d5bb-4486-93b9-502ef7b01957), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.109010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:04.118230 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-114e8ace-e78e-42d8-a736-48ab1f23bfde tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "PUT /v2.0/routers/678fbccb-a396-494b-8300-3227f087f043/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.6414628 Mar 24 02:15:04.129941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58536) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:04.149177 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-814daeef-b3ca-40dc-af57-dc65e23803ef tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c/tags HTTP/1.1" status: 204 len: 168 time: 0.2924230 Mar 24 02:15:04.156097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58538) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:04.158904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61f5141a-fdbb-4d03-a4da-a6f40c192bc1 None None] Sync routers for ids ['678fbccb-a396-494b-8300-3227f087f043'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:04.164992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-3c2db99e-e817-48d7-a4f6-f0bbe5ac98be tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'fd481460-0ec4-4fb5-8f6d-7cd94f9a7629') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:04.215733 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61f5141a-fdbb-4d03-a4da-a6f40c192bc1 None None] Routers {'678fbccb-a396-494b-8300-3227f087f043'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:04.216383 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-61f5141a-fdbb-4d03-a4da-a6f40c192bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['678fbccb-a396-494b-8300-3227f087f043'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:04.240688 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31f7ed7a-735c-4954-bea1-88338b57f900 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (8f09cd00-d5bb-4486-93b9-502ef7b01957), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.282123 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-61f5141a-fdbb-4d03-a4da-a6f40c192bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:04.282354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31f7ed7a-735c-4954-bea1-88338b57f900 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Subnet': ['ID=8f09cd00-d5bb-4486-93b9-502ef7b01957,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:04.289152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-31f7ed7a-735c-4954-bea1-88338b57f900 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.297204 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-31f7ed7a-735c-4954-bea1-88338b57f900 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/8f09cd00-d5bb-4486-93b9-502ef7b01957 HTTP/1.1" status: 204 len: 168 time: 0.7638457 Mar 24 02:15:04.298740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58540) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:04.312462 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3c2db99e-e817-48d7-a4f6-f0bbe5ac98be tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629/tags HTTP/1.1" status: 204 len: 168 time: 0.1518981 Mar 24 02:15:04.312462 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58542) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:04.316246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-544e6097-b376-43a8-a234-70ffdb914caa tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '3a5facc4-fdf7-4c83-b38e-71e5119554fa') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:04.318642 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2932cf11-5a0c-4e4e-a342-d403d6ac3253 None None] Network ab372b63-e00c-4c6b-960a-f947e3e6d92b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:04.369886 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '6d5bc392-754c-4d1a-b6fb-be5a9dd1e536'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:04.370770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.392270 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61f5141a-fdbb-4d03-a4da-a6f40c192bc1 None None] Routers {'678fbccb-a396-494b-8300-3227f087f043'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:04.392964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-61f5141a-fdbb-4d03-a4da-a6f40c192bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['678fbccb-a396-494b-8300-3227f087f043'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:04.416325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (ab372b63-e00c-4c6b-960a-f947e3e6d92b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.440548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Allocated IP 172.20.0.2 (45362ce7-a285-4da1-9701-694b323ee056/16dd5a29-c454-424a-849c-aefd975b27bd/949c051e-3800-4a8e-b53a-ab4c86451a71) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:04.449631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-61f5141a-fdbb-4d03-a4da-a6f40c192bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:04.450257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61f5141a-fdbb-4d03-a4da-a6f40c192bc1 None None] The sync data for ids ['678fbccb-a396-494b-8300-3227f087f043'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:04.468786 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-544e6097-b376-43a8-a234-70ffdb914caa tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa/tags HTTP/1.1" status: 204 len: 168 time: 0.1503677 Mar 24 02:15:04.469087 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58544) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:04.485076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Request body: {'port': {'network_id': '865b7da0-660b-4753-ad39-55ce579ff27d', 'name': 'tempest-FloatingIPNegativeTestJSON-336025300'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:04.499332 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7463b81c-2d70-4e57-ab4f-41cb4d5638ae tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 1.2519345 Mar 24 02:15:04.503712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58546) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:04.509370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:d5:ae:0e', 'name': 'tempest-NetworksTestDHCPv6-697359606'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:04.641435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 97bd1dc6-1eff-4e82-b2e6-8901925388ce {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:04.641773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.663198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9584c562-ef91-4c58-ae3b-fef28c637302 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for subnetpool (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.666754 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9584c562-ef91-4c58-ae3b-fef28c637302 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnetpools/2f3dec41-c0d7-466b-9528-7c678bf536bb HTTP/1.1" status: 204 len: 168 time: 0.1943424 Mar 24 02:15:04.670180 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58548) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:04.728168 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-77d24a13-cef5-4f79-b8b3-2cc112d67ba2 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "GET /v2.0/ports?device_id=c1552e39-333b-4715-a11d-0de0485b308c HTTP/1.1" status: 200 len: 205 time: 0.0491798 Mar 24 02:15:04.734287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58550) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:04.735727 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2513840b-7a6d-4cfd-833c-8ae6b27de92e no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:04.779805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 2513840b-7a6d-4cfd-833c-8ae6b27de92e {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:04.780207 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2513840b-7a6d-4cfd-833c-8ae6b27de92e not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:04.819207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b8f2be8-8444-45e4-bb1c-c75a5de1e551 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for router (c1552e39-333b-4715-a11d-0de0485b308c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:04.883735 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Allocated IP 2001:db8::f816:3eff:feb7:1fb0 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/6d5bc392-754c-4d1a-b6fb-be5a9dd1e536/033d328c-c7b2-479c-b1da-0f8e4b4d8aa1) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:04.982822 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] DHCP port deletion for ab372b63-e00c-4c6b-960a-f947e3e6d92b request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:04.989483 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Publish callbacks [] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.007984 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.034507 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port 97bd1dc6-1eff-4e82-b2e6-8901925388ce, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=97bd1dc6-1eff-4e82-b2e6-8901925388ce,segment=NetworkSegment(7c9caef7-9e27-4e66-816e-a8c02d3397bc),segment_id=7c9caef7-9e27-4e66-816e-a8c02d3397bc)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:05.034941 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.052541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 97bd1dc6-1eff-4e82-b2e6-8901925388ce owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:05.054748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:05.084288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b8f2be8-8444-45e4-bb1c-c75a5de1e551 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (c1552e39-333b-4715-a11d-0de0485b308c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.088829 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b8f2be8-8444-45e4-bb1c-c75a5de1e551 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for router_controller (c1552e39-333b-4715-a11d-0de0485b308c), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.097813 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Network 45362ce7-a285-4da1-9701-694b323ee056 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:05.104335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:05.106412 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:05.108222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.110050 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:05.139545 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Pushing event updated for resources: {'Port': ['ID=949c051e-3800-4a8e-b53a-ab4c86451a71,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:05.177913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (8c66df04-ea2e-4348-b7a8-b59203f4446e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.182341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Made reservation on behalf of 64fcebf53303474789f3b0a392800f49 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:05.185911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.219026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.246250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 422a0fb0-a605-4922-b7f5-c816ab147bc3 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:05.251037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.266557 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] Deleting port 97bd1dc6-1eff-4e82-b2e6-8901925388ce {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:05.267390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.273989 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b8f2be8-8444-45e4-bb1c-c75a5de1e551 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (c1552e39-333b-4715-a11d-0de0485b308c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.274491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b8f2be8-8444-45e4-bb1c-c75a5de1e551 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Fanout notify agent at l3_agent the message router_deleted on router c1552e39-333b-4715-a11d-0de0485b308c {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:15:05.280584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 32e46455-c30c-49b7-8ba4-417e4700abc5 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:05.289589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Publish callbacks [] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.289952 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b8f2be8-8444-45e4-bb1c-c75a5de1e551 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.291050 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9b8f2be8-8444-45e4-bb1c-c75a5de1e551 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/routers/c1552e39-333b-4715-a11d-0de0485b308c HTTP/1.1" status: 204 len: 168 time: 0.5562975 Mar 24 02:15:05.296945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58552) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:05.298298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] device_id is not set on port 21a9a229-a077-467a-8af9-24332e9cfcfa yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:05.319285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=97bd1dc6-1eff-4e82-b2e6-8901925388ce,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:05.324291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Attempting to bind port 949c051e-3800-4a8e-b53a-ab4c86451a71 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:05.324815 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Attempting to bind port 949c051e-3800-4a8e-b53a-ab4c86451a71 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '8e190789-98fa-4cc3-9981-803d5127bf6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '45362ce7-a285-4da1-9701-694b323ee056'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:05.325304 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Attempting to bind port 949c051e-3800-4a8e-b53a-ab4c86451a71 on network 45362ce7-a285-4da1-9701-694b323ee056 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:05.328654 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No DVR routers for this DVR port 97bd1dc6-1eff-4e82-b2e6-8901925388ce on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:05.351886 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.364913 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:05.365178 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Checking segment: {'id': '8e190789-98fa-4cc3-9981-803d5127bf6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '45362ce7-a285-4da1-9701-694b323ee056'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:05.365445 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.365812 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Bound using segment: {'id': '8e190789-98fa-4cc3-9981-803d5127bf6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '45362ce7-a285-4da1-9701-694b323ee056'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:05.366306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Bound port: 949c051e-3800-4a8e-b53a-ab4c86451a71, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e190789-98fa-4cc3-9981-803d5127bf6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '45362ce7-a285-4da1-9701-694b323ee056'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:05.366725 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.424170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:05.454432 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (ab372b63-e00c-4c6b-960a-f947e3e6d92b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.460092 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] For port 97bd1dc6-1eff-4e82-b2e6-8901925388ce, host dv-neutron-834874-3-hyperv, got binding levels [] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:05.460491 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.464665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:05.476957 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:05.485213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ab372b63-e00c-4c6b-960a-f947e3e6d92b']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:05.486766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Pushing event updated for resources: {'Port': ['ID=033d328c-c7b2-479c-b1da-0f8e4b4d8aa1,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:05.495951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] Calling delete_port for 97bd1dc6-1eff-4e82-b2e6-8901925388ce owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:05.500249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fed5:ae0e (6f3080fc-791f-4748-a0a2-9eff6ea2a609/6d5bc392-754c-4d1a-b6fb-be5a9dd1e536/422a0fb0-a605-4922-b7f5-c816ab147bc3) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:05.503438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7c9caef7-9e27-4e66-816e-a8c02d3397bc') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:05.505115 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7c9caef7-9e27-4e66-816e-a8c02d3397bc') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:05.507644 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.ipam_backend_mixin [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] Port 97bd1dc6-1eff-4e82-b2e6-8901925388ce was not found and therefore no delete operation was performed {{(pid=104038) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:571}} Mar 24 02:15:05.521344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (97bd1dc6-1eff-4e82-b2e6-8901925388ce), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.521751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (7c9caef7-9e27-4e66-816e-a8c02d3397bc), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.542083 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (7c9caef7-9e27-4e66-816e-a8c02d3397bc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.559166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Releasing vlan 128 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:15:05.559571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (7c9caef7-9e27-4e66-816e-a8c02d3397bc), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:15:05.562508 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:15:05.575170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] Pushing event deleted for resources: {'Port': ['ID=97bd1dc6-1eff-4e82-b2e6-8901925388ce,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:05.580855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] For port 949c051e-3800-4a8e-b53a-ab4c86451a71, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:05.584411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-193922a0-5462-4b62-9c21-142f50a29436 None None] No DVR routers for this DVR port 97bd1dc6-1eff-4e82-b2e6-8901925388ce on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:05.615170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Allocated IP 172.20.0.5 (865b7da0-660b-4753-ad39-55ce579ff27d/f0610870-6f1c-4e3c-b816-4ab5a7015c57/21a9a229-a077-467a-8af9-24332e9cfcfa) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:05.628900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] For port 949c051e-3800-4a8e-b53a-ab4c86451a71, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=949c051e-3800-4a8e-b53a-ab4c86451a71,segment=NetworkSegment(8e190789-98fa-4cc3-9981-803d5127bf6d),segment_id=8e190789-98fa-4cc3-9981-803d5127bf6d)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:05.636827 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Attempting to bind port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:05.637435 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Attempting to bind port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:05.637955 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Attempting to bind port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:05.640965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.649129 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.13 (45362ce7-a285-4da1-9701-694b323ee056/16dd5a29-c454-424a-849c-aefd975b27bd/32e46455-c30c-49b7-8ba4-417e4700abc5) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:05.666287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d4391760-d912-4301-9206-de122a98653d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Deleting port fd481460-0ec4-4fb5-8f6d-7cd94f9a7629 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:05.666654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d4391760-d912-4301-9206-de122a98653d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fd481460-0ec4-4fb5-8f6d-7cd94f9a7629), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.670140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:05.670549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:05.670934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.671322 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:05.672152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Bound port: 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:05.672443 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.694893 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (ab372b63-e00c-4c6b-960a-f947e3e6d92b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.712438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.742511 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/networks/ab372b63-e00c-4c6b-960a-f947e3e6d92b HTTP/1.1" status: 204 len: 168 time: 1.4414463 Mar 24 02:15:05.745381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70cac799-1fac-4cb3-bf65-91576a8eddce None None] Pushing event updated for resources: {'Port': ['ID=949c051e-3800-4a8e-b53a-ab4c86451a71,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:05.746266 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58554) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:05.752716 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1433119f-525e-4965-9c42-dcd958118670 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-552916328', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:05.762215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Router 8c66df04-ea2e-4348-b7a8-b59203f4446e is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:15:05.774735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f11705d0-1d11-4fb5-bb26-4725965949ec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Network': ['ID=ab372b63-e00c-4c6b-960a-f947e3e6d92b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:05.774978 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] For port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:05.778835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] For port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=033d328c-c7b2-479c-b1da-0f8e4b4d8aa1,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:05.788395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.813603 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1433119f-525e-4965-9c42-dcd958118670 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.814969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1433119f-525e-4965-9c42-dcd958118670 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.859398 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (422a0fb0-a605-4922-b7f5-c816ab147bc3), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.870143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0fe9eca-7293-4eb1-834c-2987da69a7ae None None] Pushing event updated for resources: {'Port': ['ID=033d328c-c7b2-479c-b1da-0f8e4b4d8aa1,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:05.922373 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1433119f-525e-4965-9c42-dcd958118670 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.930367 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1433119f-525e-4965-9c42-dcd958118670 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.938473 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d4391760-d912-4301-9206-de122a98653d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fd481460-0ec4-4fb5-8f6d-7cd94f9a7629), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.967267 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1433119f-525e-4965-9c42-dcd958118670 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.971446 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1433119f-525e-4965-9c42-dcd958118670 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 702 time: 0.2227876 Mar 24 02:15:05.972722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (422a0fb0-a605-4922-b7f5-c816ab147bc3), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:05.974243 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58556) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:05.979281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1059127423'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:06.059744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:06.067695 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=422a0fb0-a605-4922-b7f5-c816ab147bc3,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:06.072752 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:06.074882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:06.080371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:06.081014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.085412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:06.089003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.128787 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7761c9a2-2253-47a0-a984-93d384b0e2a7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.6208358 Mar 24 02:15:06.130042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58558) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:06.144021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 128} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:06.174823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (9ca3f463-7da4-494a-9476-e461158b9b02), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.175171 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added segment 9ca3f463-7da4-494a-9476-e461158b9b02 of type vlan for network 2b9b3266-75a3-4535-a81d-5ca19fed980f Mar 24 02:15:06.239282 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (2b9b3266-75a3-4535-a81d-5ca19fed980f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.254160 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc8507c6-885b-48b8-8f58-888b5d1e22ca tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:06.259572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc8507c6-885b-48b8-8f58-888b5d1e22ca tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:06.261277 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cc8507c6-885b-48b8-8f58-888b5d1e22ca tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.1309826 Mar 24 02:15:06.264463 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58560) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:06.291802 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (2b9b3266-75a3-4535-a81d-5ca19fed980f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.297034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:06.297653 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.374363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d4391760-d912-4301-9206-de122a98653d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Calling delete_port for fd481460-0ec4-4fb5-8f6d-7cd94f9a7629 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:06.393946 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.4186268 Mar 24 02:15:06.400748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58562) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:06.407912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'subnet': {'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:06.474064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e6e6369-9291-4324-8f23-dd6b611397b8 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Network': ['ID=2b9b3266-75a3-4535-a81d-5ca19fed980f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:06.485204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 2b9b3266-75a3-4535-a81d-5ca19fed980f details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:06.491579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (32e46455-c30c-49b7-8ba4-417e4700abc5), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.533747 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for port (21a9a229-a077-467a-8af9-24332e9cfcfa), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.540367 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-13d3d0c0-89b7-4c5e-9edc-9ccdb9cfdfd0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 422a0fb0-a605-4922-b7f5-c816ab147bc3 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:06.540708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-13d3d0c0-89b7-4c5e-9edc-9ccdb9cfdfd0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (422a0fb0-a605-4922-b7f5-c816ab147bc3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.556544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:06.560276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.570438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:06.586735 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Sync routers for ids ['8c66df04-ea2e-4348-b7a8-b59203f4446e'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:06.596702 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Routers {'8c66df04-ea2e-4348-b7a8-b59203f4446e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:06.597583 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['8c66df04-ea2e-4348-b7a8-b59203f4446e'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:06.626040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.629724 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-443bf7a2-8261-49d8-b428-225f6fe0d7a4 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 875 time: 6.6057374 Mar 24 02:15:06.631679 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58564) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:06.717323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-13d3d0c0-89b7-4c5e-9edc-9ccdb9cfdfd0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (422a0fb0-a605-4922-b7f5-c816ab147bc3), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.749680 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-13d3d0c0-89b7-4c5e-9edc-9ccdb9cfdfd0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 422a0fb0-a605-4922-b7f5-c816ab147bc3 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:06.762269 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (32e46455-c30c-49b7-8ba4-417e4700abc5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.788574 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (21a9a229-a077-467a-8af9-24332e9cfcfa), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.795820 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Set router 8c66df04-ea2e-4348-b7a8-b59203f4446e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:06.848302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d4391760-d912-4301-9206-de122a98653d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (fd481460-0ec4-4fb5-8f6d-7cd94f9a7629), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:06.856718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 45362ce7-a285-4da1-9701-694b323ee056 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:06.860541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 949c051e-3800-4a8e-b53a-ab4c86451a71 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:06.875097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:06.886411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:06.917688 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Network 865b7da0-660b-4753-ad39-55ce579ff27d is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:06.920302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=32e46455-c30c-49b7-8ba4-417e4700abc5,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:06.963405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:06.972029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 949c051e-3800-4a8e-b53a-ab4c86451a71 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:06.972407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.001453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:07.033056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (8c66df04-ea2e-4348-b7a8-b59203f4446e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.140335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 949c051e-3800-4a8e-b53a-ab4c86451a71 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:07.141810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.167971 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c66df04-ea2e-4348-b7a8-b59203f4446e', 'name': '', 'tenant_id': '65b8f224365f41ae9e617e104bd7afce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'b76374f6-b383-4550-bd17-a0e476586959', 'external_fixed_ips': [{'subnet_id': '8ca3c91b-2add-4279-a908-10cba8e1fd3a', 'ip_address': '172.20.0.5'}], 'enable_snat': True}, 'gw_port_id': '2f062d24-adc3-4651-9895-52fcff291849', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:00Z', 'updated_at': '2022-03-24T02:15:03Z', 'revision_number': 3, 'project_id': '65b8f224365f41ae9e617e104bd7afce', 'gw_port': {'id': '2f062d24-adc3-4651-9895-52fcff291849', 'name': '', 'network_id': 'b76374f6-b383-4550-bd17-a0e476586959', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:c1:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c66df04-ea2e-4348-b7a8-b59203f4446e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '8ca3c91b-2add-4279-a908-10cba8e1fd3a', 'ip_address': '172.20.0.5', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:02Z', 'updated_at': '2022-03-24T02:15:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '8ca3c91b-2add-4279-a908-10cba8e1fd3a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:07.189529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 949c051e-3800-4a8e-b53a-ab4c86451a71, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=949c051e-3800-4a8e-b53a-ab4c86451a71,segment=NetworkSegment(8e190789-98fa-4cc3-9981-803d5127bf6d),segment_id=8e190789-98fa-4cc3-9981-803d5127bf6d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:07.196335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.198667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:07.222327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (88bf3d71-7761-47c5-902c-89ab60fdf88d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.227342 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Checking router: 8c66df04-ea2e-4348-b7a8-b59203f4446e for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:07.227697 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Updating router 8c66df04-ea2e-4348-b7a8-b59203f4446e port 2f062d24-adc3-4651-9895-52fcff291849 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:15:07.278399 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2f062d24-adc3-4651-9895-52fcff291849), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.308857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event updated for resources: {'Port': ['ID=21a9a229-a077-467a-8af9-24332e9cfcfa,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:07.340006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=949c051e-3800-4a8e-b53a-ab4c86451a71,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:07.351447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-13d3d0c0-89b7-4c5e-9edc-9ccdb9cfdfd0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (422a0fb0-a605-4922-b7f5-c816ab147bc3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.398382 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:07.399000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.413412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:07.414701 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.436278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d3d0c0-89b7-4c5e-9edc-9ccdb9cfdfd0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=422a0fb0-a605-4922-b7f5-c816ab147bc3,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:07.443073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ef6d7b1-02c4-4edb-9948-b37565e89378 None None] Network 45362ce7-a285-4da1-9701-694b323ee056 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:07.503303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:07.503891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.510066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-13d3d0c0-89b7-4c5e-9edc-9ccdb9cfdfd0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.516025 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-13d3d0c0-89b7-4c5e-9edc-9ccdb9cfdfd0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/422a0fb0-a605-4922-b7f5-c816ab147bc3 HTTP/1.1" status: 204 len: 168 time: 1.2338321 Mar 24 02:15:07.519094 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Subnet': ['ID=88bf3d71-7761-47c5-902c-89ab60fdf88d,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:07.531093 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58566) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:07.565814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4391760-d912-4301-9206-de122a98653d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Pushing event deleted for resources: {'Port': ['ID=fd481460-0ec4-4fb5-8f6d-7cd94f9a7629,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:07.586581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-579f9828-c94f-4c9b-bee7-83b44dc128aa None None] Provisioning complete for port 949c051e-3800-4a8e-b53a-ab4c86451a71 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:07.587177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-579f9828-c94f-4c9b-bee7-83b44dc128aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.595987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (8c66df04-ea2e-4348-b7a8-b59203f4446e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.615870 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-576d04d2-3b8e-41ce-9807-6d968f8052cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 887 time: 3.5391736 Mar 24 02:15:07.615870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d4391760-d912-4301-9206-de122a98653d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.632040 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d4391760-d912-4301-9206-de122a98653d tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/ports/fd481460-0ec4-4fb5-8f6d-7cd94f9a7629 HTTP/1.1" status: 204 len: 168 time: 2.3248806 Mar 24 02:15:07.632040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58568) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:07.632712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58570) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:07.640589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a361c0f-f256-487b-bfee-35d2dc80de49 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:07.642557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a361c0f-f256-487b-bfee-35d2dc80de49 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:07.645660 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3a361c0f-f256-487b-bfee-35d2dc80de49 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1465 time: 0.1100643 Mar 24 02:15:07.653145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58572) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:07.654233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Checking segment: {'id': '9ca3f463-7da4-494a-9476-e461158b9b02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:07.654876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network hostable DHCP agents. Network: 2b9b3266-75a3-4535-a81d-5ca19fed980f, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:07.672980 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Publish callbacks [] for port (2f062d24-adc3-4651-9895-52fcff291849), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.696828 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2f062d24-adc3-4651-9895-52fcff291849), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.724275 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:07.724684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.735062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-2b66a7d6-7cf7-4cc8-b62d-3dda25ad2496 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Deleting subnet 3a5facc4-fdf7-4c83-b38e-71e5119554fa {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:07.742176 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-1921a362-ebf6-47ca-9ab7-6b1e642b6327 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 6d5bc392-754c-4d1a-b6fb-be5a9dd1e536 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:07.746796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1921a362-ebf6-47ca-9ab7-6b1e642b6327 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (6d5bc392-754c-4d1a-b6fb-be5a9dd1e536), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.767128 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d550b8c1-f710-42f2-8bb7-9255ad0a46eb None None] Pushing event updated for resources: {'Port': ['ID=2f062d24-adc3-4651-9895-52fcff291849,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:07.784859 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=033d328c-c7b2-479c-b1da-0f8e4b4d8aa1,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:07.809114 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Attempting to bind port 2f062d24-adc3-4651-9895-52fcff291849 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:07.809741 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Attempting to bind port 2f062d24-adc3-4651-9895-52fcff291849 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'f272c462-0e9b-4ad2-95d2-28368d50be16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'b76374f6-b383-4550-bd17-a0e476586959'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:07.810267 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Attempting to bind port 2f062d24-adc3-4651-9895-52fcff291849 on network b76374f6-b383-4550-bd17-a0e476586959 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:07.817644 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d1f951fe-e5d6-4809-9b73-3225a2fd4714 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 3.6809061 Mar 24 02:15:07.818242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2b66a7d6-7cf7-4cc8-b62d-3dda25ad2496 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for subnet (3a5facc4-fdf7-4c83-b38e-71e5119554fa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.820729 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:07.821104 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Checking segment: {'id': 'f272c462-0e9b-4ad2-95d2-28368d50be16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'b76374f6-b383-4550-bd17-a0e476586959'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:07.821508 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.821896 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Bound using segment: {'id': 'f272c462-0e9b-4ad2-95d2-28368d50be16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'b76374f6-b383-4550-bd17-a0e476586959'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:07.822369 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Bound port: 2f062d24-adc3-4651-9895-52fcff291849, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f272c462-0e9b-4ad2-95d2-28368d50be16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'b76374f6-b383-4550-bd17-a0e476586959'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:07.822786 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2f062d24-adc3-4651-9895-52fcff291849), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.823104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1921a362-ebf6-47ca-9ab7-6b1e642b6327 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (6d5bc392-754c-4d1a-b6fb-be5a9dd1e536), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.829236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.869410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 2b9b3266-75a3-4535-a81d-5ca19fed980f is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:07.876499 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58574) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:07.894251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:07.915934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-579f9828-c94f-4c9b-bee7-83b44dc128aa None None] Current status of the port 949c051e-3800-4a8e-b53a-ab4c86451a71 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:07.931636 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] For port 2f062d24-adc3-4651-9895-52fcff291849, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:07.934847 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2b66a7d6-7cf7-4cc8-b62d-3dda25ad2496 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (3a5facc4-fdf7-4c83-b38e-71e5119554fa), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.935279 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 97bd1dc6-1eff-4e82-b2e6-8901925388ce no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:07.939733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 2b9b3266-75a3-4535-a81d-5ca19fed980f) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:07.940547 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] For port 2f062d24-adc3-4651-9895-52fcff291849, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2f062d24-adc3-4651-9895-52fcff291849,segment=NetworkSegment(f272c462-0e9b-4ad2-95d2-28368d50be16),segment_id=f272c462-0e9b-4ad2-95d2-28368d50be16)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:07.956119 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2f062d24-adc3-4651-9895-52fcff291849), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.958225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:07.958866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.975415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:07.982942 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=033d328c-c7b2-479c-b1da-0f8e4b4d8aa1,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:08.041886 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2a68a8d6-d89f-495f-b8f0-00e1723a70a1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6377966 Mar 24 02:15:08.050923 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44d020c1-1866-49bc-aeb9-e2c616c065eb None None] Network 2b9b3266-75a3-4535-a81d-5ca19fed980f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:08.052864 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d550b8c1-f710-42f2-8bb7-9255ad0a46eb None None] Pushing event updated for resources: {'Port': ['ID=2f062d24-adc3-4651-9895-52fcff291849,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:08.055832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58576) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:08.070242 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 97bd1dc6-1eff-4e82-b2e6-8901925388ce {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:08.070948 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 97bd1dc6-1eff-4e82-b2e6-8901925388ce not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:08.072367 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Routers {'8c66df04-ea2e-4348-b7a8-b59203f4446e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:08.073165 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['8c66df04-ea2e-4348-b7a8-b59203f4446e'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:08.111635 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1921a362-ebf6-47ca-9ab7-6b1e642b6327 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (6d5bc392-754c-4d1a-b6fb-be5a9dd1e536), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.117536 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-579f9828-c94f-4c9b-bee7-83b44dc128aa None None] Provisioning complete for port 21a9a229-a077-467a-8af9-24332e9cfcfa triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:08.118240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-579f9828-c94f-4c9b-bee7-83b44dc128aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (21a9a229-a077-467a-8af9-24332e9cfcfa), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.205697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1921a362-ebf6-47ca-9ab7-6b1e642b6327 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (6d5bc392-754c-4d1a-b6fb-be5a9dd1e536), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.215713 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] Set router 8c66df04-ea2e-4348-b7a8-b59203f4446e gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:08.297025 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1921a362-ebf6-47ca-9ab7-6b1e642b6327 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.303334 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1921a362-ebf6-47ca-9ab7-6b1e642b6327 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/6d5bc392-754c-4d1a-b6fb-be5a9dd1e536 HTTP/1.1" status: 204 len: 168 time: 0.6431320 Mar 24 02:15:08.303551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1921a362-ebf6-47ca-9ab7-6b1e642b6327 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=6d5bc392-754c-4d1a-b6fb-be5a9dd1e536,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:08.313512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58578) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:08.314440 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c66df04-ea2e-4348-b7a8-b59203f4446e', 'name': '', 'tenant_id': '65b8f224365f41ae9e617e104bd7afce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:00Z', 'updated_at': '2022-03-24T02:15:07Z', 'revision_number': 4, 'project_id': '65b8f224365f41ae9e617e104bd7afce', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:08.349074 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b651733b-43e2-4a1e-b042-99608ed132ed None None] The sync data for ids ['8c66df04-ea2e-4348-b7a8-b59203f4446e'] in dv-neutron-834874-3-hyperv is: [{'id': '8c66df04-ea2e-4348-b7a8-b59203f4446e', 'name': '', 'tenant_id': '65b8f224365f41ae9e617e104bd7afce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:00Z', 'updated_at': '2022-03-24T02:15:07Z', 'revision_number': 4, 'project_id': '65b8f224365f41ae9e617e104bd7afce', 'gw_port_host': None}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:08.413057 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-56556ca7-822a-488d-99db-f18759f1f3cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0909343 Mar 24 02:15:08.418761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58580) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:08.469367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-579f9828-c94f-4c9b-bee7-83b44dc128aa None None] Port 21a9a229-a077-467a-8af9-24332e9cfcfa cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:08.475208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02e19f8e-a1c1-48c1-ab03-e1184e1c34df None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:08.503559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Deleting port 2f062d24-adc3-4651-9895-52fcff291849 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:08.505620 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2f062d24-adc3-4651-9895-52fcff291849), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.535147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bb19bd2-e26d-4a50-9d1e-1a2c5d49b811 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:08.539723 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9bb19bd2-e26d-4a50-9d1e-1a2c5d49b811 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1158726 Mar 24 02:15:08.541702 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58582) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:08.613372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2b66a7d6-7cf7-4cc8-b62d-3dda25ad2496 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (3a5facc4-fdf7-4c83-b38e-71e5119554fa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.623093 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-2b9b3266-75a3-4535-a81d-5ca19fed980f', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:08.624010 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.646649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Provisioning complete for port 32e46455-c30c-49b7-8ba4-417e4700abc5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:08.647022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (32e46455-c30c-49b7-8ba4-417e4700abc5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.647484 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-957e92a7-985a-433a-a1d6-9f4cc56ef470 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 32e46455-c30c-49b7-8ba4-417e4700abc5 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:08.647828 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-957e92a7-985a-433a-a1d6-9f4cc56ef470 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (32e46455-c30c-49b7-8ba4-417e4700abc5), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.658249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.685677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e54e7b93-ea03-45f6-b43a-9c20ebf1ff24 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:08.687473 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e54e7b93-ea03-45f6-b43a-9c20ebf1ff24 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1448188 Mar 24 02:15:08.690682 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58584) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:08.767454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 949c051e-3800-4a8e-b53a-ab4c86451a71 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:08.797701 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1a43f7bb-7ab3-4817-8a9d-a9f4b09a3c73 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1021454 Mar 24 02:15:08.797947 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Port 32e46455-c30c-49b7-8ba4-417e4700abc5 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:08.800229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58586) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:08.804275 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:08.811318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Could not find standard attr ID for object 422a0fb0-a605-4922-b7f5-c816ab147bc3. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:08.870275 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Provisioning complete for port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:08.870576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.925694 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Allocated IP 2001:db8::2 (2b9b3266-75a3-4535-a81d-5ca19fed980f/88bf3d71-7761-47c5-902c-89ab60fdf88d/19421d72-7afc-4c39-bbc3-6d060a8307ae) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:08.947948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Allocated IP 172.26.2.178 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/66d8293e-67b2-4e11-ae49-61aa40707931) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:08.959688 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:08.963202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.972400 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:15:08.976417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 949c051e-3800-4a8e-b53a-ab4c86451a71 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:08.976795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:08.978701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e031c3d-28ae-4e7b-a90b-6bc02a4471de None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:09.027345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.165714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] For port 2f062d24-adc3-4651-9895-52fcff291849, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2f062d24-adc3-4651-9895-52fcff291849,segment=NetworkSegment(f272c462-0e9b-4ad2-95d2-28368d50be16),segment_id=f272c462-0e9b-4ad2-95d2-28368d50be16)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:09.165924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2f062d24-adc3-4651-9895-52fcff291849), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.174474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for port (66d8293e-67b2-4e11-ae49-61aa40707931), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.207202 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2b66a7d6-7cf7-4cc8-b62d-3dda25ad2496 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (3a5facc4-fdf7-4c83-b38e-71e5119554fa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.211355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-957e92a7-985a-433a-a1d6-9f4cc56ef470 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (32e46455-c30c-49b7-8ba4-417e4700abc5), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.214936 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Current status of the port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:09.216358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Calling delete_port for 2f062d24-adc3-4651-9895-52fcff291849 owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:09.244652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9e031c3d-28ae-4e7b-a90b-6bc02a4471de None None] Deleting port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:09.245015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9e031c3d-28ae-4e7b-a90b-6bc02a4471de None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.265224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (5d7605ad-705a-466b-8486-3ef52ceb92f9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.273300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (66d8293e-67b2-4e11-ae49-61aa40707931), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.326556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 949c051e-3800-4a8e-b53a-ab4c86451a71 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:09.327844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:09.331651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-957e92a7-985a-433a-a1d6-9f4cc56ef470 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 32e46455-c30c-49b7-8ba4-417e4700abc5 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:09.334358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b66a7d6-7cf7-4cc8-b62d-3dda25ad2496 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Pushing event deleted for resources: {'Subnet': ['ID=3a5facc4-fdf7-4c83-b38e-71e5119554fa,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:09.348602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2b66a7d6-7cf7-4cc8-b62d-3dda25ad2496 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.352186 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2b66a7d6-7cf7-4cc8-b62d-3dda25ad2496 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/subnets/3a5facc4-fdf7-4c83-b38e-71e5119554fa HTTP/1.1" status: 204 len: 168 time: 1.7071638 Mar 24 02:15:09.355854 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58588) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:09.362950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:09.364938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Provisioning complete for port 949c051e-3800-4a8e-b53a-ab4c86451a71 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:09.365319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.369038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event updated for resources: {'Port': ['ID=66d8293e-67b2-4e11-ae49-61aa40707931,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:09.372654 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:09.375798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:09.382152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:09.382856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.385352 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:09.385868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-318515e9-2415-4e3d-a74c-7b86ff680c5e None None] Network 2d226bac-d4ff-471e-bc00-d4e71858b25f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:09.390708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:09.396761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=5d7605ad-705a-466b-8486-3ef52ceb92f9,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:09.465019 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5ee95afd-4d0e-49c8-9e0d-f9203f6bc09a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6621158 Mar 24 02:15:09.465842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58590) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:09.470976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:fc:f9:e5', 'name': 'tempest-NetworksTestDHCPv6-445550118'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:09.472854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Publish callbacks [] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.497636 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9e031c3d-28ae-4e7b-a90b-6bc02a4471de None None] For port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=033d328c-c7b2-479c-b1da-0f8e4b4d8aa1,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:09.498046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9e031c3d-28ae-4e7b-a90b-6bc02a4471de None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.513045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.531513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9e031c3d-28ae-4e7b-a90b-6bc02a4471de None None] Calling delete_port for 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:09.621956 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for floatingip (3af90d24-c381-4c70-9a40-42c4e79dc6ce), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.638002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (2d226bac-d4ff-471e-bc00-d4e71858b25f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.643448 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Network 2b9b3266-75a3-4535-a81d-5ca19fed980f is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:09.659987 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:09.665496 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:09.671203 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Pushing event updated for resources: {'Port': ['ID=19421d72-7afc-4c39-bbc3-6d060a8307ae,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:09.699895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:09.700119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (66d8293e-67b2-4e11-ae49-61aa40707931), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.700239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.732766 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:09.736903 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.783856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port c540393b-b093-493e-824f-9956fc005df9 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:09.824218 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 2001:db8::1 (2b9b3266-75a3-4535-a81d-5ca19fed980f/88bf3d71-7761-47c5-902c-89ab60fdf88d/bdc0750a-cabb-4e17-bcb5-ee00d873a4b6) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:09.838980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d7526081-619f-4aff-99c6-5950db469178 None None] Current status of the port 949c051e-3800-4a8e-b53a-ab4c86451a71 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:09.841095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Attempting to bind port 19421d72-7afc-4c39-bbc3-6d060a8307ae on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:09.841541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Attempting to bind port 19421d72-7afc-4c39-bbc3-6d060a8307ae by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '9ca3f463-7da4-494a-9476-e461158b9b02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:09.841872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Attempting to bind port 19421d72-7afc-4c39-bbc3-6d060a8307ae on network 2b9b3266-75a3-4535-a81d-5ca19fed980f {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:09.847352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9e031c3d-28ae-4e7b-a90b-6bc02a4471de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (033d328c-c7b2-479c-b1da-0f8e4b4d8aa1), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.853321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Could not find standard attr ID for object 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:09.882660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:09.882993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Checking segment: {'id': '9ca3f463-7da4-494a-9476-e461158b9b02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:09.883296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.883768 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Bound using segment: {'id': '9ca3f463-7da4-494a-9476-e461158b9b02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:09.884207 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Bound port: 19421d72-7afc-4c39-bbc3-6d060a8307ae, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ca3f463-7da4-494a-9476-e461158b9b02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:09.884650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:09.886683 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No ports have port_id starting with 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 Mar 24 02:15:09.890352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e031c3d-28ae-4e7b-a90b-6bc02a4471de None None] Pushing event deleted for resources: {'Port': ['ID=033d328c-c7b2-479c-b1da-0f8e4b4d8aa1,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:09.892184 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e031c3d-28ae-4e7b-a90b-6bc02a4471de None None] No DVR routers for this DVR port 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:09.913792 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3cc9d917-1c34-4a21-bcb7-7b6ce690b216 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:09.926195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (2f062d24-adc3-4651-9895-52fcff291849), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.054365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::35a (6f3080fc-791f-4748-a0a2-9eff6ea2a609/5d7605ad-705a-466b-8486-3ef52ceb92f9/c540393b-b093-493e-824f-9956fc005df9) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:10.055146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event deleted for resources: {'Port': ['ID=2f062d24-adc3-4651-9895-52fcff291849,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:10.074447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for port (66d8293e-67b2-4e11-ae49-61aa40707931), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.078310 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fcb388c-b3bd-4f6a-9d34-af0c7bff5fd9 None None] DHCP port deletion for 2d226bac-d4ff-471e-bc00-d4e71858b25f request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:10.089710 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (66d8293e-67b2-4e11-ae49-61aa40707931), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.155556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-957e92a7-985a-433a-a1d6-9f4cc56ef470 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (32e46455-c30c-49b7-8ba4-417e4700abc5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.204234 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event updated for resources: {'Port': ['ID=66d8293e-67b2-4e11-ae49-61aa40707931,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:10.213316 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957e92a7-985a-433a-a1d6-9f4cc56ef470 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=32e46455-c30c-49b7-8ba4-417e4700abc5,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:10.233619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Deleting port 73059fbd-c506-4972-b84b-84e574b09293 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:10.233970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (73059fbd-c506-4972-b84b-84e574b09293), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.311418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.318032 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (8c66df04-ea2e-4348-b7a8-b59203f4446e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.327508 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] For port 19421d72-7afc-4c39-bbc3-6d060a8307ae, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:10.342532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] For port 19421d72-7afc-4c39-bbc3-6d060a8307ae, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=19421d72-7afc-4c39-bbc3-6d060a8307ae,segment=NetworkSegment(9ca3f463-7da4-494a-9476-e461158b9b02),segment_id=9ca3f463-7da4-494a-9476-e461158b9b02)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:10.347594 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '5d7605ad-705a-466b-8486-3ef52ceb92f9'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:10.348990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.367583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.401317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (c540393b-b093-493e-824f-9956fc005df9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.402853 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (3af90d24-c381-4c70-9a40-42c4e79dc6ce), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.428905 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.429392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7fcb388c-b3bd-4f6a-9d34-af0c7bff5fd9 None None] Deleting port 73059fbd-c506-4972-b84b-84e574b09293 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:10.430146 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-03466b0d-8da6-4fa7-9568-cda2000d602f tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.5524514 Mar 24 02:15:10.432898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7fcb388c-b3bd-4f6a-9d34-af0c7bff5fd9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (73059fbd-c506-4972-b84b-84e574b09293), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.434667 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58594) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:10.439484 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-63c34ea5-fc95-4d82-aad1-97f5c6872e0c tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Request body: {'floatingip': {'port_id': '21a9a229-a077-467a-8af9-24332e9cfcfa', 'fixed_ip_address': '172.20.0.5'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:10.528898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-63c34ea5-fc95-4d82-aad1-97f5c6872e0c tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for floatingip (3af90d24-c381-4c70-9a40-42c4e79dc6ce), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.532313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] For port 73059fbd-c506-4972-b84b-84e574b09293, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=73059fbd-c506-4972-b84b-84e574b09293,segment=NetworkSegment(ed7e0ac9-0d10-429d-a503-0bac03239347),segment_id=ed7e0ac9-0d10-429d-a503-0bac03239347)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:10.532921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (73059fbd-c506-4972-b84b-84e574b09293), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.573728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Calling delete_port for 73059fbd-c506-4972-b84b-84e574b09293 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:10.576459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (8c66df04-ea2e-4348-b7a8-b59203f4446e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.586092 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_controller (8c66df04-ea2e-4348-b7a8-b59203f4446e), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.592463 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c540393b-b093-493e-824f-9956fc005df9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.596835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-957e92a7-985a-433a-a1d6-9f4cc56ef470 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.602766 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-957e92a7-985a-433a-a1d6-9f4cc56ef470 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/32e46455-c30c-49b7-8ba4-417e4700abc5 HTTP/1.1" status: 204 len: 168 time: 2.9647086 Mar 24 02:15:10.607692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58596) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:10.710773 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-e58322f8-66be-4a4f-ba6e-935a3afbaffd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:15:10.712329 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e58322f8-66be-4a4f-ba6e-935a3afbaffd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/32e46455-c30c-49b7-8ba4-417e4700abc5 HTTP/1.1" status: 404 len: 333 time: 0.0724843 Mar 24 02:15:10.714802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (8c66df04-ea2e-4348-b7a8-b59203f4446e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.715177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 8c66df04-ea2e-4348-b7a8-b59203f4446e {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:15:10.717101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:10.718313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58598) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:10.732288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.732782 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8b39d873-56c4-4294-98b5-5f2c9f7a7570 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "DELETE /v2.0/routers/8c66df04-ea2e-4348-b7a8-b59203f4446e HTTP/1.1" status: 204 len: 168 time: 4.0978184 Mar 24 02:15:10.735097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.738704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:10.776528 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58600) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:10.798035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:10.805610 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:10.806681 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.865876 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 73059fbd-c506-4972-b84b-84e574b09293 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:10.912991 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361c3a4d-187e-498f-95f3-6e5683e66886 None None] Pushing event updated for resources: {'Port': ['ID=19421d72-7afc-4c39-bbc3-6d060a8307ae,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:10.928157 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=c540393b-b093-493e-824f-9956fc005df9,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:10.965369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-42fbf7d1-4fab-4e09-9c66-6e94ab13f7a0 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet 16dd5a29-c454-424a-849c-aefd975b27bd {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:10.970101 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 2b9b3266-75a3-4535-a81d-5ca19fed980f is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:10.972876 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-42fbf7d1-4fab-4e09-9c66-6e94ab13f7a0 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (16dd5a29-c454-424a-849c-aefd975b27bd), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.975689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=bdc0750a-cabb-4e17-bcb5-ee00d873a4b6,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:10.981900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7fcb388c-b3bd-4f6a-9d34-af0c7bff5fd9 None None] For port 73059fbd-c506-4972-b84b-84e574b09293, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=73059fbd-c506-4972-b84b-84e574b09293,segment=NetworkSegment(ed7e0ac9-0d10-429d-a503-0bac03239347),segment_id=ed7e0ac9-0d10-429d-a503-0bac03239347)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:10.982572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7fcb388c-b3bd-4f6a-9d34-af0c7bff5fd9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (73059fbd-c506-4972-b84b-84e574b09293), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:10.998559 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d0287a3d-c7c2-4d54-b3e0-5a63159844d6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.5317416 Mar 24 02:15:11.007158 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58602) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:11.011171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:11.020131 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-63c34ea5-fc95-4d82-aad1-97f5c6872e0c tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] update failed (client error): The resource could not be found. Mar 24 02:15:11.024020 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-63c34ea5-fc95-4d82-aad1-97f5c6872e0c tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "PUT /v2.0/floatingips/3af90d24-c381-4c70-9a40-42c4e79dc6ce HTTP/1.1" status: 404 len: 507 time: 0.5857432 Mar 24 02:15:11.025986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:11.026553 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.027175 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58604) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:11.039914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7fcb388c-b3bd-4f6a-9d34-af0c7bff5fd9 None None] Calling delete_port for 73059fbd-c506-4972-b84b-84e574b09293 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:11.088795 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-42fbf7d1-4fab-4e09-9c66-6e94ab13f7a0 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (16dd5a29-c454-424a-849c-aefd975b27bd), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.112311 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (73059fbd-c506-4972-b84b-84e574b09293), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.118575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/5d7605ad-705a-466b-8486-3ef52ceb92f9/2ebd3446-b063-4a93-86b7-802fc8742026) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:11.144228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Port 73059fbd-c506-4972-b84b-84e574b09293 update to DOWN by agent not found {{(pid=104038) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2233}} Mar 24 02:15:11.144976 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:11.187608 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:11.188518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 033d328c-c7b2-479c-b1da-0f8e4b4d8aa1 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:11.202283 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Pushing event deleted for resources: {'Port': ['ID=73059fbd-c506-4972-b84b-84e574b09293,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:11.206864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] No DVR routers for this DVR port 73059fbd-c506-4972-b84b-84e574b09293 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:11.288549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7fcb388c-b3bd-4f6a-9d34-af0c7bff5fd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (73059fbd-c506-4972-b84b-84e574b09293), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.328093 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fcb388c-b3bd-4f6a-9d34-af0c7bff5fd9 None None] Pushing event deleted for resources: {'Port': ['ID=73059fbd-c506-4972-b84b-84e574b09293,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:11.340471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fcb388c-b3bd-4f6a-9d34-af0c7bff5fd9 None None] No DVR routers for this DVR port 73059fbd-c506-4972-b84b-84e574b09293 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:11.376203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (2d226bac-d4ff-471e-bc00-d4e71858b25f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.416682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.423460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2d226bac-d4ff-471e-bc00-d4e71858b25f']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:11.438916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-42fbf7d1-4fab-4e09-9c66-6e94ab13f7a0 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (16dd5a29-c454-424a-849c-aefd975b27bd), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.452256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-3e7c420e-4fee-4b97-81e0-c60358bc6af0 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Deleting subnet 8ca3c91b-2add-4279-a908-10cba8e1fd3a {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:11.466993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Publish callbacks [] for port (2ebd3446-b063-4a93-86b7-802fc8742026), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.479933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.502545 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e7c420e-4fee-4b97-81e0-c60358bc6af0 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for subnet (8ca3c91b-2add-4279-a908-10cba8e1fd3a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.546018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:11.549396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:11.557882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:11.630191 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Pushing event updated for resources: {'Port': ['ID=2ebd3446-b063-4a93-86b7-802fc8742026,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:11.647902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e7c420e-4fee-4b97-81e0-c60358bc6af0 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (8ca3c91b-2add-4279-a908-10cba8e1fd3a), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.659987 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Attempting to bind port 2ebd3446-b063-4a93-86b7-802fc8742026 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:11.661274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Attempting to bind port 2ebd3446-b063-4a93-86b7-802fc8742026 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:11.664668 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Attempting to bind port 2ebd3446-b063-4a93-86b7-802fc8742026 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:11.679547 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:11.680304 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:11.680909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.681509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:11.682190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Bound port: 2ebd3446-b063-4a93-86b7-802fc8742026, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:11.682808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.702779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36b3f18d-89ce-43ff-8693-cf3edfcec56f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:11.704586 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-36b3f18d-89ce-43ff-8693-cf3edfcec56f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.6964042 Mar 24 02:15:11.708875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58606) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:11.753004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e7c420e-4fee-4b97-81e0-c60358bc6af0 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (8ca3c91b-2add-4279-a908-10cba8e1fd3a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.793489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] For port 2ebd3446-b063-4a93-86b7-802fc8742026, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:11.797134 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] For port 2ebd3446-b063-4a93-86b7-802fc8742026, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2ebd3446-b063-4a93-86b7-802fc8742026,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:11.809215 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.824856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ed7e0ac9-0d10-429d-a503-0bac03239347') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:11.825489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ed7e0ac9-0d10-429d-a503-0bac03239347') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:11.847879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (ed7e0ac9-0d10-429d-a503-0bac03239347), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.869923 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Deleting port 66d8293e-67b2-4e11-ae49-61aa40707931 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:11.870298 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (66d8293e-67b2-4e11-ae49-61aa40707931), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.904451 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (ed7e0ac9-0d10-429d-a503-0bac03239347), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.923921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Releasing vlan 121 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:15:11.924325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (ed7e0ac9-0d10-429d-a503-0bac03239347), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:15:11.933130 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:15:11.937175 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87e4bf7a-4b9a-416c-b328-cac8b2aee7e8 None None] Pushing event updated for resources: {'Port': ['ID=2ebd3446-b063-4a93-86b7-802fc8742026,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:12.013552 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e7c420e-4fee-4b97-81e0-c60358bc6af0 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (8ca3c91b-2add-4279-a908-10cba8e1fd3a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.047880 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b516e90-d2b9-496b-811d-963cb698ba97 None None] Network 2b9b3266-75a3-4535-a81d-5ca19fed980f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:12.067756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7c420e-4fee-4b97-81e0-c60358bc6af0 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=8ca3c91b-2add-4279-a908-10cba8e1fd3a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:12.071742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0d0c4d46-1cbd-410d-888c-a3bbe6666401 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port c540393b-b093-493e-824f-9956fc005df9 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:12.072279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d0c4d46-1cbd-410d-888c-a3bbe6666401 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c540393b-b093-493e-824f-9956fc005df9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.080395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-42fbf7d1-4fab-4e09-9c66-6e94ab13f7a0 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (16dd5a29-c454-424a-849c-aefd975b27bd), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.103163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-42fbf7d1-4fab-4e09-9c66-6e94ab13f7a0 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.108921 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-42fbf7d1-4fab-4e09-9c66-6e94ab13f7a0 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/16dd5a29-c454-424a-849c-aefd975b27bd HTTP/1.1" status: 204 len: 168 time: 1.3867412 Mar 24 02:15:12.127232 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58608) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:12.164287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d0c4d46-1cbd-410d-888c-a3bbe6666401 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c540393b-b093-493e-824f-9956fc005df9), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.177995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e7c420e-4fee-4b97-81e0-c60358bc6af0 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.183577 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3e7c420e-4fee-4b97-81e0-c60358bc6af0 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "DELETE /v2.0/subnets/8ca3c91b-2add-4279-a908-10cba8e1fd3a HTTP/1.1" status: 204 len: 168 time: 1.3895044 Mar 24 02:15:12.183751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (2d226bac-d4ff-471e-bc00-d4e71858b25f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.183891 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0d0c4d46-1cbd-410d-888c-a3bbe6666401 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for c540393b-b093-493e-824f-9956fc005df9 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:12.184007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42fbf7d1-4fab-4e09-9c66-6e94ab13f7a0 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=16dd5a29-c454-424a-849c-aefd975b27bd,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:12.185161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58610) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:12.186069 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (66d8293e-67b2-4e11-ae49-61aa40707931), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.186069 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for floatingip (66d8293e-67b2-4e11-ae49-61aa40707931), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.214337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f42e73ee-4ba4-408d-b03b-651e9524eadc None None] Network 45362ce7-a285-4da1-9701-694b323ee056 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:12.218869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.220345 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Calling delete_port for 66d8293e-67b2-4e11-ae49-61aa40707931 owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:12.224221 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] 10.222.0.20 "DELETE /v2.0/networks/2d226bac-d4ff-471e-bc00-d4e71858b25f HTTP/1.1" status: 204 len: 168 time: 2.8519180 Mar 24 02:15:12.291191 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbbd4328-3e0a-4556-b951-19e492242511 tempest-TagsExtTest-1322754214 tempest-TagsExtTest-1322754214-project] Pushing event deleted for resources: {'Network': ['ID=2d226bac-d4ff-471e-bc00-d4e71858b25f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:12.327131 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (45362ce7-a285-4da1-9701-694b323ee056), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.387804 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (b76374f6-b383-4550-bd17-a0e476586959), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.427600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f28109d3-6f88-401f-8e87-8ebb24fa685c None None] Provisioning complete for port 19421d72-7afc-4c39-bbc3-6d060a8307ae triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:12.431238 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f28109d3-6f88-401f-8e87-8ebb24fa685c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.600612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (b76374f6-b383-4550-bd17-a0e476586959), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.612778 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 949c051e-3800-4a8e-b53a-ab4c86451a71 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:12.613116 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.656743 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f28109d3-6f88-401f-8e87-8ebb24fa685c None None] Current status of the port 19421d72-7afc-4c39-bbc3-6d060a8307ae is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:12.657326 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f28109d3-6f88-401f-8e87-8ebb24fa685c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.688667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] For port 949c051e-3800-4a8e-b53a-ab4c86451a71, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=949c051e-3800-4a8e-b53a-ab4c86451a71,segment=NetworkSegment(8e190789-98fa-4cc3-9981-803d5127bf6d),segment_id=8e190789-98fa-4cc3-9981-803d5127bf6d)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:12.689040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.710078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f28109d3-6f88-401f-8e87-8ebb24fa685c None None] For port 19421d72-7afc-4c39-bbc3-6d060a8307ae, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=19421d72-7afc-4c39-bbc3-6d060a8307ae,segment=NetworkSegment(9ca3f463-7da4-494a-9476-e461158b9b02),segment_id=9ca3f463-7da4-494a-9476-e461158b9b02)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:12.717041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 949c051e-3800-4a8e-b53a-ab4c86451a71 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:12.722007 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d0c4d46-1cbd-410d-888c-a3bbe6666401 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c540393b-b093-493e-824f-9956fc005df9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.733615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f28109d3-6f88-401f-8e87-8ebb24fa685c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.806394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (66d8293e-67b2-4e11-ae49-61aa40707931), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.816860 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0c4d46-1cbd-410d-888c-a3bbe6666401 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=c540393b-b093-493e-824f-9956fc005df9,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:12.846237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09d6c11b-4ba1-4c6f-a64b-1df86cca88c1 None None] DHCP port deletion for 45362ce7-a285-4da1-9701-694b323ee056 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:12.852030 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d0c4d46-1cbd-410d-888c-a3bbe6666401 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.860485 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0d0c4d46-1cbd-410d-888c-a3bbe6666401 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/c540393b-b093-493e-824f-9956fc005df9 HTTP/1.1" status: 204 len: 168 time: 1.1467600 Mar 24 02:15:12.867216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.868796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58618) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:12.873356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event deleted for resources: {'Port': ['ID=66d8293e-67b2-4e11-ae49-61aa40707931,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:12.874093 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b76374f6-b383-4550-bd17-a0e476586959']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:12.887339 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.888453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:12.922009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f272c462-0e9b-4ad2-95d2-28368d50be16') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:12.926847 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f272c462-0e9b-4ad2-95d2-28368d50be16') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:12.941811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58622) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:12.976677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f28109d3-6f88-401f-8e87-8ebb24fa685c None None] Pushing event updated for resources: {'Port': ['ID=19421d72-7afc-4c39-bbc3-6d060a8307ae,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:13.002215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (f272c462-0e9b-4ad2-95d2-28368d50be16), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.054219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2ebd3446-b063-4a93-86b7-802fc8742026 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:13.137824 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-09d6c11b-4ba1-4c6f-a64b-1df86cca88c1 None None] Deleting port 949c051e-3800-4a8e-b53a-ab4c86451a71 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:13.138205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-09d6c11b-4ba1-4c6f-a64b-1df86cca88c1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.184308 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e0c619b-0e13-483e-afb0-3f59f3e60862 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:13.187939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (f272c462-0e9b-4ad2-95d2-28368d50be16), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.190646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e0c619b-0e13-483e-afb0-3f59f3e60862 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:13.196224 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5e0c619b-0e13-483e-afb0-3f59f3e60862 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1451 time: 0.3147445 Mar 24 02:15:13.207035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58628) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:13.210051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=bdc0750a-cabb-4e17-bcb5-ee00d873a4b6,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:13.232023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Releasing vlan 120 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:15:13.232423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (f272c462-0e9b-4ad2-95d2-28368d50be16), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:15:13.239734 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:15:13.241754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.286742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c32ed1b8-e801-4fe9-8176-ab4cdada5072 None None] Provisioning complete for port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:13.287116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c32ed1b8-e801-4fe9-8176-ab4cdada5072 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.360423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-c41f90d9-b5ba-4e60-b884-a10cc986b6e1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 5d7605ad-705a-466b-8486-3ef52ceb92f9 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:13.372383 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c41f90d9-b5ba-4e60-b884-a10cc986b6e1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (5d7605ad-705a-466b-8486-3ef52ceb92f9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.372590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-09d6c11b-4ba1-4c6f-a64b-1df86cca88c1 None None] For port 949c051e-3800-4a8e-b53a-ab4c86451a71, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=949c051e-3800-4a8e-b53a-ab4c86451a71,segment=NetworkSegment(8e190789-98fa-4cc3-9981-803d5127bf6d),segment_id=8e190789-98fa-4cc3-9981-803d5127bf6d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:13.372867 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-09d6c11b-4ba1-4c6f-a64b-1df86cca88c1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.398893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=949c051e-3800-4a8e-b53a-ab4c86451a71,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:13.402158 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 2ebd3446-b063-4a93-86b7-802fc8742026 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:13.402860 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.416619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No DVR routers for this DVR port 949c051e-3800-4a8e-b53a-ab4c86451a71 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:13.418414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-09d6c11b-4ba1-4c6f-a64b-1df86cca88c1 None None] Calling delete_port for 949c051e-3800-4a8e-b53a-ab4c86451a71 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:13.452785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c32ed1b8-e801-4fe9-8176-ab4cdada5072 None None] Port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:13.467792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c41f90d9-b5ba-4e60-b884-a10cc986b6e1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (5d7605ad-705a-466b-8486-3ef52ceb92f9), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.497510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (b76374f6-b383-4550-bd17-a0e476586959), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.505538 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cd05277d-612d-4072-9c23-1ae33cd76386 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=30ab9ea00c694b8587d9c5e75dd43927&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5432539 Mar 24 02:15:13.554325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58630) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:13.561992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c32ed1b8-e801-4fe9-8176-ab4cdada5072 None None] Provisioning complete for port 19421d72-7afc-4c39-bbc3-6d060a8307ae triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:13.562854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c32ed1b8-e801-4fe9-8176-ab4cdada5072 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.583137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network b76374f6-b383-4550-bd17-a0e476586959 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Mar 24 02:15:13.600957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c41f90d9-b5ba-4e60-b884-a10cc986b6e1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (5d7605ad-705a-466b-8486-3ef52ceb92f9), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.620584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event deleted for resources: {'Network': ['ID=b76374f6-b383-4550-bd17-a0e476586959,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:13.645542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.653001 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9ba1b1fe-7b90-4af3-a1b9-f4a9ed8d9af9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "DELETE /v2.0/networks/b76374f6-b383-4550-bd17-a0e476586959 HTTP/1.1" status: 204 len: 168 time: 1.4640541 Mar 24 02:15:13.663154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 2b9b3266-75a3-4535-a81d-5ca19fed980f is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:13.686332 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:13.714895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for floatingip (3af90d24-c381-4c70-9a40-42c4e79dc6ce), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.719924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (45362ce7-a285-4da1-9701-694b323ee056), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.720694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.725223 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-880716b5-bbc3-4a57-9b08-5dca9ea9bb69 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "DELETE /v2.0/floatingips/3af90d24-c381-4c70-9a40-42c4e79dc6ce HTTP/1.1" status: 204 len: 168 time: 2.6966541 Mar 24 02:15:13.727669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c41f90d9-b5ba-4e60-b884-a10cc986b6e1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (5d7605ad-705a-466b-8486-3ef52ceb92f9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.731933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2ebd3446-b063-4a93-86b7-802fc8742026 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:13.732514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.732980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58634) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:13.738356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-174b23fe-0452-4a0f-9bcc-1dcc42b54c78 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Request body: {'floatingip': {'floating_network_id': '865b7da0-660b-4753-ad39-55ce579ff27d', 'port_id': '21a9a229-a077-467a-8af9-24332e9cfcfa', 'fixed_ip_address': '172.20.0.5'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:13.762468 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-09d6c11b-4ba1-4c6f-a64b-1df86cca88c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (949c051e-3800-4a8e-b53a-ab4c86451a71), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.788690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c41f90d9-b5ba-4e60-b884-a10cc986b6e1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.795274 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c41f90d9-b5ba-4e60-b884-a10cc986b6e1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/5d7605ad-705a-466b-8486-3ef52ceb92f9 HTTP/1.1" status: 204 len: 168 time: 0.5823274 Mar 24 02:15:13.795274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41f90d9-b5ba-4e60-b884-a10cc986b6e1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=5d7605ad-705a-466b-8486-3ef52ceb92f9,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:13.799359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58636) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:13.886948 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8c374d7b-65f2-4b82-8b13-7e73f09a590d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0791910 Mar 24 02:15:13.887563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58638) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:13.899628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['45362ce7-a285-4da1-9701-694b323ee056']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:13.911620 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3a4ef26f-7486-429d-959f-85048c72c45b admin admin] Publish callbacks [] for security_group (90161421-056e-4af0-ae7b-a103b04404c7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:13.921406 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f10de19-cf2d-49f0-bb47-9c3e3a4dc245 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:13.938609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e190789-98fa-4cc3-9981-803d5127bf6d') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:13.938830 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09d6c11b-4ba1-4c6f-a64b-1df86cca88c1 None None] No DVR routers for this DVR port 949c051e-3800-4a8e-b53a-ab4c86451a71 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:13.938918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e190789-98fa-4cc3-9981-803d5127bf6d') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:13.948315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d6c11b-4ba1-4c6f-a64b-1df86cca88c1 None None] Pushing event deleted for resources: {'Port': ['ID=949c051e-3800-4a8e-b53a-ab4c86451a71,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:14.001121 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3a4ef26f-7486-429d-959f-85048c72c45b admin admin] Publish callbacks [] for security_group (90161421-056e-4af0-ae7b-a103b04404c7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.042408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7233135f-0b06-42c1-a549-7f2c7f9fdf9e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:14.046166 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7233135f-0b06-42c1-a549-7f2c7f9fdf9e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.1559093 Mar 24 02:15:14.046437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58644) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:14.066723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-174b23fe-0452-4a0f-9bcc-1dcc42b54c78 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.086295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (8e190789-98fa-4cc3-9981-803d5127bf6d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.105374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (8e190789-98fa-4cc3-9981-803d5127bf6d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.114271 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:15:14.118928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (8e190789-98fa-4cc3-9981-803d5127bf6d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:15:14.130043 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:15:14.141396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a968e4e-e6ea-45cb-ae57-8636fb071eff tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:14.146278 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3a968e4e-e6ea-45cb-ae57-8636fb071eff tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0959687 Mar 24 02:15:14.146844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58646) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:14.149154 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c32ed1b8-e801-4fe9-8176-ab4cdada5072 None None] Current status of the port 19421d72-7afc-4c39-bbc3-6d060a8307ae is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:14.201698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:15:14.202445 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:15:14.220519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58648) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:14.234334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f5728718-a74c-4453-87a9-ba2a0cff607c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'router': {'name': 'tempest-router--666175464', 'project_id': 'e5fc9b6232c54ef7844f6d9cefb6b1ec'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:14.238050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3a4ef26f-7486-429d-959f-85048c72c45b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (90161421-056e-4af0-ae7b-a103b04404c7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.241127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3a4ef26f-7486-429d-959f-85048c72c45b admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.241351 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-857f4d7e-0f43-4303-88b1-231b95793e76 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0930717 Mar 24 02:15:14.245419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58650) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:14.245525 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3a4ef26f-7486-429d-959f-85048c72c45b admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/90161421-056e-4af0-ae7b-a103b04404c7 HTTP/1.1" status: 204 len: 168 time: 0.6739564 Mar 24 02:15:14.247500 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:14.280829 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] Provisioning complete for port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:14.281298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.314162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a4ef26f-7486-429d-959f-85048c72c45b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90161421-056e-4af0-ae7b-a103b04404c7,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:14.332904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-501fd960-13b0-4b4e-8f74-57fac871e2b6 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:14.344942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:15:14.350625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (45362ce7-a285-4da1-9701-694b323ee056), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.368728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.372344 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/networks/45362ce7-a285-4da1-9701-694b323ee056 HTTP/1.1" status: 204 len: 168 time: 2.2414367 Mar 24 02:15:14.377452 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] Port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:14.377807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58654) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:14.384687 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5728718-a74c-4453-87a9-ba2a0cff607c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (de37c872-20d7-47bc-a551-142408ae6d0f), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.387037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5728718-a74c-4453-87a9-ba2a0cff607c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (de37c872-20d7-47bc-a551-142408ae6d0f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.407789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] Provisioning complete for port 2ebd3446-b063-4a93-86b7-802fc8742026 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:14.408171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.410807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'name': 'tempest-PortsTestJSON-308774308'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:14.429942 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:14.434602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.468013 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-501fd960-13b0-4b4e-8f74-57fac871e2b6 None None] Deleting port 2ebd3446-b063-4a93-86b7-802fc8742026 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:14.468370 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-501fd960-13b0-4b4e-8f74-57fac871e2b6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.487767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba135d3-453c-4afc-99db-02719043941d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Network': ['ID=45362ce7-a285-4da1-9701-694b323ee056,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:14.702693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5728718-a74c-4453-87a9-ba2a0cff607c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_controller (de37c872-20d7-47bc-a551-142408ae6d0f), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.733937 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] Current status of the port 2ebd3446-b063-4a93-86b7-802fc8742026 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:14.734331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.738273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:14.740463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5728718-a74c-4453-87a9-ba2a0cff607c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (de37c872-20d7-47bc-a551-142408ae6d0f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.759934 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6f9b9518-b017-4ad4-adec-a026630678ca tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7030287 Mar 24 02:15:14.760822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58662) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:14.761775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:14.771681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-501fd960-13b0-4b4e-8f74-57fac871e2b6 None None] For port 2ebd3446-b063-4a93-86b7-802fc8742026, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2ebd3446-b063-4a93-86b7-802fc8742026,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:14.772083 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-501fd960-13b0-4b4e-8f74-57fac871e2b6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.778908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1332629889'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:14.782838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:14.786623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.794055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f5728718-a74c-4453-87a9-ba2a0cff607c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.795602 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f5728718-a74c-4453-87a9-ba2a0cff607c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.5645261 Mar 24 02:15:14.799893 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-174b23fe-0452-4a0f-9bcc-1dcc42b54c78 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:15:14.801728 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-174b23fe-0452-4a0f-9bcc-1dcc42b54c78 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 400 len: 373 time: 1.0667093 Mar 24 02:15:14.809468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58666) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:14.810118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58668) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:14.810610 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-501fd960-13b0-4b4e-8f74-57fac871e2b6 None None] Calling delete_port for 2ebd3446-b063-4a93-86b7-802fc8742026 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:14.814230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2ebd3446-b063-4a93-86b7-802fc8742026 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:14.814642 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.819832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '21a9a229-a077-467a-8af9-24332e9cfcfa', 'fixed_ip_address': '172.20.0.5'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:14.846709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:14.847698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:14.851603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] For port 2ebd3446-b063-4a93-86b7-802fc8742026, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2ebd3446-b063-4a93-86b7-802fc8742026,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:14.885026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:15:14.913224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.928669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port fc43bb42-0222-4a26-9ab4-aee148529459 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:14.979092 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:14.982441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:14.985119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:15:14.985456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:15:15.001614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.060305 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.078245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:15.104211 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffeac644-d279-4db9-9b12-005036af0d00 None None] Pushing event updated for resources: {'Port': ['ID=2ebd3446-b063-4a93-86b7-802fc8742026,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:15.149817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.165268 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9d0214f3-1dfa-4dbb-b0b0-409e16dfd657 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (de37c872-20d7-47bc-a551-142408ae6d0f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.278707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-501fd960-13b0-4b4e-8f74-57fac871e2b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.337075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501fd960-13b0-4b4e-8f74-57fac871e2b6 None None] Pushing event deleted for resources: {'Port': ['ID=2ebd3446-b063-4a93-86b7-802fc8742026,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:15.341124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-501fd960-13b0-4b4e-8f74-57fac871e2b6 None None] No DVR routers for this DVR port 2ebd3446-b063-4a93-86b7-802fc8742026 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:15.446432 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] For port 2ebd3446-b063-4a93-86b7-802fc8742026, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2ebd3446-b063-4a93-86b7-802fc8742026,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:15.453627 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:11Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:12Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:15.487354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (2ebd3446-b063-4a93-86b7-802fc8742026), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.492206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:15.492777 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Updating router d36063bd-d604-40b2-9839-addfdc6c944c port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:15:15.494715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (2ebd3446-b063-4a93-86b7-802fc8742026), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.527667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.533924 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=2ebd3446-b063-4a93-86b7-802fc8742026,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:15.543743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (4be25361-fe42-44ca-9770-b0e035cbeb42), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.561556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 123} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:15.599150 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:15.607096 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:15.612091 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:15.612631 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.618225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=4be25361-fe42-44ca-9770-b0e035cbeb42,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:15.643339 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9566414b-9ddd-467e-a3f0-49c5f3c083cb tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.4000094 Mar 24 02:15:15.646385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58686) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:15.657240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-eb5f1bb7-2fa7-4cd4-9abf-b6ad7899a177 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:15.695462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9d0214f3-1dfa-4dbb-b0b0-409e16dfd657 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (de37c872-20d7-47bc-a551-142408ae6d0f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.697763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9d0214f3-1dfa-4dbb-b0b0-409e16dfd657 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_controller (de37c872-20d7-47bc-a551-142408ae6d0f), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.712665 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b57e537a-4271-4ac0-97f0-35d217bd7835), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.713607 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added segment b57e537a-4271-4ac0-97f0-35d217bd7835 of type vlan for network 93c5002c-aaba-409a-ac62-41e827f93969 Mar 24 02:15:15.721058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (fc43bb42-0222-4a26-9ab4-aee148529459), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.747791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04f3d5b0-aec5-4819-96b2-8a9279ab4ace None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:15.810188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9d0214f3-1dfa-4dbb-b0b0-409e16dfd657 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (de37c872-20d7-47bc-a551-142408ae6d0f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.810768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d0214f3-1dfa-4dbb-b0b0-409e16dfd657 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Fanout notify agent at l3_agent the message router_deleted on router de37c872-20d7-47bc-a551-142408ae6d0f {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:15:15.817996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (93c5002c-aaba-409a-ac62-41e827f93969), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.831583 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9d0214f3-1dfa-4dbb-b0b0-409e16dfd657 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.832788 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9d0214f3-1dfa-4dbb-b0b0-409e16dfd657 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "DELETE /v2.0/routers/de37c872-20d7-47bc-a551-142408ae6d0f HTTP/1.1" status: 204 len: 168 time: 1.0196459 Mar 24 02:15:15.834796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb5f1bb7-2fa7-4cd4-9abf-b6ad7899a177 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:15.843611 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eb5f1bb7-2fa7-4cd4-9abf-b6ad7899a177 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.885676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (fc43bb42-0222-4a26-9ab4-aee148529459), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.891426 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (93c5002c-aaba-409a-ac62-41e827f93969), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.896695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:15.898005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.918324 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '4be25361-fe42-44ca-9770-b0e035cbeb42'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:15.919221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:15.945051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Port 2ebd3446-b063-4a93-86b7-802fc8742026 update to ACTIVE by agent not found {{(pid=104038) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2233}} Mar 24 02:15:15.945499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 19421d72-7afc-4c39-bbc3-6d060a8307ae up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:15.948132 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 1.1746387 Mar 24 02:15:15.950376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58696) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:15.969143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'subnet': {'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:16.012002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:16.025150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:16.038490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.046373 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:16.064779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:16.065455 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.111752 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.ipam_backend_mixin [None req-eb5f1bb7-2fa7-4cd4-9abf-b6ad7899a177 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 4be25361-fe42-44ca-9770-b0e035cbeb42 (CIDR: 2001:db8::/64) Mar 24 02:15:16.119201 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-eb5f1bb7-2fa7-4cd4-9abf-b6ad7899a177 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:15:16.120224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-eb5f1bb7-2fa7-4cd4-9abf-b6ad7899a177 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:16.156574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Publish callbacks [] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.156837 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-eb5f1bb7-2fa7-4cd4-9abf-b6ad7899a177 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5047958 Mar 24 02:15:16.157392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58700) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:16.163326 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:16.167114 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:16.171919 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 1.7743948 Mar 24 02:15:16.174281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.177420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58702) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:16.186483 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 19421d72-7afc-4c39-bbc3-6d060a8307ae triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:16.188943 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.210543 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a66c4cfc-5765-43d5-b305-b6d4fdb476c5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Network': ['ID=93c5002c-aaba-409a-ac62-41e827f93969,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:16.213871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58704) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:16.233361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.242718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Allocated IP 2001:db8::f816:3eff:fe16:f964 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/4be25361-fe42-44ca-9770-b0e035cbeb42/fa877a77-6d70-4db3-9ad1-f0aaaec4941c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:16.282559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9618be4e-a35e-4c9b-8f80-31d16e67cdbc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=fc43bb42-0222-4a26-9ab4-aee148529459,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:16.403303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Allocated IP 172.26.2.121 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/44aaeeb6-14d5-4f64-8bb6-0e7f44d62683) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:16.417822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6020784f-83a4-462b-87da-ef10cfd9c5cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port fc43bb42-0222-4a26-9ab4-aee148529459 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:16.418162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6020784f-83a4-462b-87da-ef10cfd9c5cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fc43bb42-0222-4a26-9ab4-aee148529459), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.422433 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Publish callbacks [] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.433155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 93c5002c-aaba-409a-ac62-41e827f93969 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:16.443905 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.499390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:16.507958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.522708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58710) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:16.542669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6020784f-83a4-462b-87da-ef10cfd9c5cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fc43bb42-0222-4a26-9ab4-aee148529459), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.565437 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6020784f-83a4-462b-87da-ef10cfd9c5cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for fc43bb42-0222-4a26-9ab4-aee148529459 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:16.630950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:16.636980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad40033c-c2f0-4a5e-839d-e06421eac4fb None None] Pushing event updated for resources: {'Port': ['ID=bdc0750a-cabb-4e17-bcb5-ee00d873a4b6,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:16.647550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for port (44aaeeb6-14d5-4f64-8bb6-0e7f44d62683), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.651367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1487958114', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:16.659283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:16.693542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:16.725515 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'network': {'name': 'tempest-network-smoke--452825233', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'port_security_enabled': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:16.744216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.745411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.759873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:16.763294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.780260 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Attempting to bind port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:16.780643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Attempting to bind port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '9ca3f463-7da4-494a-9476-e461158b9b02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:16.781082 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Attempting to bind port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 on network 2b9b3266-75a3-4535-a81d-5ca19fed980f {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:16.794199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.828623 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (7a9cb681-7c90-4932-bab9-71e68608b7fe), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.887947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6020784f-83a4-462b-87da-ef10cfd9c5cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (fc43bb42-0222-4a26-9ab4-aee148529459), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.901081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.904546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (44aaeeb6-14d5-4f64-8bb6-0e7f44d62683), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.972848 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Subnet': ['ID=7a9cb681-7c90-4932-bab9-71e68608b7fe,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:16.977455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:16.977657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Checking segment: {'id': 'b57e537a-4271-4ac0-97f0-35d217bd7835', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:16.977867 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Checking segment: {'id': '9ca3f463-7da4-494a-9476-e461158b9b02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:16.977997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network hostable DHCP agents. Network: 93c5002c-aaba-409a-ac62-41e827f93969, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:16.978398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.978879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Bound using segment: {'id': '9ca3f463-7da4-494a-9476-e461158b9b02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:16.979429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Bound port: bdc0750a-cabb-4e17-bcb5-ee00d873a4b6, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ca3f463-7da4-494a-9476-e461158b9b02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:16.979892 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:16.981745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Pushing event updated for resources: {'Port': ['ID=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:16.989829 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6020784f-83a4-462b-87da-ef10cfd9c5cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=fc43bb42-0222-4a26-9ab4-aee148529459,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:17.001845 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Attempting to bind port fa877a77-6d70-4db3-9ad1-f0aaaec4941c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:17.002306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Attempting to bind port fa877a77-6d70-4db3-9ad1-f0aaaec4941c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:17.006673 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 93c5002c-aaba-409a-ac62-41e827f93969 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:17.014741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Attempting to bind port fa877a77-6d70-4db3-9ad1-f0aaaec4941c on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:17.019331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6020784f-83a4-462b-87da-ef10cfd9c5cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.026206 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6020784f-83a4-462b-87da-ef10cfd9c5cf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/fc43bb42-0222-4a26-9ab4-aee148529459 HTTP/1.1" status: 204 len: 168 time: 0.8441806 Mar 24 02:15:17.027792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58714) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:17.034096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:17.034699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:17.035132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.035911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'mac_address': 'fa:16:3e:f4:b7:35', 'name': 'tempest-PortsTestJSON-418432184'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:17.036044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:17.036495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Bound port: fa877a77-6d70-4db3-9ad1-f0aaaec4941c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:17.036985 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.040668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:17.043638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 93c5002c-aaba-409a-ac62-41e827f93969) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:17.074273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:17.080010 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 19421d72-7afc-4c39-bbc3-6d060a8307ae is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:17.081878 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:17.082069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84fd132d-3237-4b3f-9b4a-34acea4830d5 None None] Network 93c5002c-aaba-409a-ac62-41e827f93969 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:17.084195 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:17.084792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.087258 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (10aba204-5510-435e-bb9a-1bef0715ce68), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.089234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (a7001f9f-979d-46f2-815e-6bc51053ec9e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.151476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:17.157907 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:17.168133 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:17.168734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.183825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a7001f9f-979d-46f2-815e-6bc51053ec9e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.184223 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-05b78712-4005-4e67-96da-a9f7560b46f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.2301521 Mar 24 02:15:17.188941 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58716) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:17.210819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8e7d1d99-4f7c-4334-bf0d-29317f196a8c None None] Provisioning complete for port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:17.211282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8e7d1d99-4f7c-4334-bf0d-29317f196a8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.212765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event updated for resources: {'Port': ['ID=44aaeeb6-14d5-4f64-8bb6-0e7f44d62683,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:17.241754 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=10aba204-5510-435e-bb9a-1bef0715ce68,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:17.255299 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.260503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] For port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:17.283937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 108} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:17.292806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a7001f9f-979d-46f2-815e-6bc51053ec9e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:17.298673 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f0388c41-03e2-4560-84ae-19d00ab75d25 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.1374753 Mar 24 02:15:17.299563 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] For port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=bdc0750a-cabb-4e17-bcb5-ee00d873a4b6,segment=NetworkSegment(9ca3f463-7da4-494a-9476-e461158b9b02),segment_id=9ca3f463-7da4-494a-9476-e461158b9b02)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:17.303097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58718) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:17.307999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:64:e8:cc', 'name': 'tempest-NetworksTestDHCPv6-1645956451'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:17.310643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] For port fa877a77-6d70-4db3-9ad1-f0aaaec4941c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:17.316944 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8e7d1d99-4f7c-4334-bf0d-29317f196a8c None None] Port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:17.321080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:17.339299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.341778 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (5e901f2f-82e7-4a47-a540-857908c70ec7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.342331 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Added segment 5e901f2f-82e7-4a47-a540-857908c70ec7 of type vlan for network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d Mar 24 02:15:17.354511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] For port fa877a77-6d70-4db3-9ad1-f0aaaec4941c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:17.376489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 19421d72-7afc-4c39-bbc3-6d060a8307ae up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:17.378583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-93c5002c-aaba-409a-ac62-41e827f93969', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:17.379432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.421431 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.479451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad40033c-c2f0-4a5e-839d-e06421eac4fb None None] Pushing event updated for resources: {'Port': ['ID=bdc0750a-cabb-4e17-bcb5-ee00d873a4b6,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:17.503390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (4ce8d77b-f4f5-4987-9cce-04a12234cd5d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.551789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.587056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (4ce8d77b-f4f5-4987-9cce-04a12234cd5d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.596467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:17.597683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.606686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:17.607343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:17.631608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 4b06adb2-e4b2-4edf-a6a9-4936dcf9b790 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:17.708375 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.1800139 Mar 24 02:15:17.737102 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58720) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:17.738310 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6269c45f-d308-4439-a566-47e89abfd1d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Network': ['ID=4ce8d77b-f4f5-4987-9cce-04a12234cd5d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:17.771305 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'admin_state_up': True, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:17.826596 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7030d6-98af-4715-bb25-af61b1ac50b7 None None] Pushing event updated for resources: {'Port': ['ID=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:17.888414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Deleting port 44aaeeb6-14d5-4f64-8bb6-0e7f44d62683 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:17.888828 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (44aaeeb6-14d5-4f64-8bb6-0e7f44d62683), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.893824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:17.920702 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:17.983278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.985533 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (1f63a954-e411-4138-b423-94a29a3b7505), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:17.986556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (1f63a954-e411-4138-b423-94a29a3b7505), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.006509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:18.022589 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.052142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (44aaeeb6-14d5-4f64-8bb6-0e7f44d62683), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.052459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for floatingip (44aaeeb6-14d5-4f64-8bb6-0e7f44d62683), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.106189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Calling delete_port for 44aaeeb6-14d5-4f64-8bb6-0e7f44d62683 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:18.142008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 19421d72-7afc-4c39-bbc3-6d060a8307ae triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:18.142385 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.196102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Allocated IP 2001:db8:1::2 (93c5002c-aaba-409a-ac62-41e827f93969/7a9cb681-7c90-4932-bab9-71e68608b7fe/6698fb88-e677-43ca-b552-2988e9a178d0) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:18.201659 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ab63bac5-7150-4218-8a8c-aa92c43a8f59 None None] Provisioning complete for port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:18.202059 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab63bac5-7150-4218-8a8c-aa92c43a8f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.236509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Allocated IP 172.26.2.218 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/4a31b3fe-c12e-4b05-894b-d29baa692949) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:18.321147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (44aaeeb6-14d5-4f64-8bb6-0e7f44d62683), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.363436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event deleted for resources: {'Port': ['ID=44aaeeb6-14d5-4f64-8bb6-0e7f44d62683,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:18.474874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (1f63a954-e411-4138-b423-94a29a3b7505), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.484222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.498368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 19421d72-7afc-4c39-bbc3-6d060a8307ae is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:18.552683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:11Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:17Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:18.554491 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ab63bac5-7150-4218-8a8c-aa92c43a8f59 None None] Current status of the port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:18.555012 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab63bac5-7150-4218-8a8c-aa92c43a8f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.625590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 949c051e-3800-4a8e-b53a-ab4c86451a71 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:18.633544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8db6a1ff-74ca-489a-90d9-1c5aeb1b7879 None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:11Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:17Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:18.635158 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 16ff0bcb-8742-460a-9cc6-a6e0e598bd52 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:18.668696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Publish callbacks [] for port (6698fb88-e677-43ca-b552-2988e9a178d0), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.678844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 949c051e-3800-4a8e-b53a-ab4c86451a71 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:18.679543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 949c051e-3800-4a8e-b53a-ab4c86451a71 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:18.680206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2ebd3446-b063-4a93-86b7-802fc8742026 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:18.704130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (4b06adb2-e4b2-4edf-a6a9-4936dcf9b790), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.707634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.713176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 2ebd3446-b063-4a93-86b7-802fc8742026 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:18.713518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2ebd3446-b063-4a93-86b7-802fc8742026 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:18.791110 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ab63bac5-7150-4218-8a8c-aa92c43a8f59 None None] For port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=bdc0750a-cabb-4e17-bcb5-ee00d873a4b6,segment=NetworkSegment(9ca3f463-7da4-494a-9476-e461158b9b02),segment_id=9ca3f463-7da4-494a-9476-e461158b9b02)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:18.803297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Network 93c5002c-aaba-409a-ac62-41e827f93969 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:18.805192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Pushing event updated for resources: {'Port': ['ID=6698fb88-e677-43ca-b552-2988e9a178d0,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:18.808816 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:18.811587 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab63bac5-7150-4218-8a8c-aa92c43a8f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.828407 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.843634 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (1f63a954-e411-4138-b423-94a29a3b7505), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.862763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:18.911496 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] create failed (client error): The resource could not be found. Mar 24 02:15:18.920843 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-31244cbc-1288-4870-850f-f1edf7cd6922 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 404 len: 507 time: 4.1048942 Mar 24 02:15:18.928767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58722) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:18.948745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Attempting to bind port 6698fb88-e677-43ca-b552-2988e9a178d0 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:18.949116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Attempting to bind port 6698fb88-e677-43ca-b552-2988e9a178d0 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'b57e537a-4271-4ac0-97f0-35d217bd7835', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:18.949482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Attempting to bind port 6698fb88-e677-43ca-b552-2988e9a178d0 on network 93c5002c-aaba-409a-ac62-41e827f93969 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:18.963380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:18.963655 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Checking segment: {'id': 'b57e537a-4271-4ac0-97f0-35d217bd7835', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:18.964012 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.964413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Bound using segment: {'id': 'b57e537a-4271-4ac0-97f0-35d217bd7835', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:18.965095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Bound port: 6698fb88-e677-43ca-b552-2988e9a178d0, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b57e537a-4271-4ac0-97f0-35d217bd7835', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:18.965241 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:18.968217 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab63bac5-7150-4218-8a8c-aa92c43a8f59 None None] Pushing event updated for resources: {'Port': ['ID=bdc0750a-cabb-4e17-bcb5-ee00d873a4b6,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:19.065890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] For port 6698fb88-e677-43ca-b552-2988e9a178d0, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:19.068138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for port (4a31b3fe-c12e-4b05-894b-d29baa692949), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:19.071348 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] For port 6698fb88-e677-43ca-b552-2988e9a178d0, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=6698fb88-e677-43ca-b552-2988e9a178d0,segment=NetworkSegment(b57e537a-4271-4ac0-97f0-35d217bd7835),segment_id=b57e537a-4271-4ac0-97f0-35d217bd7835)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:19.083470 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:19.195677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (4b06adb2-e4b2-4edf-a6a9-4936dcf9b790), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:19.229341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00646ba7-ff79-4ac4-b9ae-a25784768b77 None None] Pushing event updated for resources: {'Port': ['ID=6698fb88-e677-43ca-b552-2988e9a178d0,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:19.253368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7657257b-11ed-4933-911e-7bc3c60a1f10 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:19.356521 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-88ac9e6f-cdfa-46db-b132-c42aedbadfc1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Deleting port 21a9a229-a077-467a-8af9-24332e9cfcfa {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:19.356883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-88ac9e6f-cdfa-46db-b132-c42aedbadfc1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (21a9a229-a077-467a-8af9-24332e9cfcfa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:19.567465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-88ac9e6f-cdfa-46db-b132-c42aedbadfc1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (21a9a229-a077-467a-8af9-24332e9cfcfa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:19.570339 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:19.594033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (4a31b3fe-c12e-4b05-894b-d29baa692949), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:19.594654 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8:0:1::c9 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/10aba204-5510-435e-bb9a-1bef0715ce68/16ff0bcb-8742-460a-9cc6-a6e0e598bd52) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:19.606824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:19.610473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:19.619478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:19.620491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:19.627719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-88ac9e6f-cdfa-46db-b132-c42aedbadfc1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Calling delete_port for 21a9a229-a077-467a-8af9-24332e9cfcfa owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:19.712137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fe64:e8cc (6f3080fc-791f-4748-a0a2-9eff6ea2a609/4be25361-fe42-44ca-9770-b0e035cbeb42/16ff0bcb-8742-460a-9cc6-a6e0e598bd52) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:19.722438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=4b06adb2-e4b2-4edf-a6a9-4936dcf9b790,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:19.730629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:19.756249 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:19.773200 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-55e36772-2e85-44bb-a6e2-c95b5da7e7dd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 2.7434077 Mar 24 02:15:19.773826 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58726) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:19.785547 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:19.791647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:19.822403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event updated for resources: {'Port': ['ID=4a31b3fe-c12e-4b05-894b-d29baa692949,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:19.845186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f95393f6-9333-425f-aa99-896bbef022cd None None] Provisioning complete for port fa877a77-6d70-4db3-9ad1-f0aaaec4941c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:19.845561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f95393f6-9333-425f-aa99-896bbef022cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:19.944021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff42c5a8-b6ed-4582-a280-d995e6607f19 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:19.947111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6000a50c-d78a-40e3-be39-f904192076de None None] Update dhcp port {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': '4be25361-fe42-44ca-9770-b0e035cbeb42', 'ip_address': '2001:db8::f816:3eff:fe16:f964'}, {'subnet_id': '10aba204-5510-435e-bb9a-1bef0715ce68'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': 'fa877a77-6d70-4db3-9ad1-f0aaaec4941c'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:15:19.948446 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ff42c5a8-b6ed-4582-a280-d995e6607f19 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/4b06adb2-e4b2-4edf-a6a9-4936dcf9b790 HTTP/1.1" status: 200 len: 840 time: 0.1667109 Mar 24 02:15:19.949059 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58728) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:20.001473 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6000a50c-d78a-40e3-be39-f904192076de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.057247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-88ac9e6f-cdfa-46db-b132-c42aedbadfc1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (21a9a229-a077-467a-8af9-24332e9cfcfa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.082162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 2001:db8:1::1 (93c5002c-aaba-409a-ac62-41e827f93969/7a9cb681-7c90-4932-bab9-71e68608b7fe/a3d4d703-080d-4bed-82c7-4fbdbbfa5c03) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:20.093949 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:20.094190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.155331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ac9e6f-cdfa-46db-b132-c42aedbadfc1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event deleted for resources: {'Port': ['ID=21a9a229-a077-467a-8af9-24332e9cfcfa,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:20.231379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f95393f6-9333-425f-aa99-896bbef022cd None None] Current status of the port fa877a77-6d70-4db3-9ad1-f0aaaec4941c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:20.231898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f95393f6-9333-425f-aa99-896bbef022cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.263389 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.279543 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-88ac9e6f-cdfa-46db-b132-c42aedbadfc1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.285814 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-88ac9e6f-cdfa-46db-b132-c42aedbadfc1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "DELETE /v2.0/ports/21a9a229-a077-467a-8af9-24332e9cfcfa HTTP/1.1" status: 204 len: 168 time: 1.3548625 Mar 24 02:15:20.294282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f95393f6-9333-425f-aa99-896bbef022cd None None] For port fa877a77-6d70-4db3-9ad1-f0aaaec4941c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:20.320431 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58730) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:20.343861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:20.345244 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fa877a77-6d70-4db3-9ad1-f0aaaec4941c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:20.388404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f95393f6-9333-425f-aa99-896bbef022cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.404093 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (1f63a954-e411-4138-b423-94a29a3b7505), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.456891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fa877a77-6d70-4db3-9ad1-f0aaaec4941c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:20.457315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.470076 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.514649 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (16ff0bcb-8742-460a-9cc6-a6e0e598bd52), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.519037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95393f6-9333-425f-aa99-896bbef022cd None None] Pushing event updated for resources: {'Port': ['ID=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:20.539058 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a6890cf3-7f18-4bac-8249-3f509953ebfb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 4b06adb2-e4b2-4edf-a6a9-4936dcf9b790 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:20.539394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6890cf3-7f18-4bac-8249-3f509953ebfb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4b06adb2-e4b2-4edf-a6a9-4936dcf9b790), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.579994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fa877a77-6d70-4db3-9ad1-f0aaaec4941c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:20.584378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.642064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-855e0b89-f793-4546-ad86-4add70b07124 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:20.643700 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-855e0b89-f793-4546-ad86-4add70b07124 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "GET /v2.0/ports?device_id=678fbccb-a396-494b-8300-3227f087f043 HTTP/1.1" status: 200 len: 913 time: 0.3189845 Mar 24 02:15:20.654616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58732) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:20.686970 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.723216 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6890cf3-7f18-4bac-8249-3f509953ebfb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4b06adb2-e4b2-4edf-a6a9-4936dcf9b790), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.767989 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a6890cf3-7f18-4bac-8249-3f509953ebfb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 4b06adb2-e4b2-4edf-a6a9-4936dcf9b790 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:20.770808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (16ff0bcb-8742-460a-9cc6-a6e0e598bd52), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.829919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:20.843372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-6000a50c-d78a-40e3-be39-f904192076de None None] Allocated IP 2001:db8:0:1::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/10aba204-5510-435e-bb9a-1bef0715ce68/fa877a77-6d70-4db3-9ad1-f0aaaec4941c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:20.856817 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e42b18e6-3d4c-4877-b583-8c3e8b2269f8 None None] Network 93c5002c-aaba-409a-ac62-41e827f93969 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:20.875349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:20.891931 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:20.898331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:20.899022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.906498 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.82 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/be6cc3d7-c553-4ab5-82ae-05b89ab5c636) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:20.939714 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:20.947788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=16ff0bcb-8742-460a-9cc6-a6e0e598bd52,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:20.985180 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-13c52af2-2757-4e45-acf1-d8aefd49f12b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 3.6786108 Mar 24 02:15:20.985413 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Router 8c9b2d33-abdb-40bb-ae90-72bc0a776f29 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:15:20.987751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58734) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:21.009361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2e729595-06af-4248-b2af-351b03343eac None None] Provisioning complete for port 6698fb88-e677-43ca-b552-2988e9a178d0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:21.009738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2e729595-06af-4248-b2af-351b03343eac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.034701 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 93c5002c-aaba-409a-ac62-41e827f93969 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:21.047320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:21.058755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:21.059478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.130268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6000a50c-d78a-40e3-be39-f904192076de None None] For port fa877a77-6d70-4db3-9ad1-f0aaaec4941c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:21.149345 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=a3d4d703-080d-4bed-82c7-4fbdbbfa5c03,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:21.151671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6890cf3-7f18-4bac-8249-3f509953ebfb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (4b06adb2-e4b2-4edf-a6a9-4936dcf9b790), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.189858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2e729595-06af-4248-b2af-351b03343eac None None] Current status of the port 6698fb88-e677-43ca-b552-2988e9a178d0 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:21.191321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2e729595-06af-4248-b2af-351b03343eac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.256706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6000a50c-d78a-40e3-be39-f904192076de None None] Publish callbacks [] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.269040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6000a50c-d78a-40e3-be39-f904192076de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.275746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2e729595-06af-4248-b2af-351b03343eac None None] For port 6698fb88-e677-43ca-b552-2988e9a178d0, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=6698fb88-e677-43ca-b552-2988e9a178d0,segment=NetworkSegment(b57e537a-4271-4ac0-97f0-35d217bd7835),segment_id=b57e537a-4271-4ac0-97f0-35d217bd7835)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:21.283419 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:21.295318 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e673146-a892-4887-9dc0-532ba0c8563c None None] Sync routers for ids ['8c9b2d33-abdb-40bb-ae90-72bc0a776f29'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:21.310782 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2e729595-06af-4248-b2af-351b03343eac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.328505 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.330069 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0abe489d-f153-4794-a9dc-396ddb002654 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 5.1097364 Mar 24 02:15:21.335174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-73a40220-5e84-45b0-9275-f92493984e4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 16ff0bcb-8742-460a-9cc6-a6e0e598bd52 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:21.335786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-73a40220-5e84-45b0-9275-f92493984e4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (16ff0bcb-8742-460a-9cc6-a6e0e598bd52), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.341122 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e673146-a892-4887-9dc0-532ba0c8563c None None] Routers {'8c9b2d33-abdb-40bb-ae90-72bc0a776f29'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:21.341917 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8e673146-a892-4887-9dc0-532ba0c8563c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['8c9b2d33-abdb-40bb-ae90-72bc0a776f29'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:21.416585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6000a50c-d78a-40e3-be39-f904192076de None None] Pushing event updated for resources: {'Port': ['ID=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:21.418004 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58736) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:21.443599 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8e673146-a892-4887-9dc0-532ba0c8563c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:21.473821 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e673146-a892-4887-9dc0-532ba0c8563c None None] Routers {'8c9b2d33-abdb-40bb-ae90-72bc0a776f29'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:21.475693 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8e673146-a892-4887-9dc0-532ba0c8563c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['8c9b2d33-abdb-40bb-ae90-72bc0a776f29'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:21.502710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (678fbccb-a396-494b-8300-3227f087f043), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.508982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fa877a77-6d70-4db3-9ad1-f0aaaec4941c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:21.547270 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e729595-06af-4248-b2af-351b03343eac None None] Pushing event updated for resources: {'Port': ['ID=6698fb88-e677-43ca-b552-2988e9a178d0,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:21.550232 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8e673146-a892-4887-9dc0-532ba0c8563c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:21.551120 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e673146-a892-4887-9dc0-532ba0c8563c None None] The sync data for ids ['8c9b2d33-abdb-40bb-ae90-72bc0a776f29'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:21.586069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fa877a77-6d70-4db3-9ad1-f0aaaec4941c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:21.586445 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.665162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6890cf3-7f18-4bac-8249-3f509953ebfb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=4b06adb2-e4b2-4edf-a6a9-4936dcf9b790,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:21.692555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6890cf3-7f18-4bac-8249-3f509953ebfb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.692775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fa877a77-6d70-4db3-9ad1-f0aaaec4941c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:21.694649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6698fb88-e677-43ca-b552-2988e9a178d0 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:21.696077 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a6890cf3-7f18-4bac-8249-3f509953ebfb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/4b06adb2-e4b2-4edf-a6a9-4936dcf9b790 HTTP/1.1" status: 204 len: 168 time: 1.7386189 Mar 24 02:15:21.709916 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58738) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:21.722256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.752859 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-a35cd4a5-c60e-4d36-8714-d57ec70f613a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:15:21.755545 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a35cd4a5-c60e-4d36-8714-d57ec70f613a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/4b06adb2-e4b2-4edf-a6a9-4936dcf9b790 HTTP/1.1" status: 404 len: 333 time: 0.0445685 Mar 24 02:15:21.761178 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58740) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:21.767137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'name': 'tempest-PortsTestJSON-79443016'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:21.789216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 6698fb88-e677-43ca-b552-2988e9a178d0 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:21.789589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.822506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3b504745-5e6e-4d04-a53c-ae6e0da51096 None None] Provisioning complete for port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:21.822934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3b504745-5e6e-4d04-a53c-ae6e0da51096 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.888635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3b504745-5e6e-4d04-a53c-ae6e0da51096 None None] Port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:21.910807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3b504745-5e6e-4d04-a53c-ae6e0da51096 None None] Provisioning complete for port 6698fb88-e677-43ca-b552-2988e9a178d0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:21.911440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3b504745-5e6e-4d04-a53c-ae6e0da51096 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:21.931006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.026032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.051139 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3b504745-5e6e-4d04-a53c-ae6e0da51096 None None] Current status of the port 6698fb88-e677-43ca-b552-2988e9a178d0 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:22.056188 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 6698fb88-e677-43ca-b552-2988e9a178d0 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:22.069574 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:22.092676 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:22.094744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:22.098669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.100991 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:22.185735 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7a168676-2ebe-496e-b06d-29a654f2a6be None None] Provisioning complete for port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:22.186237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7a168676-2ebe-496e-b06d-29a654f2a6be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.215250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-73a40220-5e84-45b0-9275-f92493984e4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (16ff0bcb-8742-460a-9cc6-a6e0e598bd52), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.224767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7a168676-2ebe-496e-b06d-29a654f2a6be None None] Port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:22.230912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 1b56f894-ddf9-4566-85d0-dfd01ed53956 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:22.240028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=be6cc3d7-c553-4ab5-82ae-05b89ab5c636,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:22.240409 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7699c9d9-971a-44c4-9e60-f2f5da495d30 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/routers/8c9b2d33-abdb-40bb-ae90-72bc0a776f29 HTTP/1.1" status: 200 len: 921 time: 0.8128028 Mar 24 02:15:22.241009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58742) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:22.242539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-73a40220-5e84-45b0-9275-f92493984e4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 16ff0bcb-8742-460a-9cc6-a6e0e598bd52 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:22.284522 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c6517ac9-d7af-4411-9d36-e940a4565ac9 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c9b2d33-abdb-40bb-ae90-72bc0a776f29 HTTP/1.1" status: 200 len: 205 time: 0.0393367 Mar 24 02:15:22.288158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58744) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:22.358115 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0cadebc5-afdd-4dfa-bd44-85bc64ed494c None None] Provisioning complete for port fa877a77-6d70-4db3-9ad1-f0aaaec4941c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:22.358498 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0cadebc5-afdd-4dfa-bd44-85bc64ed494c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.523461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.694838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Deleting port 843012a6-d00d-477a-8a59-ac34faaf055b {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:22.695221 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (843012a6-d00d-477a-8a59-ac34faaf055b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.711634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0cadebc5-afdd-4dfa-bd44-85bc64ed494c None None] Current status of the port fa877a77-6d70-4db3-9ad1-f0aaaec4941c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:22.765016 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (1b56f894-ddf9-4566-85d0-dfd01ed53956), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.793503 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.803065 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.814393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.815269 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.825934 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-73a40220-5e84-45b0-9275-f92493984e4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (16ff0bcb-8742-460a-9cc6-a6e0e598bd52), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.827516 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3449607d-80d2-4fa6-a4fd-98414ab18328 None None] Could not find standard attr ID for object 16ff0bcb-8742-460a-9cc6-a6e0e598bd52. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:22.858801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (1f63a954-e411-4138-b423-94a29a3b7505), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.884097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a40220-5e84-45b0-9275-f92493984e4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=16ff0bcb-8742-460a-9cc6-a6e0e598bd52,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:22.926759 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (843012a6-d00d-477a-8a59-ac34faaf055b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.958162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Calling delete_port for 843012a6-d00d-477a-8a59-ac34faaf055b owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:22.962462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-73a40220-5e84-45b0-9275-f92493984e4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:22.968247 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-73a40220-5e84-45b0-9275-f92493984e4e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/16ff0bcb-8742-460a-9cc6-a6e0e598bd52 HTTP/1.1" status: 204 len: 168 time: 1.9770477 Mar 24 02:15:22.969630 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58748) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:22.986415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (1b56f894-ddf9-4566-85d0-dfd01ed53956), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.002736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=a3d4d703-080d-4bed-82c7-4fbdbbfa5c03,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:23.050678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Deleting port 4a31b3fe-c12e-4b05-894b-d29baa692949 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:23.051557 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4a31b3fe-c12e-4b05-894b-d29baa692949), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.064244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:23.074552 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:23.082430 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:23.087627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:23.088247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.126916 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=1b56f894-ddf9-4566-85d0-dfd01ed53956,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:23.147852 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5d5629e-3ad3-4ee9-9fd6-9bc6289cc197 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:23.151785 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c5d5629e-3ad3-4ee9-9fd6-9bc6289cc197 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.1788664 Mar 24 02:15:23.154483 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58750) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:23.192168 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cb1eb3d8-8a8a-4a52-b945-e0ca8736dd94 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 844 time: 1.4267797 Mar 24 02:15:23.192168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 93c5002c-aaba-409a-ac62-41e827f93969 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:23.211062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fa877a77-6d70-4db3-9ad1-f0aaaec4941c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:23.217473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:23.224177 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58752) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:23.231878 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0442e922-fb31-4038-90fb-28be30c3b97a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:23.244708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4a31b3fe-c12e-4b05-894b-d29baa692949), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.271193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Calling delete_port for 4a31b3fe-c12e-4b05-894b-d29baa692949 owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:23.284491 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fa877a77-6d70-4db3-9ad1-f0aaaec4941c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:23.284822 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.372180 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26541bf8-1868-4441-948f-58641d6deb55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:23.373743 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-26541bf8-1868-4441-948f-58641d6deb55 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.2183189 Mar 24 02:15:23.381488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58754) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:23.408694 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fa877a77-6d70-4db3-9ad1-f0aaaec4941c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:23.411192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6698fb88-e677-43ca-b552-2988e9a178d0 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:23.423158 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0442e922-fb31-4038-90fb-28be30c3b97a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1b56f894-ddf9-4566-85d0-dfd01ed53956), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.437980 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (1f63a954-e411-4138-b423-94a29a3b7505), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.455228 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (843012a6-d00d-477a-8a59-ac34faaf055b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.480374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 6698fb88-e677-43ca-b552-2988e9a178d0 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:23.480909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.531185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7919fc9c-b69b-4b67-9fa8-d3787eb4c976 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:23.532498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7919fc9c-b69b-4b67-9fa8-d3787eb4c976 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:23.533926 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7919fc9c-b69b-4b67-9fa8-d3787eb4c976 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:23.536721 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7919fc9c-b69b-4b67-9fa8-d3787eb4c976 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.1540587 Mar 24 02:15:23.546088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58758) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:23.549696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event deleted for resources: {'Port': ['ID=843012a6-d00d-477a-8a59-ac34faaf055b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:23.583117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 6698fb88-e677-43ca-b552-2988e9a178d0 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:23.692251 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0cd53c6d-c4ca-4557-833f-f6c85e3d0088 None None] Provisioning complete for port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:23.692633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0cd53c6d-c4ca-4557-833f-f6c85e3d0088 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.701755 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-e1672355-f329-4b9f-959d-eea03797d481 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 10aba204-5510-435e-bb9a-1bef0715ce68 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:23.714730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1672355-f329-4b9f-959d-eea03797d481 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (10aba204-5510-435e-bb9a-1bef0715ce68), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.736293 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0cd53c6d-c4ca-4557-833f-f6c85e3d0088 None None] Port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:23.827736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (4a31b3fe-c12e-4b05-894b-d29baa692949), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.833191 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (678fbccb-a396-494b-8300-3227f087f043), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.837956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1672355-f329-4b9f-959d-eea03797d481 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (10aba204-5510-435e-bb9a-1bef0715ce68), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:23.886426 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event deleted for resources: {'Port': ['ID=4a31b3fe-c12e-4b05-894b-d29baa692949,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:23.949724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:24.090922 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0442e922-fb31-4038-90fb-28be30c3b97a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (1b56f894-ddf9-4566-85d0-dfd01ed53956), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.100935 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0442e922-fb31-4038-90fb-28be30c3b97a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (1b56f894-ddf9-4566-85d0-dfd01ed53956), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.158084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0442e922-fb31-4038-90fb-28be30c3b97a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] In _notify_port_updated(), no bound segment for port 1b56f894-ddf9-4566-85d0-dfd01ed53956 on network c8466e8e-4c16-4f91-aa0d-8651c7d4116a {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:15:24.163769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0442e922-fb31-4038-90fb-28be30c3b97a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:24.164404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0442e922-fb31-4038-90fb-28be30c3b97a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.168226 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0442e922-fb31-4038-90fb-28be30c3b97a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "PUT /v2.0/ports/1b56f894-ddf9-4566-85d0-dfd01ed53956 HTTP/1.1" status: 200 len: 818 time: 0.9387755 Mar 24 02:15:24.175647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58760) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:24.193623 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0442e922-fb31-4038-90fb-28be30c3b97a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=1b56f894-ddf9-4566-85d0-dfd01ed53956,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:24.215046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:24.225445 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:24.227020 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-968084fc-c030-4033-bce1-735d34831dec tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.0355563 Mar 24 02:15:24.227801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58762) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:24.236493 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:24.236990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:24.238852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1249806665'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:24.289279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 1f63a954-e411-4138-b423-94a29a3b7505 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:15:24.298698 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:24.302019 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.329699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:24.391219 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.399111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1672355-f329-4b9f-959d-eea03797d481 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (10aba204-5510-435e-bb9a-1bef0715ce68), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.402088 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 115} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:24.430320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (927da624-ebed-4101-bcc4-f658632d156c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.430747 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added segment 927da624-ebed-4101-bcc4-f658632d156c of type vlan for network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 Mar 24 02:15:24.444170 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-03f2d56e-c5c8-492d-ad49-367ebd09acea tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 1b56f894-ddf9-4566-85d0-dfd01ed53956 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:24.444538 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03f2d56e-c5c8-492d-ad49-367ebd09acea tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1b56f894-ddf9-4566-85d0-dfd01ed53956), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.521146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Router 678fbccb-a396-494b-8300-3227f087f043 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:24.530561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.534308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.540921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:21Z', 'revision_number': 3, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:22Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:24.551550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (97fcb308-ee86-471e-a60b-8b94d0aed9e6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.556524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03f2d56e-c5c8-492d-ad49-367ebd09acea tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1b56f894-ddf9-4566-85d0-dfd01ed53956), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.569766 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:24.573472 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:24.573828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Updating router d36063bd-d604-40b2-9839-addfdc6c944c port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:15:24.582130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-03f2d56e-c5c8-492d-ad49-367ebd09acea tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 1b56f894-ddf9-4566-85d0-dfd01ed53956 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:24.589851 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Sync routers for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:24.600603 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:24.601450 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:24.619188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.623901 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fd063b82-3f1e-4295-bc37-ba3c6321e03c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 6.8699498 Mar 24 02:15:24.624904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58764) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:24.625795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.657205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:24.663588 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5d02357f-5435-4c49-9555-bdc94243d503 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "PUT /v2.0/routers/678fbccb-a396-494b-8300-3227f087f043/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0079303 Mar 24 02:15:24.666859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58766) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:24.681804 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (97fcb308-ee86-471e-a60b-8b94d0aed9e6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.694811 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:24.695693 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.720662 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:24.753012 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bec55eb8-9fde-441e-8988-946d023fa4d1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for router (678fbccb-a396-494b-8300-3227f087f043), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.755441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (8c9b2d33-abdb-40bb-ae90-72bc0a776f29), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.755980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Fanout notify agent at l3_agent the message router_deleted on router 8c9b2d33-abdb-40bb-ae90-72bc0a776f29 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:15:24.764118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.765334 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-746075ee-0cf5-4cbd-8b0a-73f0016e98d0 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/8c9b2d33-abdb-40bb-ae90-72bc0a776f29 HTTP/1.1" status: 204 len: 168 time: 2.4762018 Mar 24 02:15:24.773531 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58770) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:24.800141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1672355-f329-4b9f-959d-eea03797d481 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (10aba204-5510-435e-bb9a-1bef0715ce68), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.808395 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1193213624', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': False}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:24.861606 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.6268485 Mar 24 02:15:24.863188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58772) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:24.868124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1672355-f329-4b9f-959d-eea03797d481 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.872359 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e1672355-f329-4b9f-959d-eea03797d481 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/10aba204-5510-435e-bb9a-1bef0715ce68 HTTP/1.1" status: 204 len: 168 time: 1.3239410 Mar 24 02:15:24.875139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1672355-f329-4b9f-959d-eea03797d481 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=10aba204-5510-435e-bb9a-1bef0715ce68,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:24.876768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58774) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:24.880729 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ac22f126-c5a3-4f69-933c-c6748fef1b72 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=6c0b7eea99a4423dac22912b1fa60ca2&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2201390 Mar 24 02:15:24.885941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58776) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:24.886082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'subnet': {'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'cidr': '2001:db8:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:2::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:24.962929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e61454d9-ddb6-4e7a-b934-f40ef470a5ab tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Network': ['ID=97fcb308-ee86-471e-a60b-8b94d0aed9e6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:24.982868 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (acb71783-5509-49e0-adff-499ad7a6d6ef), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:24.984278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (acb71783-5509-49e0-adff-499ad7a6d6ef), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.003040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bec55eb8-9fde-441e-8988-946d023fa4d1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (678fbccb-a396-494b-8300-3227f087f043), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.005552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bec55eb8-9fde-441e-8988-946d023fa4d1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for router_controller (678fbccb-a396-494b-8300-3227f087f043), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.014712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03f2d56e-c5c8-492d-ad49-367ebd09acea tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (1b56f894-ddf9-4566-85d0-dfd01ed53956), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.023387 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:15:22Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:25.038118 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03f2d56e-c5c8-492d-ad49-367ebd09acea tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.044462 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-03f2d56e-c5c8-492d-ad49-367ebd09acea tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/1b56f894-ddf9-4566-85d0-dfd01ed53956 HTTP/1.1" status: 204 len: 168 time: 0.8629043 Mar 24 02:15:25.048657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58778) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:25.054621 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Checking router: 1f63a954-e411-4138-b423-94a29a3b7505 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:25.055131 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Updating router 1f63a954-e411-4138-b423-94a29a3b7505 port be6cc3d7-c553-4ab5-82ae-05b89ab5c636 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:15:25.082007 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Publish callbacks [] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.088958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bec55eb8-9fde-441e-8988-946d023fa4d1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (678fbccb-a396-494b-8300-3227f087f043), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.089526 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bec55eb8-9fde-441e-8988-946d023fa4d1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Fanout notify agent at l3_agent the message router_deleted on router 678fbccb-a396-494b-8300-3227f087f043 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:15:25.095119 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.099055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8fe1d7c-fefa-463f-aa82-1c21e9a08bf2 None None] Sync routers for ids ['678fbccb-a396-494b-8300-3227f087f043'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:25.114547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f2d56e-c5c8-492d-ad49-367ebd09acea tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=1b56f894-ddf9-4566-85d0-dfd01ed53956,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:25.125520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0089a260-1250-441b-b420-a9e0c69972f0 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:25.127301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bec55eb8-9fde-441e-8988-946d023fa4d1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.128423 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bec55eb8-9fde-441e-8988-946d023fa4d1 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "DELETE /v2.0/routers/678fbccb-a396-494b-8300-3227f087f043 HTTP/1.1" status: 204 len: 168 time: 0.4606028 Mar 24 02:15:25.135411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58780) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:25.136662 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:25.142390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.196108 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_controller (acb71783-5509-49e0-adff-499ad7a6d6ef), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.223954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-ac1d7b0f-876a-4b3a-b21e-21e6f109b3a0 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Deleting subnet f0610870-6f1c-4e3c-b816-4ab5a7015c57 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:25.233066 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac1d7b0f-876a-4b3a-b21e-21e6f109b3a0 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for subnet (f0610870-6f1c-4e3c-b816-4ab5a7015c57), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.287352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8fe1d7c-fefa-463f-aa82-1c21e9a08bf2 None None] Routers set() bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:25.287843 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8fe1d7c-fefa-463f-aa82-1c21e9a08bf2 None None] Router IDs set() for agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:463}} Mar 24 02:15:25.288402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_agentschedulers_db [None req-c8fe1d7c-fefa-463f-aa82-1c21e9a08bf2 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'678fbccb-a396-494b-8300-3227f087f043'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent'). {{(pid=104038) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Mar 24 02:15:25.291388 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e5f7285-41c5-479f-b9e8-642bd0dba510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 4be25361-fe42-44ca-9770-b0e035cbeb42 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:25.323345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e5f7285-41c5-479f-b9e8-642bd0dba510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (4be25361-fe42-44ca-9770-b0e035cbeb42), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.343449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8fe1d7c-fefa-463f-aa82-1c21e9a08bf2 None None] Routers set() bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:25.343814 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8fe1d7c-fefa-463f-aa82-1c21e9a08bf2 None None] Router IDs set() for agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:463}} Mar 24 02:15:25.344409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_agentschedulers_db [None req-c8fe1d7c-fefa-463f-aa82-1c21e9a08bf2 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'678fbccb-a396-494b-8300-3227f087f043'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent'). {{(pid=104038) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Mar 24 02:15:25.344906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8fe1d7c-fefa-463f-aa82-1c21e9a08bf2 None None] The sync data for ids ['678fbccb-a396-494b-8300-3227f087f043'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:25.354068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3d303f-d1a9-4cf7-a3c8-9a6bd0d3da83 None None] Pushing event updated for resources: {'Port': ['ID=a3d4d703-080d-4bed-82c7-4fbdbbfa5c03,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:25.385729 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac1d7b0f-876a-4b3a-b21e-21e6f109b3a0 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (f0610870-6f1c-4e3c-b816-4ab5a7015c57), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.395665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:25.401892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.421602 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Publish callbacks [] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.430746 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.458298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9214f0c6-7afe-4843-81ee-03ac0c3cba88 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:25.463522 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Attempting to bind port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:25.463890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Attempting to bind port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'b57e537a-4271-4ac0-97f0-35d217bd7835', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:25.464250 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Attempting to bind port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 on network 93c5002c-aaba-409a-ac62-41e827f93969 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:25.464585 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Attempting to bind port be6cc3d7-c553-4ab5-82ae-05b89ab5c636 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:25.465057 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Attempting to bind port be6cc3d7-c553-4ab5-82ae-05b89ab5c636 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:25.465520 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Attempting to bind port be6cc3d7-c553-4ab5-82ae-05b89ab5c636 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:25.465729 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9214f0c6-7afe-4843-81ee-03ac0c3cba88 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.5781784 Mar 24 02:15:25.470874 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e5f7285-41c5-479f-b9e8-642bd0dba510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (4be25361-fe42-44ca-9770-b0e035cbeb42), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.473898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58782) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:25.482133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:25.482423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Checking segment: {'id': 'b57e537a-4271-4ac0-97f0-35d217bd7835', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:25.482874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.483311 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Bound using segment: {'id': 'b57e537a-4271-4ac0-97f0-35d217bd7835', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:25.483785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Bound port: a3d4d703-080d-4bed-82c7-4fbdbbfa5c03, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b57e537a-4271-4ac0-97f0-35d217bd7835', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:25.484160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.503674 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:25.504253 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:25.504907 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.505511 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:25.506257 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Bound port: be6cc3d7-c553-4ab5-82ae-05b89ab5c636, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:25.506902 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.578200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] For port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:25.583601 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] For port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a3d4d703-080d-4bed-82c7-4fbdbbfa5c03,segment=NetworkSegment(b57e537a-4271-4ac0-97f0-35d217bd7835),segment_id=b57e537a-4271-4ac0-97f0-35d217bd7835)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:25.595162 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.602272 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] For port be6cc3d7-c553-4ab5-82ae-05b89ab5c636, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:25.606380 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] For port be6cc3d7-c553-4ab5-82ae-05b89ab5c636, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=be6cc3d7-c553-4ab5-82ae-05b89ab5c636,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:25.616557 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.662464 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:25.663618 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:25.697953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e5f7285-41c5-479f-b9e8-642bd0dba510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (4be25361-fe42-44ca-9770-b0e035cbeb42), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.720030 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (26e1ee63-7d8e-4edb-a909-6a9a796c2d5b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.752717 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3d303f-d1a9-4cf7-a3c8-9a6bd0d3da83 None None] Pushing event updated for resources: {'Port': ['ID=a3d4d703-080d-4bed-82c7-4fbdbbfa5c03,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:25.763599 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:25.765764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:25.776826 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bc5ba75c-2924-4da0-b629-42c3991f685a tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2997875 Mar 24 02:15:25.781075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58784) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:25.783430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e5f7285-41c5-479f-b9e8-642bd0dba510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (4be25361-fe42-44ca-9770-b0e035cbeb42), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.792168 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1338236576', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:25.825840 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Subnet': ['ID=26e1ee63-7d8e-4edb-a909-6a9a796c2d5b,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:25.826628 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:25.954308 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:25.960002 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Pushing event updated for resources: {'Port': ['ID=be6cc3d7-c553-4ab5-82ae-05b89ab5c636,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:25.971629 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.971980 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.972335 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.973415 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.973415 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.973602 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.973874 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.974215 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.974550 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.978609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e5f7285-41c5-479f-b9e8-642bd0dba510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:25.978919 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.979301 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.979758 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.980105 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.980441 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.981227 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:25.996021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (acb71783-5509-49e0-adff-499ad7a6d6ef), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.005841 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7e5f7285-41c5-479f-b9e8-642bd0dba510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/4be25361-fe42-44ca-9770-b0e035cbeb42 HTTP/1.1" status: 204 len: 168 time: 1.1235154 Mar 24 02:15:26.005841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e5f7285-41c5-479f-b9e8-642bd0dba510 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=4be25361-fe42-44ca-9770-b0e035cbeb42,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:26.016736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58786) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:26.052183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c7faa6f4-1a31-43f9-8575-b3b3fb7ce7be None None] Provisioning complete for port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:26.053245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c7faa6f4-1a31-43f9-8575-b3b3fb7ce7be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.057189 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-908c84ee-e277-4783-a1db-d46d8457f66c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:26.059832 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-908c84ee-e277-4783-a1db-d46d8457f66c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 1.0094025 Mar 24 02:15:26.062828 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58788) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:26.134759 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2d5150e1-72ee-46ab-b09d-8ea4579a0fbe tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1167932 Mar 24 02:15:26.141051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac1d7b0f-876a-4b3a-b21e-21e6f109b3a0 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (f0610870-6f1c-4e3c-b816-4ab5a7015c57), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.143907 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58790) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:26.159613 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce582d78-4cd9-4f1d-9968-0027757a194b None None] Pushing event updated for resources: {'Port': ['ID=be6cc3d7-c553-4ab5-82ae-05b89ab5c636,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:26.161576 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-c651d9c6-306e-4a91-aeb1-524c0608674b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:15:26.161730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:26.166425 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c651d9c6-306e-4a91-aeb1-524c0608674b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/1b56f894-ddf9-4566-85d0-dfd01ed53956 HTTP/1.1" status: 404 len: 333 time: 0.0989738 Mar 24 02:15:26.168059 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58792) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:26.173999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1775734023'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:26.209185 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:26.212748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.218125 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:15:22Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:26.218436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Checking segment: {'id': '927da624-ebed-4101-bcc4-f658632d156c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:26.218580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network hostable DHCP agents. Network: 97fcb308-ee86-471e-a60b-8b94d0aed9e6, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:26.257436 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f775b7-311e-428d-be16-cb55b80dd1f9 None None] The sync data for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv is: [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:15:22Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:26.285775 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 133} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:26.308708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:26.336791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (f78f480f-9b99-427d-95eb-6b523e41ad01), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.337246 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Added segment f78f480f-9b99-427d-95eb-6b523e41ad01 of type vlan for network 6f4baa7f-2b71-4f44-946e-878882d49d9f Mar 24 02:15:26.353852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 97fcb308-ee86-471e-a60b-8b94d0aed9e6) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:26.366598 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:26.367352 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.374360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c7faa6f4-1a31-43f9-8575-b3b3fb7ce7be None None] Current status of the port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:26.374990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c7faa6f4-1a31-43f9-8575-b3b3fb7ce7be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.396760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-548370df-66a2-413b-a3ca-06e9d3ff5981 None None] Network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:26.419205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:21Z', 'revision_number': 3, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:25Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:26.434481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (6f4baa7f-2b71-4f44-946e-878882d49d9f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.449536 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-05f553e8-dc62-461d-81d7-8972dc61b9d4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.5676012 Mar 24 02:15:26.450302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58794) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:26.476282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f14922-8c1d-4719-9a72-e57aae7b5998 None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:21Z', 'revision_number': 3, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:25Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:26.524681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c7faa6f4-1a31-43f9-8575-b3b3fb7ce7be None None] For port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a3d4d703-080d-4bed-82c7-4fbdbbfa5c03,segment=NetworkSegment(b57e537a-4271-4ac0-97f0-35d217bd7835),segment_id=b57e537a-4271-4ac0-97f0-35d217bd7835)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:26.536341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c7faa6f4-1a31-43f9-8575-b3b3fb7ce7be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.651075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12ae7da8-6e5a-47c0-a121-cd43561b96a4 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:26.668070 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:26.669953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.703409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:26.707633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.719722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (6f4baa7f-2b71-4f44-946e-878882d49d9f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.725465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:26.726162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.818293 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac1d7b0f-876a-4b3a-b21e-21e6f109b3a0 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (f0610870-6f1c-4e3c-b816-4ab5a7015c57), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.848716 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac1d7b0f-876a-4b3a-b21e-21e6f109b3a0 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event deleted for resources: {'Subnet': ['ID=f0610870-6f1c-4e3c-b816-4ab5a7015c57,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:26.855010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:26.859041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.931650 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac1d7b0f-876a-4b3a-b21e-21e6f109b3a0 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:26.934993 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ac1d7b0f-876a-4b3a-b21e-21e6f109b3a0 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "DELETE /v2.0/subnets/f0610870-6f1c-4e3c-b816-4ab5a7015c57 HTTP/1.1" status: 204 len: 168 time: 1.7964537 Mar 24 02:15:26.942919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58796) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:27.015392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fafa4035-a2b0-4192-946d-1d57f3859c7d None None] Network 865b7da0-660b-4753-ad39-55ce579ff27d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:27.043352 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (865b7da0-660b-4753-ad39-55ce579ff27d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:27.054805 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.8845637 Mar 24 02:15:27.055944 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58798) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:27.066421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7466e295-9161-4f14-881f-c9c11786797e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Network': ['ID=6f4baa7f-2b71-4f44-946e-878882d49d9f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:27.067195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:27.125598 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (acb71783-5509-49e0-adff-499ad7a6d6ef), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:27.126823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:27.150292 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:27.248835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7faa6f4-1a31-43f9-8575-b3b3fb7ce7be None None] Pushing event updated for resources: {'Port': ['ID=a3d4d703-080d-4bed-82c7-4fbdbbfa5c03,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:27.277042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c5969ffd-f61c-4058-8683-30d1c13cdde5 None None] Provisioning complete for port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:27.277419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5969ffd-f61c-4058-8683-30d1c13cdde5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:27.389680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device be6cc3d7-c553-4ab5-82ae-05b89ab5c636 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:27.452491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (852aacbf-87d9-49af-b73c-786b9253307e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:27.473161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Allocated IP 172.26.2.166 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:27.497796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:27.505935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:27.545662 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cc841258-8bbf-4dc9-abe4-9c233622c41d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:27.734560 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Allocated IP 2001:db8:2::2 (97fcb308-ee86-471e-a60b-8b94d0aed9e6/26e1ee63-7d8e-4edb-a909-6a9a796c2d5b/2823099e-1b16-4672-9222-fa884b5d898f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:27.814840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4112d31a-e0e0-460e-baa7-df3757d9a5bb None None] DHCP port deletion for 865b7da0-660b-4753-ad39-55ce579ff27d request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:27.832459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port be6cc3d7-c553-4ab5-82ae-05b89ab5c636 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:27.832666 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:15:27.833102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:27.877556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Subnet': ['ID=852aacbf-87d9-49af-b73c-786b9253307e,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:27.878328 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-105174f3-988f-4adc-93ed-ee2bf5d0a75e None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:27.959219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c5969ffd-f61c-4058-8683-30d1c13cdde5 None None] Current status of the port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:28.006569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Checking segment: {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:28.006944 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network hostable DHCP agents. Network: 4ce8d77b-f4f5-4987-9cce-04a12234cd5d, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:28.019341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Deleting port d5b5a62a-862a-4c47-a76b-7176b3707e7c {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:28.027280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.070864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c5969ffd-f61c-4058-8683-30d1c13cdde5 None None] Provisioning complete for port fa877a77-6d70-4db3-9ad1-f0aaaec4941c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:28.071297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5969ffd-f61c-4058-8683-30d1c13cdde5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.111386 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port be6cc3d7-c553-4ab5-82ae-05b89ab5c636 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:28.112234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.118851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:28.158615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 4ce8d77b-f4f5-4987-9cce-04a12234cd5d) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:28.164232 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:28.164831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.173796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Publish callbacks [] for port (2823099e-1b16-4672-9222-fa884b5d898f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.175960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] For port d5b5a62a-862a-4c47-a76b-7176b3707e7c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d5b5a62a-862a-4c47-a76b-7176b3707e7c,segment=NetworkSegment(825566a2-a114-400b-b59a-dc08809da829),segment_id=825566a2-a114-400b-b59a-dc08809da829)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:28.176883 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4112d31a-e0e0-460e-baa7-df3757d9a5bb None None] Deleting port d5b5a62a-862a-4c47-a76b-7176b3707e7c {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:28.177247 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4112d31a-e0e0-460e-baa7-df3757d9a5bb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.177461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.179956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port be6cc3d7-c553-4ab5-82ae-05b89ab5c636, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=be6cc3d7-c553-4ab5-82ae-05b89ab5c636,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:28.221721 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8bc3455-09b0-40c1-996d-af714a7bd987 None None] Network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:28.224354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.226700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Calling delete_port for d5b5a62a-862a-4c47-a76b-7176b3707e7c owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:28.230737 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.235929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.236695 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:28.239009 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (2823099e-1b16-4672-9222-fa884b5d898f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.243923 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-105174f3-988f-4adc-93ed-ee2bf5d0a75e None None] Deleting port fa877a77-6d70-4db3-9ad1-f0aaaec4941c {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:28.244600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-105174f3-988f-4adc-93ed-ee2bf5d0a75e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.248454 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-61cdb2b3-a9b5-4f7f-a6ae-28501d595bf7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 2.4625278 Mar 24 02:15:28.250960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58800) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:28.377079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (77524766-c63f-44d6-a6df-ae1c18097bb3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.384815 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.419576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:28.436358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4112d31a-e0e0-460e-baa7-df3757d9a5bb None None] For port d5b5a62a-862a-4c47-a76b-7176b3707e7c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d5b5a62a-862a-4c47-a76b-7176b3707e7c,segment=NetworkSegment(825566a2-a114-400b-b59a-dc08809da829),segment_id=825566a2-a114-400b-b59a-dc08809da829)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:28.436760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4112d31a-e0e0-460e-baa7-df3757d9a5bb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.442432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:28.484272 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:28.501796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=77524766-c63f-44d6-a6df-ae1c18097bb3,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:28.508975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.512221 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Checking segment: {'id': 'f78f480f-9b99-427d-95eb-6b523e41ad01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:28.512501 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network hostable DHCP agents. Network: 6f4baa7f-2b71-4f44-946e-878882d49d9f, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:28.516113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4112d31a-e0e0-460e-baa7-df3757d9a5bb None None] Calling delete_port for d5b5a62a-862a-4c47-a76b-7176b3707e7c owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:28.527119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=be6cc3d7-c553-4ab5-82ae-05b89ab5c636,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:28.542507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] For port fa877a77-6d70-4db3-9ad1-f0aaaec4941c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:28.560225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:28.581888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 6f4baa7f-2b71-4f44-946e-878882d49d9f) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:28.587110 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:28.593220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:28.594130 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.598349 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.602617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:28.611993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:28.615166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c5969ffd-f61c-4058-8683-30d1c13cdde5 None None] Current status of the port fa877a77-6d70-4db3-9ad1-f0aaaec4941c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:28.616790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.622255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.630993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event updated for resources: {'Port': ['ID=a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:28.634471 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b399888f-ad89-41f1-953a-fa05a54e317e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5750420 Mar 24 02:15:28.680950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-616f6741-c65f-449f-b366-4190a5b2ba55 None None] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:28.708903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,revision_number=8']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:28.713713 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58802) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:28.718359 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (ccba19f2-5556-4978-b044-9e51066b2aa5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.731929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ec6b798d-26a3-4e59-99b6-8c4c51de25e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:28.742394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:28.762181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:28.762500 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:28.762778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.766039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:28.767250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.780651 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-105174f3-988f-4adc-93ed-ee2bf5d0a75e None None] For port fa877a77-6d70-4db3-9ad1-f0aaaec4941c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:28.781687 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-105174f3-988f-4adc-93ed-ee2bf5d0a75e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.800390 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.6480408 Mar 24 02:15:28.803386 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58804) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:28.809003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-469acc83-b1af-414e-b10a-1795840c76b1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:28.859647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b33ba413-f455-4ca3-879f-feac68ef833b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=ccba19f2-5556-4978-b044-9e51066b2aa5,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:28.873442 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] No DVR routers for this DVR port d5b5a62a-862a-4c47-a76b-7176b3707e7c on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:28.877727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event deleted for resources: {'Port': ['ID=d5b5a62a-862a-4c47-a76b-7176b3707e7c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:28.949291 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-469acc83-b1af-414e-b10a-1795840c76b1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:28.951098 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Pushing event updated for resources: {'Port': ['ID=2823099e-1b16-4672-9222-fa884b5d898f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:28.956447 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-469acc83-b1af-414e-b10a-1795840c76b1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.964336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:28.964774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:28.975384 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Attempting to bind port 2823099e-1b16-4672-9222-fa884b5d898f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:28.975851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Attempting to bind port 2823099e-1b16-4672-9222-fa884b5d898f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '927da624-ebed-4101-bcc4-f658632d156c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:28.976279 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Attempting to bind port 2823099e-1b16-4672-9222-fa884b5d898f on network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:29.008594 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-105174f3-988f-4adc-93ed-ee2bf5d0a75e None None] Calling delete_port for fa877a77-6d70-4db3-9ad1-f0aaaec4941c owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:29.039430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:29.039819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Checking segment: {'id': '927da624-ebed-4101-bcc4-f658632d156c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:29.040266 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.040820 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Bound using segment: {'id': '927da624-ebed-4101-bcc4-f658632d156c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:29.041394 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Bound port: 2823099e-1b16-4672-9222-fa884b5d898f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '927da624-ebed-4101-bcc4-f658632d156c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:29.041833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2823099e-1b16-4672-9222-fa884b5d898f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.085691 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.ipam_backend_mixin [None req-469acc83-b1af-414e-b10a-1795840c76b1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet ccba19f2-5556-4978-b044-9e51066b2aa5 (CIDR: 2001:db8::/64) Mar 24 02:15:29.090218 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-469acc83-b1af-414e-b10a-1795840c76b1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:15:29.090806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-469acc83-b1af-414e-b10a-1795840c76b1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:29.115430 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-469acc83-b1af-414e-b10a-1795840c76b1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3079295 Mar 24 02:15:29.115809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58808) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:29.121682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:29.229636 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4112d31a-e0e0-460e-baa7-df3757d9a5bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (d5b5a62a-862a-4c47-a76b-7176b3707e7c), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.260586 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:29.262859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (865b7da0-660b-4753-ad39-55ce579ff27d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.264285 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.282033 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f4baa7f-2b71-4f44-946e-878882d49d9f', 'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f', 'project_id': '59047855c41744dd95105383d31cd553', 'fixed_ips': [{'subnet_id': '77524766-c63f-44d6-a6df-ae1c18097bb3'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:29.282982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.321371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4112d31a-e0e0-460e-baa7-df3757d9a5bb None None] Pushing event deleted for resources: {'Port': ['ID=d5b5a62a-862a-4c47-a76b-7176b3707e7c,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:29.351838 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4112d31a-e0e0-460e-baa7-df3757d9a5bb None None] No DVR routers for this DVR port d5b5a62a-862a-4c47-a76b-7176b3707e7c on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:29.412974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] For port 2823099e-1b16-4672-9222-fa884b5d898f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:29.419247 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Allocated IP 172.20.0.2 (4ce8d77b-f4f5-4987-9cce-04a12234cd5d/852aacbf-87d9-49af-b73c-786b9253307e/a8660dbb-71b0-408c-97bd-d62ccfd2232c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:29.430343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:29.513282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] For port 2823099e-1b16-4672-9222-fa884b5d898f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2823099e-1b16-4672-9222-fa884b5d898f,segment=NetworkSegment(927da624-ebed-4101-bcc4-f658632d156c),segment_id=927da624-ebed-4101-bcc4-f658632d156c)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:29.534630 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2823099e-1b16-4672-9222-fa884b5d898f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.540587 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (acb71783-5509-49e0-adff-499ad7a6d6ef), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.570453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (c4e19c6d-57a9-4795-8342-1100d61a56ec), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.584956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device be6cc3d7-c553-4ab5-82ae-05b89ab5c636 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:29.617547 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:29.622797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:29.627999 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:29.628313 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['865b7da0-660b-4753-ad39-55ce579ff27d']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:29.629436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.635905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=c4e19c6d-57a9-4795-8342-1100d61a56ec,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:29.652622 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-87f2d327-9141-4ebf-812a-3f847660151d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.5356507 Mar 24 02:15:29.655215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58810) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:29.662000 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:49:4e:a3', 'name': 'tempest-NetworksTestDHCPv6-267645425'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:29.703722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-105174f3-988f-4adc-93ed-ee2bf5d0a75e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (fa877a77-6d70-4db3-9ad1-f0aaaec4941c), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.759406 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5bb1e0-98b6-4642-8218-34acc3ae2d85 None None] Pushing event updated for resources: {'Port': ['ID=2823099e-1b16-4672-9222-fa884b5d898f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:29.795162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:29.811337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Allocated IP 172.20.0.2 (6f4baa7f-2b71-4f44-946e-878882d49d9f/77524766-c63f-44d6-a6df-ae1c18097bb3/e7daf644-6aca-4c51-b17b-b82dd20b11a2) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:29.845551 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-105174f3-988f-4adc-93ed-ee2bf5d0a75e None None] Pushing event deleted for resources: {'Port': ['ID=fa877a77-6d70-4db3-9ad1-f0aaaec4941c,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:29.873668 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-105174f3-988f-4adc-93ed-ee2bf5d0a75e None None] No DVR routers for this DVR port fa877a77-6d70-4db3-9ad1-f0aaaec4941c on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:29.906015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:29.932571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 02f40670-e322-4f49-b0a8-40b4ce1ec0e3 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:30.013748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port be6cc3d7-c553-4ab5-82ae-05b89ab5c636 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:30.014417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.037777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '825566a2-a114-400b-b59a-dc08809da829') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:30.038068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '825566a2-a114-400b-b59a-dc08809da829') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:30.060939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd375479-d404-444a-96bb-916bc47f0c02 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:30.072393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 2001:db8:2::1 (97fcb308-ee86-471e-a60b-8b94d0aed9e6/26e1ee63-7d8e-4edb-a909-6a9a796c2d5b/3f9f9d5e-7262-4cb8-8f93-06abc7097f13) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:30.082354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (825566a2-a114-400b-b59a-dc08809da829), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.107614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec6b798d-26a3-4e59-99b6-8c4c51de25e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:30.111022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ec6b798d-26a3-4e59-99b6-8c4c51de25e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.164184 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (825566a2-a114-400b-b59a-dc08809da829), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.204829 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Publish callbacks [] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.205034 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8:0:1::1ff (6f3080fc-791f-4748-a0a2-9eff6ea2a609/c4e19c6d-57a9-4795-8342-1100d61a56ec/02f40670-e322-4f49-b0a8-40b4ce1ec0e3) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:30.217387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::f816:3eff:fe49:4ea3 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/ccba19f2-5556-4978-b044-9e51066b2aa5/02f40670-e322-4f49-b0a8-40b4ce1ec0e3) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:30.217944 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Releasing vlan 106 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:15:30.218437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (825566a2-a114-400b-b59a-dc08809da829), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:15:30.233553 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:15:30.249697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.330455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:30.335600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Publish callbacks [] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.341243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:30.352062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:30.359328 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.385272 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Pushing event updated for resources: {'Port': ['ID=a8660dbb-71b0-408c-97bd-d62ccfd2232c,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:30.399134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (02f40670-e322-4f49-b0a8-40b4ce1ec0e3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.443504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (02f40670-e322-4f49-b0a8-40b4ce1ec0e3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.461671 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': 'c4e19c6d-57a9-4795-8342-1100d61a56ec'}, {'subnet_id': 'ccba19f2-5556-4978-b044-9e51066b2aa5'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:30.462564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.468258 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:30.482285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (865b7da0-660b-4753-ad39-55ce579ff27d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.489988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:30.493445 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:30.498317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:30.500610 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.504065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:30.504512 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.515228 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] 10.222.0.20 "DELETE /v2.0/networks/865b7da0-660b-4753-ad39-55ce579ff27d HTTP/1.1" status: 204 len: 168 time: 3.5607381 Mar 24 02:15:30.515393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:30.526469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=02f40670-e322-4f49-b0a8-40b4ce1ec0e3,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:30.527900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:30.531254 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port be6cc3d7-c553-4ab5-82ae-05b89ab5c636 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:30.532305 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:30.536658 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ca8f9343-6150-4bf8-b556-517c33be09db tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 0.8799534 Mar 24 02:15:30.539593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58814) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:30.578801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Pushing event updated for resources: {'Port': ['ID=e7daf644-6aca-4c51-b17b-b82dd20b11a2,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:30.581082 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Attempting to bind port a8660dbb-71b0-408c-97bd-d62ccfd2232c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:30.581447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Attempting to bind port a8660dbb-71b0-408c-97bd-d62ccfd2232c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:30.581803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Attempting to bind port a8660dbb-71b0-408c-97bd-d62ccfd2232c on network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:30.590489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9027f4d6-24c9-4af4-ab43-1282d948623c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.613237 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.ipam_backend_mixin [None req-ec6b798d-26a3-4e59-99b6-8c4c51de25e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 77524766-c63f-44d6-a6df-ae1c18097bb3 (CIDR: 172.20.0.0/28) Mar 24 02:15:30.622660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.646858 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-ec6b798d-26a3-4e59-99b6-8c4c51de25e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:15:30.647534 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ec6b798d-26a3-4e59-99b6-8c4c51de25e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:30.649772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb0f3da2-9d6e-48e4-8e8b-ff6d684ee181 tempest-FloatingIPNegativeTestJSON-6244068 tempest-FloatingIPNegativeTestJSON-6244068-project] Pushing event deleted for resources: {'Network': ['ID=865b7da0-660b-4753-ad39-55ce579ff27d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:30.663758 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:30.664135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Checking segment: {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:30.664930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.664930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Bound using segment: {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:30.665449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Bound port: a8660dbb-71b0-408c-97bd-d62ccfd2232c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:30.665830 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.680143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-65d324a8-6ac4-4589-a662-16b8e5e93383 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 02f40670-e322-4f49-b0a8-40b4ce1ec0e3 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:30.681060 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-65d324a8-6ac4-4589-a662-16b8e5e93383 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (02f40670-e322-4f49-b0a8-40b4ce1ec0e3), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.710315 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.736851 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ec6b798d-26a3-4e59-99b6-8c4c51de25e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 2.0162680 Mar 24 02:15:30.742230 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58816) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:30.747552 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:30.767390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Attempting to bind port e7daf644-6aca-4c51-b17b-b82dd20b11a2 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:30.767757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Attempting to bind port e7daf644-6aca-4c51-b17b-b82dd20b11a2 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'f78f480f-9b99-427d-95eb-6b523e41ad01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:30.768119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Attempting to bind port e7daf644-6aca-4c51-b17b-b82dd20b11a2 on network 6f4baa7f-2b71-4f44-946e-878882d49d9f {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:30.806444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:30.806848 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Checking segment: {'id': 'f78f480f-9b99-427d-95eb-6b523e41ad01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:30.807256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.807643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Bound using segment: {'id': 'f78f480f-9b99-427d-95eb-6b523e41ad01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:30.808132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Bound port: e7daf644-6aca-4c51-b17b-b82dd20b11a2, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f78f480f-9b99-427d-95eb-6b523e41ad01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:30.808514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.845843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-65d324a8-6ac4-4589-a662-16b8e5e93383 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (02f40670-e322-4f49-b0a8-40b4ce1ec0e3), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.864750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-65d324a8-6ac4-4589-a662-16b8e5e93383 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 02f40670-e322-4f49-b0a8-40b4ce1ec0e3 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:30.898656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:30.938289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58820) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:30.987147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (acb71783-5509-49e0-adff-499ad7a6d6ef), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.094481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:31.109931 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-65d324a8-6ac4-4589-a662-16b8e5e93383 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (02f40670-e322-4f49-b0a8-40b4ce1ec0e3), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.113374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:31.116539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:31.117472 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.125693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.126561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:31.126928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.146229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] For port a8660dbb-71b0-408c-97bd-d62ccfd2232c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:31.172105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d324a8-6ac4-4589-a662-16b8e5e93383 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=02f40670-e322-4f49-b0a8-40b4ce1ec0e3,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:31.192710 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=3f9f9d5e-7262-4cb8-8f93-06abc7097f13,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:31.236994 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-65d324a8-6ac4-4589-a662-16b8e5e93383 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.252328 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-65d324a8-6ac4-4589-a662-16b8e5e93383 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/02f40670-e322-4f49-b0a8-40b4ce1ec0e3 HTTP/1.1" status: 204 len: 168 time: 0.7112863 Mar 24 02:15:31.254866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58824) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:31.256442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] For port a8660dbb-71b0-408c-97bd-d62ccfd2232c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a8660dbb-71b0-408c-97bd-d62ccfd2232c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:31.295034 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.302365 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-13eb32ce-c848-4ede-97e0-3385ecfa5704 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0432200 Mar 24 02:15:31.303246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58826) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:31.320185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7be13501-7fd7-4e43-bf40-f38a777ae66c None None] Network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:31.327545 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Allocated IP 2001:db8:0:1::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/c4e19c6d-57a9-4795-8342-1100d61a56ec/5692a503-01ca-4041-94b0-cc3f2309e2f7) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:31.340241 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9fbfc4ce-aef3-4d85-bd58-aa19916a3307 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0362382 Mar 24 02:15:31.343076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58828) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:31.393104 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Allocated IP 2001:db8::f816:3eff:feb7:a637 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/ccba19f2-5556-4978-b044-9e51066b2aa5/5692a503-01ca-4041-94b0-cc3f2309e2f7) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:31.396269 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] For port e7daf644-6aca-4c51-b17b-b82dd20b11a2, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:31.404487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a10d625-16d0-412f-a4ae-48b076e40443 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:31.405819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a10d625-16d0-412f-a4ae-48b076e40443 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:31.407148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a10d625-16d0-412f-a4ae-48b076e40443 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:31.411852 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4a10d625-16d0-412f-a4ae-48b076e40443 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.0648768 Mar 24 02:15:31.412336 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58830) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:31.450884 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fc85f24c-ce73-4849-b99e-8b16475f4f1d admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=64fcebf53303474789f3b0a392800f49&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5022333 Mar 24 02:15:31.451081 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58832) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:31.465957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:31.469320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.487230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] For port e7daf644-6aca-4c51-b17b-b82dd20b11a2, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e7daf644-6aca-4c51-b17b-b82dd20b11a2,segment=NetworkSegment(f78f480f-9b99-427d-95eb-6b523e41ad01),segment_id=f78f480f-9b99-427d-95eb-6b523e41ad01)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:31.513469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-49e9f7d2-e691-4d06-b0d9-760c9e2f0a29 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet c4e19c6d-57a9-4795-8342-1100d61a56ec {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:31.558470 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669503b8-81f1-420c-a341-a63f3ab51e98 None None] Pushing event updated for resources: {'Port': ['ID=a8660dbb-71b0-408c-97bd-d62ccfd2232c,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:31.561573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.578371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-140d3818-a6e5-4742-bd26-173593842de5 None None] Provisioning complete for port 2823099e-1b16-4672-9222-fa884b5d898f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:31.578762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-140d3818-a6e5-4742-bd26-173593842de5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2823099e-1b16-4672-9222-fa884b5d898f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.581936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.609220 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:31.749474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429cfb29-2fa6-449c-8f9e-a8dfc2ac2566 None None] Pushing event updated for resources: {'Port': ['ID=e7daf644-6aca-4c51-b17b-b82dd20b11a2,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:31.757851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fa877a77-6d70-4db3-9ad1-f0aaaec4941c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:31.776904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-40f969b5-44cf-4f47-b41b-b778451f7da3 admin admin] Publish callbacks [] for security_group (f0f8a87f-9bfa-4e4c-85f6-1a241311675d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.789792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Router acb71783-5509-49e0-adff-499ad7a6d6ef is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:15:31.819017 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: fa877a77-6d70-4db3-9ad1-f0aaaec4941c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:31.819266 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fa877a77-6d70-4db3-9ad1-f0aaaec4941c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:31.819634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d5b5a62a-862a-4c47-a76b-7176b3707e7c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:31.851897 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d5b5a62a-862a-4c47-a76b-7176b3707e7c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:31.852205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d5b5a62a-862a-4c47-a76b-7176b3707e7c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:31.884903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Publish callbacks [] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.896560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-49e9f7d2-e691-4d06-b0d9-760c9e2f0a29 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (c4e19c6d-57a9-4795-8342-1100d61a56ec), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.916608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-40f969b5-44cf-4f47-b41b-b778451f7da3 admin admin] Publish callbacks [] for security_group (f0f8a87f-9bfa-4e4c-85f6-1a241311675d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:31.931015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.1 (4ce8d77b-f4f5-4987-9cce-04a12234cd5d/852aacbf-87d9-49af-b73c-786b9253307e/7b1d481b-3bfa-4756-b24a-0449c4204f8c) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:31.955111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.020488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:32.021220 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-140d3818-a6e5-4742-bd26-173593842de5 None None] Current status of the port 2823099e-1b16-4672-9222-fa884b5d898f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:32.021589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-140d3818-a6e5-4742-bd26-173593842de5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2823099e-1b16-4672-9222-fa884b5d898f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.034790 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:32.042582 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:32.044642 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Pushing event updated for resources: {'Port': ['ID=5692a503-01ca-4041-94b0-cc3f2309e2f7,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:32.105118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-49e9f7d2-e691-4d06-b0d9-760c9e2f0a29 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (c4e19c6d-57a9-4795-8342-1100d61a56ec), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.161599 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-140d3818-a6e5-4742-bd26-173593842de5 None None] For port 2823099e-1b16-4672-9222-fa884b5d898f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2823099e-1b16-4672-9222-fa884b5d898f,segment=NetworkSegment(927da624-ebed-4101-bcc4-f658632d156c),segment_id=927da624-ebed-4101-bcc4-f658632d156c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:32.216142 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-140d3818-a6e5-4742-bd26-173593842de5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2823099e-1b16-4672-9222-fa884b5d898f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.241043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-49e9f7d2-e691-4d06-b0d9-760c9e2f0a29 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (c4e19c6d-57a9-4795-8342-1100d61a56ec), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.244436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Attempting to bind port 5692a503-01ca-4041-94b0-cc3f2309e2f7 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:32.244805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Attempting to bind port 5692a503-01ca-4041-94b0-cc3f2309e2f7 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:32.245361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Attempting to bind port 5692a503-01ca-4041-94b0-cc3f2309e2f7 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:32.308503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2823099e-1b16-4672-9222-fa884b5d898f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:32.310799 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:32.311186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:32.311602 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.312015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:32.312507 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Bound port: 5692a503-01ca-4041-94b0-cc3f2309e2f7, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:32.313018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.352998 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-49e9f7d2-e691-4d06-b0d9-760c9e2f0a29 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (c4e19c6d-57a9-4795-8342-1100d61a56ec), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.409184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49e9f7d2-e691-4d06-b0d9-760c9e2f0a29 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=c4e19c6d-57a9-4795-8342-1100d61a56ec,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:32.418232 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-49e9f7d2-e691-4d06-b0d9-760c9e2f0a29 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.421478 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-49e9f7d2-e691-4d06-b0d9-760c9e2f0a29 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/c4e19c6d-57a9-4795-8342-1100d61a56ec HTTP/1.1" status: 204 len: 168 time: 1.0081413 Mar 24 02:15:32.425128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58834) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:32.434501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-140d3818-a6e5-4742-bd26-173593842de5 None None] Pushing event updated for resources: {'Port': ['ID=2823099e-1b16-4672-9222-fa884b5d898f,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:32.437219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.484069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 2823099e-1b16-4672-9222-fa884b5d898f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:32.484592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2823099e-1b16-4672-9222-fa884b5d898f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.492720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] For port 5692a503-01ca-4041-94b0-cc3f2309e2f7, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:32.497768 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] For port 5692a503-01ca-4041-94b0-cc3f2309e2f7, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5692a503-01ca-4041-94b0-cc3f2309e2f7,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:32.500117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-f3d763fe-bd38-48d9-8a6e-e3b300eee208 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet ccba19f2-5556-4978-b044-9e51066b2aa5 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:32.503595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3d763fe-bd38-48d9-8a6e-e3b300eee208 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (ccba19f2-5556-4978-b044-9e51066b2aa5), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.544935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.564731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3d763fe-bd38-48d9-8a6e-e3b300eee208 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (ccba19f2-5556-4978-b044-9e51066b2aa5), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.638330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-09892a2c-d1e9-4ead-ab3f-0494a8d3c0ce None None] Provisioning complete for port 2823099e-1b16-4672-9222-fa884b5d898f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:32.639106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-09892a2c-d1e9-4ead-ab3f-0494a8d3c0ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2823099e-1b16-4672-9222-fa884b5d898f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.705309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3d763fe-bd38-48d9-8a6e-e3b300eee208 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (ccba19f2-5556-4978-b044-9e51066b2aa5), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.719247 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c182d125-9064-4039-a57a-adb5fa5caf6a None None] Pushing event updated for resources: {'Port': ['ID=5692a503-01ca-4041-94b0-cc3f2309e2f7,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:32.754570 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39857bae-b6c8-4a37-8fd5-72b05f77efba None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:32.803361 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3d763fe-bd38-48d9-8a6e-e3b300eee208 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (ccba19f2-5556-4978-b044-9e51066b2aa5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.808973 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2823099e-1b16-4672-9222-fa884b5d898f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:32.810075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a8660dbb-71b0-408c-97bd-d62ccfd2232c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:32.853970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d763fe-bd38-48d9-8a6e-e3b300eee208 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=ccba19f2-5556-4978-b044-9e51066b2aa5,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:32.856522 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f3d763fe-bd38-48d9-8a6e-e3b300eee208 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.865283 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f3d763fe-bd38-48d9-8a6e-e3b300eee208 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/ccba19f2-5556-4978-b044-9e51066b2aa5 HTTP/1.1" status: 204 len: 168 time: 0.4371989 Mar 24 02:15:32.865931 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58836) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:32.929752 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-09892a2c-d1e9-4ead-ab3f-0494a8d3c0ce None None] Current status of the port 2823099e-1b16-4672-9222-fa884b5d898f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:32.939907 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9a5cce1c-d0bd-4b9c-8988-70e48186adb3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0726552 Mar 24 02:15:32.942902 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58838) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:32.948823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:32.963967 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a8660dbb-71b0-408c-97bd-d62ccfd2232c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:32.964618 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:32.996049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-09892a2c-d1e9-4ead-ab3f-0494a8d3c0ce None None] Provisioning complete for port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:32.996673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-09892a2c-d1e9-4ead-ab3f-0494a8d3c0ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.038861 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:33.046555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-40f969b5-44cf-4f47-b41b-b778451f7da3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f0f8a87f-9bfa-4e4c-85f6-1a241311675d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.049089 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-40f969b5-44cf-4f47-b41b-b778451f7da3 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.052943 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-40f969b5-44cf-4f47-b41b-b778451f7da3 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/f0f8a87f-9bfa-4e4c-85f6-1a241311675d HTTP/1.1" status: 204 len: 168 time: 1.5962183 Mar 24 02:15:33.057266 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Sync routers for ids ['acb71783-5509-49e0-adff-499ad7a6d6ef'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:33.083564 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Routers {'acb71783-5509-49e0-adff-499ad7a6d6ef'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:33.084208 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['acb71783-5509-49e0-adff-499ad7a6d6ef'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:33.092867 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40f969b5-44cf-4f47-b41b-b778451f7da3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0f8a87f-9bfa-4e4c-85f6-1a241311675d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:33.106917 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:33.115590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.174316 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-09892a2c-d1e9-4ead-ab3f-0494a8d3c0ce None None] Port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:33.206361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.211224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.226110 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.233277 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6834255b-a1f8-431f-b782-758074d77dfa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 908 time: 8.4282379 Mar 24 02:15:33.239864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58842) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:33.322950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2667de56-6c6d-40b6-9817-f15e6939facd None None] Update dhcp port {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': 'ccba19f2-5556-4978-b044-9e51066b2aa5'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': '5692a503-01ca-4041-94b0-cc3f2309e2f7'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:15:33.346544 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Set router acb71783-5509-49e0-adff-499ad7a6d6ef gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:33.386847 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2667de56-6c6d-40b6-9817-f15e6939facd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.389016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5dacdb1-d3a3-443f-bce9-dec5a59b245c None None] Network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:33.503273 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:33.523362 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (ac319f4a-9335-45b4-9176-ca0152a41a6b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.533940 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.551740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:33.557973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.558975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.604759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:33.608094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:33.612192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:33.618146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:33.619391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.623810 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=ac319f4a-9335-45b4-9176-ca0152a41a6b,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:33.657422 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e826fcc9-80f1-46b6-88d9-0e5fcb49fa29 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/routers/acb71783-5509-49e0-adff-499ad7a6d6ef HTTP/1.1" status: 200 len: 909 time: 0.4100456 Mar 24 02:15:33.658362 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7485b48d-7a89-4f0f-88b2-afec1ba40374 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.7142375 Mar 24 02:15:33.660033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58850) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:33.660391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:33.660891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58852) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:33.661168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.668815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e6d3fda8-b480-4529-8f16-e6bc1ec4c6f3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:33.680883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1193213624', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': True}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:33.701211 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'acb71783-5509-49e0-adff-499ad7a6d6ef', 'name': 'tempest-snat-router-1193213624', 'tenant_id': '65b8f224365f41ae9e617e104bd7afce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.166'}], 'enable_snat': False}, 'gw_port_id': 'a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:24Z', 'updated_at': '2022-03-24T02:15:29Z', 'revision_number': 3, 'project_id': '65b8f224365f41ae9e617e104bd7afce', 'gw_port': {'id': 'a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:59:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'acb71783-5509-49e0-adff-499ad7a6d6ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 701, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:27Z', 'updated_at': '2022-03-24T02:15:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:33.719127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a8660dbb-71b0-408c-97bd-d62ccfd2232c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:33.720274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.725731 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-290c63e9-317c-462e-a416-9c91fe55785a None None] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:33.736311 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Checking router: acb71783-5509-49e0-adff-499ad7a6d6ef for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:33.736713 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Updating router acb71783-5509-49e0-adff-499ad7a6d6ef port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:15:33.756647 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-effcd5d6-eb7d-4de4-8b77-74194e387d91 None None] Provisioning complete for port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:33.757206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-effcd5d6-eb7d-4de4-8b77-74194e387d91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.766089 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.767322 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.792988 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:33.795523 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=3f9f9d5e-7262-4cb8-8f93-06abc7097f13,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:33.803063 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:33.814346 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8e79197b-931e-4edb-b4d1-3503955d3f47 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 3.0706983 Mar 24 02:15:33.819708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:33.822744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-effcd5d6-eb7d-4de4-8b77-74194e387d91 None None] Port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:33.899342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port a8660dbb-71b0-408c-97bd-d62ccfd2232c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a8660dbb-71b0-408c-97bd-d62ccfd2232c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:33.917256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (1f63a954-e411-4138-b423-94a29a3b7505), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.920103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58856) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:33.923285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.925056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:33.978438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f', 'fixed_ips': [{'subnet_id': '77524766-c63f-44d6-a6df-ae1c18097bb3'}, {'subnet_id': '17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e'}], 'name': 'tempest-PortsTestJSON-1226909929'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:34.070259 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] Provisioning complete for port a8660dbb-71b0-408c-97bd-d62ccfd2232c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:34.071015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.209920 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Publish callbacks [] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.216257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f552bd2d-fba6-438c-a578-fa2e8fac9ab9 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:34.225487 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.237041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=7b1d481b-3bfa-4756-b24a-0449c4204f8c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:34.244764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=a8660dbb-71b0-408c-97bd-d62ccfd2232c,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:34.298721 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dc666da-9bbd-4f96-adb6-3db591adb61b None None] Pushing event updated for resources: {'Port': ['ID=a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:34.335324 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Attempting to bind port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:34.335905 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Attempting to bind port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:34.336268 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Attempting to bind port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:34.345262 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:34.345681 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:34.346340 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.346756 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:34.348488 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Bound port: a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:34.348626 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.349855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2823099e-1b16-4672-9222-fa884b5d898f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:34.422004 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58868) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:34.435778 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (e4bd909a-4259-4d75-85d2-243adaa6ad33), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.437425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (e4bd909a-4259-4d75-85d2-243adaa6ad33), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.438912 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] For port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:34.440338 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:34.442656 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] For port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:34.448733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:34.452645 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.471835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.524250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_controller (e4bd909a-4259-4d75-85d2-243adaa6ad33), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.596226 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] Current status of the port a8660dbb-71b0-408c-97bd-d62ccfd2232c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:34.628412 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dc666da-9bbd-4f96-adb6-3db591adb61b None None] Pushing event updated for resources: {'Port': ['ID=a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:34.637767 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Routers {'acb71783-5509-49e0-adff-499ad7a6d6ef'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:34.640029 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['acb71783-5509-49e0-adff-499ad7a6d6ef'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:34.646310 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:34.690080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-0fcdebf6-af1c-4e27-9250-7540427390f0 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] Request body: {'port': {'network_id': '7534325e-edae-4c20-9687-4516bdfb9f51', 'name': 'tempest-NetworksNegativeTestJSON-689308821'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:34.699238 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6d3fda8-b480-4529-8f16-e6bc1ec4c6f3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:34.702683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e6d3fda8-b480-4529-8f16-e6bc1ec4c6f3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.751624 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-0fcdebf6-af1c-4e27-9250-7540427390f0 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] POST failed (client error): The resource could not be found. Mar 24 02:15:34.752205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0fcdebf6-af1c-4e27-9250-7540427390f0 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:34.754500 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0fcdebf6-af1c-4e27-9250-7540427390f0 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 404 len: 339 time: 0.3307257 Mar 24 02:15:34.763251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58872) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:34.768247 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] Provisioning complete for port e7daf644-6aca-4c51-b17b-b82dd20b11a2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:34.769182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.809667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 2823099e-1b16-4672-9222-fa884b5d898f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:34.810298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2823099e-1b16-4672-9222-fa884b5d898f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.817109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f5ed567-533f-462d-9705-fbfa01df5c32 None None] Update dhcp port {'port': {'network_id': '6f4baa7f-2b71-4f44-946e-878882d49d9f', 'fixed_ips': [{'subnet_id': '77524766-c63f-44d6-a6df-ae1c18097bb3', 'ip_address': '172.20.0.2'}, {'subnet_id': '17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': 'e7daf644-6aca-4c51-b17b-b82dd20b11a2'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:15:34.917495 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-3949d528-8328-4766-ae61-5e7d64a65629 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] DELETE failed (client error): The resource could not be found. Mar 24 02:15:34.918116 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3949d528-8328-4766-ae61-5e7d64a65629 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:34.933041 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3949d528-8328-4766-ae61-5e7d64a65629 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "DELETE /v2.0/networks/4a067404-a35b-436f-a696-eef834b28850 HTTP/1.1" status: 404 len: 339 time: 0.1557841 Mar 24 02:15:34.933041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58874) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:34.972802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (e4bd909a-4259-4d75-85d2-243adaa6ad33), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.982060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f5ed567-533f-462d-9705-fbfa01df5c32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:34.982279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:34.992339 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-2687df35-beef-4c76-a843-52a886a92287 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] DELETE failed (client error): The resource could not be found. Mar 24 02:15:34.993015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2687df35-beef-4c76-a843-52a886a92287 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:35.006878 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2687df35-beef-4c76-a843-52a886a92287 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "DELETE /v2.0/ports/6c3724b5-4308-43cb-a62a-cdcef086a4f5 HTTP/1.1" status: 404 len: 333 time: 0.0590751 Mar 24 02:15:35.007159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58876) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.015329 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] Set router acb71783-5509-49e0-adff-499ad7a6d6ef gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:35.042747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.064120 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.ipam_backend_mixin [None req-e6d3fda8-b480-4529-8f16-e6bc1ec4c6f3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet ac319f4a-9335-45b4-9176-ca0152a41a6b (CIDR: 2001:db8::/64) Mar 24 02:15:35.067129 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-44941cbd-9b95-4d91-80ea-017710973e7e tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] DELETE failed (client error): The resource could not be found. Mar 24 02:15:35.067828 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-44941cbd-9b95-4d91-80ea-017710973e7e tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:35.078059 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-44941cbd-9b95-4d91-80ea-017710973e7e tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "DELETE /v2.0/subnets/b9c8c565-b37c-461f-b53a-c5c46cd6f96a HTTP/1.1" status: 404 len: 337 time: 0.0630710 Mar 24 02:15:35.106418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58878) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.107829 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-e6d3fda8-b480-4529-8f16-e6bc1ec4c6f3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:15:35.108507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e6d3fda8-b480-4529-8f16-e6bc1ec4c6f3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:35.150240 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-eb4fbc8d-e660-4740-8c60-969f7b7c762c tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] GET failed (client error): The resource could not be found. Mar 24 02:15:35.156409 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eb4fbc8d-e660-4740-8c60-969f7b7c762c tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "GET /v2.0/networks/78164086-2f41-47b4-8d38-17904f3ec7d1 HTTP/1.1" status: 404 len: 339 time: 0.0449259 Mar 24 02:15:35.158382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58880) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.176843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 2bd8f0a9-61ab-4c8b-a119-c6e98565e95f yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:35.220949 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] Current status of the port e7daf644-6aca-4c51-b17b-b82dd20b11a2 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:35.220949 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.246153 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e6d3fda8-b480-4529-8f16-e6bc1ec4c6f3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.5804319 Mar 24 02:15:35.246690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58884) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.249969 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-eb7c644b-999f-419c-96fd-89a9b6937af0 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] GET failed (client error): The resource could not be found. Mar 24 02:15:35.254930 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eb7c644b-999f-419c-96fd-89a9b6937af0 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "GET /v2.0/ports/58feedfc-3dce-47f1-8d0e-26b650e0cf3b HTTP/1.1" status: 404 len: 333 time: 0.0917301 Mar 24 02:15:35.256157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:35.261053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58886) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.296226 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'acb71783-5509-49e0-adff-499ad7a6d6ef', 'name': 'tempest-snat-router-1193213624', 'tenant_id': '65b8f224365f41ae9e617e104bd7afce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.166'}], 'enable_snat': False}, 'gw_port_id': 'a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:24Z', 'updated_at': '2022-03-24T02:15:29Z', 'revision_number': 3, 'project_id': '65b8f224365f41ae9e617e104bd7afce', 'gw_port': {'id': 'a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:59:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'acb71783-5509-49e0-adff-499ad7a6d6ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 701, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:27Z', 'updated_at': '2022-03-24T02:15:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:35.320136 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-b03c581b-f087-4dd8-9110-61d33b445de5 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] GET failed (client error): The resource could not be found. Mar 24 02:15:35.325065 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b03c581b-f087-4dd8-9110-61d33b445de5 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "GET /v2.0/subnets/2a51318d-3549-4e04-b1c0-41bb94685398 HTTP/1.1" status: 404 len: 337 time: 0.0583689 Mar 24 02:15:35.333692 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58888) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.338804 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-327eddf9-7718-4201-93f8-13aa7b0e72ed None None] The sync data for ids ['acb71783-5509-49e0-adff-499ad7a6d6ef'] in dv-neutron-834874-3-hyperv is: [{'id': 'acb71783-5509-49e0-adff-499ad7a6d6ef', 'name': 'tempest-snat-router-1193213624', 'tenant_id': '65b8f224365f41ae9e617e104bd7afce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.166'}], 'enable_snat': False}, 'gw_port_id': 'a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:24Z', 'updated_at': '2022-03-24T02:15:29Z', 'revision_number': 3, 'project_id': '65b8f224365f41ae9e617e104bd7afce', 'gw_port': {'id': 'a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:59:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'acb71783-5509-49e0-adff-499ad7a6d6ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 701, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:27Z', 'updated_at': '2022-03-24T02:15:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:35.346243 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8e00cf7f-6c4f-4a2c-a649-8f21e8c8c236 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] Request body: {'network': {'name': 'new_name'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:35.355376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:35.375194 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-aa577c36-ff3d-490f-8d85-44e4a8ea5f14 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.9211478 Mar 24 02:15:35.381122 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58890) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.389437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1499096781'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:35.409060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] For port e7daf644-6aca-4c51-b17b-b82dd20b11a2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e7daf644-6aca-4c51-b17b-b82dd20b11a2,segment=NetworkSegment(f78f480f-9b99-427d-95eb-6b523e41ad01),segment_id=f78f480f-9b99-427d-95eb-6b523e41ad01)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:35.418615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:35.442308 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-8e00cf7f-6c4f-4a2c-a649-8f21e8c8c236 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] PUT failed (client error): The resource could not be found. Mar 24 02:15:35.442638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8e00cf7f-6c4f-4a2c-a649-8f21e8c8c236 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:35.447075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:35.447075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:35.448582 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c60cc418-4c01-401d-926a-a6fc3fd78cd2 None None] Update dhcp port {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': 'ac319f4a-9335-45b4-9176-ca0152a41a6b'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': '5692a503-01ca-4041-94b0-cc3f2309e2f7'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:15:35.449345 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8e00cf7f-6c4f-4a2c-a649-8f21e8c8c236 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "PUT /v2.0/networks/c42d2476-25fd-4cd8-a5e9-479cbd87169c HTTP/1.1" status: 404 len: 339 time: 0.1133265 Mar 24 02:15:35.450423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58892) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.450582 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.471799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:35.475123 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:35.475331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.479660 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.488131 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5aafb410-512b-46d1-bb61-5fc21f4e2b17 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] Request body: {'port': {'name': 'new_name'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:35.544023 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-5aafb410-512b-46d1-bb61-5fc21f4e2b17 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] PUT failed (client error): The resource could not be found. Mar 24 02:15:35.544600 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5aafb410-512b-46d1-bb61-5fc21f4e2b17 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:35.550586 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5aafb410-512b-46d1-bb61-5fc21f4e2b17 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "PUT /v2.0/ports/0bb2c0ad-33bf-4219-894b-5ef7fb6b7676 HTTP/1.1" status: 404 len: 333 time: 0.0888102 Mar 24 02:15:35.551606 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58896) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.594350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a706c2d4-3c9c-48ee-aed5-d0b1d8d3eb48 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] Request body: {'subnet': {'name': 'new_name'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:35.607190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb12a07-9a7a-4738-a244-3e275936a43d None None] Pushing event updated for resources: {'Port': ['ID=e7daf644-6aca-4c51-b17b-b82dd20b11a2,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:35.620561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2823099e-1b16-4672-9222-fa884b5d898f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:35.621602 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e7daf644-6aca-4c51-b17b-b82dd20b11a2 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:35.637612 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-a706c2d4-3c9c-48ee-aed5-d0b1d8d3eb48 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] PUT failed (client error): The resource could not be found. Mar 24 02:15:35.638067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a706c2d4-3c9c-48ee-aed5-d0b1d8d3eb48 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:35.643343 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a706c2d4-3c9c-48ee-aed5-d0b1d8d3eb48 tempest-NetworksNegativeTestJSON-1441785903 tempest-NetworksNegativeTestJSON-1441785903-project] 10.222.0.20 "PUT /v2.0/subnets/f768935d-f1ee-463e-9580-16ffb775e164 HTTP/1.1" status: 404 len: 337 time: 0.0838838 Mar 24 02:15:35.661921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 144} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:35.687199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.693854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4f560d11-8497-4703-9ca3-3831988ae8de), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.694550 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added segment 4f560d11-8497-4703-9ca3-3831988ae8de of type vlan for network 3771196e-a727-49bc-a43a-35151470fb34 Mar 24 02:15:35.704471 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.783890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c60cc418-4c01-401d-926a-a6fc3fd78cd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.795509 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (3771196e-a727-49bc-a43a-35151470fb34), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.822298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-37c2c3e0-bd75-4566-804d-15bcbfa3e465 None None] Provisioning complete for port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:35.822705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37c2c3e0-bd75-4566-804d-15bcbfa3e465 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.850070 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (3771196e-a727-49bc-a43a-35151470fb34), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.856302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:35.856952 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.857656 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (e4bd909a-4259-4d75-85d2-243adaa6ad33), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.887244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:35.903502 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-6f5ed567-533f-462d-9705-fbfa01df5c32 None None] Allocated IP 172.20.0.18 (6f4baa7f-2b71-4f44-946e-878882d49d9f/17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e/e7daf644-6aca-4c51-b17b-b82dd20b11a2) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:35.968912 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.5810416 Mar 24 02:15:35.972477 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58900) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:35.983817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'subnet': {'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'cidr': '2001:db8:3::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:3::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:35.987724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=7b1d481b-3bfa-4756-b24a-0449c4204f8c,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:36.027956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:36.038767 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (1f63a954-e411-4138-b423-94a29a3b7505), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:36.051969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Allocated IP 172.26.2.87 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/53fc12eb-89f1-4a23-87a1-fb77bfc1e424) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:36.072950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1f9c70-da59-4a13-8b7c-4b5964d37c61 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Network': ['ID=3771196e-a727-49bc-a43a-35151470fb34,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:36.130000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 3771196e-a727-49bc-a43a-35151470fb34 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:36.150620 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58904) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:36.193958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Made reservation on behalf of ad85d379c34c467487816ef2bb559f24 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:36.197864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:36.301356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for port (53fc12eb-89f1-4a23-87a1-fb77bfc1e424), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:36.330284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:36.334039 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:36.437951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (53fc12eb-89f1-4a23-87a1-fb77bfc1e424), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:36.495426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-78e33e65-333b-43fc-b17f-485e52d42007 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:36.511303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:36.520358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:36.530454 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:36.551482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-37c2c3e0-bd75-4566-804d-15bcbfa3e465 None None] Port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:36.610261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port e7daf644-6aca-4c51-b17b-b82dd20b11a2 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:36.610669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:36.734765 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f5ed567-533f-462d-9705-fbfa01df5c32 None None] For port e7daf644-6aca-4c51-b17b-b82dd20b11a2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e7daf644-6aca-4c51-b17b-b82dd20b11a2,segment=NetworkSegment(f78f480f-9b99-427d-95eb-6b523e41ad01),segment_id=f78f480f-9b99-427d-95eb-6b523e41ad01)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:36.737488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event updated for resources: {'Port': ['ID=53fc12eb-89f1-4a23-87a1-fb77bfc1e424,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:36.799746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-37c2c3e0-bd75-4566-804d-15bcbfa3e465 None None] Provisioning complete for port 7b1d481b-3bfa-4756-b24a-0449c4204f8c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:36.800277 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37c2c3e0-bd75-4566-804d-15bcbfa3e465 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:36.893082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.objects.ports [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=104037) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:15:36.893676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f5ed567-533f-462d-9705-fbfa01df5c32 None None] Publish callbacks [] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:36.906978 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-c60cc418-4c01-401d-926a-a6fc3fd78cd2 None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/ac319f4a-9335-45b4-9176-ca0152a41a6b/5692a503-01ca-4041-94b0-cc3f2309e2f7) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:36.936149 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-37c2c3e0-bd75-4566-804d-15bcbfa3e465 None None] Port 7b1d481b-3bfa-4756-b24a-0449c4204f8c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:36.937980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f5ed567-533f-462d-9705-fbfa01df5c32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:36.997600 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (e4bd909a-4259-4d75-85d2-243adaa6ad33), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.061576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 1f63a954-e411-4138-b423-94a29a3b7505 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:37.120814 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (a7c72fce-ef84-4709-a1ef-6dc870f90812), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.121235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-37c2c3e0-bd75-4566-804d-15bcbfa3e465 None None] Provisioning complete for port a8660dbb-71b0-408c-97bd-d62ccfd2232c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:37.121626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37c2c3e0-bd75-4566-804d-15bcbfa3e465 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.174439 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port e7daf644-6aca-4c51-b17b-b82dd20b11a2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:37.182014 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f5ed567-533f-462d-9705-fbfa01df5c32 None None] Pushing event updated for resources: {'Port': ['ID=e7daf644-6aca-4c51-b17b-b82dd20b11a2,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:37.186948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Subnet': ['ID=a7c72fce-ef84-4709-a1ef-6dc870f90812,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:37.243131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c60cc418-4c01-401d-926a-a6fc3fd78cd2 None None] For port 5692a503-01ca-4041-94b0-cc3f2309e2f7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5692a503-01ca-4041-94b0-cc3f2309e2f7,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:37.263784 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:31Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:32Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:37.274226 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.14 (6f4baa7f-2b71-4f44-946e-878882d49d9f/77524766-c63f-44d6-a6df-ae1c18097bb3/2bd8f0a9-61ab-4c8b-a119-c6e98565e95f) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:37.301873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:37.302236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Updating router d36063bd-d604-40b2-9839-addfdc6c944c port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:15:37.329912 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c60cc418-4c01-401d-926a-a6fc3fd78cd2 None None] Publish callbacks [] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.336206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.26 (6f4baa7f-2b71-4f44-946e-878882d49d9f/17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e/2bd8f0a9-61ab-4c8b-a119-c6e98565e95f) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:37.339473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-78e33e65-333b-43fc-b17f-485e52d42007 admin admin] Publish callbacks [] for security_group (de4143c3-3e92-4446-ac80-c19ce36c4a07), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.352381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c60cc418-4c01-401d-926a-a6fc3fd78cd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.366537 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-78e33e65-333b-43fc-b17f-485e52d42007 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (de4143c3-3e92-4446-ac80-c19ce36c4a07), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.430893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.473066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Checking segment: {'id': '4f560d11-8497-4703-9ca3-3831988ae8de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '3771196e-a727-49bc-a43a-35151470fb34'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:37.473498 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network hostable DHCP agents. Network: 3771196e-a727-49bc-a43a-35151470fb34, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:37.479401 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-37c2c3e0-bd75-4566-804d-15bcbfa3e465 None None] Current status of the port a8660dbb-71b0-408c-97bd-d62ccfd2232c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:37.484409 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-78e33e65-333b-43fc-b17f-485e52d42007 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=ef014cbd8e8d4ae9a92085cbdd25d2f6&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3312700 Mar 24 02:15:37.491125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58914) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:37.507544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.509964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:37.514614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (e4bd909a-4259-4d75-85d2-243adaa6ad33), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.580906 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e33e65-333b-43fc-b17f-485e52d42007 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de4143c3-3e92-4446-ac80-c19ce36c4a07,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:37.615592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:37.627927 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a55c5772-ba16-4efb-9de1-356fba1f8eaf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/1f63a954-e411-4138-b423-94a29a3b7505/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.3735242 Mar 24 02:15:37.634063 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Sync routers for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:37.642943 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 3771196e-a727-49bc-a43a-35151470fb34 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:37.647712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58916) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:37.653942 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:37.662495 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:37.750307 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c60cc418-4c01-401d-926a-a6fc3fd78cd2 None None] Pushing event updated for resources: {'Port': ['ID=5692a503-01ca-4041-94b0-cc3f2309e2f7,revision_number=6']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:37.821544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 3771196e-a727-49bc-a43a-35151470fb34) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:37.855822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:37.856454 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.872914 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:37.931567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.946270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] For port 5692a503-01ca-4041-94b0-cc3f2309e2f7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5692a503-01ca-4041-94b0-cc3f2309e2f7,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:37.982832 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-24f87594-d8d4-4e87-98cb-f0753d0d1338 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 2.0011563 Mar 24 02:15:37.991715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d8358dd3-41ef-43a2-b118-a83322685339 None None] Provisioning complete for port 7b1d481b-3bfa-4756-b24a-0449c4204f8c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:37.991715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8358dd3-41ef-43a2-b118-a83322685339 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:37.996529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.006708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58918) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:38.026432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.026953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2975246-5dbb-4c72-8156-69237cd16f74 None None] Network 3771196e-a727-49bc-a43a-35151470fb34 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:38.140343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.140822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.141306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.141739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.142194 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.142675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.143127 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.143575 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.144025 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.145018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.145471 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.145921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.146371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.151242 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-eb35d2d4-797f-4b67-af31-0cbd3e17fd4d tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 9137 time: 0.4999909 Mar 24 02:15:38.152110 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58920) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:38.185055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (647cce81-b4d4-4b29-96ee-997075fcc3a8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.220233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.258441 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:15:34Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:35Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:38.268660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07c948c6-e359-488f-b672-af64a33e85a8 None None] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:38.297260 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Checking router: 1f63a954-e411-4138-b423-94a29a3b7505 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:38.297986 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Updating router 1f63a954-e411-4138-b423-94a29a3b7505 port 7b1d481b-3bfa-4756-b24a-0449c4204f8c binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:15:38.324013 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=2bd8f0a9-61ab-4c8b-a119-c6e98565e95f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:38.336538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d8358dd3-41ef-43a2-b118-a83322685339 None None] Port 7b1d481b-3bfa-4756-b24a-0449c4204f8c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:38.338395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:38.338797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.355563 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.374580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:38.383279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:38.404046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:38.418794 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.419665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.420766 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.421410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.422046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.422722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.423537 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.424167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.424793 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.425950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.430606 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.432253 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.433055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.433697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.437163 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-072f1163-3ec9-4829-90b8-9323caefac92 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 8909 time: 0.2841144 Mar 24 02:15:38.464629 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58924) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:38.500050 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-3771196e-a727-49bc-a43a-35151470fb34', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:38.500752 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.557421 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-72d4cd9a-0aaa-4d6b-93da-f2cfb37d9c2c None None] Provisioning complete for port e7daf644-6aca-4c51-b17b-b82dd20b11a2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:38.557805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-72d4cd9a-0aaa-4d6b-93da-f2cfb37d9c2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.612700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=5692a503-01ca-4041-94b0-cc3f2309e2f7,revision_number=7']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:38.681550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.682883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.692096 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Router e4bd909a-4259-4d75-85d2-243adaa6ad33 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:15:38.705467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebc02602-9816-4820-8df9-e7a80ffb8349 admin admin] Publish callbacks [] for security_group (de4143c3-3e92-4446-ac80-c19ce36c4a07), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.714501 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Publish callbacks [] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.722532 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.736779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebc02602-9816-4820-8df9-e7a80ffb8349 admin admin] Publish callbacks [] for security_group (de4143c3-3e92-4446-ac80-c19ce36c4a07), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.751539 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-37bd4cae-96db-4071-8a69-eca4a0305ea1 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1005 time: 4.8189528 Mar 24 02:15:38.755717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58926) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:38.761590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '77524766-c63f-44d6-a6df-ae1c18097bb3'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:38.791158 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c279adf6-8490-4516-bd75-586c8501ac6c None None] Pushing event updated for resources: {'Port': ['ID=7b1d481b-3bfa-4756-b24a-0449c4204f8c,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:38.803844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:38.818002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:38.835802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebc02602-9816-4820-8df9-e7a80ffb8349 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (de4143c3-3e92-4446-ac80-c19ce36c4a07), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.839019 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebc02602-9816-4820-8df9-e7a80ffb8349 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.855740 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ebc02602-9816-4820-8df9-e7a80ffb8349 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/de4143c3-3e92-4446-ac80-c19ce36c4a07 HTTP/1.1" status: 204 len: 168 time: 1.3634584 Mar 24 02:15:38.885871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:38.886475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.890313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=647cce81-b4d4-4b29-96ee-997075fcc3a8,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:38.920068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.946967 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Attempting to bind port 7b1d481b-3bfa-4756-b24a-0449c4204f8c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:38.947342 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Attempting to bind port 7b1d481b-3bfa-4756-b24a-0449c4204f8c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:38.947706 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Attempting to bind port 7b1d481b-3bfa-4756-b24a-0449c4204f8c on network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:38.962024 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:38.962555 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Checking segment: {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:38.963105 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.963494 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Bound using segment: {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:38.963974 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Bound port: 7b1d481b-3bfa-4756-b24a-0449c4204f8c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:38.964355 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.975613 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:38.976014 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:38.988973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebc02602-9816-4820-8df9-e7a80ffb8349 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de4143c3-3e92-4446-ac80-c19ce36c4a07,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:39.011078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Publish callbacks [] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:39.079763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:39.134798 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] For port 7b1d481b-3bfa-4756-b24a-0449c4204f8c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:39.147644 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] For port 7b1d481b-3bfa-4756-b24a-0449c4204f8c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7b1d481b-3bfa-4756-b24a-0449c4204f8c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:39.157095 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:39.201900 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-763792fe-f096-43ed-840d-a1842a54da78 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 3.9538064 Mar 24 02:15:39.206210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58932) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:39.232161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:7e:f1:d0', 'name': 'tempest-NetworksTestDHCPv6-311164809'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:39.261123 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:39.296299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Allocated IP 2001:db8:3::2 (3771196e-a727-49bc-a43a-35151470fb34/a7c72fce-ef84-4709-a1ef-6dc870f90812/e9998b49-b45f-411d-bfda-94b29f644f7d) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:39.298350 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c279adf6-8490-4516-bd75-586c8501ac6c None None] Pushing event updated for resources: {'Port': ['ID=7b1d481b-3bfa-4756-b24a-0449c4204f8c,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:39.322694 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:39.323610 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:39.373241 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:39.374141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a8660dbb-71b0-408c-97bd-d62ccfd2232c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:39.572014 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:39.591954 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9b7a1d23-53bc-4095-892b-ca271a9896da tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 4998 time: 1.1244228 Mar 24 02:15:39.748376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a8660dbb-71b0-408c-97bd-d62ccfd2232c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:39.748770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:39.856104 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98dd82d2-f62d-4ac0-af75-c55aee6a6c18 None None] Pushing event updated for resources: {'Port': ['ID=3f9f9d5e-7262-4cb8-8f93-06abc7097f13,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:39.859364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Delete allocated IP 172.20.0.26 (6f4baa7f-2b71-4f44-946e-878882d49d9f/17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e) {{(pid=104036) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Mar 24 02:15:39.899750 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:15:34Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:39Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:39.906747 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-622a9234-12c9-45ef-beae-977d2a0b9aca None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:39.916453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:39.932403 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56673735-9c8d-4f58-b99c-e5d049aa5078 None None] The sync data for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv is: [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:15:34Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:39Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:40.062057 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Sync routers for ids ['e4bd909a-4259-4d75-85d2-243adaa6ad33'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:40.120101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.132052 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.168020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:40.195774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58952) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:40.203396 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.211160 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e883348b-63d6-44ff-827a-8565c8345892 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 6.5335777 Mar 24 02:15:40.214884 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-158c1bcf-6d93-43a3-b956-69a713aa3309 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1963976978', 'description': 'tempest-secgroup-smoke-1963976978 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:40.215697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-72d4cd9a-0aaa-4d6b-93da-f2cfb37d9c2c None None] Current status of the port e7daf644-6aca-4c51-b17b-b82dd20b11a2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:40.220922 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58954) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:40.317428 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58956) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:40.326343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Routers {'e4bd909a-4259-4d75-85d2-243adaa6ad33'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:40.327225 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e4bd909a-4259-4d75-85d2-243adaa6ad33'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:40.393020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=2bd8f0a9-61ab-4c8b-a119-c6e98565e95f,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:40.416015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-158c1bcf-6d93-43a3-b956-69a713aa3309 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.427948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] In _notify_port_updated(), no bound segment for port 2bd8f0a9-61ab-4c8b-a119-c6e98565e95f on network 6f4baa7f-2b71-4f44-946e-878882d49d9f {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:15:40.433497 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:40.434150 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.438053 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-21dce548-91e3-4796-882b-dab73a0f8a73 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "PUT /v2.0/ports/2bd8f0a9-61ab-4c8b-a119-c6e98565e95f HTTP/1.1" status: 200 len: 920 time: 1.6784739 Mar 24 02:15:40.451630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58960) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:40.473761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '77524766-c63f-44d6-a6df-ae1c18097bb3'}, {'subnet_id': '17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:40.496214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.515846 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.587755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Publish callbacks [] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.591951 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f67e1a08-5e0d-45fd-9ac4-81f292e74392 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/routers/e4bd909a-4259-4d75-85d2-243adaa6ad33 HTTP/1.1" status: 200 len: 907 time: 0.3657694 Mar 24 02:15:40.591951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58962) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:40.652204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a8660dbb-71b0-408c-97bd-d62ccfd2232c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:40.652990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e7daf644-6aca-4c51-b17b-b82dd20b11a2 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:40.739970 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.750724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Attempting to bind port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:40.751154 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Attempting to bind port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '927da624-ebed-4101-bcc4-f658632d156c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:40.751520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Attempting to bind port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 on network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:40.766005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-158c1bcf-6d93-43a3-b956-69a713aa3309 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (18484e4b-fd02-4452-91f3-85188a2c27cc), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.773251 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Network 3771196e-a727-49bc-a43a-35151470fb34 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:40.777335 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-158c1bcf-6d93-43a3-b956-69a713aa3309 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (18484e4b-fd02-4452-91f3-85188a2c27cc), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.786130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:40.790661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port e7daf644-6aca-4c51-b17b-b82dd20b11a2 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:40.791035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.799154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 38679b87-a0e3-451f-89bf-9c4615d3b0e0 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:40.815743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-test-network-1591740113'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:40.829042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:40.835077 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:40.850489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:40.850879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Checking segment: {'id': '927da624-ebed-4101-bcc4-f658632d156c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:40.851296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.852188 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Bound using segment: {'id': '927da624-ebed-4101-bcc4-f658632d156c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:40.852188 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Bound port: 3f9f9d5e-7262-4cb8-8f93-06abc7097f13, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '927da624-ebed-4101-bcc4-f658632d156c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:40.852543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.886396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158c1bcf-6d93-43a3-b956-69a713aa3309 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=18484e4b-fd02-4452-91f3-85188a2c27cc,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:40.906821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-158c1bcf-6d93-43a3-b956-69a713aa3309 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.908847 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-158c1bcf-6d93-43a3-b956-69a713aa3309 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.7117751 Mar 24 02:15:40.912924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58964) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:40.938196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-3b77c976-1b99-4a07-8a25-0ef20f974cd8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '18484e4b-fd02-4452-91f3-85188a2c27cc', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:40.961279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.964462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:40.973395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:40.976679 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (e4bd909a-4259-4d75-85d2-243adaa6ad33), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.014216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Provisioning complete for port 5692a503-01ca-4041-94b0-cc3f2309e2f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:41.015281 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.037045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.040497 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Allocated IP 2001:db8:3::1 (3771196e-a727-49bc-a43a-35151470fb34/a7c72fce-ef84-4709-a1ef-6dc870f90812/d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:41.048433 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port e7daf644-6aca-4c51-b17b-b82dd20b11a2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:41.163792 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Attempting to bind port e9998b49-b45f-411d-bfda-94b29f644f7d on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:41.164724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Attempting to bind port e9998b49-b45f-411d-bfda-94b29f644f7d by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '4f560d11-8497-4703-9ca3-3831988ae8de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '3771196e-a727-49bc-a43a-35151470fb34'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:41.164724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Attempting to bind port e9998b49-b45f-411d-bfda-94b29f644f7d on network 3771196e-a727-49bc-a43a-35151470fb34 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:41.204394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b77c976-1b99-4a07-8a25-0ef20f974cd8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (19641af5-97e5-4751-bb60-9a40e0196e0d), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.214411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:41.215245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Checking segment: {'id': '4f560d11-8497-4703-9ca3-3831988ae8de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '3771196e-a727-49bc-a43a-35151470fb34'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:41.215678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.216164 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Bound using segment: {'id': '4f560d11-8497-4703-9ca3-3831988ae8de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '3771196e-a727-49bc-a43a-35151470fb34'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:41.216759 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Bound port: e9998b49-b45f-411d-bfda-94b29f644f7d, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f560d11-8497-4703-9ca3-3831988ae8de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '3771196e-a727-49bc-a43a-35151470fb34'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:41.216980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.241462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Pushing event updated for resources: {'Port': ['ID=e9998b49-b45f-411d-bfda-94b29f644f7d,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:41.374736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:41.449500 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.511652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] For port e9998b49-b45f-411d-bfda-94b29f644f7d, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:41.518362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] For port e9998b49-b45f-411d-bfda-94b29f644f7d, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e9998b49-b45f-411d-bfda-94b29f644f7d,segment=NetworkSegment(4f560d11-8497-4703-9ca3-3831988ae8de),segment_id=4f560d11-8497-4703-9ca3-3831988ae8de)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:41.535004 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b77c976-1b99-4a07-8a25-0ef20f974cd8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (19641af5-97e5-4751-bb60-9a40e0196e0d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.568040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.593094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b77c976-1b99-4a07-8a25-0ef20f974cd8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (19641af5-97e5-4751-bb60-9a40e0196e0d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.616177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Current status of the port 5692a503-01ca-4041-94b0-cc3f2309e2f7 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:41.616947 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.632896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] For port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:41.649354 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] For port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3f9f9d5e-7262-4cb8-8f93-06abc7097f13,segment=NetworkSegment(927da624-ebed-4101-bcc4-f658632d156c),segment_id=927da624-ebed-4101-bcc4-f658632d156c)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:41.654739 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Set router e4bd909a-4259-4d75-85d2-243adaa6ad33 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:41.676903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 3771196e-a727-49bc-a43a-35151470fb34 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:41.678292 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b77c976-1b99-4a07-8a25-0ef20f974cd8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=19641af5-97e5-4751-bb60-9a40e0196e0d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:41.690258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:41.714149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:41.715034 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.725989 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.795755 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::92 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/ac319f4a-9335-45b4-9176-ca0152a41a6b/38679b87-a0e3-451f-89bf-9c4615d3b0e0) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:41.801615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b77c976-1b99-4a07-8a25-0ef20f974cd8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.809961 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3b77c976-1b99-4a07-8a25-0ef20f974cd8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8892384 Mar 24 02:15:41.813236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.813368 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58966) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:41.819221 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-f2cd232d-2f53-42f6-88df-61f12cd0fbb7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '18484e4b-fd02-4452-91f3-85188a2c27cc', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:41.838776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:41.844380 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8:0:1:f816:3eff:fe7e:f1d0 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/647cce81-b4d4-4b29-96ee-997075fcc3a8/38679b87-a0e3-451f-89bf-9c4615d3b0e0) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:41.881984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (143913a0-76e0-4f07-91a1-eaea0e844366), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.890964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (143913a0-76e0-4f07-91a1-eaea0e844366), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.902905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 118} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:41.926920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (90bce2cd-2d9e-4697-bef8-e219d1c040c9), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.927275 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Added segment 90bce2cd-2d9e-4697-bef8-e219d1c040c9 of type vlan for network 8ec9fea4-b38d-4612-9d1d-87145ce2366f Mar 24 02:15:41.937078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] For port 5692a503-01ca-4041-94b0-cc3f2309e2f7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5692a503-01ca-4041-94b0-cc3f2309e2f7,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:41.938082 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:41.938975 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:41.940657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:41.942136 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:42.018748 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (8ec9fea4-b38d-4612-9d1d-87145ce2366f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.183766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (8ec9fea4-b38d-4612-9d1d-87145ce2366f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.194102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:42.195244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.201511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.225287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.28 (6f4baa7f-2b71-4f44-946e-878882d49d9f/17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e/2bd8f0a9-61ab-4c8b-a119-c6e98565e95f) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:42.244635 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.9242029 Mar 24 02:15:42.259378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98dd82d2-f62d-4ac0-af75-c55aee6a6c18 None None] Pushing event updated for resources: {'Port': ['ID=3f9f9d5e-7262-4cb8-8f93-06abc7097f13,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:42.263184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58968) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:42.326806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'name': 'tempest-PortsIpV6TestJSON-465233379'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:42.375770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f2cd232d-2f53-42f6-88df-61f12cd0fbb7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (66705331-5f3b-4103-979a-bb06078a0e5d), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.408595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d073458-ee38-46a6-97b2-579ef7f05143 None None] Pushing event updated for resources: {'Port': ['ID=e9998b49-b45f-411d-bfda-94b29f644f7d,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:42.413133 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (e4bd909a-4259-4d75-85d2-243adaa6ad33), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.417407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'SecurityGroup': ['ID=143913a0-76e0-4f07-91a1-eaea0e844366,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:42.427542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Provisioning complete for port 7b1d481b-3bfa-4756-b24a-0449c4204f8c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:42.427906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.528533 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:42.533259 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.566082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f2cd232d-2f53-42f6-88df-61f12cd0fbb7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (66705331-5f3b-4103-979a-bb06078a0e5d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.569015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.573908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9e6ca0-88d0-4042-970f-aecbfb70e00e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Network': ['ID=8ec9fea4-b38d-4612-9d1d-87145ce2366f,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:42.608283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:42.623902 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.647099 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f2cd232d-2f53-42f6-88df-61f12cd0fbb7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (66705331-5f3b-4103-979a-bb06078a0e5d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.673639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=2bd8f0a9-61ab-4c8b-a119-c6e98565e95f,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:42.679229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:42.682861 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.703149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2cd232d-2f53-42f6-88df-61f12cd0fbb7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=66705331-5f3b-4103-979a-bb06078a0e5d,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:42.740591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port aee2f7ee-569a-4b32-9981-c7cefe350ef1 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:42.742105 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Pushing event updated for resources: {'Port': ['ID=5692a503-01ca-4041-94b0-cc3f2309e2f7,revision_number=8']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:42.747923 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Deleting port 53fc12eb-89f1-4a23-87a1-fb77bfc1e424 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:42.748638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (53fc12eb-89f1-4a23-87a1-fb77bfc1e424), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.757080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f2cd232d-2f53-42f6-88df-61f12cd0fbb7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.766502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58970) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:42.767594 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f2cd232d-2f53-42f6-88df-61f12cd0fbb7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.9526248 Mar 24 02:15:42.807290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-66b5168b-01e1-4678-b71e-023005b57978 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '18484e4b-fd02-4452-91f3-85188a2c27cc', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:42.958349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] In _notify_port_updated(), no bound segment for port 2bd8f0a9-61ab-4c8b-a119-c6e98565e95f on network 6f4baa7f-2b71-4f44-946e-878882d49d9f {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:15:42.964608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:42.965470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:42.969412 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a7f64e1b-f0fd-4a5e-b65c-b59fdebf96e6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "PUT /v2.0/ports/2bd8f0a9-61ab-4c8b-a119-c6e98565e95f HTTP/1.1" status: 200 len: 1000 time: 2.5073938 Mar 24 02:15:42.980986 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58972) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:42.987697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:42.988865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7b1d481b-3bfa-4756-b24a-0449c4204f8c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:43.011764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e4bd909a-4259-4d75-85d2-243adaa6ad33', 'name': 'tempest-snat-router-1193213624', 'tenant_id': '65b8f224365f41ae9e617e104bd7afce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.87'}], 'enable_snat': True}, 'gw_port_id': '53fc12eb-89f1-4a23-87a1-fb77bfc1e424', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:34Z', 'updated_at': '2022-03-24T02:15:36Z', 'revision_number': 3, 'project_id': '65b8f224365f41ae9e617e104bd7afce', 'gw_port': {'id': '53fc12eb-89f1-4a23-87a1-fb77bfc1e424', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:c2:2c:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e4bd909a-4259-4d75-85d2-243adaa6ad33', 'device_owner': 'network:router_gateway', 'standard_attr_id': 718, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:35Z', 'updated_at': '2022-03-24T02:15:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:43.012185 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (53fc12eb-89f1-4a23-87a1-fb77bfc1e424), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.033332 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Calling delete_port for 53fc12eb-89f1-4a23-87a1-fb77bfc1e424 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:43.089074 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Checking router: e4bd909a-4259-4d75-85d2-243adaa6ad33 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:43.089467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Updating router e4bd909a-4259-4d75-85d2-243adaa6ad33 port 53fc12eb-89f1-4a23-87a1-fb77bfc1e424 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:15:43.161856 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Current status of the port 7b1d481b-3bfa-4756-b24a-0449c4204f8c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:43.162271 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.166766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:31Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:41Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:43.185330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (53fc12eb-89f1-4a23-87a1-fb77bfc1e424), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.251963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b7d1797-c88a-4a88-80f5-f80d48b94bdf None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:31Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:41Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:43.302750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (53fc12eb-89f1-4a23-87a1-fb77bfc1e424), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.306578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (38679b87-a0e3-451f-89bf-9c4615d3b0e0), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.385264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] For port 7b1d481b-3bfa-4756-b24a-0449c4204f8c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7b1d481b-3bfa-4756-b24a-0449c4204f8c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:43.404247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event deleted for resources: {'Port': ['ID=53fc12eb-89f1-4a23-87a1-fb77bfc1e424,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:43.453657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 7b1d481b-3bfa-4756-b24a-0449c4204f8c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:43.453825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.474182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (e4bd909a-4259-4d75-85d2-243adaa6ad33), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.498601 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-66b5168b-01e1-4678-b71e-023005b57978 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (86d106a4-df73-48b2-b46e-1d99f94cfdfd), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.517598 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.597013 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (e4bd909a-4259-4d75-85d2-243adaa6ad33), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.599344 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_controller (e4bd909a-4259-4d75-85d2-243adaa6ad33), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.617089 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Provisioning complete for port 2bd8f0a9-61ab-4c8b-a119-c6e98565e95f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:43.617528 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.673243 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (e4bd909a-4259-4d75-85d2-243adaa6ad33), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.673942 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Fanout notify agent at l3_agent the message router_deleted on router e4bd909a-4259-4d75-85d2-243adaa6ad33 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:15:43.679585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.685292 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a76b1f50-1cd4-4ce9-8be8-efaea1540f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "DELETE /v2.0/routers/e4bd909a-4259-4d75-85d2-243adaa6ad33 HTTP/1.1" status: 204 len: 168 time: 3.0920391 Mar 24 02:15:43.685727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58976) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:43.710541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 7b1d481b-3bfa-4756-b24a-0449c4204f8c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:43.711719 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5692a503-01ca-4041-94b0-cc3f2309e2f7 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:43.745430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f53d2070-7dee-4fce-b3e3-84fcc83c106a None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:15:43.750353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (38679b87-a0e3-451f-89bf-9c4615d3b0e0), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.760067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-c291d216-1c89-4f35-9f68-b248ad8689e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 2bd8f0a9-61ab-4c8b-a119-c6e98565e95f {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:43.760405 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c291d216-1c89-4f35-9f68-b248ad8689e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.775015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-66b5168b-01e1-4678-b71e-023005b57978 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (86d106a4-df73-48b2-b46e-1d99f94cfdfd), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.817602 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Pushing event updated for resources: {'Port': ['ID=7b1d481b-3bfa-4756-b24a-0449c4204f8c,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:43.829987 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Port 2bd8f0a9-61ab-4c8b-a119-c6e98565e95f cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:43.875488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Provisioning complete for port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:43.875488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.886496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=38679b87-a0e3-451f-89bf-9c4615d3b0e0,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:43.889237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-66b5168b-01e1-4678-b71e-023005b57978 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (86d106a4-df73-48b2-b46e-1d99f94cfdfd), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.903426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c291d216-1c89-4f35-9f68-b248ad8689e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.908638 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.925241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-c291d216-1c89-4f35-9f68-b248ad8689e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 2bd8f0a9-61ab-4c8b-a119-c6e98565e95f owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:43.935541 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:43.951353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b5168b-01e1-4678-b71e-023005b57978 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=86d106a4-df73-48b2-b46e-1d99f94cfdfd,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:43.957070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:43.965480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:43.971607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:43.972449 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.986816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-66b5168b-01e1-4678-b71e-023005b57978 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:43.991658 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-66b5168b-01e1-4678-b71e-023005b57978 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.2240937 Mar 24 02:15:43.993856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58980) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:44.010058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c92602bd-1259-422a-8845-ccd01c14c585 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '18484e4b-fd02-4452-91f3-85188a2c27cc', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:44.042016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 5692a503-01ca-4041-94b0-cc3f2309e2f7 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:44.042930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.061466 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2a888b9a-b4e3-425b-baa8-720b700dfc94 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1031 time: 4.8517568 Mar 24 02:15:44.066788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58982) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:44.067926 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (acb71783-5509-49e0-adff-499ad7a6d6ef), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.069120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.072145 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c92602bd-1259-422a-8845-ccd01c14c585 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (fd1f6859-fb98-4d30-92d5-2cb8865db306), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.107487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.108420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.177035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:15:44.177330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:15:44.177835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f53d2070-7dee-4fce-b3e3-84fcc83c106a None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:15:44.179554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Current status of the port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:44.179938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.217517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.254933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] For port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3f9f9d5e-7262-4cb8-8f93-06abc7097f13,segment=NetworkSegment(927da624-ebed-4101-bcc4-f658632d156c),segment_id=927da624-ebed-4101-bcc4-f658632d156c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:44.258425 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5692a503-01ca-4041-94b0-cc3f2309e2f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:44.273952 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.277719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (acb71783-5509-49e0-adff-499ad7a6d6ef), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.334028 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c92602bd-1259-422a-8845-ccd01c14c585 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (fd1f6859-fb98-4d30-92d5-2cb8865db306), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.354167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event updated for resources: {'Port': ['ID=d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:44.366383 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c92602bd-1259-422a-8845-ccd01c14c585 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (fd1f6859-fb98-4d30-92d5-2cb8865db306), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.387382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c291d216-1c89-4f35-9f68-b248ad8689e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (2bd8f0a9-61ab-4c8b-a119-c6e98565e95f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.403908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92602bd-1259-422a-8845-ccd01c14c585 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fd1f6859-fb98-4d30-92d5-2cb8865db306,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:44.464337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c291d216-1c89-4f35-9f68-b248ad8689e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=2bd8f0a9-61ab-4c8b-a119-c6e98565e95f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:44.491590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c92602bd-1259-422a-8845-ccd01c14c585 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.498537 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c92602bd-1259-422a-8845-ccd01c14c585 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4966602 Mar 24 02:15:44.510967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58986) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:44.515789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-20c186f1-26bf-4e0e-a088-cbe4988d0a64 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '18484e4b-fd02-4452-91f3-85188a2c27cc', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:44.535721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=aee2f7ee-569a-4b32-9981-c7cefe350ef1,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:44.547185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ec35980f-9688-4e04-a0b2-7c4ac79a17c2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 38679b87-a0e3-451f-89bf-9c4615d3b0e0 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:44.547547 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec35980f-9688-4e04-a0b2-7c4ac79a17c2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (38679b87-a0e3-451f-89bf-9c4615d3b0e0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.569438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Provisioning complete for port e7daf644-6aca-4c51-b17b-b82dd20b11a2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:44.569808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.572184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Network 3771196e-a727-49bc-a43a-35151470fb34 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:44.585349 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Checking segment: {'id': '90bce2cd-2d9e-4697-bef8-e219d1c040c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:44.585719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network hostable DHCP agents. Network: 8ec9fea4-b38d-4612-9d1d-87145ce2366f, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:44.623333 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Pushing event updated for resources: {'Port': ['ID=3f9f9d5e-7262-4cb8-8f93-06abc7097f13,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:44.639864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Deleting port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:44.640912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.642247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:44.665754 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-20c186f1-26bf-4e0e-a088-cbe4988d0a64 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:15:44.670978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c291d216-1c89-4f35-9f68-b248ad8689e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.685064 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c291d216-1c89-4f35-9f68-b248ad8689e9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/2bd8f0a9-61ab-4c8b-a119-c6e98565e95f HTTP/1.1" status: 204 len: 168 time: 1.6998882 Mar 24 02:15:44.685257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-20c186f1-26bf-4e0e-a088-cbe4988d0a64 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (5147001d-ff20-4e76-b1ca-34b71f15f5ca), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.693771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58988) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:44.706558 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:44.711900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Port 53fc12eb-89f1-4a23-87a1-fb77bfc1e424 not found while updating agent binding for router e4bd909a-4259-4d75-85d2-243adaa6ad33. {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:216}} Mar 24 02:15:44.760115 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] For port a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:44.760503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.774977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Calling delete_port for a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:44.781181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Routers set() bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:44.781789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Router IDs set() for agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:463}} Mar 24 02:15:44.782392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_agentschedulers_db [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'e4bd909a-4259-4d75-85d2-243adaa6ad33'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent'). {{(pid=104038) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Mar 24 02:15:44.782791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99e37f0a-abb6-48cf-a333-b60ed2dcde81 None None] The sync data for ids ['e4bd909a-4259-4d75-85d2-243adaa6ad33'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:44.802857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:44.804138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-60e69e00-bf81-4553-80a3-d1c2a52295a2 None None] Current status of the port e7daf644-6aca-4c51-b17b-b82dd20b11a2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:44.819767 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-8c0c53c4-f34c-48f5-bc94-2d790d1cf900 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:15:44.824193 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8c0c53c4-f34c-48f5-bc94-2d790d1cf900 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/2bd8f0a9-61ab-4c8b-a119-c6e98565e95f HTTP/1.1" status: 404 len: 333 time: 0.1265523 Mar 24 02:15:44.824331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58990) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:44.844666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:44.853084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.869913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28746033-3659-47bd-a445-2c4d4f61d99d req-8dcb7dc9-b4d5-45da-88aa-4da4a1594d7d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:44.871534 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-28746033-3659-47bd-a445-2c4d4f61d99d req-8dcb7dc9-b4d5-45da-88aa-4da4a1594d7d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3287141 Mar 24 02:15:44.872172 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 8ec9fea4-b38d-4612-9d1d-87145ce2366f) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:44.876022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec35980f-9688-4e04-a0b2-7c4ac79a17c2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (38679b87-a0e3-451f-89bf-9c4615d3b0e0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.900266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:44.906769 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:44.908143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.912335 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-67ba900c-c408-448c-a6fa-a7bc7219d595 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet 17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:44.920908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.922297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67ba900c-c408-448c-a6fa-a7bc7219d595 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.927795 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ec35980f-9688-4e04-a0b2-7c4ac79a17c2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 38679b87-a0e3-451f-89bf-9c4615d3b0e0 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:44.963891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Provisioning complete for port e9998b49-b45f-411d-bfda-94b29f644f7d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:44.964530 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:44.992029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:44.993325 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e9998b49-b45f-411d-bfda-94b29f644f7d up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:45.013603 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:45.025382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67ba900c-c408-448c-a6fa-a7bc7219d595 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.046501 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0e03a5c8-ded4-4ecf-a187-398afbb0903b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 2.7260029 Mar 24 02:15:45.048619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-20c186f1-26bf-4e0e-a088-cbe4988d0a64 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (5147001d-ff20-4e76-b1ca-34b71f15f5ca), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.050803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58992) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:45.056269 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1648041481'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:45.077308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-20c186f1-26bf-4e0e-a088-cbe4988d0a64 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (5147001d-ff20-4e76-b1ca-34b71f15f5ca), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.090396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port e9998b49-b45f-411d-bfda-94b29f644f7d triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:45.090919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.118401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:45.121450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.142587 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Current status of the port e9998b49-b45f-411d-bfda-94b29f644f7d is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:45.142954 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-28746033-3659-47bd-a445-2c4d4f61d99d req-9b6dcf33-b50e-462a-b3e1-e38eb9c7ac6c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2496600 Mar 24 02:15:45.143046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.145859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20c186f1-26bf-4e0e-a088-cbe4988d0a64 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5147001d-ff20-4e76-b1ca-34b71f15f5ca,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:45.157762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-20c186f1-26bf-4e0e-a088-cbe4988d0a64 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.160334 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-20c186f1-26bf-4e0e-a088-cbe4988d0a64 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.6475229 Mar 24 02:15:45.165730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 58994) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:45.252441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.257314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] For port e9998b49-b45f-411d-bfda-94b29f644f7d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e9998b49-b45f-411d-bfda-94b29f644f7d,segment=NetworkSegment(4f560d11-8497-4703-9ca3-3831988ae8de),segment_id=4f560d11-8497-4703-9ca3-3831988ae8de)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:45.274259 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 100} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:45.287161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.299766 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67ba900c-c408-448c-a6fa-a7bc7219d595 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.307895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port e9998b49-b45f-411d-bfda-94b29f644f7d is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:45.308423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.317090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:45.332583 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:45.336448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event deleted for resources: {'Port': ['ID=a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:45.344063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-fc7bd8d0-2589-4148-983c-b996bf05cb2a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '18484e4b-fd02-4452-91f3-85188a2c27cc', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:45.358955 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-80cb728f-29c0-41b1-9956-852a1bc0d186 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.3468349 Mar 24 02:15:45.362871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 58998) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:45.366337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Provisioning complete for port 5692a503-01ca-4041-94b0-cc3f2309e2f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:45.366848 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.371663 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'routes': [{'nexthop': '2001:db8:1::2', 'destination': '2001:db8:1::/64'}, {'nexthop': '2001:db8:2::2', 'destination': '2001:db8:2::/64'}, {'nexthop': '2001:db8:3::2', 'destination': '2001:db8:3::/64'}, {'nexthop': '2001:db8::2', 'destination': '2001:db8::/64'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:45.372479 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:45.373123 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:45.377032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (05c2056c-ae82-4622-bba5-66b27c7ef705), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.377374 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Added segment 05c2056c-ae82-4622-bba5-66b27c7ef705 of type vlan for network abc3348d-dd75-4258-af99-83f2bdb2550c Mar 24 02:15:45.429295 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-fc7bd8d0-2589-4148-983c-b996bf05cb2a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:15:45.467903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Pushing event updated for resources: {'Port': ['ID=e9998b49-b45f-411d-bfda-94b29f644f7d,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:45.477196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78141610-04de-4ecc-a89f-ae526fe9457a req-ebd0f2ab-f01d-407d-a8a8-721ee0812e69 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:45.486234 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-78141610-04de-4ecc-a89f-ae526fe9457a req-ebd0f2ab-f01d-407d-a8a8-721ee0812e69 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1573527 Mar 24 02:15:45.490335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:15:45.495388 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc7bd8d0-2589-4148-983c-b996bf05cb2a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7ab88b6c-e2db-4802-8e4c-bcd135c4b5ea), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.496764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:15:45.543541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Current status of the port 5692a503-01ca-4041-94b0-cc3f2309e2f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:45.547800 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Could not find standard attr ID for object 2bd8f0a9-61ab-4c8b-a119-c6e98565e95f. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:45.548909 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (abc3348d-dd75-4258-af99-83f2bdb2550c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.567580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (acb71783-5509-49e0-adff-499ad7a6d6ef), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.571546 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Provisioning complete for port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:45.572084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.602167 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:45.678563 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Current status of the port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:45.683741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9b763b63-4444-4f6f-9af1-ceab32111bf7 None None] Could not find standard attr ID for object 02f40670-e322-4f49-b0a8-40b4ce1ec0e3. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:45.713143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec35980f-9688-4e04-a0b2-7c4ac79a17c2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (38679b87-a0e3-451f-89bf-9c4615d3b0e0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.714654 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67ba900c-c408-448c-a6fa-a7bc7219d595 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.756845 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-78141610-04de-4ecc-a89f-ae526fe9457a req-39fb1869-db98-48b6-a397-738d5216e956 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2685637 Mar 24 02:15:45.763276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec35980f-9688-4e04-a0b2-7c4ac79a17c2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=38679b87-a0e3-451f-89bf-9c4615d3b0e0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:45.812884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc7bd8d0-2589-4148-983c-b996bf05cb2a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7ab88b6c-e2db-4802-8e4c-bcd135c4b5ea), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.845906 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec35980f-9688-4e04-a0b2-7c4ac79a17c2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.849554 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ec35980f-9688-4e04-a0b2-7c4ac79a17c2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/38679b87-a0e3-451f-89bf-9c4615d3b0e0 HTTP/1.1" status: 204 len: 168 time: 1.7783878 Mar 24 02:15:45.850784 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc7bd8d0-2589-4148-983c-b996bf05cb2a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (7ab88b6c-e2db-4802-8e4c-bcd135c4b5ea), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.868208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59002) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:45.901051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb97b936-1395-4957-9f92-4f7135c5a79d None None] Network 3771196e-a727-49bc-a43a-35151470fb34 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:45.950566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc7bd8d0-2589-4148-983c-b996bf05cb2a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:45.959798 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fc7bd8d0-2589-4148-983c-b996bf05cb2a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.6371908 Mar 24 02:15:45.975519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc7bd8d0-2589-4148-983c-b996bf05cb2a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7ab88b6c-e2db-4802-8e4c-bcd135c4b5ea,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:46.014441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9de548fd-dba6-4349-8c76-fb6a843a91dd None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:46.030376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11e1e61f-2dcd-4892-8d0b-2df796ddf71a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:46.032048 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-11e1e61f-2dcd-4892-8d0b-2df796ddf71a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.1594539 Mar 24 02:15:46.041075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fec05e6-bb5e-4a7a-86ed-3b79c7a6f003 req-1535423a-8227-4ae2-ab92-430bdab39311 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:46.042726 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1fec05e6-bb5e-4a7a-86ed-3b79c7a6f003 req-1535423a-8227-4ae2-ab92-430bdab39311 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1756041 Mar 24 02:15:46.043233 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59008) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:46.060331 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:15:46.102706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9c0401d8-d31f-419e-a9da-04a907b10163 None None] Could not find standard attr ID for object 38679b87-a0e3-451f-89bf-9c4615d3b0e0. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:46.139704 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1fec05e6-bb5e-4a7a-86ed-3b79c7a6f003 req-7e74c9b0-ace6-4493-ab5d-11856659a6c1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0869455 Mar 24 02:15:46.153100 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93073f30-b878-48b5-948b-62a3ac8a73b9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:46.159523 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-93073f30-b878-48b5-948b-62a3ac8a73b9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.1152735 Mar 24 02:15:46.164038 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59010) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:46.264085 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:42Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd52d976f-1ff4-45e1-862e-ce0e0eaa3dc3', 'name': '', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:9e:54:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 727, 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:40Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:46.306790 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:46.307157 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Updating router d36063bd-d604-40b2-9839-addfdc6c944c port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:15:46.362134 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.364736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port e9998b49-b45f-411d-bfda-94b29f644f7d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:46.366411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5692a503-01ca-4041-94b0-cc3f2309e2f7 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:46.411243 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ba900c-c408-448c-a6fa-a7bc7219d595 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:46.418875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (acb71783-5509-49e0-adff-499ad7a6d6ef), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.424360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9c0401d8-d31f-419e-a9da-04a907b10163 None None] Provisioning complete for port 5692a503-01ca-4041-94b0-cc3f2309e2f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:46.424966 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9c0401d8-d31f-419e-a9da-04a907b10163 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.426445 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67ba900c-c408-448c-a6fa-a7bc7219d595 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.435041 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-67ba900c-c408-448c-a6fa-a7bc7219d595 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e HTTP/1.1" status: 204 len: 168 time: 1.6097569 Mar 24 02:15:46.435823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (abc3348d-dd75-4258-af99-83f2bdb2550c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.437132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ccd0a86-f366-49f0-aaf8-e8a468dc0f1a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:46.439143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ccd0a86-f366-49f0-aaf8-e8a468dc0f1a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:46.440655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ccd0a86-f366-49f0-aaf8-e8a468dc0f1a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:46.440911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:46.442077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.443211 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0ccd0a86-f366-49f0-aaf8-e8a468dc0f1a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.2781692 Mar 24 02:15:46.443927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59028) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:46.447901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8ece3d6-8f92-4947-bfc8-bdf973359e46 None None] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:46.456488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_controller (acb71783-5509-49e0-adff-499ad7a6d6ef), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.458376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59030) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:46.524819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b2515da-5e49-4a82-aea8-b6c137dfa874 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet 77524766-c63f-44d6-a6df-ae1c18097bb3 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:46.533104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b2515da-5e49-4a82-aea8-b6c137dfa874 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (77524766-c63f-44d6-a6df-ae1c18097bb3), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.612377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19af2e3f-a756-49b1-a762-58587fcce330 req-bfbc3a04-837a-446d-8210-d76d521c8f6a tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:46.615465 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19af2e3f-a756-49b1-a762-58587fcce330 req-bfbc3a04-837a-446d-8210-d76d521c8f6a tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2774255 Mar 24 02:15:46.625289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-d27ba8ad-0d2e-41c6-b2f0-ebefa5d22837 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 647cce81-b4d4-4b29-96ee-997075fcc3a8 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:46.636735 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.5822017 Mar 24 02:15:46.651474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59032) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:46.652271 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d27ba8ad-0d2e-41c6-b2f0-ebefa5d22837 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (647cce81-b4d4-4b29-96ee-997075fcc3a8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.714989 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 5692a503-01ca-4041-94b0-cc3f2309e2f7 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:46.714989 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.721254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'ports': [{'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f'}, {'network_id': 'abc3348d-dd75-4258-af99-83f2bdb2550c'}]} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:46.721569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:46.722027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': 'abc3348d-dd75-4258-af99-83f2bdb2550c'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:46.723925 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19af2e3f-a756-49b1-a762-58587fcce330 req-3bbbf2a8-3eef-4476-87ae-9e4cf8f293ae tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0841763 Mar 24 02:15:46.733048 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-0424d130-197d-4d12-a3d4-2946001f9679 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1963976978&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.3892586 Mar 24 02:15:46.850755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11d7efc1-a51e-43f4-8550-2e4400bee05d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Network': ['ID=abc3348d-dd75-4258-af99-83f2bdb2550c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:46.863075 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Publish callbacks [] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.875313 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.885693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9c0401d8-d31f-419e-a9da-04a907b10163 None None] Current status of the port 5692a503-01ca-4041-94b0-cc3f2309e2f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:46.899332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network abc3348d-dd75-4258-af99-83f2bdb2550c details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:46.966502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (acb71783-5509-49e0-adff-499ad7a6d6ef), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.967107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Fanout notify agent at l3_agent the message router_deleted on router acb71783-5509-49e0-adff-499ad7a6d6ef {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:15:46.979315 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:46.986748 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b478e884-4e69-4d77-82e4-88cae63cffc6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "DELETE /v2.0/routers/acb71783-5509-49e0-adff-499ad7a6d6ef HTTP/1.1" status: 204 len: 168 time: 3.2935569 Mar 24 02:15:46.999000 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59038) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:47.001307 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-6de4a658-e51f-44b0-9f04-ca736f03c2d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:47.002896 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-6de4a658-e51f-44b0-9f04-ca736f03c2d7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/networks?id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d HTTP/1.1" status: 200 len: 796 time: 0.2592537 Mar 24 02:15:47.007388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-727644634', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:47.007720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b2515da-5e49-4a82-aea8-b6c137dfa874 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (77524766-c63f-44d6-a6df-ae1c18097bb3), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.019544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d27ba8ad-0d2e-41c6-b2f0-ebefa5d22837 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (647cce81-b4d4-4b29-96ee-997075fcc3a8), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.027375 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5172bc-47ea-4c85-aae8-b79fe9f7a1d1 None None] Pushing event updated for resources: {'Port': ['ID=d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:47.038052 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-eafd4123-94c5-4222-a380-aba423d58d53 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/quotas/6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 375 time: 0.0272212 Mar 24 02:15:47.095945 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-38d090f2-36b8-4135-8c79-048468d98869 None None] Could not find standard attr ID for object 38679b87-a0e3-451f-89bf-9c4615d3b0e0. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:47.198764 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Attempting to bind port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:47.199184 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Attempting to bind port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '4f560d11-8497-4703-9ca3-3831988ae8de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '3771196e-a727-49bc-a43a-35151470fb34'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:47.202003 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Attempting to bind port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 on network 3771196e-a727-49bc-a43a-35151470fb34 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:47.219070 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:47.219447 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Checking segment: {'id': '4f560d11-8497-4703-9ca3-3831988ae8de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '3771196e-a727-49bc-a43a-35151470fb34'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:47.219848 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.220238 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Bound using segment: {'id': '4f560d11-8497-4703-9ca3-3831988ae8de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '3771196e-a727-49bc-a43a-35151470fb34'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:47.221108 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Bound port: d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f560d11-8497-4703-9ca3-3831988ae8de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '3771196e-a727-49bc-a43a-35151470fb34'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:47.221502 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.224027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (279dd154-f36b-433d-8d99-f38b264f38d1), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.225176 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (279dd154-f36b-433d-8d99-f38b264f38d1), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.240468 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5692a503-01ca-4041-94b0-cc3f2309e2f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:47.242059 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7b1d481b-3bfa-4756-b24a-0449c4204f8c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:47.307691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (279dd154-f36b-433d-8d99-f38b264f38d1), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.353907 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] For port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:47.357410 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] For port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3,segment=NetworkSegment(4f560d11-8497-4703-9ca3-3831988ae8de),segment_id=4f560d11-8497-4703-9ca3-3831988ae8de)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:47.373045 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.384262 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] Provisioning complete for port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:47.386593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.447533 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 2} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:47.451913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.452224 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5172bc-47ea-4c85-aae8-b79fe9f7a1d1 None None] Pushing event updated for resources: {'Port': ['ID=d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:47.494385 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:47.495286 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:47.539133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 7b1d481b-3bfa-4756-b24a-0449c4204f8c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:47.539657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.614503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.646152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (279dd154-f36b-433d-8d99-f38b264f38d1), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.693868 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:47.718673 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d27ba8ad-0d2e-41c6-b2f0-ebefa5d22837 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (647cce81-b4d4-4b29-96ee-997075fcc3a8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.727541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] Current status of the port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:47.727929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.812162 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-80e45ffd-3557-478a-9708-71a8938c4989 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&fields=id HTTP/1.1" status: 200 len: 302 time: 0.7284944 Mar 24 02:15:47.876645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] For port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3,segment=NetworkSegment(4f560d11-8497-4703-9ca3-3831988ae8de),segment_id=4f560d11-8497-4703-9ca3-3831988ae8de)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:47.880373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 7b1d481b-3bfa-4756-b24a-0449c4204f8c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:47.900177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.958913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.extraroute_db [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}] {{(pid=104036) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Mar 24 02:15:47.987905 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.extraroute_db [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Removed routes are [] {{(pid=104036) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Mar 24 02:15:47.988299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:47.996881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32d850e1-bdbc-4312-ac79-6d6c6f5f98ca req-5775a293-9a9f-4f03-8fb8-bf5bc380bb60 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:48.001332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] Provisioning complete for port e9998b49-b45f-411d-bfda-94b29f644f7d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:48.001928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.009018 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-32d850e1-bdbc-4312-ac79-6d6c6f5f98ca req-5775a293-9a9f-4f03-8fb8-bf5bc380bb60 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.9698260 Mar 24 02:15:48.054731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b2515da-5e49-4a82-aea8-b6c137dfa874 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (77524766-c63f-44d6-a6df-ae1c18097bb3), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.100489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:48.105587 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] Pushing event updated for resources: {'Port': ['ID=d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:48.190296 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:42Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd52d976f-1ff4-45e1-862e-ce0e0eaa3dc3', 'name': '', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:9e:54:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 727, 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:40Z', 'updated_at': '2022-03-24T02:15:47Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:48.199488 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-32d850e1-bdbc-4312-ac79-6d6c6f5f98ca req-ff7015c4-68c4-4f66-a338-9bb4726a82b6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1889536 Mar 24 02:15:48.241951 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-0253b873-c639-49a1-91ef-27da0e4ddfaf service neutron] 10.222.0.20 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3940942 Mar 24 02:15:48.263462 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0383621c-0454-444a-acfc-5eb07de7a2fc None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:42Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd52d976f-1ff4-45e1-862e-ce0e0eaa3dc3', 'name': '', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:9e:54:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 727, 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:40Z', 'updated_at': '2022-03-24T02:15:47Z', 'revision_number': 4, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:48.397465 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-c46c5f5d-255e-49d3-861d-29609c9aa5f9 service neutron] 10.222.0.20 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1471024 Mar 24 02:15:48.408502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b2515da-5e49-4a82-aea8-b6c137dfa874 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (77524766-c63f-44d6-a6df-ae1c18097bb3), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.412998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d27ba8ad-0d2e-41c6-b2f0-ebefa5d22837 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (647cce81-b4d4-4b29-96ee-997075fcc3a8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.465235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b2515da-5e49-4a82-aea8-b6c137dfa874 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.466020 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-05d4bba5-29a5-4f60-9603-7f9a234d7d90 None None] Current status of the port e9998b49-b45f-411d-bfda-94b29f644f7d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:48.472893 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4b2515da-5e49-4a82-aea8-b6c137dfa874 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/77524766-c63f-44d6-a6df-ae1c18097bb3 HTTP/1.1" status: 204 len: 168 time: 2.0155494 Mar 24 02:15:48.474565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b2515da-5e49-4a82-aea8-b6c137dfa874 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=77524766-c63f-44d6-a6df-ae1c18097bb3,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:48.476423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59040) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:48.482302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port 99be106a-597b-4a5c-b95e-dbd8bc367965 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:48.487512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d36e4807-5828-4794-afb4-aa4f04ee8fd9 None None] Network 6f4baa7f-2b71-4f44-946e-878882d49d9f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:48.492559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:48.493036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.620090 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27ba8ad-0d2e-41c6-b2f0-ebefa5d22837 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=647cce81-b4d4-4b29-96ee-997075fcc3a8,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:48.656439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d27ba8ad-0d2e-41c6-b2f0-ebefa5d22837 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.663623 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d27ba8ad-0d2e-41c6-b2f0-ebefa5d22837 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/647cce81-b4d4-4b29-96ee-997075fcc3a8 HTTP/1.1" status: 204 len: 168 time: 2.1174810 Mar 24 02:15:48.665295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (6f4baa7f-2b71-4f44-946e-878882d49d9f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.667235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-026fbbc6-6e5a-47b4-88ef-fd7e4f040a2d None None] Provisioning complete for port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:48.667868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-026fbbc6-6e5a-47b4-88ef-fd7e4f040a2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.669350 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59048) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:48.739907 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b2fc4f1-74cb-4b4d-9b66-3206b40bf0d4 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:48.778791 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e6ddaa0d-316a-4506-a1dc-646e35d75df8 req-3a509708-9ccd-4253-ae49-aa26bbd999f1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 210 time: 0.0943801 Mar 24 02:15:48.821378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f3a0ca7-f52f-4242-a126-2ecce3c50883 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet ac319f4a-9335-45b4-9176-ca0152a41a6b {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:15:48.837442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1f3a0ca7-f52f-4242-a126-2ecce3c50883 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (ac319f4a-9335-45b4-9176-ca0152a41a6b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.893861 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1f3a0ca7-f52f-4242-a126-2ecce3c50883 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (ac319f4a-9335-45b4-9176-ca0152a41a6b), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.895195 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.920659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:48.932676 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (99be106a-597b-4a5c-b95e-dbd8bc367965), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.044669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:49.045777 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e9998b49-b45f-411d-bfda-94b29f644f7d up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:49.063063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4201473-92f2-4bd4-bcbf-168c58cddf70 None None] DHCP port deletion for 6f4baa7f-2b71-4f44-946e-878882d49d9f request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:49.130209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-026fbbc6-6e5a-47b4-88ef-fd7e4f040a2d None None] Current status of the port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:49.134085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1f3a0ca7-f52f-4242-a126-2ecce3c50883 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (ac319f4a-9335-45b4-9176-ca0152a41a6b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.249280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port e7daf644-6aca-4c51-b17b-b82dd20b11a2 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:49.249631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.249750 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port e9998b49-b45f-411d-bfda-94b29f644f7d triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:49.250100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.252746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-026fbbc6-6e5a-47b4-88ef-fd7e4f040a2d None None] Provisioning complete for port e7daf644-6aca-4c51-b17b-b82dd20b11a2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:49.253108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-026fbbc6-6e5a-47b4-88ef-fd7e4f040a2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.310935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b4201473-92f2-4bd4-bcbf-168c58cddf70 None None] Deleting port e7daf644-6aca-4c51-b17b-b82dd20b11a2 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:49.311556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4201473-92f2-4bd4-bcbf-168c58cddf70 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.350559 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port b6d6e24c-0667-4a3a-84bd-42d0f6fd326a yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:49.362633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] For port e7daf644-6aca-4c51-b17b-b82dd20b11a2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e7daf644-6aca-4c51-b17b-b82dd20b11a2,segment=NetworkSegment(f78f480f-9b99-427d-95eb-6b523e41ad01),segment_id=f78f480f-9b99-427d-95eb-6b523e41ad01)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:49.363035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.379139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for e7daf644-6aca-4c51-b17b-b82dd20b11a2 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:49.417747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (279dd154-f36b-433d-8d99-f38b264f38d1), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.420656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:49.421730 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b4201473-92f2-4bd4-bcbf-168c58cddf70 None None] For port e7daf644-6aca-4c51-b17b-b82dd20b11a2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e7daf644-6aca-4c51-b17b-b82dd20b11a2,segment=NetworkSegment(f78f480f-9b99-427d-95eb-6b523e41ad01),segment_id=f78f480f-9b99-427d-95eb-6b523e41ad01)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:49.422375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4201473-92f2-4bd4-bcbf-168c58cddf70 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.440519 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b4201473-92f2-4bd4-bcbf-168c58cddf70 None None] Calling delete_port for e7daf644-6aca-4c51-b17b-b82dd20b11a2 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:49.455588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1f3a0ca7-f52f-4242-a126-2ecce3c50883 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (ac319f4a-9335-45b4-9176-ca0152a41a6b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.471269 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.522645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3a0ca7-f52f-4242-a126-2ecce3c50883 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=ac319f4a-9335-45b4-9176-ca0152a41a6b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:49.530184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1f3a0ca7-f52f-4242-a126-2ecce3c50883 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.539631 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1f3a0ca7-f52f-4242-a126-2ecce3c50883 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/ac319f4a-9335-45b4-9176-ca0152a41a6b HTTP/1.1" status: 204 len: 168 time: 0.8502567 Mar 24 02:15:49.539631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59062) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:49.552768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.577945 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-026fbbc6-6e5a-47b4-88ef-fd7e4f040a2d None None] Could not find standard attr ID for object e7daf644-6aca-4c51-b17b-b82dd20b11a2. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:15:49.580087 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.plugins.ml2.db [None req-026fbbc6-6e5a-47b4-88ef-fd7e4f040a2d None None] No ports have port_id starting with e7daf644-6aca-4c51-b17b-b82dd20b11a2 Mar 24 02:15:49.612259 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9696a049-4ad1-494a-bacf-fd5f4528dae1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0696957 Mar 24 02:15:49.613453 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59064) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:49.617715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8632128c-aff1-4a97-8750-57ecd00e18a5 None None] Update dhcp port {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'fixed_ips': [{'subnet_id': 'ac319f4a-9335-45b4-9176-ca0152a41a6b'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': '5692a503-01ca-4041-94b0-cc3f2309e2f7'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:15:49.620242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:49.635210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=e7daf644-6aca-4c51-b17b-b82dd20b11a2,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:49.640806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No DVR routers for this DVR port e7daf644-6aca-4c51-b17b-b82dd20b11a2 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:49.649394 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8632128c-aff1-4a97-8750-57ecd00e18a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.696696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port e9998b49-b45f-411d-bfda-94b29f644f7d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:49.732345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868e483e-3a08-436b-9161-197f5bd43856 req-eb01695b-10b9-47bd-b214-ba98dec32541 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:49.737512 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-868e483e-3a08-436b-9161-197f5bd43856 req-eb01695b-10b9-47bd-b214-ba98dec32541 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2780979 Mar 24 02:15:49.775969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (6f4baa7f-2b71-4f44-946e-878882d49d9f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.794733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (b6d6e24c-0667-4a3a-84bd-42d0f6fd326a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.801099 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4201473-92f2-4bd4-bcbf-168c58cddf70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (e7daf644-6aca-4c51-b17b-b82dd20b11a2), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.811935 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:49.814437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Allocated IP 172.26.2.209 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/47870b71-6642-4317-9849-7b30457616eb) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:49.824759 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-868e483e-3a08-436b-9161-197f5bd43856 req-7c90c3ec-dfc1-413b-ba26-8c85e1fb17b9 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0715234 Mar 24 02:15:49.829445 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.834082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f4baa7f-2b71-4f44-946e-878882d49d9f']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:49.836186 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59068) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:49.836587 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e26477d8-c235-4bad-875c-341385f4a89e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c HTTP/1.1" status: 200 len: 953 time: 4.4657874 Mar 24 02:15:49.837575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:49.849910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:49.884340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4201473-92f2-4bd4-bcbf-168c58cddf70 None None] No DVR routers for this DVR port e7daf644-6aca-4c51-b17b-b82dd20b11a2 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:49.898726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f78f480f-9b99-427d-95eb-6b523e41ad01') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:49.898909 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f78f480f-9b99-427d-95eb-6b523e41ad01') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:49.901001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b4e093f5-d7a9-44f2-adcc-c3c9079d3a6d None None] Provisioning complete for port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:49.904069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4e093f5-d7a9-44f2-adcc-c3c9079d3a6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.914181 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:49.918541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.932085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:49.932537 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a26a94bf-4bb6-4318-b5f3-95b7e3d30f8b not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:49.954928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (f78f480f-9b99-427d-95eb-6b523e41ad01), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:49.974931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4201473-92f2-4bd4-bcbf-168c58cddf70 None None] Pushing event deleted for resources: {'Port': ['ID=e7daf644-6aca-4c51-b17b-b82dd20b11a2,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:49.982458 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6db973bb-736d-4982-b21a-0ad41d13c5cf req-58fb9a51-81e2-401f-97e7-7f7be99914a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 210 time: 0.0518823 Mar 24 02:15:49.993984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (f78f480f-9b99-427d-95eb-6b523e41ad01), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.024144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:15:50.024596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (f78f480f-9b99-427d-95eb-6b523e41ad01), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:15:50.027987 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:15:50.098755 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-18482bab-ee78-46d4-b835-13fd04f596c1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c HTTP/1.1" status: 200 len: 953 time: 0.2614186 Mar 24 02:15:50.102857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59072) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:50.107905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'routes': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:50.126685 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:50.127319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:50.173053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (99be106a-597b-4a5c-b95e-dbd8bc367965), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.197795 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (6f4baa7f-2b71-4f44-946e-878882d49d9f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.200010 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:50.206244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.213808 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/networks/6f4baa7f-2b71-4f44-946e-878882d49d9f HTTP/1.1" status: 204 len: 168 time: 1.7362227 Mar 24 02:15:50.220814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59074) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:50.247313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac6c5cd-e9c6-440f-9cbb-ffc06b16b2d9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Network': ['ID=6f4baa7f-2b71-4f44-946e-878882d49d9f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:50.268836 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=99be106a-597b-4a5c-b95e-dbd8bc367965,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:50.303405 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2bb0932-be92-4c5d-83e9-c14a35194621 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:50.341983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:50.351252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:50.361367 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:50.362228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b6d6e24c-0667-4a3a-84bd-42d0f6fd326a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.367976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for port (47870b71-6642-4317-9849-7b30457616eb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.368384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a4b3473-2076-4031-8fa1-10cdcfebb98c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:50.370118 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7a4b3473-2076-4031-8fa1-10cdcfebb98c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.1467400 Mar 24 02:15:50.398132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59076) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:50.434228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:50.479014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=b6d6e24c-0667-4a3a-84bd-42d0f6fd326a,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:50.502289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.512121 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-42b54812-c62e-4025-8e64-b41a362109bf tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.1126132 Mar 24 02:15:50.517117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59078) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:50.525671 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1629059046'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:50.539963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Checking segment: {'id': '05c2056c-ae82-4622-bba5-66b27c7ef705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'abc3348d-dd75-4258-af99-83f2bdb2550c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:50.540330 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network hostable DHCP agents. Network: abc3348d-dd75-4258-af99-83f2bdb2550c, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:50.562240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b4e093f5-d7a9-44f2-adcc-c3c9079d3a6d None None] Current status of the port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:50.567380 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:50.568703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:50.569398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.578874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:50.583983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:50.584547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.585567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:50.589214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.594986 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (47870b71-6642-4317-9849-7b30457616eb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.607182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:50.612732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network abc3348d-dd75-4258-af99-83f2bdb2550c is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:50.650215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 142} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:50.651894 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:50.652779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, abc3348d-dd75-4258-af99-83f2bdb2550c) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:50.662883 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8834eed6-33b0-4dbe-88b7-72c656242411 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.0463946 Mar 24 02:15:50.669360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59080) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:50.670137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:50.673902 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfe437eb-bb4a-4a05-a786-4bb02dac4712 None None] Network abc3348d-dd75-4258-af99-83f2bdb2550c requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:50.676668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6c734fe4-7dab-49b2-b89e-f78e3039ef8d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:50.680518 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:50.683873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (41a6167d-5209-4f9d-b46e-2a681f471477), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.684215 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Added segment 41a6167d-5209-4f9d-b46e-2a681f471477 of type vlan for network b5173458-c877-40eb-8ceb-c04dd0584e92 Mar 24 02:15:50.685848 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:50.690424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:50.691172 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.697835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:50.718276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event updated for resources: {'Port': ['ID=47870b71-6642-4317-9849-7b30457616eb,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:50.766079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (b5173458-c877-40eb-8ceb-c04dd0584e92), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.785549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.extraroute_db [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added routes are [] {{(pid=104037) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Mar 24 02:15:50.785822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.extraroute_db [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Removed routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}] {{(pid=104037) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Mar 24 02:15:50.822628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (b5173458-c877-40eb-8ceb-c04dd0584e92), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.828063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:50.828768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.917178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:50.965481 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.4446094 Mar 24 02:15:50.969575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59084) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:50.978811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': 'b5173458-c877-40eb-8ceb-c04dd0584e92', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:50.991801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b14818e-082c-4714-8845-f20dd9f1d735 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Network': ['ID=b5173458-c877-40eb-8ceb-c04dd0584e92,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:51.136625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network b5173458-c877-40eb-8ceb-c04dd0584e92 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:51.149618 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-042f9e4f-e87c-46ba-a04f-9cc19546b0e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 4.4887156 Mar 24 02:15:51.154302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59092) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:51.205437 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7672569c-bff5-47eb-9f8c-4f851cf66447 None None] Provisioning complete for port 5692a503-01ca-4041-94b0-cc3f2309e2f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:51.205953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7672569c-bff5-47eb-9f8c-4f851cf66447 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:51.223302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5849cef0-2e6f-4099-9722-2742e574a9b6 None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:15:51.299360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:51.403538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:47Z', 'revision_number': 6, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd52d976f-1ff4-45e1-862e-ce0e0eaa3dc3', 'name': '', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:9e:54:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 727, 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:40Z', 'updated_at': '2022-03-24T02:15:47Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:51.403988 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c734fe4-7dab-49b2-b89e-f78e3039ef8d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:51.407589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6c734fe4-7dab-49b2-b89e-f78e3039ef8d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:51.414244 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e7daf644-6aca-4c51-b17b-b82dd20b11a2 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:51.472310 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: e7daf644-6aca-4c51-b17b-b82dd20b11a2 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:15:51.472689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e7daf644-6aca-4c51-b17b-b82dd20b11a2 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:51.507014 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:51.524600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5849cef0-2e6f-4099-9722-2742e574a9b6 None None] Deleting port 5692a503-01ca-4041-94b0-cc3f2309e2f7 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:51.525439 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5849cef0-2e6f-4099-9722-2742e574a9b6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:51.545833 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0be3f1b9-8300-4017-b379-43a39f0d50b7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port b6d6e24c-0667-4a3a-84bd-42d0f6fd326a {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:51.546228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0be3f1b9-8300-4017-b379-43a39f0d50b7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b6d6e24c-0667-4a3a-84bd-42d0f6fd326a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:51.572376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:51.573101 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:51.578144 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7672569c-bff5-47eb-9f8c-4f851cf66447 None None] Current status of the port 5692a503-01ca-4041-94b0-cc3f2309e2f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:51.584640 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fafd5562-b6fa-4b3b-9479-00a1ab5a725a req-731b37ed-efff-4067-a514-e329300cc52a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 210 time: 0.1259909 Mar 24 02:15:51.660449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0be3f1b9-8300-4017-b379-43a39f0d50b7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b6d6e24c-0667-4a3a-84bd-42d0f6fd326a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:51.686402 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-08617674-1b30-4656-b389-c7018373bafa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:51.687972 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-08617674-1b30-4656-b389-c7018373bafa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d HTTP/1.1" status: 200 len: 796 time: 0.8005888 Mar 24 02:15:51.690481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0be3f1b9-8300-4017-b379-43a39f0d50b7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for b6d6e24c-0667-4a3a-84bd-42d0f6fd326a owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:51.697952 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.ipam_backend_mixin [None req-6c734fe4-7dab-49b2-b89e-f78e3039ef8d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4 (CIDR: 2001:db8::/64) Mar 24 02:15:51.706730 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-6c734fe4-7dab-49b2-b89e-f78e3039ef8d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:15:51.707181 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6c734fe4-7dab-49b2-b89e-f78e3039ef8d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:15:51.723165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:51.734967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f03515fa-f4b4-4cbe-b6e8-c42c2bf0cb7c req-a795d4dd-0e9f-49ed-87bc-17731ce82fd8 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:51.742087 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f03515fa-f4b4-4cbe-b6e8-c42c2bf0cb7c req-a795d4dd-0e9f-49ed-87bc-17731ce82fd8 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.7549045 Mar 24 02:15:51.759515 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (279dd154-f36b-433d-8d99-f38b264f38d1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:51.774117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-5849cef0-2e6f-4099-9722-2742e574a9b6 None None] For port 5692a503-01ca-4041-94b0-cc3f2309e2f7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5692a503-01ca-4041-94b0-cc3f2309e2f7,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:51.774698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5849cef0-2e6f-4099-9722-2742e574a9b6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:51.803296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5849cef0-2e6f-4099-9722-2742e574a9b6 None None] Calling delete_port for 5692a503-01ca-4041-94b0-cc3f2309e2f7 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:51.806068 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6c734fe4-7dab-49b2-b89e-f78e3039ef8d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.1338770 Mar 24 02:15:51.837777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59102) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:51.844398 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'subnet': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:51.904958 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-cc0b62fb-31b3-434a-b014-abbdbf941db4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 380 time: 0.1821985 Mar 24 02:15:51.908527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:51.914942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.010354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0be3f1b9-8300-4017-b379-43a39f0d50b7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b6d6e24c-0667-4a3a-84bd-42d0f6fd326a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.037862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.057211 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'admin_state_up': True, 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'security_groups': ['18484e4b-fd02-4452-91f3-85188a2c27cc']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:52.067164 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5692a503-01ca-4041-94b0-cc3f2309e2f7 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:15:52.073677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.137200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No active binding found for port 5692a503-01ca-4041-94b0-cc3f2309e2f7 {{(pid=104038) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Mar 24 02:15:52.137200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] The host dv-neutron-834874-3-hyperv is not matching for port 5692a503-01ca-4041-94b0-cc3f2309e2f7 host None! {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2354}} Mar 24 02:15:52.137576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5692a503-01ca-4041-94b0-cc3f2309e2f7 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:15:52.138745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5849cef0-2e6f-4099-9722-2742e574a9b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (5692a503-01ca-4041-94b0-cc3f2309e2f7), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.143040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:50Z', 'revision_number': 7, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd52d976f-1ff4-45e1-862e-ce0e0eaa3dc3', 'name': '', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:9e:54:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 727, 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:40Z', 'updated_at': '2022-03-24T02:15:47Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:52.183885 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be3f1b9-8300-4017-b379-43a39f0d50b7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=b6d6e24c-0667-4a3a-84bd-42d0f6fd326a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:52.199532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0be3f1b9-8300-4017-b379-43a39f0d50b7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.201579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eb3c946-6369-44f8-87a6-a6a567d6856e None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:50Z', 'revision_number': 7, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd52d976f-1ff4-45e1-862e-ce0e0eaa3dc3', 'name': '', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:9e:54:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 727, 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:40Z', 'updated_at': '2022-03-24T02:15:47Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:52.202920 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0be3f1b9-8300-4017-b379-43a39f0d50b7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/b6d6e24c-0667-4a3a-84bd-42d0f6fd326a HTTP/1.1" status: 204 len: 168 time: 1.0480065 Mar 24 02:15:52.207090 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5849cef0-2e6f-4099-9722-2742e574a9b6 None None] No DVR routers for this DVR port 5692a503-01ca-4041-94b0-cc3f2309e2f7 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:15:52.208088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5849cef0-2e6f-4099-9722-2742e574a9b6 None None] Pushing event deleted for resources: {'Port': ['ID=5692a503-01ca-4041-94b0-cc3f2309e2f7,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:52.208646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59114) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:52.244547 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1780eca5-148b-4561-b6cd-cc6a0d7854c9 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:52.275317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:52.279344 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.316720 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f03515fa-f4b4-4cbe-b6e8-c42c2bf0cb7c req-f4f51fc6-3bab-4afc-85c8-9af30451627a tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5705383 Mar 24 02:15:52.360957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (279dd154-f36b-433d-8d99-f38b264f38d1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.440243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'project_id': '61b2614e46ca47e598c15c239d583ee4', 'fixed_ips': [{'subnet_id': '64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:52.440703 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0362b36c-31ff-428f-911f-b16f6ecb9468 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:52.442178 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.448255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0362b36c-31ff-428f-911f-b16f6ecb9468 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:52.450175 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0362b36c-31ff-428f-911f-b16f6ecb9468 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1455 time: 0.2404187 Mar 24 02:15:52.453159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59118) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:52.601200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Allocated IP 2001:db8::2 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4/cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:52.624870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4136d17b-f86a-4292-bab1-19e7f4bc3ce1 req-6298a928-25c6-43c0-b548-ae97aa720f4c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:52.626322 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4136d17b-f86a-4292-bab1-19e7f4bc3ce1 req-6298a928-25c6-43c0-b548-ae97aa720f4c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.3744192 Mar 24 02:15:52.662489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:52.681566 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Router 279dd154-f36b-433d-8d99-f38b264f38d1 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:15:52.721054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:52.724941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.773187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Publish callbacks [] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.780075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.792552 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ee098cfb-09d2-4859-902f-3d5f9f8840d8 req-791c97f6-caf8-491a-ac6b-d9dddb3596be tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 210 time: 0.0848997 Mar 24 02:15:52.812869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (bff9ad11-3244-4fdd-aca0-5e91de44c852), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.831539 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:52.831539 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:52.831539 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:52.887881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Pushing event updated for resources: {'Port': ['ID=cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:52.902081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Attempting to bind port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:52.902081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Attempting to bind port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:52.902400 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Attempting to bind port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 on network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:52.905534 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:52.907942 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:52.908318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Checking segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:52.908723 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.909117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Bound using segment: {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:52.909590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Bound port: cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10c9520a-ce90-4c32-a99e-00890d4b2069', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:52.910657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.922852 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31937eac-66a4-46df-bb5b-061c7d18c551 None None] Sync routers for ids ['279dd154-f36b-433d-8d99-f38b264f38d1'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:52.934340 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31937eac-66a4-46df-bb5b-061c7d18c551 None None] Routers {'279dd154-f36b-433d-8d99-f38b264f38d1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:52.935218 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-31937eac-66a4-46df-bb5b-061c7d18c551 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['279dd154-f36b-433d-8d99-f38b264f38d1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:52.943371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:52.947834 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-85af5228-d220-44b6-a219-5e93c8f9fc1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 5.9464138 Mar 24 02:15:52.949818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59122) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:52.955078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-67e32b51-0367-4cc7-ab3e-074d6d2b1d4c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': False}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:52.979735 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4136d17b-f86a-4292-bab1-19e7f4bc3ce1 req-82e49d81-ac2d-4333-b678-9cbe22712e9b tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3186579 Mar 24 02:15:52.988287 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-31937eac-66a4-46df-bb5b-061c7d18c551 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:52.999826 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31937eac-66a4-46df-bb5b-061c7d18c551 None None] Routers {'279dd154-f36b-433d-8d99-f38b264f38d1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:53.000693 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-31937eac-66a4-46df-bb5b-061c7d18c551 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['279dd154-f36b-433d-8d99-f38b264f38d1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:53.007698 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.objects.ports [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=104036) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Mar 24 02:15:53.011550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] For port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:53.015140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] For port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:53.024036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.056579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d9aa3e71-5ab7-4ee2-8f16-47cea70d2550 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 99be106a-597b-4a5c-b95e-dbd8bc367965 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:53.056908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d9aa3e71-5ab7-4ee2-8f16-47cea70d2550 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (99be106a-597b-4a5c-b95e-dbd8bc367965), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.058403 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-31937eac-66a4-46df-bb5b-061c7d18c551 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:53.059101 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31937eac-66a4-46df-bb5b-061c7d18c551 None None] The sync data for ids ['279dd154-f36b-433d-8d99-f38b264f38d1'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:53.072573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=bff9ad11-3244-4fdd-aca0-5e91de44c852,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:53.108712 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1afb9f-e2ec-4f19-b54c-825b38cf20a4 None None] Pushing event updated for resources: {'Port': ['ID=cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:53.169762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:53.181477 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:53.183011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.188521 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b30bd81a-f2b0-4a6c-a6e5-daef62adcda4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c HTTP/1.1" status: 200 len: 703 time: 3.0834868 Mar 24 02:15:53.188979 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59124) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:53.202489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Checking segment: {'id': '41a6167d-5209-4f9d-b46e-2a681f471477', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'b5173458-c877-40eb-8ceb-c04dd0584e92'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:53.202899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network hostable DHCP agents. Network: b5173458-c877-40eb-8ceb-c04dd0584e92, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:53.212817 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:53.219106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:53.229009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d9aa3e71-5ab7-4ee2-8f16-47cea70d2550 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (99be106a-597b-4a5c-b95e-dbd8bc367965), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.252252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.8 (4ce8d77b-f4f5-4987-9cce-04a12234cd5d/852aacbf-87d9-49af-b73c-786b9253307e/79123375-136b-4c1b-ba67-948e46e33a7c) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:53.254617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d9aa3e71-5ab7-4ee2-8f16-47cea70d2550 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 99be106a-597b-4a5c-b95e-dbd8bc367965 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:53.277849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network b5173458-c877-40eb-8ceb-c04dd0584e92 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:53.380166 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-10c66e68-de95-4dfe-a4a2-958b6d676622 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c HTTP/1.1" status: 200 len: 703 time: 0.1892958 Mar 24 02:15:53.381119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59128) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:53.398717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, b5173458-c877-40eb-8ceb-c04dd0584e92) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:53.404122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:53.405097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.535442 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-67890c8b-e3a0-4f93-a7fa-d0ed925ac33b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.5599999 Mar 24 02:15:53.536331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59130) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:53.555634 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': 'b5173458-c877-40eb-8ceb-c04dd0584e92', 'name': 'tempest-PortsTestJSON-973170273'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:53.564635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6d8c260-8f0f-48ae-a568-9df750815de3 None None] Network b5173458-c877-40eb-8ceb-c04dd0584e92 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:53.641909 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d9aa3e71-5ab7-4ee2-8f16-47cea70d2550 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (99be106a-597b-4a5c-b95e-dbd8bc367965), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.642961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.667232 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:53.702843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9aa3e71-5ab7-4ee2-8f16-47cea70d2550 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=99be106a-597b-4a5c-b95e-dbd8bc367965,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:53.711450 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d9aa3e71-5ab7-4ee2-8f16-47cea70d2550 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.717612 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d9aa3e71-5ab7-4ee2-8f16-47cea70d2550 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/99be106a-597b-4a5c-b95e-dbd8bc367965 HTTP/1.1" status: 204 len: 168 time: 1.2556152 Mar 24 02:15:53.724563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59132) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:53.759472 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c5a23d-3efe-45de-8570-951bd26a6331 req-f73a9371-716d-4dda-8449-2fbad5ee84d6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:53.761096 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-75c5a23d-3efe-45de-8570-951bd26a6331 req-f73a9371-716d-4dda-8449-2fbad5ee84d6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3038263 Mar 24 02:15:53.766386 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-b5173458-c877-40eb-8ceb-c04dd0584e92', 'network_id': 'b5173458-c877-40eb-8ceb-c04dd0584e92', 'project_id': '59047855c41744dd95105383d31cd553', 'fixed_ips': [{'subnet_id': 'bff9ad11-3244-4fdd-aca0-5e91de44c852'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:53.767295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.812317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (79123375-136b-4c1b-ba67-948e46e33a7c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.903517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:53.906903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:53.919518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea44c211-eca0-4d60-aca1-c5fce40edf44 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:53.921047 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ea44c211-eca0-4d60-aca1-c5fce40edf44 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 847 time: 0.1869349 Mar 24 02:15:53.931370 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59136) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:53.946286 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-75c5a23d-3efe-45de-8570-951bd26a6331 req-ce9e2c29-876b-4a72-846d-9870ffa2001e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1576693 Mar 24 02:15:53.976454 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-de42264b-46f6-4aa6-8c03-1372ac0a3168 req-abc759c0-6ea9-4a86-bcfa-47c1f2916b13 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 210 time: 0.0739582 Mar 24 02:15:54.001897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.006243 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-f7c2f5c9-8acd-4eea-bfa2-67bcd8a09d81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:15:54.011392 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f7c2f5c9-8acd-4eea-bfa2-67bcd8a09d81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/b6d6e24c-0667-4a3a-84bd-42d0f6fd326a HTTP/1.1" status: 404 len: 333 time: 0.0742471 Mar 24 02:15:54.015731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 6ded70b4-5f23-459c-80ef-c526b84a6dcc yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:54.023576 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59140) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:54.123958 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-c7021c46-2555-44eb-b21b-ce2a752e1261 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:15:54.127935 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c7021c46-2555-44eb-b21b-ce2a752e1261 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/99be106a-597b-4a5c-b95e-dbd8bc367965 HTTP/1.1" status: 404 len: 333 time: 0.1006515 Mar 24 02:15:54.127935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:54.133223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59142) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:54.141399 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Allocated IP 172.20.0.2 (b5173458-c877-40eb-8ceb-c04dd0584e92/bff9ad11-3244-4fdd-aca0-5e91de44c852/d3348104-b75b-43fe-b495-0b6438d16645) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:54.154756 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:54.157791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:54.296567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=79123375-136b-4c1b-ba67-948e46e33a7c,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:54.355935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:54.358310 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.359592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:54.371898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Publish callbacks [] for port (d3348104-b75b-43fe-b495-0b6438d16645), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.386485 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-088a018e-1d75-4c53-bb58-4b28b600226d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3533993 Mar 24 02:15:54.414700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Request body: {'port': {'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:54.428542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (d3348104-b75b-43fe-b495-0b6438d16645), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.477821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (abc3348d-dd75-4258-af99-83f2bdb2550c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.537221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Pushing event updated for resources: {'Port': ['ID=d3348104-b75b-43fe-b495-0b6438d16645,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:54.598889 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Network b5173458-c877-40eb-8ceb-c04dd0584e92 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:54.603647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e4e0bf-8d38-4a38-ae8b-990f8d63f694 req-cf26d4b3-4c46-4f73-801a-582eafbfeb88 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:54.606877 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a0e4e0bf-8d38-4a38-ae8b-990f8d63f694 req-cf26d4b3-4c46-4f73-801a-582eafbfeb88 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.4666514 Mar 24 02:15:54.610056 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] For port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:54.631012 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:54.631473 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.633542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.635410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67e32b51-0367-4cc7-ab3e-074d6d2b1d4c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (279dd154-f36b-433d-8d99-f38b264f38d1), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.639014 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:54.662904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.8 (b5173458-c877-40eb-8ceb-c04dd0584e92/bff9ad11-3244-4fdd-aca0-5e91de44c852/6ded70b4-5f23-459c-80ef-c526b84a6dcc) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:54.693098 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:54.711797 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.714762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Provisioning complete for port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:54.715138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.720715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.767661 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (abc3348d-dd75-4258-af99-83f2bdb2550c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.776286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (a5f96abf-6076-4bb9-8c25-133dca34c71d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.841809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['abc3348d-dd75-4258-af99-83f2bdb2550c']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:54.858138 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:54.865829 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65,revision_number=4']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:54.871831 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:54.882017 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:54.882640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.885862 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Subnet': ['ID=a5f96abf-6076-4bb9-8c25-133dca34c71d,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:54.897415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c04df33-dead-495f-bb3d-b70c1990039d None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:54.899216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:54.899677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.901419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Attempting to bind port d3348104-b75b-43fe-b495-0b6438d16645 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:54.901837 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Attempting to bind port d3348104-b75b-43fe-b495-0b6438d16645 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '41a6167d-5209-4f9d-b46e-2a681f471477', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'b5173458-c877-40eb-8ceb-c04dd0584e92'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:54.902251 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Attempting to bind port d3348104-b75b-43fe-b495-0b6438d16645 on network b5173458-c877-40eb-8ceb-c04dd0584e92 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:54.910451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:50Z', 'revision_number': 7, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd52d976f-1ff4-45e1-862e-ce0e0eaa3dc3', 'name': '', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:9e:54:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 727, 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:40Z', 'updated_at': '2022-03-24T02:15:47Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:54.914285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.915026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.915026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.915326 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.915659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.915990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.916643 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.916643 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.916950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.917275 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.917598 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:54.917740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.917919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.918071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Checking segment: {'id': '41a6167d-5209-4f9d-b46e-2a681f471477', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'b5173458-c877-40eb-8ceb-c04dd0584e92'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:54.918241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.919341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.919491 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.919592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.919683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Bound using segment: {'id': '41a6167d-5209-4f9d-b46e-2a681f471477', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'b5173458-c877-40eb-8ceb-c04dd0584e92'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:54.919683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Bound port: d3348104-b75b-43fe-b495-0b6438d16645, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '41a6167d-5209-4f9d-b46e-2a681f471477', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'b5173458-c877-40eb-8ceb-c04dd0584e92'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:54.920114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d3348104-b75b-43fe-b495-0b6438d16645), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:54.931060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.931410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.931757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.932100 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.932436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.932871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.933199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.933388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.933717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.934042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.934366 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.934930 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.935034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.935519 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.935648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:54.955546 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8db67db3-c8f0-4170-9a2b-a10e6bcd30ba tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 864 time: 3.1166050 Mar 24 02:15:54.956323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59144) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:54.967327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Request body: {'port': {'network_id': '6f3080fc-791f-4748-a0a2-9eff6ea2a609', 'mac_address': 'fa:16:3e:a3:4d:26', 'name': 'tempest-NetworksTestDHCPv6-380490843'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:54.990956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '05c2056c-ae82-4622-bba5-66b27c7ef705') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:54.991255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '05c2056c-ae82-4622-bba5-66b27c7ef705') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:55.000405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (05c2056c-ae82-4622-bba5-66b27c7ef705), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:55.011648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:15:55.093995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] For port d3348104-b75b-43fe-b495-0b6438d16645, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:55.098334 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] For port d3348104-b75b-43fe-b495-0b6438d16645, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3348104-b75b-43fe-b495-0b6438d16645,segment=NetworkSegment(41a6167d-5209-4f9d-b46e-2a681f471477),segment_id=41a6167d-5209-4f9d-b46e-2a681f471477)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:55.112622 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Current status of the port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:55.113735 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:55.120832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d3348104-b75b-43fe-b495-0b6438d16645), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:55.138675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:55.150242 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:55.156807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:55.157447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:55.194849 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:55.303947 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Made reservation on behalf of 61b2614e46ca47e598c15c239d583ee4 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:55.373503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Pushing event updated for resources: {'Port': ['ID=d3348104-b75b-43fe-b495-0b6438d16645,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:55.395542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.395886 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.396530 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.396647 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.396888 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.397219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.397545 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.397879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.398592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.398592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.398872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.399189 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.399512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.399831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.400148 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c77a8eeb-d7f9-4037-8610-9423bf1a4041 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:55.412066 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:15:55.412425 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:15:55.415405 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:55.551101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:55.599867 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:55.621817 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a0e4e0bf-8d38-4a38-ae8b-990f8d63f694 req-6b277112-6f2d-4706-9dd8-48351168308b tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.9828029 Mar 24 02:15:55.663980 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] device_id is not set on port 6c52ec2e-a7a9-48ed-b21e-0444cf7269d9 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:55.666902 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (05c2056c-ae82-4622-bba5-66b27c7ef705), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:55.693108 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Releasing vlan 100 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:15:55.693392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (05c2056c-ae82-4622-bba5-66b27c7ef705), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:15:55.702780 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:15:55.708912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 79123375-136b-4c1b-ba67-948e46e33a7c {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:15:55.796796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:50Z', 'revision_number': 7, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd52d976f-1ff4-45e1-862e-ce0e0eaa3dc3', 'name': '', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:9e:54:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 727, 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:40Z', 'updated_at': '2022-03-24T02:15:47Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:55.823653 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Publish callbacks [] for port (79123375-136b-4c1b-ba67-948e46e33a7c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:55.838811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab0aa988-d3a9-4910-934d-8ebee72febbf None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:50Z', 'revision_number': 7, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd52d976f-1ff4-45e1-862e-ce0e0eaa3dc3', 'name': '', 'network_id': '3771196e-a727-49bc-a43a-35151470fb34', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:9e:54:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 727, 'fixed_ips': [{'subnet_id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:40Z', 'updated_at': '2022-03-24T02:15:47Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': 'a7c72fce-ef84-4709-a1ef-6dc870f90812', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:55.892527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441a6271-313d-4cc2-8bdb-ded62be1f746 req-aefb96b3-c6cc-4442-85ae-50e5c5306a08 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:55.895557 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-441a6271-313d-4cc2-8bdb-ded62be1f746 req-aefb96b3-c6cc-4442-85ae-50e5c5306a08 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3019400 Mar 24 02:15:55.969816 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Current status of the port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:55.984104 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Provisioning complete for port 79123375-136b-4c1b-ba67-948e46e33a7c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:55.984484 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.018543 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Transition to ACTIVE for port object 79123375-136b-4c1b-ba67-948e46e33a7c will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:15:56.023193 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-441a6271-313d-4cc2-8bdb-ded62be1f746 req-1b87f5b3-7b21-4012-b250-b8126f2287af tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1076555 Mar 24 02:15:56.035643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (abc3348d-dd75-4258-af99-83f2bdb2550c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.057263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.070286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67e32b51-0367-4cc7-ab3e-074d6d2b1d4c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (279dd154-f36b-433d-8d99-f38b264f38d1), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.072112 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (6ded70b4-5f23-459c-80ef-c526b84a6dcc), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.091271 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2969d5c3-06df-4e0c-bac8-c88ae2696ab1 None None] Port 79123375-136b-4c1b-ba67-948e46e33a7c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:56.106553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67e32b51-0367-4cc7-ab3e-074d6d2b1d4c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (279dd154-f36b-433d-8d99-f38b264f38d1), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.133325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.140156 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/networks/abc3348d-dd75-4258-af99-83f2bdb2550c HTTP/1.1" status: 204 len: 168 time: 2.0016367 Mar 24 02:15:56.145753 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59150) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:56.184396 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-542255524'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:56.198460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb3dc497-8453-4305-b035-5e7beb75ac0a req-83a3ca68-631d-4293-8a64-8046a5809f65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:56.204157 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fb3dc497-8453-4305-b035-5e7beb75ac0a req-83a3ca68-631d-4293-8a64-8046a5809f65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 931 time: 0.4122353 Mar 24 02:15:56.213819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Network': ['ID=abc3348d-dd75-4258-af99-83f2bdb2550c,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:56.271155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:56.289699 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Pushing event updated for resources: {'Port': ['ID=79123375-136b-4c1b-ba67-948e46e33a7c,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:56.312001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.312357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.315071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.315423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.315766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.316638 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.316974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.317304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.317631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.317958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.318311 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.318728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.319060 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.319211 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:56.319385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.319708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1556a504-c430-422f-bb0e-b693607f49e1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.319830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.384730 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:56.385341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.417788 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fb3dc497-8453-4305-b035-5e7beb75ac0a req-a521338f-cbe7-4c70-8253-aa010db8c8e5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1909654 Mar 24 02:15:56.471957 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:56.477205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.480149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (6ded70b4-5f23-459c-80ef-c526b84a6dcc), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.514045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Attempting to bind port 79123375-136b-4c1b-ba67-948e46e33a7c on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:56.514385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Attempting to bind port 79123375-136b-4c1b-ba67-948e46e33a7c by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:56.514762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Attempting to bind port 79123375-136b-4c1b-ba67-948e46e33a7c on network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:56.517473 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.517837 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.518178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.518545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.518870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.519252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.519588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.519976 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.520308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.520631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.520957 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.521275 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.521596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.521915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.522237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:15:56.555137 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:56.556231 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3348104-b75b-43fe-b495-0b6438d16645 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:56.611492 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=6ded70b4-5f23-459c-80ef-c526b84a6dcc,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:56.628375 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network b5173458-c877-40eb-8ceb-c04dd0584e92 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:56.630601 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Port 79123375-136b-4c1b-ba67-948e46e33a7c on network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:15:56.630928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Attempting to bind port 79123375-136b-4c1b-ba67-948e46e33a7c on network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:56.636812 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:56.637171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Checking segment: {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:56.637816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Bound using segment: {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:56.638261 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Bound port: 79123375-136b-4c1b-ba67-948e46e33a7c, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5e901f2f-82e7-4a47-a540-857908c70ec7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:56.638641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.640002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d3348104-b75b-43fe-b495-0b6438d16645 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:56.640388 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3348104-b75b-43fe-b495-0b6438d16645), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.676031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:56.689333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:56.864354 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d345cf71-23e0-4dd1-af83-246fa07248b7 None None] Network b5173458-c877-40eb-8ceb-c04dd0584e92 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:56.883250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 134} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:15:56.888368 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8::364 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4/6c52ec2e-a7a9-48ed-b21e-0444cf7269d9) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:56.891570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:56.892709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.902172 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-67e32b51-0367-4cc7-ab3e-074d6d2b1d4c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Router 279dd154-f36b-433d-8d99-f38b264f38d1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:56.906389 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Allocated IP 2001:db8:0:1:f816:3eff:fea3:4d26 (6f3080fc-791f-4748-a0a2-9eff6ea2a609/a5f96abf-6076-4bb9-8c25-133dca34c71d/6c52ec2e-a7a9-48ed-b21e-0444cf7269d9) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:56.907309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] For port 79123375-136b-4c1b-ba67-948e46e33a7c, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:56.919054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] For port 79123375-136b-4c1b-ba67-948e46e33a7c, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=79123375-136b-4c1b-ba67-948e46e33a7c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:56.927394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (64b82b4c-8030-4953-bd09-d1681cca9cb9), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.927681 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Added segment 64b82b4c-8030-4953-bd09-d1681cca9cb9 of type vlan for network 4737a54d-fb43-4f33-9571-8788f5e66399 Mar 24 02:15:56.936877 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7d6f5bb4-a8ec-47e4-b98d-18ae871a4f72 None None] Provisioning complete for port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:56.937413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d6f5bb4-a8ec-47e4-b98d-18ae871a4f72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:56.950293 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a921441-5133-4394-bed6-96c3ba4b35bf req-105e5970-ef49-4a59-8efe-9f01610d5ce0 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:56.952373 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a921441-5133-4394-bed6-96c3ba4b35bf req-105e5970-ef49-4a59-8efe-9f01610d5ce0 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.1929405 Mar 24 02:15:56.977554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.008193 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-58e47eb5-b8d7-481c-b5c9-ee451b416589 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 3.4650004 Mar 24 02:15:57.009861 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59154) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:57.014771 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': 'b5173458-c877-40eb-8ceb-c04dd0584e92', 'name': 'tempest-PortsTestJSON-1459668336'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:57.029029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d3348104-b75b-43fe-b495-0b6438d16645 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:57.029798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d3348104-b75b-43fe-b495-0b6438d16645), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.035958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (4737a54d-fb43-4f33-9571-8788f5e66399), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.060925 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:57.061474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.062886 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] 10.222.0.30 "PUT /v2.0/ports/79123375-136b-4c1b-ba67-948e46e33a7c HTTP/1.1" status: 200 len: 1093 time: 2.6687891 Mar 24 02:15:57.063332 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:15:57.066383 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-24feb996-b86f-4695-bf48-dcbab3bffa7d" -d '{"events": [{"name": "network-changed", "server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:15:57.079609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3,segment=NetworkSegment(4f560d11-8497-4703-9ca3-3831988ae8de),segment_id=4f560d11-8497-4703-9ca3-3831988ae8de)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:57.079609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.120150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-368df3f8-0231-480b-b06a-86addfcb3125 service neutron] Pushing event updated for resources: {'Port': ['ID=79123375-136b-4c1b-ba67-948e46e33a7c,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:57.157137 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d3348104-b75b-43fe-b495-0b6438d16645, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3348104-b75b-43fe-b495-0b6438d16645,segment=NetworkSegment(41a6167d-5209-4f9d-b46e-2a681f471477),segment_id=41a6167d-5209-4f9d-b46e-2a681f471477)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:15:57.169693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7d6f5bb4-a8ec-47e4-b98d-18ae871a4f72 None None] Current status of the port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:57.172049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d3348104-b75b-43fe-b495-0b6438d16645), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.191480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (4737a54d-fb43-4f33-9571-8788f5e66399), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.196541 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:57.197148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.218018 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a921441-5133-4394-bed6-96c3ba4b35bf req-98a06bf1-33f0-4dee-96ad-f15f5311c0c3 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2353833 Mar 24 02:15:57.227281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:57.268611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d3348104-b75b-43fe-b495-0b6438d16645,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:57.320361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1e18be34-2d54-41cc-9585-96acdb4c7bc8 None None] Provisioning complete for port d3348104-b75b-43fe-b495-0b6438d16645 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:57.321023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1e18be34-2d54-41cc-9585-96acdb4c7bc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3348104-b75b-43fe-b495-0b6438d16645), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.364084 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:15:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4191ea4d-edbd-49cb-b90e-7306f87c6a31 x-openstack-request-id: req-4191ea4d-edbd-49cb-b90e-7306f87c6a31 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:15:57.364309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:15:57.364539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-4191ea4d-edbd-49cb-b90e-7306f87c6a31 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:15:57.364970 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4191ea4d-edbd-49cb-b90e-7306f87c6a31'] response: {'name': 'network-changed', 'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c', 'status': 'completed', 'code': 200} Mar 24 02:15:57.394865 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.2280190 Mar 24 02:15:57.399421 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59160) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:57.406315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '4737a54d-fb43-4f33-9571-8788f5e66399', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:fffe'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:57.412386 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c97ad1-d73b-437e-9324-15bd924b08bc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Network': ['ID=4737a54d-fb43-4f33-9571-8788f5e66399,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:57.445014 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 4737a54d-fb43-4f33-9571-8788f5e66399 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:15:57.456298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dddd825e-79b1-4455-ae3d-827029c3e734 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.507570 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67e32b51-0367-4cc7-ab3e-074d6d2b1d4c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:57.519180 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e1022d0-95a5-4de0-bb2f-70e7b717a6f4 None None] Sync routers for ids ['279dd154-f36b-433d-8d99-f38b264f38d1'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:57.530358 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e1022d0-95a5-4de0-bb2f-70e7b717a6f4 None None] Routers {'279dd154-f36b-433d-8d99-f38b264f38d1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:57.531241 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-1e1022d0-95a5-4de0-bb2f-70e7b717a6f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['279dd154-f36b-433d-8d99-f38b264f38d1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:57.537329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67e32b51-0367-4cc7-ab3e-074d6d2b1d4c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.541453 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-67e32b51-0367-4cc7-ab3e-074d6d2b1d4c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "PUT /v2.0/routers/279dd154-f36b-433d-8d99-f38b264f38d1 HTTP/1.1" status: 200 len: 921 time: 4.5898812 Mar 24 02:15:57.544082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-b50ed2dd-6c89-4c49-94b8-414ade517654 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:57.545327 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-b50ed2dd-6c89-4c49-94b8-414ade517654 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 1127 time: 0.4272602 Mar 24 02:15:57.546374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59164) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:57.608142 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-1e1022d0-95a5-4de0-bb2f-70e7b717a6f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:57.609129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1e18be34-2d54-41cc-9585-96acdb4c7bc8 None None] Current status of the port d3348104-b75b-43fe-b495-0b6438d16645 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:57.629542 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e1022d0-95a5-4de0-bb2f-70e7b717a6f4 None None] Routers {'279dd154-f36b-433d-8d99-f38b264f38d1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:57.630605 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-1e1022d0-95a5-4de0-bb2f-70e7b717a6f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['279dd154-f36b-433d-8d99-f38b264f38d1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:57.667886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07398d5-c3e7-4fc5-bae1-4953dc1c1499 req-c05ac3a7-d880-466b-a544-bda5cb11db87 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:57.674771 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a07398d5-c3e7-4fc5-bae1-4953dc1c1499 req-c05ac3a7-d880-466b-a544-bda5cb11db87 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.4510398 Mar 24 02:15:57.680856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:57.682782 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-51835ba5-e46a-4f83-90ac-6c483cb9cc31 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=79123375-136b-4c1b-ba67-948e46e33a7c HTTP/1.1" status: 200 len: 217 time: 0.0957153 Mar 24 02:15:57.684285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.695451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for port (6c52ec2e-a7a9-48ed-b21e-0444cf7269d9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.714678 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-1e1022d0-95a5-4de0-bb2f-70e7b717a6f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:57.714898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:57.715535 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e1022d0-95a5-4de0-bb2f-70e7b717a6f4 None None] The sync data for ids ['279dd154-f36b-433d-8d99-f38b264f38d1'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:15:57.718313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.749044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0b9676a3-e88d-4259-be54-5e62cc24ba4f None None] Provisioning complete for port d3348104-b75b-43fe-b495-0b6438d16645 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:57.749866 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0b9676a3-e88d-4259-be54-5e62cc24ba4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3348104-b75b-43fe-b495-0b6438d16645), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.762317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port c9cae757-3452-4db8-8ac6-d2f6caef38ae yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:57.845595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.ipam_backend_mixin [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Performing IP validity checks on allocation pools {{(pid=104037) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:322}} Mar 24 02:15:57.846291 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7a90377a-fcd0-4a9c-a85b-9dba6f61ea1c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/routers/279dd154-f36b-433d-8d99-f38b264f38d1 HTTP/1.1" status: 200 len: 921 time: 0.2970407 Mar 24 02:15:57.848883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.ipam_backend_mixin [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Checking for overlaps among allocation pools and gateway ip {{(pid=104037) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:343}} Mar 24 02:15:57.849020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59166) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:57.858457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a918b6f9-9b2a-4b0c-a6eb-8d7f90a45fb7 req-9bd4c3ce-8cdc-46ce-a0f0-e1afb5195c42 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:57.859962 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a918b6f9-9b2a-4b0c-a6eb-8d7f90a45fb7 req-9bd4c3ce-8cdc-46ce-a0f0-e1afb5195c42 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 943 time: 0.3137472 Mar 24 02:15:57.870768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-7f6019b6-1f76-47ef-aa8d-37fd080302b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:57.872756 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-7f6019b6-1f76-47ef-aa8d-37fd080302b5 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=852aacbf-87d9-49af-b73c-786b9253307e HTTP/1.1" status: 200 len: 835 time: 0.1812742 Mar 24 02:15:57.873878 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0b9676a3-e88d-4259-be54-5e62cc24ba4f None None] Current status of the port d3348104-b75b-43fe-b495-0b6438d16645 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:57.885478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0b9676a3-e88d-4259-be54-5e62cc24ba4f None None] Provisioning complete for port 6ded70b4-5f23-459c-80ef-c526b84a6dcc triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:57.886065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0b9676a3-e88d-4259-be54-5e62cc24ba4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6ded70b4-5f23-459c-80ef-c526b84a6dcc), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.886647 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a07398d5-c3e7-4fc5-bae1-4953dc1c1499 req-dac6bbd7-044d-405a-8db5-a1d18a7e929e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2102656 Mar 24 02:15:57.929959 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0b9676a3-e88d-4259-be54-5e62cc24ba4f None None] Port 6ded70b4-5f23-459c-80ef-c526b84a6dcc cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:57.960820 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6c52ec2e-a7a9-48ed-b21e-0444cf7269d9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:57.991263 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a918b6f9-9b2a-4b0c-a6eb-8d7f90a45fb7 req-678580b8-eac0-4bf3-8d05-5790c10734b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1022508 Mar 24 02:15:58.029434 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-ec7c8a55-ced1-4ba5-a3c0-c37f3e3e164a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:58.031019 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-ec7c8a55-ced1-4ba5-a3c0-c37f3e3e164a service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.1432524 Mar 24 02:15:58.064281 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f4c18049-8b01-4c69-bbe3-f445a65cb578 None None] Provisioning complete for port 6ded70b4-5f23-459c-80ef-c526b84a6dcc triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:58.067440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f4c18049-8b01-4c69-bbe3-f445a65cb578 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6ded70b4-5f23-459c-80ef-c526b84a6dcc), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.070936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:58.089255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.091346 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:58.094626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3348104-b75b-43fe-b495-0b6438d16645 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:15:58.094807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-786020d6-9049-4929-9e9e-b58ee414872b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:58.099819 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-786020d6-9049-4929-9e9e-b58ee414872b tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=279dd154-f36b-433d-8d99-f38b264f38d1&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2437150 Mar 24 02:15:58.100776 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59168) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:58.104449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:58.109647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:58.110249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.112691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event updated for resources: {'Port': ['ID=6c52ec2e-a7a9-48ed-b21e-0444cf7269d9,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:58.118532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.5 (b5173458-c877-40eb-8ceb-c04dd0584e92/bff9ad11-3244-4fdd-aca0-5e91de44c852/c9cae757-3452-4db8-8ac6-d2f6caef38ae) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:58.154120 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f4c18049-8b01-4c69-bbe3-f445a65cb578 None None] Port 6ded70b4-5f23-459c-80ef-c526b84a6dcc cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:58.182567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (04aa60b1-669f-48fd-bf85-14b2a8d09559), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.185761 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d3348104-b75b-43fe-b495-0b6438d16645 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:58.186143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3348104-b75b-43fe-b495-0b6438d16645), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.248167 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-cb264628-df92-421c-b4f7-59adb4973f07 service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2102535 Mar 24 02:15:58.251326 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:58.268672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=04aa60b1-669f-48fd-bf85-14b2a8d09559,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:58.347079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Checking segment: {'id': '64b82b4c-8030-4953-bd09-d1681cca9cb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '4737a54d-fb43-4f33-9571-8788f5e66399'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:58.347447 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network hostable DHCP agents. Network: 4737a54d-fb43-4f33-9571-8788f5e66399, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:15:58.378085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d3348104-b75b-43fe-b495-0b6438d16645 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:15:58.409012 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b50434af-4103-484c-adb7-35dc5f938e90 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:58.422722 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59172) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:58.426366 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b50434af-4103-484c-adb7-35dc5f938e90 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 881 time: 0.3093791 Mar 24 02:15:58.437859 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-133709a3-56fc-4c37-9d66-12ed0be5864b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 3.4763155 Mar 24 02:15:58.461943 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59174) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:58.475657 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f6b75051-b28b-47ed-b3e8-4e6d6afb78fc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=279dd154-f36b-433d-8d99-f38b264f38d1 HTTP/1.1" status: 200 len: 205 time: 0.0516675 Mar 24 02:15:58.480644 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59176) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:58.485138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 4737a54d-fb43-4f33-9571-8788f5e66399 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:15:58.494510 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-bfb2e752-4c1b-4104-b192-ca7f7d92c949 None None] Provisioning complete for port 6c52ec2e-a7a9-48ed-b21e-0444cf7269d9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:58.496642 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bfb2e752-4c1b-4104-b192-ca7f7d92c949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6c52ec2e-a7a9-48ed-b21e-0444cf7269d9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.578564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-bfb2e752-4c1b-4104-b192-ca7f7d92c949 None None] Port 6c52ec2e-a7a9-48ed-b21e-0444cf7269d9 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:58.588522 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f3e7f97-6ace-429b-9e79-29c0fe5d27be req-4cb20508-f456-427c-ade0-b9d357223f37 service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3280087 Mar 24 02:15:58.592344 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 4737a54d-fb43-4f33-9571-8788f5e66399) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:58.605333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:58.606188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.626481 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be80f967-f16b-422b-908d-95d652105175 None None] Network 4737a54d-fb43-4f33-9571-8788f5e66399 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:15:58.633100 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16f6e3d-3818-40be-bd60-4b2a6219d21f req-15e978cf-712e-4ec1-ac63-b8e24433068e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:58.634783 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f16f6e3d-3818-40be-bd60-4b2a6219d21f req-15e978cf-712e-4ec1-ac63-b8e24433068e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.2603920 Mar 24 02:15:58.653022 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ec83dd5c-b915-402f-bb8b-d254e1728b5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2525380 Mar 24 02:15:58.653670 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59178) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:58.663463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '4737a54d-fb43-4f33-9571-8788f5e66399', 'name': 'tempest-PortsIpV6TestJSON-449159262'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:15:58.694611 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.713675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (c9cae757-3452-4db8-8ac6-d2f6caef38ae), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.729006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5f06b039-4051-41e4-af23-7cf3682bcee9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting port 6c52ec2e-a7a9-48ed-b21e-0444cf7269d9 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:58.729343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f06b039-4051-41e4-af23-7cf3682bcee9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6c52ec2e-a7a9-48ed-b21e-0444cf7269d9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.754400 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (279dd154-f36b-433d-8d99-f38b264f38d1), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.756943 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-4737a54d-fb43-4f33-9571-8788f5e66399', 'network_id': '4737a54d-fb43-4f33-9571-8788f5e66399', 'project_id': '7b8dee850d65489ba8498576f69edde9', 'fixed_ips': [{'subnet_id': '04aa60b1-669f-48fd-bf85-14b2a8d09559'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:15:58.758089 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.892877 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f16f6e3d-3818-40be-bd60-4b2a6219d21f req-eb4126de-b0a2-4c9a-82c2-c3eab0d45f0d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2464178 Mar 24 02:15:58.916424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c9cae757-3452-4db8-8ac6-d2f6caef38ae), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:58.917979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-7e2dab75-b1be-414e-89f5-14158855931e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:58.919415 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-7e2dab75-b1be-414e-89f5-14158855931e service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 1127 time: 0.2442849 Mar 24 02:15:58.937132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Allocated IP 2001:db8::2 (4737a54d-fb43-4f33-9571-8788f5e66399/04aa60b1-669f-48fd-bf85-14b2a8d09559/9d759c72-9df8-4539-b94a-909a7781ba24) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:59.015051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (279dd154-f36b-433d-8d99-f38b264f38d1), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.018083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:15:59.022088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.039474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network b5173458-c877-40eb-8ceb-c04dd0584e92 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:59.053700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f06b039-4051-41e4-af23-7cf3682bcee9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6c52ec2e-a7a9-48ed-b21e-0444cf7269d9), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.056638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:59.074334 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:59.075263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port 45bdc105-f3cc-40ff-bbcf-fe99177447ee yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:15:59.119329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5f06b039-4051-41e4-af23-7cf3682bcee9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Calling delete_port for 6c52ec2e-a7a9-48ed-b21e-0444cf7269d9 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:15:59.131817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=c9cae757-3452-4db8-8ac6-d2f6caef38ae,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:59.158182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:59.158859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.167418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:15:59.234667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Publish callbacks [] for port (9d759c72-9df8-4539-b94a-909a7781ba24), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.235071 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e3e1d102-ed6b-4c18-b51b-e16ae3f44574 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.2241521 Mar 24 02:15:59.244579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.272829 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59184) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:59.297392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Pushing event updated for resources: {'Port': ['ID=9d759c72-9df8-4539-b94a-909a7781ba24,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:59.321678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Network 4737a54d-fb43-4f33-9571-8788f5e66399 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:15:59.324895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:15:59.327969 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:15:59.402649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Attempting to bind port 9d759c72-9df8-4539-b94a-909a7781ba24 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:15:59.405295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Attempting to bind port 9d759c72-9df8-4539-b94a-909a7781ba24 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '64b82b4c-8030-4953-bd09-d1681cca9cb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '4737a54d-fb43-4f33-9571-8788f5e66399'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:15:59.405916 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Attempting to bind port 9d759c72-9df8-4539-b94a-909a7781ba24 on network 4737a54d-fb43-4f33-9571-8788f5e66399 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:15:59.420307 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 15, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:15:59.420793 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:15:59.421611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Checking segment: {'id': '64b82b4c-8030-4953-bd09-d1681cca9cb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '4737a54d-fb43-4f33-9571-8788f5e66399'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:15:59.423005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.423751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Bound using segment: {'id': '64b82b4c-8030-4953-bd09-d1681cca9cb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '4737a54d-fb43-4f33-9571-8788f5e66399'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:15:59.424288 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Bound port: 9d759c72-9df8-4539-b94a-909a7781ba24, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64b82b4c-8030-4953-bd09-d1681cca9cb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '4737a54d-fb43-4f33-9571-8788f5e66399'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:15:59.424652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.435571 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e37d5397-db58-46c2-9364-4c39516c08db tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0508506 Mar 24 02:15:59.441770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:15:59.444144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98a4d0bb-0855-459e-89af-e9f2a0023ca2 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:59.445719 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-98a4d0bb-0855-459e-89af-e9f2a0023ca2 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports?fixed_ips=ip_address%3D172.20.0.8 HTTP/1.1" status: 200 len: 921 time: 0.1719160 Mar 24 02:15:59.446322 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59186) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:59.459994 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59188) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:15:59.486302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a0840a07-ad06-4f5f-9fa4-5b133a1690a4 None None] Provisioning complete for port c9cae757-3452-4db8-8ac6-d2f6caef38ae triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:15:59.486302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a0840a07-ad06-4f5f-9fa4-5b133a1690a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c9cae757-3452-4db8-8ac6-d2f6caef38ae), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.519684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:15:59.520333 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:15:59.542827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-45ed91f4-bc5f-4f06-b26b-be72e5e7d343 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:59.544326 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-45ed91f4-bc5f-4f06-b26b-be72e5e7d343 service neutron] 10.222.0.30 "GET /v2.0/networks?id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d HTTP/1.1" status: 200 len: 897 time: 0.6148396 Mar 24 02:15:59.552540 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e5aa67b-782a-4f55-a12e-6d0a5b7a4922 req-a9463144-4f07-41c5-b2e6-aee4b04c4574 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:59.554097 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3e5aa67b-782a-4f55-a12e-6d0a5b7a4922 req-a9463144-4f07-41c5-b2e6-aee4b04c4574 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.5615013 Mar 24 02:15:59.623467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a0840a07-ad06-4f5f-9fa4-5b133a1690a4 None None] Port c9cae757-3452-4db8-8ac6-d2f6caef38ae cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:15:59.627907 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-3b89a578-ee02-4d56-8ea6-093212c2cf9a service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=79123375-136b-4c1b-ba67-948e46e33a7c HTTP/1.1" status: 200 len: 217 time: 0.0710735 Mar 24 02:15:59.635515 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] For port 9d759c72-9df8-4539-b94a-909a7781ba24, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:15:59.640506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] For port 9d759c72-9df8-4539-b94a-909a7781ba24, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9d759c72-9df8-4539-b94a-909a7781ba24,segment=NetworkSegment(64b82b4c-8030-4953-bd09-d1681cca9cb9),segment_id=64b82b4c-8030-4953-bd09-d1681cca9cb9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:15:59.651676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:15:59.654152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.729206 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36847cca-031a-4e8b-9ee1-9e0e64e4e5a6 req-028ec6df-2f17-4fdc-8828-de4131f665eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:59.736472 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36847cca-031a-4e8b-9ee1-9e0e64e4e5a6 req-028ec6df-2f17-4fdc-8828-de4131f665eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 943 time: 0.6348357 Mar 24 02:15:59.761146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Deleting port 47870b71-6642-4317-9849-7b30457616eb {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:15:59.762192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (47870b71-6642-4317-9849-7b30457616eb), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:15:59.815499 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3e5aa67b-782a-4f55-a12e-6d0a5b7a4922 req-31f1c907-7662-43c7-ac6e-1f860d995264 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2455342 Mar 24 02:15:59.833749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7c26546-a682-44c4-bdd6-ad8a41a1871e None None] Pushing event updated for resources: {'Port': ['ID=9d759c72-9df8-4539-b94a-909a7781ba24,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:15:59.882223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::a6 (4737a54d-fb43-4f33-9571-8788f5e66399/04aa60b1-669f-48fd-bf85-14b2a8d09559/45bdc105-f3cc-40ff-bbcf-fe99177447ee) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:15:59.899694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-3d52948c-721a-403a-a751-3a5db194e582 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:15:59.901338 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-3d52948c-721a-403a-a751-3a5db194e582 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=852aacbf-87d9-49af-b73c-786b9253307e HTTP/1.1" status: 200 len: 835 time: 0.2441385 Mar 24 02:16:00.051322 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-7c7ee9c3-cfd5-47ba-921c-972ff813654c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting subnet a7c72fce-ef84-4709-a1ef-6dc870f90812 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:00.097377 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36847cca-031a-4e8b-9ee1-9e0e64e4e5a6 req-34e32caa-ae53-4f50-81b3-6ee9970b5567 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3596661 Mar 24 02:16:00.180695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (47870b71-6642-4317-9849-7b30457616eb), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.198985 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7c7ee9c3-cfd5-47ba-921c-972ff813654c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (a7c72fce-ef84-4709-a1ef-6dc870f90812), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.236978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f06b039-4051-41e4-af23-7cf3682bcee9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6c52ec2e-a7a9-48ed-b21e-0444cf7269d9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.278502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f06b039-4051-41e4-af23-7cf3682bcee9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Port': ['ID=6c52ec2e-a7a9-48ed-b21e-0444cf7269d9,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:00.284755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:57Z', 'revision_number': 8, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:00.287011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-a5c556e9-a61d-4a76-92e9-e87b893eb221 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:00.288474 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-a5c556e9-a61d-4a76-92e9-e87b893eb221 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.3751063 Mar 24 02:16:00.292959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7c7ee9c3-cfd5-47ba-921c-972ff813654c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (a7c72fce-ef84-4709-a1ef-6dc870f90812), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.293266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Calling delete_port for 47870b71-6642-4317-9849-7b30457616eb owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:00.315081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:16:00.324807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:00.325294 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:15:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:00.428349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:00.437397 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f06b039-4051-41e4-af23-7cf3682bcee9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.446270 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5f06b039-4051-41e4-af23-7cf3682bcee9 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/6c52ec2e-a7a9-48ed-b21e-0444cf7269d9 HTTP/1.1" status: 204 len: 168 time: 1.9790828 Mar 24 02:16:00.450185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59196) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:00.462380 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3010d365-1be5-4475-ba9b-ea5bd481381e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port c9cae757-3452-4db8-8ac6-d2f6caef38ae {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:00.462974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3010d365-1be5-4475-ba9b-ea5bd481381e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c9cae757-3452-4db8-8ac6-d2f6caef38ae), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.524348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7c7ee9c3-cfd5-47ba-921c-972ff813654c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (a7c72fce-ef84-4709-a1ef-6dc870f90812), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.568256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0a935632-83c1-4557-854b-b093ca73d3e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.574739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-1a08162d-cc00-40be-905f-aa99d388e94d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:00.576277 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-1a08162d-cc00-40be-905f-aa99d388e94d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 1130 time: 0.4374392 Mar 24 02:16:00.624345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0724f497-53f5-405e-8ea1-f4bb8e9fe576 req-650a6bbb-e481-477e-9e12-d2cbb211d288 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:00.626157 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0724f497-53f5-405e-8ea1-f4bb8e9fe576 req-650a6bbb-e481-477e-9e12-d2cbb211d288 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.4066219 Mar 24 02:16:00.630978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3010d365-1be5-4475-ba9b-ea5bd481381e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c9cae757-3452-4db8-8ac6-d2f6caef38ae), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.649210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3010d365-1be5-4475-ba9b-ea5bd481381e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for c9cae757-3452-4db8-8ac6-d2f6caef38ae owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:00.656053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5f83ba-3deb-489d-b0d8-f9ca52c7f71a req-75e47ad8-5d05-4093-844d-e6dc3f4032b2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:00.663663 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b5f83ba-3deb-489d-b0d8-f9ca52c7f71a req-75e47ad8-5d05-4093-844d-e6dc3f4032b2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.4132125 Mar 24 02:16:00.665351 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7c7ee9c3-cfd5-47ba-921c-972ff813654c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (a7c72fce-ef84-4709-a1ef-6dc870f90812), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.680153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:57Z', 'revision_number': 8, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:00.715997 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99c7a27b-6698-42d6-adfd-f6b2de5097c8 None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:15:57Z', 'revision_number': 8, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': '3f9f9d5e-7262-4cb8-8f93-06abc7097f13', 'name': '', 'network_id': '97fcb308-ee86-471e-a60b-8b94d0aed9e6', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:6d:8b:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:28Z', 'updated_at': '2022-03-24T02:15:44Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '26e1ee63-7d8e-4edb-a909-6a9a796c2d5b', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:00.731786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7ee9c3-cfd5-47ba-921c-972ff813654c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Subnet': ['ID=a7c72fce-ef84-4709-a1ef-6dc870f90812,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:00.739278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7c7ee9c3-cfd5-47ba-921c-972ff813654c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.746106 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7c7ee9c3-cfd5-47ba-921c-972ff813654c tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/a7c72fce-ef84-4709-a1ef-6dc870f90812 HTTP/1.1" status: 204 len: 168 time: 1.2970107 Mar 24 02:16:00.748844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59198) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:00.755629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f7808c5-0288-415d-bce6-ddce90fa2414 None None] Network 3771196e-a727-49bc-a43a-35151470fb34 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:00.790944 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-8ea15a07-3103-4774-8ade-662333fc228b service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4626486 Mar 24 02:16:00.863918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (3771196e-a727-49bc-a43a-35151470fb34), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.869113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.893631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (45bdc105-f3cc-40ff-bbcf-fe99177447ee), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:00.932034 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e996a344-6e21-4b19-adc1-d7d2bccd8f21 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:00.933767 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e996a344-6e21-4b19-adc1-d7d2bccd8f21 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.4501848 Mar 24 02:16:00.950971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59200) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:01.006077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3010d365-1be5-4475-ba9b-ea5bd481381e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c9cae757-3452-4db8-8ac6-d2f6caef38ae), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.027790 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7b5f83ba-3deb-489d-b0d8-f9ca52c7f71a req-d24b4c33-0c37-4b9e-a577-4931a472e71b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3631234 Mar 24 02:16:01.048466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3010d365-1be5-4475-ba9b-ea5bd481381e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=c9cae757-3452-4db8-8ac6-d2f6caef38ae,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:01.071629 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0724f497-53f5-405e-8ea1-f4bb8e9fe576 req-677365ef-bbbd-4c83-aa03-31ae18932249 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4008508 Mar 24 02:16:01.099835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1314ba6b-dc2f-4409-a9b5-3b3c2d9f6918 None None] DHCP port deletion for 3771196e-a727-49bc-a43a-35151470fb34 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:01.120194 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port e9998b49-b45f-411d-bfda-94b29f644f7d {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:01.120194 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.126850 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-ca7788e8-c455-4dc8-a3d4-1a4b085c04e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:01.128405 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-ca7788e8-c455-4dc8-a3d4-1a4b085c04e5 service neutron] 10.222.0.30 "GET /v2.0/networks?id=597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 200 len: 913 time: 0.5391355 Mar 24 02:16:01.240105 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87bf6328-46b7-4329-ab9c-742a9c6ec645 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:01.244263 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-87bf6328-46b7-4329-ab9c-742a9c6ec645 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.2890546 Mar 24 02:16:01.244429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1314ba6b-dc2f-4409-a9b5-3b3c2d9f6918 None None] Deleting port e9998b49-b45f-411d-bfda-94b29f644f7d {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:01.244429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1314ba6b-dc2f-4409-a9b5-3b3c2d9f6918 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.254797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59204) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:01.301577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (45bdc105-f3cc-40ff-bbcf-fe99177447ee), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.337559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c4e6dbd-9083-48b2-96c1-2f7d3bcf5937 None None] Network 4737a54d-fb43-4f33-9571-8788f5e66399 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:01.337810 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-24feb996-b86f-4695-bf48-dcbab3bffa7d req-fa3c4991-f71d-4851-9286-d7cdf677df28 service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4737980 Mar 24 02:16:01.348689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (47870b71-6642-4317-9849-7b30457616eb), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.395645 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3010d365-1be5-4475-ba9b-ea5bd481381e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.403118 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3010d365-1be5-4475-ba9b-ea5bd481381e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/c9cae757-3452-4db8-8ac6-d2f6caef38ae HTTP/1.1" status: 204 len: 168 time: 1.9420786 Mar 24 02:16:01.419469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port e9998b49-b45f-411d-bfda-94b29f644f7d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e9998b49-b45f-411d-bfda-94b29f644f7d,segment=NetworkSegment(4f560d11-8497-4703-9ca3-3831988ae8de),segment_id=4f560d11-8497-4703-9ca3-3831988ae8de)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:01.419844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.422457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59206) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:01.424924 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-45417a0b-b5d8-4de0-94eb-5818d298db8a service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 200 len: 1001 time: 0.2880690 Mar 24 02:16:01.443759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for e9998b49-b45f-411d-bfda-94b29f644f7d owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:01.482768 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1314ba6b-dc2f-4409-a9b5-3b3c2d9f6918 None None] For port e9998b49-b45f-411d-bfda-94b29f644f7d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e9998b49-b45f-411d-bfda-94b29f644f7d,segment=NetworkSegment(4f560d11-8497-4703-9ca3-3831988ae8de),segment_id=4f560d11-8497-4703-9ca3-3831988ae8de)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:01.483304 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1314ba6b-dc2f-4409-a9b5-3b3c2d9f6918 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.498346 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-486e5469-e9f4-4f34-989e-2fe60a66e69b None None] Provisioning complete for port 9d759c72-9df8-4539-b94a-909a7781ba24 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:01.498894 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-486e5469-e9f4-4f34-989e-2fe60a66e69b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.505148 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1314ba6b-dc2f-4409-a9b5-3b3c2d9f6918 None None] Calling delete_port for e9998b49-b45f-411d-bfda-94b29f644f7d owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:01.514553 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-837a88d3-a7dd-4c6a-a8dd-c16e0b2589b9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:16:01.515931 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-837a88d3-a7dd-4c6a-a8dd-c16e0b2589b9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/c9cae757-3452-4db8-8ac6-d2f6caef38ae HTTP/1.1" status: 404 len: 333 time: 0.0896764 Mar 24 02:16:01.520064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59208) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:01.522300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 4737a54d-fb43-4f33-9571-8788f5e66399 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:01.542937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a47f73a-4095-40ff-af45-511309a9d71c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:01.544363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a47f73a-4095-40ff-af45-511309a9d71c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:01.545657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a47f73a-4095-40ff-af45-511309a9d71c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:01.547256 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3a47f73a-4095-40ff-af45-511309a9d71c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.2826698 Mar 24 02:16:01.557195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59210) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:01.569061 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:01.583433 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.592704 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=45bdc105-f3cc-40ff-bbcf-fe99177447ee,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:01.621544 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:01.626746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:01.627355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.633939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No DVR routers for this DVR port e9998b49-b45f-411d-bfda-94b29f644f7d on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:01.640206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=e9998b49-b45f-411d-bfda-94b29f644f7d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:01.685372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e339dcc-840a-4437-b4ce-d519d2b2681b req-3dc3500c-9625-42d0-9b0b-0bd505b9ea36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:01.686898 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0e339dcc-840a-4437-b4ce-d519d2b2681b req-3dc3500c-9625-42d0-9b0b-0bd505b9ea36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 943 time: 0.4555323 Mar 24 02:16:01.694124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-f3ac6dce-d8c5-4677-aacf-22981e4f935e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:01.700141 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-f3ac6dce-d8c5-4677-aacf-22981e4f935e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=56374a24-4e35-434f-b4b8-860ef8289893 HTTP/1.1" status: 200 len: 851 time: 0.2555358 Mar 24 02:16:01.702705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-486e5469-e9f4-4f34-989e-2fe60a66e69b None None] Current status of the port 9d759c72-9df8-4539-b94a-909a7781ba24 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:01.703324 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-486e5469-e9f4-4f34-989e-2fe60a66e69b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.711271 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event deleted for resources: {'Port': ['ID=47870b71-6642-4317-9849-7b30457616eb,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:01.725080 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1314ba6b-dc2f-4409-a9b5-3b3c2d9f6918 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (e9998b49-b45f-411d-bfda-94b29f644f7d), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.741851 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-91c2eb3f-4ba1-4dbc-990a-473ad167c252 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 3.0843949 Mar 24 02:16:01.744474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (3771196e-a727-49bc-a43a-35151470fb34), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.746888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59212) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:01.769954 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1314ba6b-dc2f-4409-a9b5-3b3c2d9f6918 None None] Pushing event deleted for resources: {'Port': ['ID=e9998b49-b45f-411d-bfda-94b29f644f7d,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:01.775927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-1129afb2-bd5c-4ca9-8e9c-daeafb155740 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet 64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:01.779177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (279dd154-f36b-433d-8d99-f38b264f38d1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.784624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1129afb2-bd5c-4ca9-8e9c-daeafb155740 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.792545 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1314ba6b-dc2f-4409-a9b5-3b3c2d9f6918 None None] No DVR routers for this DVR port e9998b49-b45f-411d-bfda-94b29f644f7d on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:01.801913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-98f03c5c-d284-46c4-be3e-769718f53d12 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 6ded70b4-5f23-459c-80ef-c526b84a6dcc {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:01.802257 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98f03c5c-d284-46c4-be3e-769718f53d12 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6ded70b4-5f23-459c-80ef-c526b84a6dcc), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.809165 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3771196e-a727-49bc-a43a-35151470fb34']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:01.821515 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-486e5469-e9f4-4f34-989e-2fe60a66e69b None None] For port 9d759c72-9df8-4539-b94a-909a7781ba24, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9d759c72-9df8-4539-b94a-909a7781ba24,segment=NetworkSegment(64b82b4c-8030-4953-bd09-d1681cca9cb9),segment_id=64b82b4c-8030-4953-bd09-d1681cca9cb9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:01.828573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-486e5469-e9f4-4f34-989e-2fe60a66e69b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.877438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4f560d11-8497-4703-9ca3-3831988ae8de') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:01.877756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4f560d11-8497-4703-9ca3-3831988ae8de') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:01.895599 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-486e5469-e9f4-4f34-989e-2fe60a66e69b None None] Pushing event updated for resources: {'Port': ['ID=9d759c72-9df8-4539-b94a-909a7781ba24,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:01.903647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (4f560d11-8497-4703-9ca3-3831988ae8de), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.951366 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4f560d11-8497-4703-9ca3-3831988ae8de), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.981440 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Releasing vlan 144 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:01.981850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (4f560d11-8497-4703-9ca3-3831988ae8de), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:01.985227 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:02.048277 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98f03c5c-d284-46c4-be3e-769718f53d12 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6ded70b4-5f23-459c-80ef-c526b84a6dcc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.076213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-98f03c5c-d284-46c4-be3e-769718f53d12 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 6ded70b4-5f23-459c-80ef-c526b84a6dcc owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:02.095544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (3771196e-a727-49bc-a43a-35151470fb34), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.098968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-527ac058-0a47-47d1-b6a6-6c0dade3ced8 None None] Provisioning complete for port 45bdc105-f3cc-40ff-bbcf-fe99177447ee triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:02.099340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-527ac058-0a47-47d1-b6a6-6c0dade3ced8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (45bdc105-f3cc-40ff-bbcf-fe99177447ee), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.100445 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.104410 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/networks/3771196e-a727-49bc-a43a-35151470fb34 HTTP/1.1" status: 204 len: 168 time: 1.3541827 Mar 24 02:16:02.115233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59218) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:02.159891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 79123375-136b-4c1b-ba67-948e46e33a7c details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:16:02.197787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-527ac058-0a47-47d1-b6a6-6c0dade3ced8 None None] Port 45bdc105-f3cc-40ff-bbcf-fe99177447ee cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:02.223916 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9d759c72-9df8-4539-b94a-909a7781ba24 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:02.266050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a2f1b659-e9bf-4405-8eed-bbe014c996f2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 45bdc105-f3cc-40ff-bbcf-fe99177447ee {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:02.266677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a2f1b659-e9bf-4405-8eed-bbe014c996f2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (45bdc105-f3cc-40ff-bbcf-fe99177447ee), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.269991 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7353c3-f068-4f57-8017-58f966e6cfa4 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Network': ['ID=3771196e-a727-49bc-a43a-35151470fb34,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:02.285708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (279dd154-f36b-433d-8d99-f38b264f38d1), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.318350 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (279dd154-f36b-433d-8d99-f38b264f38d1), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.326344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-527ac058-0a47-47d1-b6a6-6c0dade3ced8 None None] Provisioning complete for port 9d759c72-9df8-4539-b94a-909a7781ba24 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:02.326737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-527ac058-0a47-47d1-b6a6-6c0dade3ced8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.367946 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9d759c72-9df8-4539-b94a-909a7781ba24 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:02.368372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.391602 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0e339dcc-840a-4437-b4ce-d519d2b2681b req-4de37d53-a75b-4f1e-8cb1-f19ee91cb756 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6816142 Mar 24 02:16:02.405918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1129afb2-bd5c-4ca9-8e9c-daeafb155740 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.463314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.519676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9d759c72-9df8-4539-b94a-909a7781ba24 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:02.524229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (279dd154-f36b-433d-8d99-f38b264f38d1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.529412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Fanout notify agent at l3_agent the message router_deleted on router 279dd154-f36b-433d-8d99-f38b264f38d1 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:16:02.529927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a2f1b659-e9bf-4405-8eed-bbe014c996f2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (45bdc105-f3cc-40ff-bbcf-fe99177447ee), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.547699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 79123375-136b-4c1b-ba67-948e46e33a7c, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=79123375-136b-4c1b-ba67-948e46e33a7c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:02.561181 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a2f1b659-e9bf-4405-8eed-bbe014c996f2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 45bdc105-f3cc-40ff-bbcf-fe99177447ee owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:02.584127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '79123375-136b-4c1b-ba67-948e46e33a7c', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:16:02.598439 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.600291 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bfd1a509-6b39-4180-a270-18651fb63309 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/279dd154-f36b-433d-8d99-f38b264f38d1 HTTP/1.1" status: 204 len: 168 time: 4.1163149 Mar 24 02:16:02.604916 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59220) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:02.605092 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-527ac058-0a47-47d1-b6a6-6c0dade3ced8 None None] Current status of the port 9d759c72-9df8-4539-b94a-909a7781ba24 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:02.616550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-afdc9607-fce6-489d-8a78-ee429d3af6f7 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-963835217', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:02.620425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-eda864e2-c703-457c-9349-e2ee0631043a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:02.622188 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-eda864e2-c703-457c-9349-e2ee0631043a service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=597625fc-4c02-4901-9b3e-46b781f61da1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.8990309 Mar 24 02:16:02.625859 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e9998b49-b45f-411d-bfda-94b29f644f7d no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:02.647583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: e9998b49-b45f-411d-bfda-94b29f644f7d {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:02.647819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e9998b49-b45f-411d-bfda-94b29f644f7d not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:02.648218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:02.673045 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98f03c5c-d284-46c4-be3e-769718f53d12 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6ded70b4-5f23-459c-80ef-c526b84a6dcc), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.676520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:02.676520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d52d976f-1ff4-45e1-862e-ce0e0eaa3dc3 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:02.686229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd74258b-703a-4de8-90d0-85e820bf7ab3 req-f2a89ded-8a1f-4552-9628-043bf51506de tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:02.693180 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 79123375-136b-4c1b-ba67-948e46e33a7c is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:02.693994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.694545 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fd74258b-703a-4de8-90d0-85e820bf7ab3 req-f2a89ded-8a1f-4552-9628-043bf51506de tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.4384267 Mar 24 02:16:02.709596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afdc9607-fce6-489d-8a78-ee429d3af6f7 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (c6bd9e83-528f-458b-903e-02f2a5f99c3d), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.710682 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afdc9607-fce6-489d-8a78-ee429d3af6f7 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (c6bd9e83-528f-458b-903e-02f2a5f99c3d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.712485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 79123375-136b-4c1b-ba67-948e46e33a7c {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:16:02.739693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 79123375-136b-4c1b-ba67-948e46e33a7c, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=79123375-136b-4c1b-ba67-948e46e33a7c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:02.745336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98f03c5c-d284-46c4-be3e-769718f53d12 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=6ded70b4-5f23-459c-80ef-c526b84a6dcc,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:02.745974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-bfe57e15-5846-4623-8e8c-6495d2935c9c None None] Provisioning complete for port 45bdc105-f3cc-40ff-bbcf-fe99177447ee triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:02.746397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bfe57e15-5846-4623-8e8c-6495d2935c9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (45bdc105-f3cc-40ff-bbcf-fe99177447ee), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.762328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1129afb2-bd5c-4ca9-8e9c-daeafb155740 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.786381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-bfe57e15-5846-4623-8e8c-6495d2935c9c None None] Port 45bdc105-f3cc-40ff-bbcf-fe99177447ee cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:02.788005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.812220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d140f75d-5209-484a-ba58-46640e9321b0 req-51f91e02-e9c5-4dee-9ad7-ef9f991e7900 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:02.814455 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d140f75d-5209-484a-ba58-46640e9321b0 req-51f91e02-e9c5-4dee-9ad7-ef9f991e7900 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.3112497 Mar 24 02:16:02.836667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=79123375-136b-4c1b-ba67-948e46e33a7c,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:02.886703 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fd74258b-703a-4de8-90d0-85e820bf7ab3 req-0f52465f-4d6b-4d73-8db4-dfba384e0932 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1911802 Mar 24 02:16:02.898781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afdc9607-fce6-489d-8a78-ee429d3af6f7 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (c6bd9e83-528f-458b-903e-02f2a5f99c3d), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.930816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afdc9607-fce6-489d-8a78-ee429d3af6f7 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (c6bd9e83-528f-458b-903e-02f2a5f99c3d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.932859 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d140f75d-5209-484a-ba58-46640e9321b0 req-c8bd80d6-498e-4b64-b711-131c66fbd074 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1073539 Mar 24 02:16:02.936382 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-9573a4e3-ac11-476a-8d6c-14adf0a98a6c service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2926977 Mar 24 02:16:02.938250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98f03c5c-d284-46c4-be3e-769718f53d12 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.942241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1129afb2-bd5c-4ca9-8e9c-daeafb155740 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:02.945566 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-98f03c5c-d284-46c4-be3e-769718f53d12 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/6ded70b4-5f23-459c-80ef-c526b84a6dcc HTTP/1.1" status: 204 len: 168 time: 1.4244633 Mar 24 02:16:02.950930 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59222) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:02.998224 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-d691e59d-6a2d-409c-802b-7d007e049e27 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:16:03.003117 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d691e59d-6a2d-409c-802b-7d007e049e27 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/6ded70b4-5f23-459c-80ef-c526b84a6dcc HTTP/1.1" status: 404 len: 333 time: 0.0508957 Mar 24 02:16:03.019392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59224) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:03.024752 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afdc9607-fce6-489d-8a78-ee429d3af6f7 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.028463 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-afdc9607-fce6-489d-8a78-ee429d3af6f7 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.4156034 Mar 24 02:16:03.029582 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59226) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:03.031002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1129afb2-bd5c-4ca9-8e9c-daeafb155740 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:03.041700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:03.052643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98917983-a8cf-4af5-899a-a6630bef60bf None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:03.059480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1129afb2-bd5c-4ca9-8e9c-daeafb155740 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.065495 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1129afb2-bd5c-4ca9-8e9c-daeafb155740 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4 HTTP/1.1" status: 204 len: 168 time: 1.5016618 Mar 24 02:16:03.068002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59228) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:03.142551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a2f1b659-e9bf-4405-8eed-bbe014c996f2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (45bdc105-f3cc-40ff-bbcf-fe99177447ee), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.148701 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-7162566e-476d-46b3-aa19-3205e86b15ef tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet bff9ad11-3244-4fdd-aca0-5e91de44c852 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:03.157289 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7162566e-476d-46b3-aa19-3205e86b15ef tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (bff9ad11-3244-4fdd-aca0-5e91de44c852), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.188365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2f1b659-e9bf-4405-8eed-bbe014c996f2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=45bdc105-f3cc-40ff-bbcf-fe99177447ee,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:03.198711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-55150e00-4e1c-469a-beb6-aee65d1b61c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Deleting subnet a5f96abf-6076-4bb9-8c25-133dca34c71d {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:03.208104 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5a0eef52-20f8-406e-9581-cb645b8cb5d4 req-0dd58580-2cb4-4c84-b047-e994a1e15eaf service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2632415 Mar 24 02:16:03.208708 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['79123375-136b-4c1b-ba67-948e46e33a7c'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:16:03.208828 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55150e00-4e1c-469a-beb6-aee65d1b61c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (a5f96abf-6076-4bb9-8c25-133dca34c71d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.254054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7162566e-476d-46b3-aa19-3205e86b15ef tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (bff9ad11-3244-4fdd-aca0-5e91de44c852), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.296857 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a2f1b659-e9bf-4405-8eed-bbe014c996f2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.299901 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a2f1b659-e9bf-4405-8eed-bbe014c996f2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/45bdc105-f3cc-40ff-bbcf-fe99177447ee HTTP/1.1" status: 204 len: 168 time: 1.5520847 Mar 24 02:16:03.304004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59230) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:03.305746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55150e00-4e1c-469a-beb6-aee65d1b61c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (a5f96abf-6076-4bb9-8c25-133dca34c71d), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.340257 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f19a327-6e89-40d4-9f1d-ead33b6881ca tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:03.340824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9f19a327-6e89-40d4-9f1d-ead33b6881ca tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:03.346856 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9f19a327-6e89-40d4-9f1d-ead33b6881ca tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/45bdc105-f3cc-40ff-bbcf-fe99177447ee HTTP/1.1" status: 404 len: 333 time: 0.0423365 Mar 24 02:16:03.347467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59232) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:03.352287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.391814 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-cae1ab14-c712-4a0d-b016-d1f7e7f18739 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:16:03.394980 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cae1ab14-c712-4a0d-b016-d1f7e7f18739 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/45bdc105-f3cc-40ff-bbcf-fe99177447ee HTTP/1.1" status: 404 len: 333 time: 0.0446460 Mar 24 02:16:03.432539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59234) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:03.440408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7162566e-476d-46b3-aa19-3205e86b15ef tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (bff9ad11-3244-4fdd-aca0-5e91de44c852), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.650599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55150e00-4e1c-469a-beb6-aee65d1b61c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (a5f96abf-6076-4bb9-8c25-133dca34c71d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.682807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad13ffa-d410-43f9-b3d3-63be6bf564cb req-ed74f9f0-f2fc-4828-8dd3-99c5602324bd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:03.684405 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5ad13ffa-d410-43f9-b3d3-63be6bf564cb req-ed74f9f0-f2fc-4828-8dd3-99c5602324bd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 944 time: 0.1785126 Mar 24 02:16:03.688258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7162566e-476d-46b3-aa19-3205e86b15ef tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (bff9ad11-3244-4fdd-aca0-5e91de44c852), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.728035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.731876 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7162566e-476d-46b3-aa19-3205e86b15ef tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=bff9ad11-3244-4fdd-aca0-5e91de44c852,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:03.758102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7162566e-476d-46b3-aa19-3205e86b15ef tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.763814 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7162566e-476d-46b3-aa19-3205e86b15ef tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/bff9ad11-3244-4fdd-aca0-5e91de44c852 HTTP/1.1" status: 204 len: 168 time: 0.7394626 Mar 24 02:16:03.768675 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d98902b-ebde-41de-82a7-09dd1a4eae65 None None] Network b5173458-c877-40eb-8ceb-c04dd0584e92 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:03.769490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59238) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:03.913081 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5ad13ffa-d410-43f9-b3d3-63be6bf564cb req-ff8d1073-5870-44c8-85e1-4d4699320c9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1886101 Mar 24 02:16:03.920156 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55150e00-4e1c-469a-beb6-aee65d1b61c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (a5f96abf-6076-4bb9-8c25-133dca34c71d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.938555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (b5173458-c877-40eb-8ceb-c04dd0584e92), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.962775 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55150e00-4e1c-469a-beb6-aee65d1b61c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.966910 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-55150e00-4e1c-469a-beb6-aee65d1b61c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/a5f96abf-6076-4bb9-8c25-133dca34c71d HTTP/1.1" status: 204 len: 168 time: 0.8957260 Mar 24 02:16:03.972480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59244) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:03.993011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (c6bd9e83-528f-458b-903e-02f2a5f99c3d), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:03.995564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53d7d4b8-ffeb-41ff-b67c-642d6b25a2b9 None None] DHCP port deletion for b5173458-c877-40eb-8ceb-c04dd0584e92 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:04.008981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55150e00-4e1c-469a-beb6-aee65d1b61c1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Subnet': ['ID=a5f96abf-6076-4bb9-8c25-133dca34c71d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:04.076269 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-9f3f509d-9b27-4c6b-84f6-69ab3e949eea tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet 04aa60b1-669f-48fd-bf85-14b2a8d09559 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:04.088037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f3f509d-9b27-4c6b-84f6-69ab3e949eea tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (04aa60b1-669f-48fd-bf85-14b2a8d09559), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.109251 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-53d7d4b8-ffeb-41ff-b67c-642d6b25a2b9 None None] Deleting port d3348104-b75b-43fe-b495-0b6438d16645 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:04.109638 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-53d7d4b8-ffeb-41ff-b67c-642d6b25a2b9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d3348104-b75b-43fe-b495-0b6438d16645), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.110633 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-19be5ce1-72d0-4054-ace1-e9294f428230 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1358438 Mar 24 02:16:04.124247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59246) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:04.194696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3348104-b75b-43fe-b495-0b6438d16645 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:04.215103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f3f509d-9b27-4c6b-84f6-69ab3e949eea tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (04aa60b1-669f-48fd-bf85-14b2a8d09559), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.229140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b3ceed-ae16-43e0-ad7d-63b98d7ff88b req-78878ab2-d790-4491-87b9-0c001314829b tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:04.231625 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-07b3ceed-ae16-43e0-ad7d-63b98d7ff88b req-78878ab2-d790-4491-87b9-0c001314829b tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.1406057 Mar 24 02:16:04.244294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85c61507-fd74-48dc-bf4e-2043b7d5f9cb req-6a10456b-1324-4d7b-8005-d8f0aa61cfa0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:04.245901 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-85c61507-fd74-48dc-bf4e-2043b7d5f9cb req-6a10456b-1324-4d7b-8005-d8f0aa61cfa0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1657991 Mar 24 02:16:04.260909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-53d7d4b8-ffeb-41ff-b67c-642d6b25a2b9 None None] For port d3348104-b75b-43fe-b495-0b6438d16645, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3348104-b75b-43fe-b495-0b6438d16645,segment=NetworkSegment(41a6167d-5209-4f9d-b46e-2a681f471477),segment_id=41a6167d-5209-4f9d-b46e-2a681f471477)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:04.261556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-53d7d4b8-ffeb-41ff-b67c-642d6b25a2b9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d3348104-b75b-43fe-b495-0b6438d16645), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.280942 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1383e8cc-004c-4f95-b979-ca6dd2762495 None None] Network 6f3080fc-791f-4748-a0a2-9eff6ea2a609 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:04.296121 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-53d7d4b8-ffeb-41ff-b67c-642d6b25a2b9 None None] Calling delete_port for d3348104-b75b-43fe-b495-0b6438d16645 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:04.319256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port d3348104-b75b-43fe-b495-0b6438d16645 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:04.319256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d3348104-b75b-43fe-b495-0b6438d16645), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.375085 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-07b3ceed-ae16-43e0-ad7d-63b98d7ff88b req-c565a091-a162-4ed7-878d-eb5fca5fed3e tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1264472 Mar 24 02:16:04.378401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93e15c07-1985-4ac2-b167-096fe7f8184d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:04.379763 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-93e15c07-1985-4ac2-b167-096fe7f8184d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.2545514 Mar 24 02:16:04.390332 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59248) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:04.407668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f3f509d-9b27-4c6b-84f6-69ab3e949eea tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (04aa60b1-669f-48fd-bf85-14b2a8d09559), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.417234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] For port d3348104-b75b-43fe-b495-0b6438d16645, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3348104-b75b-43fe-b495-0b6438d16645,segment=NetworkSegment(41a6167d-5209-4f9d-b46e-2a681f471477),segment_id=41a6167d-5209-4f9d-b46e-2a681f471477)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:04.417600 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d3348104-b75b-43fe-b495-0b6438d16645), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.440428 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-85c61507-fd74-48dc-bf4e-2043b7d5f9cb req-dbeb3276-2e0d-4a4d-b4e0-cd92dfb68658 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1695132 Mar 24 02:16:04.441374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for d3348104-b75b-43fe-b495-0b6438d16645 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:04.508675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db3b2062-0af5-42d5-85fa-a01e25af8cc0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:04.510187 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-db3b2062-0af5-42d5-85fa-a01e25af8cc0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1170652 Mar 24 02:16:04.513644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59252) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:04.544791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ae6739a5-df63-48b8-b147-4ad620b073e8 None None] Provisioning complete for port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:04.545241 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ae6739a5-df63-48b8-b147-4ad620b073e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.587365 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cc11aeac-c927-47b3-8d03-ba881dbdc820 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0701578 Mar 24 02:16:04.593690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59254) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:04.627490 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-90a4a62d-c0ed-4645-9e12-9985e11fcfe2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:04.627946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-90a4a62d-c0ed-4645-9e12-9985e11fcfe2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:04.631482 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-90a4a62d-c0ed-4645-9e12-9985e11fcfe2 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/6c52ec2e-a7a9-48ed-b21e-0444cf7269d9 HTTP/1.1" status: 404 len: 333 time: 0.0382957 Mar 24 02:16:04.634485 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59256) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:04.645544 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc4c4cc-b3dc-44da-82ca-c956eef4a7b4 req-46fd7a60-07b1-46db-8eb5-5977edabc22f tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:04.647073 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4dc4c4cc-b3dc-44da-82ca-c956eef4a7b4 req-46fd7a60-07b1-46db-8eb5-5977edabc22f tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.1140881 Mar 24 02:16:04.652923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (d3348104-b75b-43fe-b495-0b6438d16645), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.657263 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d3348104-b75b-43fe-b495-0b6438d16645 is: ACTIVE; New status is: DOWN {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:04.657774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d3348104-b75b-43fe-b495-0b6438d16645), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.675908 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f3f509d-9b27-4c6b-84f6-69ab3e949eea tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (04aa60b1-669f-48fd-bf85-14b2a8d09559), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.695227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No DVR routers for this DVR port d3348104-b75b-43fe-b495-0b6438d16645 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:04.723286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=d3348104-b75b-43fe-b495-0b6438d16645,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:04.741538 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-9741de8e-c0c6-48f8-b413-32ce333d5c46 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:04.742059 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9741de8e-c0c6-48f8-b413-32ce333d5c46 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:04.745522 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9741de8e-c0c6-48f8-b413-32ce333d5c46 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/a5f96abf-6076-4bb9-8c25-133dca34c71d HTTP/1.1" status: 404 len: 337 time: 0.1085374 Mar 24 02:16:04.749691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59258) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:04.759192 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f3f509d-9b27-4c6b-84f6-69ab3e949eea tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=04aa60b1-669f-48fd-bf85-14b2a8d09559,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:04.783947 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-53d7d4b8-ffeb-41ff-b67c-642d6b25a2b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (d3348104-b75b-43fe-b495-0b6438d16645), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.791332 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f3f509d-9b27-4c6b-84f6-69ab3e949eea tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.798076 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9f3f509d-9b27-4c6b-84f6-69ab3e949eea tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/04aa60b1-669f-48fd-bf85-14b2a8d09559 HTTP/1.1" status: 204 len: 168 time: 1.3650107 Mar 24 02:16:04.799796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10e5eecb-e31d-4374-8fc2-c680ad8a8a51 None None] Network 4737a54d-fb43-4f33-9571-8788f5e66399 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:04.800542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59260) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:04.805860 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-e7c6ebad-1625-4745-903b-9d4e57454c82 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:04.810780 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e7c6ebad-1625-4745-903b-9d4e57454c82 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:04.817086 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e7c6ebad-1625-4745-903b-9d4e57454c82 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/64bd1d7e-7dd7-4156-88e7-4c0c00ae08d4 HTTP/1.1" status: 404 len: 337 time: 0.0618517 Mar 24 02:16:04.818319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (b5173458-c877-40eb-8ceb-c04dd0584e92), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.829997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59262) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:04.836694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (c6bd9e83-528f-458b-903e-02f2a5f99c3d), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.861183 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.867358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-879b4418-638d-4bcd-996b-42332e5ac67c None None] DHCP port deletion for 6f3080fc-791f-4748-a0a2-9eff6ea2a609 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:04.883253 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53d7d4b8-ffeb-41ff-b67c-642d6b25a2b9 None None] Pushing event deleted for resources: {'Port': ['ID=d3348104-b75b-43fe-b495-0b6438d16645,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:04.888855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53d7d4b8-ffeb-41ff-b67c-642d6b25a2b9 None None] No DVR routers for this DVR port d3348104-b75b-43fe-b495-0b6438d16645 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:04.900476 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ae6739a5-df63-48b8-b147-4ad620b073e8 None None] Current status of the port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:04.903562 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4dc4c4cc-b3dc-44da-82ca-c956eef4a7b4 req-f213ee91-5aad-4e3e-b8fe-9aa6cdf10554 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2436678 Mar 24 02:16:04.911797 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-6e793913-223e-4376-9e8a-4abb78628b72 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:04.912366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6e793913-223e-4376-9e8a-4abb78628b72 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:04.919972 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6e793913-223e-4376-9e8a-4abb78628b72 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/38679b87-a0e3-451f-89bf-9c4615d3b0e0 HTTP/1.1" status: 404 len: 333 time: 0.0845692 Mar 24 02:16:04.923157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59264) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:04.957292 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b5173458-c877-40eb-8ceb-c04dd0584e92']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:04.969536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '41a6167d-5209-4f9d-b46e-2a681f471477') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:04.969916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '41a6167d-5209-4f9d-b46e-2a681f471477') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:04.980864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (41a6167d-5209-4f9d-b46e-2a681f471477), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:04.996480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (41a6167d-5209-4f9d-b46e-2a681f471477), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.004782 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Releasing vlan 142 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:05.005218 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (41a6167d-5209-4f9d-b46e-2a681f471477), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.005377 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-879b4418-638d-4bcd-996b-42332e5ac67c None None] Deleting port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:05.005945 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-879b4418-638d-4bcd-996b-42332e5ac67c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.036586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Allocated IP 172.26.2.179 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/819e2239-aa79-4566-ac13-bba723f555a0) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:05.068484 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:05.077692 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-ae6de5d4-d7b3-4536-bb50-5ab761ec7a23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.078154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ae6de5d4-d7b3-4536-bb50-5ab761ec7a23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.092542 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ae6de5d4-d7b3-4536-bb50-5ab761ec7a23 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/647cce81-b4d4-4b29-96ee-997075fcc3a8 HTTP/1.1" status: 404 len: 337 time: 0.1635041 Mar 24 02:16:05.092542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59270) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.122789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-879b4418-638d-4bcd-996b-42332e5ac67c None None] For port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65,segment=NetworkSegment(10c9520a-ce90-4c32-a99e-00890d4b2069),segment_id=10c9520a-ce90-4c32-a99e-00890d4b2069)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:05.123190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-879b4418-638d-4bcd-996b-42332e5ac67c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.136850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:05.137450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.140351 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-879b4418-638d-4bcd-996b-42332e5ac67c None None] Calling delete_port for cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:05.194946 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-fd5292f3-fdcd-4615-9c95-8b0e3ae22c13 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.195403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fd5292f3-fdcd-4615-9c95-8b0e3ae22c13 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.200999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59272) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.201192 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fd5292f3-fdcd-4615-9c95-8b0e3ae22c13 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/ac319f4a-9335-45b4-9176-ca0152a41a6b HTTP/1.1" status: 404 len: 337 time: 0.0914743 Mar 24 02:16:05.214709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (b5173458-c877-40eb-8ceb-c04dd0584e92), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.222565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (4737a54d-fb43-4f33-9571-8788f5e66399), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.229796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f905d88-ee8c-420b-8762-828830403626 None None] DHCP port deletion for 4737a54d-fb43-4f33-9571-8788f5e66399 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:05.238482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-879b4418-638d-4bcd-996b-42332e5ac67c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.254592 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.256645 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/networks/b5173458-c877-40eb-8ceb-c04dd0584e92 HTTP/1.1" status: 204 len: 168 time: 1.4859419 Mar 24 02:16:05.257428 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-895cfa01-2a83-4f6f-b1ca-b8a14eba2c0e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.258025 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-895cfa01-2a83-4f6f-b1ca-b8a14eba2c0e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.258944 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-391716f6-4963-48f0-8a23-00e79baf8389 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Network': ['ID=b5173458-c877-40eb-8ceb-c04dd0584e92,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:05.263411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59274) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.263573 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-895cfa01-2a83-4f6f-b1ca-b8a14eba2c0e tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/02f40670-e322-4f49-b0a8-40b4ce1ec0e3 HTTP/1.1" status: 404 len: 333 time: 0.0517695 Mar 24 02:16:05.266925 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1360927315'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:05.269906 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59276) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.288592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-879b4418-638d-4bcd-996b-42332e5ac67c None None] Pushing event deleted for resources: {'Port': ['ID=cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:05.312922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36365be-cae6-4720-9732-20a072a56829 req-82c26ae6-88b6-402b-b1bb-919eb15d3ea7 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:05.313187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-879b4418-638d-4bcd-996b-42332e5ac67c None None] No DVR routers for this DVR port cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:05.314532 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d36365be-cae6-4720-9732-20a072a56829 req-82c26ae6-88b6-402b-b1bb-919eb15d3ea7 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2384090 Mar 24 02:16:05.320225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for port (819e2239-aa79-4566-ac13-bba723f555a0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.321869 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-b3847b20-3671-469e-a9b0-05c8bde24209 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.322328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b3847b20-3671-469e-a9b0-05c8bde24209 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.325391 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b3847b20-3671-469e-a9b0-05c8bde24209 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/c4e19c6d-57a9-4795-8342-1100d61a56ec HTTP/1.1" status: 404 len: 337 time: 0.0545397 Mar 24 02:16:05.333285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59278) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.351559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a1eb1f2-618e-44f0-8ef9-f820286904e5 req-d7179bba-5814-479a-828d-afbf95efab1a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:05.352873 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7a1eb1f2-618e-44f0-8ef9-f820286904e5 req-d7179bba-5814-479a-828d-afbf95efab1a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 944 time: 0.2835872 Mar 24 02:16:05.354069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3f905d88-ee8c-420b-8762-828830403626 None None] Deleting port 9d759c72-9df8-4539-b94a-909a7781ba24 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:05.354632 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3f905d88-ee8c-420b-8762-828830403626 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.366348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:05.369663 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.374331 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-e52caa3c-49d1-4c5d-9f99-ce413f863fdf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.374828 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e52caa3c-49d1-4c5d-9f99-ce413f863fdf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.381760 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e52caa3c-49d1-4c5d-9f99-ce413f863fdf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/ccba19f2-5556-4978-b044-9e51066b2aa5 HTTP/1.1" status: 404 len: 337 time: 0.0430169 Mar 24 02:16:05.381760 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59280) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.392100 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port 3f9f9d5e-7262-4cb8-8f93-06abc7097f13, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3f9f9d5e-7262-4cb8-8f93-06abc7097f13,segment=NetworkSegment(927da624-ebed-4101-bcc4-f658632d156c),segment_id=927da624-ebed-4101-bcc4-f658632d156c)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:05.392100 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.420812 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-4f9903ad-b71e-463f-8cb8-5115c15d8b99 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.421592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4f9903ad-b71e-463f-8cb8-5115c15d8b99 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.424453 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4f9903ad-b71e-463f-8cb8-5115c15d8b99 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/16ff0bcb-8742-460a-9cc6-a6e0e598bd52 HTTP/1.1" status: 404 len: 333 time: 0.0421312 Mar 24 02:16:05.426067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:05.430750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59284) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.436810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3f905d88-ee8c-420b-8762-828830403626 None None] For port 9d759c72-9df8-4539-b94a-909a7781ba24, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9d759c72-9df8-4539-b94a-909a7781ba24,segment=NetworkSegment(64b82b4c-8030-4953-bd09-d1681cca9cb9),segment_id=64b82b4c-8030-4953-bd09-d1681cca9cb9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:05.437583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3f905d88-ee8c-420b-8762-828830403626 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.460371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3f905d88-ee8c-420b-8762-828830403626 None None] Calling delete_port for 9d759c72-9df8-4539-b94a-909a7781ba24 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:05.469105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 103} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:05.475228 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d36365be-cae6-4720-9732-20a072a56829 req-f09014c6-e90a-4330-94c8-69686d3acde9 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1213930 Mar 24 02:16:05.476550 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-b90ea2d2-3114-4603-a35b-feed810be391 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.477014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b90ea2d2-3114-4603-a35b-feed810be391 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.480134 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b90ea2d2-3114-4603-a35b-feed810be391 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/10aba204-5510-435e-bb9a-1bef0715ce68 HTTP/1.1" status: 404 len: 337 time: 0.0483935 Mar 24 02:16:05.485853 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59286) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.494598 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7a1eb1f2-618e-44f0-8ef9-f820286904e5 req-f7eba873-5338-46cd-87dd-b9cf44ae37c7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1295791 Mar 24 02:16:05.515294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 9d759c72-9df8-4539-b94a-909a7781ba24 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:05.516826 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.522372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (a5a2cef6-9f35-4b65-aa36-7ab6b7841312), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.524377 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Added segment a5a2cef6-9f35-4b65-aa36-7ab6b7841312 of type vlan for network 3b457ad5-c60e-42c8-a04a-356fcf800a37 Mar 24 02:16:05.560250 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-f079f367-3251-4b93-aad9-88180e25a9a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.564553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f079f367-3251-4b93-aad9-88180e25a9a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.568182 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f079f367-3251-4b93-aad9-88180e25a9a5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/4be25361-fe42-44ca-9770-b0e035cbeb42 HTTP/1.1" status: 404 len: 337 time: 0.0820324 Mar 24 02:16:05.572144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59290) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.572326 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3f905d88-ee8c-420b-8762-828830403626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.602963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f905d88-ee8c-420b-8762-828830403626 None None] Pushing event deleted for resources: {'Port': ['ID=9d759c72-9df8-4539-b94a-909a7781ba24,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:05.610145 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f905d88-ee8c-420b-8762-828830403626 None None] No DVR routers for this DVR port 9d759c72-9df8-4539-b94a-909a7781ba24 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:05.616270 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-b39cfec5-b458-4fe5-99a7-80fdddad3209 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.616856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b39cfec5-b458-4fe5-99a7-80fdddad3209 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.622692 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b39cfec5-b458-4fe5-99a7-80fdddad3209 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/c540393b-b093-493e-824f-9956fc005df9 HTTP/1.1" status: 404 len: 333 time: 0.0460887 Mar 24 02:16:05.625624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (819e2239-aa79-4566-ac13-bba723f555a0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.627285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59292) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.695365 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-a4b89b08-2170-4be6-a8dc-02a9958688a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.695731 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a4b89b08-2170-4be6-a8dc-02a9958688a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.698950 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a4b89b08-2170-4be6-a8dc-02a9958688a1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/5d7605ad-705a-466b-8486-3ef52ceb92f9 HTTP/1.1" status: 404 len: 337 time: 0.0642092 Mar 24 02:16:05.707831 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59294) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.711564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (3b457ad5-c60e-42c8-a04a-356fcf800a37), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.714166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:05.725521 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] For port 9d759c72-9df8-4539-b94a-909a7781ba24, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9d759c72-9df8-4539-b94a-909a7781ba24,segment=NetworkSegment(64b82b4c-8030-4953-bd09-d1681cca9cb9),segment_id=64b82b4c-8030-4953-bd09-d1681cca9cb9)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:05.725890 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.751710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 9d759c72-9df8-4539-b94a-909a7781ba24 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:05.762356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:05.765336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:05.789419 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e53137e-71bd-4fc6-8cf4-e09c29983a4e req-dd9e7e87-b244-465a-9e60-6d715cbf1866 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:05.790965 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2e53137e-71bd-4fc6-8cf4-e09c29983a4e req-dd9e7e87-b244-465a-9e60-6d715cbf1866 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.1954834 Mar 24 02:16:05.795712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (3b457ad5-c60e-42c8-a04a-356fcf800a37), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.800714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:05.801289 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:05.806453 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event updated for resources: {'Port': ['ID=819e2239-aa79-4566-ac13-bba723f555a0,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:05.809779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89b105a1-087c-47cc-a8b0-932dfaf4677a req-8f0cbf86-33ab-4c11-a3bc-b43eead01ad2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:05.811289 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-89b105a1-087c-47cc-a8b0-932dfaf4677a req-8f0cbf86-33ab-4c11-a3bc-b43eead01ad2 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2108679 Mar 24 02:16:05.818032 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-68493b30-35c3-487d-8b54-2084fc2817b4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.818551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-68493b30-35c3-487d-8b54-2084fc2817b4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.821620 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-68493b30-35c3-487d-8b54-2084fc2817b4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/422a0fb0-a605-4922-b7f5-c816ab147bc3 HTTP/1.1" status: 404 len: 333 time: 0.1094890 Mar 24 02:16:05.831420 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59296) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:05.866081 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-aaad2241-54c0-49e1-adc5-216f532ae256 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:05.866549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aaad2241-54c0-49e1-adc5-216f532ae256 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:05.869612 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-aaad2241-54c0-49e1-adc5-216f532ae256 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/6d5bc392-754c-4d1a-b6fb-be5a9dd1e536 HTTP/1.1" status: 404 len: 337 time: 0.0372443 Mar 24 02:16:05.872971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59298) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:06.025126 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (3f9f9d5e-7262-4cb8-8f93-06abc7097f13), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:06.053414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:06.062081 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=3f9f9d5e-7262-4cb8-8f93-06abc7097f13,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:06.082243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:06.082748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device cb6d54c6-5336-4b96-8f4e-dd66c4bf1b65 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:06.083280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9d759c72-9df8-4539-b94a-909a7781ba24 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:06.116663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 79123375-136b-4c1b-ba67-948e46e33a7c up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:06.119377 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 9d759c72-9df8-4539-b94a-909a7781ba24 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:06.122049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9d759c72-9df8-4539-b94a-909a7781ba24 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:06.199685 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 79123375-136b-4c1b-ba67-948e46e33a7c completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:16:06.204391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 79123375-136b-4c1b-ba67-948e46e33a7c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:06.204772 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:06.273246 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.0100968 Mar 24 02:16:06.274266 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-ae5d4acf-93ae-4e0b-ac4e-fd7bbd7228b8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:06.274847 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ae5d4acf-93ae-4e0b-ac4e-fd7bbd7228b8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:06.276416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59300) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:06.277755 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ae5d4acf-93ae-4e0b-ac4e-fd7bbd7228b8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/5dc45d46-65cf-4fb0-857d-c9895c778f96 HTTP/1.1" status: 404 len: 333 time: 0.0646522 Mar 24 02:16:06.282138 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': '3b457ad5-c60e-42c8-a04a-356fcf800a37', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:06.282659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59302) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:06.324890 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 79123375-136b-4c1b-ba67-948e46e33a7c is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:06.325337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:06.334798 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4958598-891d-4d82-86b9-3c3001bc1451 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Network': ['ID=3b457ad5-c60e-42c8-a04a-356fcf800a37,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:06.340233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (c6bd9e83-528f-458b-903e-02f2a5f99c3d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:06.347955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:06.356277 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 3b457ad5-c60e-42c8-a04a-356fcf800a37 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:06.373188 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-f87a6cdc-d410-4a6d-81d8-c1ac847e403d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:06.374993 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f87a6cdc-d410-4a6d-81d8-c1ac847e403d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:06.378494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:16:06.381462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7eca2c23-4fca-48f7-a990-dcb01d906386" -d '{"events": [{"server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "name": "network-vif-plugged", "status": "completed", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:16:06.385030 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f87a6cdc-d410-4a6d-81d8-c1ac847e403d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/3e091aad-ca94-44cc-bb67-8b401bbd94fd HTTP/1.1" status: 404 len: 337 time: 0.0931926 Mar 24 02:16:06.387587 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-89b105a1-087c-47cc-a8b0-932dfaf4677a req-ffe335ce-520e-4cc6-b4c8-8d00b8bdc48b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5428689 Mar 24 02:16:06.391367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59306) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:06.437185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 79123375-136b-4c1b-ba67-948e46e33a7c, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=79123375-136b-4c1b-ba67-948e46e33a7c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:06.453052 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:06.453327 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2e53137e-71bd-4fc6-8cf4-e09c29983a4e req-36e7e635-3268-4af7-99c9-e1f2868bf89a tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6134896 Mar 24 02:16:06.461461 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-b8289ac7-60b8-45d9-bb50-c9b683a67b92 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:06.461669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b8289ac7-60b8-45d9-bb50-c9b683a67b92 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:06.468091 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b8289ac7-60b8-45d9-bb50-c9b683a67b92 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/3030d1ef-8c17-4020-9651-c6125e86ac97 HTTP/1.1" status: 404 len: 333 time: 0.0740871 Mar 24 02:16:06.468712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59310) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:06.509276 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-d33e8831-229d-47e9-bf5d-fa11f091afb1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:06.509276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d33e8831-229d-47e9-bf5d-fa11f091afb1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:06.515968 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d33e8831-229d-47e9-bf5d-fa11f091afb1 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/0b178503-60ea-4883-ac4c-105d039d9afe HTTP/1.1" status: 404 len: 337 time: 0.0448024 Mar 24 02:16:06.517368 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59314) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:06.519205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:16:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07c9a4fa-bd16-41a3-9c30-a2d31e716972 x-openstack-request-id: req-07c9a4fa-bd16-41a3-9c30-a2d31e716972 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:16:06.519625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "name": "network-vif-plugged", "status": "completed", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:16:06.519990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-07c9a4fa-bd16-41a3-9c30-a2d31e716972 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:16:06.520660 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-07c9a4fa-bd16-41a3-9c30-a2d31e716972'] response: {'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c', 'code': 200} Mar 24 02:16:06.523870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=79123375-136b-4c1b-ba67-948e46e33a7c,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:06.566304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (9d759c72-9df8-4539-b94a-909a7781ba24), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:06.573099 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-f60917a8-5409-406a-a30f-2a6cd9914326 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:06.573673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f60917a8-5409-406a-a30f-2a6cd9914326 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:06.579579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f60917a8-5409-406a-a30f-2a6cd9914326 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/ab72154d-c672-43d2-a5d3-dee78afb9ec3 HTTP/1.1" status: 404 len: 333 time: 0.0463209 Mar 24 02:16:06.594011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59316) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:06.614176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=9d759c72-9df8-4539-b94a-909a7781ba24,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:06.637386 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No DVR routers for this DVR port 9d759c72-9df8-4539-b94a-909a7781ba24 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:06.641239 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-ed3d0953-9586-4888-8c04-75185e50c577 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:06.641823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ed3d0953-9586-4888-8c04-75185e50c577 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:06.645779 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ed3d0953-9586-4888-8c04-75185e50c577 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/333a8308-f430-48a8-ae89-0cc14a94dd36 HTTP/1.1" status: 404 len: 337 time: 0.0486653 Mar 24 02:16:06.652460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59318) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:06.668065 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:06.671691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:06.738139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b4d42a-a3ba-4aaf-bd8d-4eaedd77f01e req-4e6dea34-0cc6-4b6c-985a-ae0494056980 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:06.739589 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b0b4d42a-a3ba-4aaf-bd8d-4eaedd77f01e req-4e6dea34-0cc6-4b6c-985a-ae0494056980 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2605958 Mar 24 02:16:06.796810 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-5da72c27-1b4c-4965-8317-c9a81b911a00 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:06.797388 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5da72c27-1b4c-4965-8317-c9a81b911a00 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:06.800469 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5da72c27-1b4c-4965-8317-c9a81b911a00 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/d9d25a9e-67a1-47ec-a4b7-732509df5486 HTTP/1.1" status: 404 len: 333 time: 0.1297438 Mar 24 02:16:06.803411 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59320) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:06.845593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (4737a54d-fb43-4f33-9571-8788f5e66399), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:06.861923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407c491e-a306-4ff6-a6a4-0767bd7a8837 req-5c6e6c23-1f83-489a-8f67-249edd6b1e2d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:06.863590 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-407c491e-a306-4ff6-a6a4-0767bd7a8837 req-5c6e6c23-1f83-489a-8f67-249edd6b1e2d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 945 time: 0.2607813 Mar 24 02:16:06.901542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4737a54d-fb43-4f33-9571-8788f5e66399']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:06.931235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '64b82b4c-8030-4953-bd09-d1681cca9cb9') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:06.931530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '64b82b4c-8030-4953-bd09-d1681cca9cb9') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:06.934746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e30bf4-c3c1-4a7a-ad52-6a3f09537c91 req-da2c60cc-070a-412f-b5f9-2150fd000556 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:06.936272 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-12e30bf4-c3c1-4a7a-ad52-6a3f09537c91 req-da2c60cc-070a-412f-b5f9-2150fd000556 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 1129 time: 0.2571914 Mar 24 02:16:06.945915 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b0b4d42a-a3ba-4aaf-bd8d-4eaedd77f01e req-05484b7a-70a0-4d22-abbe-dd4d5b2c2c01 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1512954 Mar 24 02:16:06.967727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (64b82b4c-8030-4953-bd09-d1681cca9cb9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.007713 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-407c491e-a306-4ff6-a6a4-0767bd7a8837 req-4432ae6d-42fe-478f-8f9c-b10301967b4f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1269329 Mar 24 02:16:07.012067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (64b82b4c-8030-4953-bd09-d1681cca9cb9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.056200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Releasing vlan 134 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:07.056803 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (64b82b4c-8030-4953-bd09-d1681cca9cb9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:07.060312 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:07.114492 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-12e30bf4-c3c1-4a7a-ad52-6a3f09537c91 req-a1ed396e-2845-4784-a861-156fa2d460cf service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1542368 Mar 24 02:16:07.144765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (4737a54d-fb43-4f33-9571-8788f5e66399), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.159936 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.164116 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/networks/4737a54d-fb43-4f33-9571-8788f5e66399 HTTP/1.1" status: 204 len: 168 time: 2.3622329 Mar 24 02:16:07.167627 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59326) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.172649 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-478199706'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:07.192701 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5091e72e-841c-493c-b164-d43fbf2c1e9a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Network': ['ID=4737a54d-fb43-4f33-9571-8788f5e66399,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:07.202118 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-7ed47995-8c09-44fc-90fc-290136168e28 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.202606 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7ed47995-8c09-44fc-90fc-290136168e28 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.205771 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7ed47995-8c09-44fc-90fc-290136168e28 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/48ad07a8-5051-44bb-8ca6-f43ab79b2221 HTTP/1.1" status: 404 len: 337 time: 0.3982160 Mar 24 02:16:07.215773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59328) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.234794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:07.238828 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.266832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad49aa1f-ea23-4f22-8521-c0bd152ddcaf req-5e3b1461-899c-41b0-8ea7-c7c922405c93 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:07.268248 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ad49aa1f-ea23-4f22-8521-c0bd152ddcaf req-5e3b1461-899c-41b0-8ea7-c7c922405c93 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.0802281 Mar 24 02:16:07.284640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 111} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:07.300833 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-82851130-382d-4b19-ba56-8e102af995c7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.301287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-82851130-382d-4b19-ba56-8e102af995c7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.304298 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-82851130-382d-4b19-ba56-8e102af995c7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/754231d8-1bfe-4921-87b1-acf5a6a33ff5 HTTP/1.1" status: 404 len: 337 time: 0.0581646 Mar 24 02:16:07.309702 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59330) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.310472 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e34d2fce-1c83-4d97-bdfa-d64b8b17b444), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.310851 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Added segment e34d2fce-1c83-4d97-bdfa-d64b8b17b444 of type vlan for network 7bcfafc7-9d55-4514-9694-bc396ba54674 Mar 24 02:16:07.353247 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ad49aa1f-ea23-4f22-8521-c0bd152ddcaf req-d78c3a14-f1c6-407a-b380-93f8f92548a0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0776045 Mar 24 02:16:07.360981 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-8ef7ef29-a1ea-4064-a8d1-b3f903acf6ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.361751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8ef7ef29-a1ea-4064-a8d1-b3f903acf6ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.367634 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8ef7ef29-a1ea-4064-a8d1-b3f903acf6ce tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/c2971a5e-67da-4438-8575-e5369dc52cca HTTP/1.1" status: 404 len: 333 time: 0.0517929 Mar 24 02:16:07.369851 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (c6bd9e83-528f-458b-903e-02f2a5f99c3d), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.372905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59332) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.379493 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (c6bd9e83-528f-458b-903e-02f2a5f99c3d), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.391006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (7bcfafc7-9d55-4514-9694-bc396ba54674), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.414760 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-bcd6cc3d-38ce-45c9-91e9-33b45234a655 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.415220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bcd6cc3d-38ce-45c9-91e9-33b45234a655 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.418278 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bcd6cc3d-38ce-45c9-91e9-33b45234a655 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/583274b6-3d5a-4b07-8a2f-cd1764f06413 HTTP/1.1" status: 404 len: 337 time: 0.0444231 Mar 24 02:16:07.423508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59334) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.424466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:07.437625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (7bcfafc7-9d55-4514-9694-bc396ba54674), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.443577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:07.444166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.516424 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.3477089 Mar 24 02:16:07.519290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59338) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.524230 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '7bcfafc7-9d55-4514-9694-bc396ba54674', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:07.528668 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-be9f0516-4252-4167-b4f6-5a7d03f9d41d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.529123 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-be9f0516-4252-4167-b4f6-5a7d03f9d41d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.532183 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-be9f0516-4252-4167-b4f6-5a7d03f9d41d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/4b356bbf-257f-4afc-b498-4e10c679cf12 HTTP/1.1" status: 404 len: 337 time: 0.1040995 Mar 24 02:16:07.539059 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59340) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.592847 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ebfb3f-00ce-4e6a-a0ca-4b667691aaad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Network': ['ID=7bcfafc7-9d55-4514-9694-bc396ba54674,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:07.602954 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-2fc54759-a4f2-4121-9032-040c0d8c3851 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.603457 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2fc54759-a4f2-4121-9032-040c0d8c3851 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.606341 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2fc54759-a4f2-4121-9032-040c0d8c3851 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/9336a83d-90d4-454f-9310-441a3b790ebb HTTP/1.1" status: 404 len: 333 time: 0.0634472 Mar 24 02:16:07.606635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 7bcfafc7-9d55-4514-9694-bc396ba54674 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:07.610533 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59342) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.654964 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-8ef97e7c-edad-484a-9e4e-a2c8a8fab409 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.655428 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8ef97e7c-edad-484a-9e4e-a2c8a8fab409 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.658445 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8ef97e7c-edad-484a-9e4e-a2c8a8fab409 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/e9a00e9f-3f7e-47d1-959f-59199b3253f0 HTTP/1.1" status: 404 len: 337 time: 0.0439827 Mar 24 02:16:07.661691 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59344) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.704584 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-9c82e5a5-5337-43e2-919e-41ca11ac8d7a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.704958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (8cf5343c-f2c3-4fa0-85d5-2eca0176df46), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.705127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9c82e5a5-5337-43e2-919e-41ca11ac8d7a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.708143 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9c82e5a5-5337-43e2-919e-41ca11ac8d7a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/bf5b9324-e973-4fdb-838e-8de9265c4c30 HTTP/1.1" status: 404 len: 337 time: 0.0455480 Mar 24 02:16:07.711536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59346) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.746982 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a0c31fe-6738-4419-8105-25188c34d602 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.747636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2a0c31fe-6738-4419-8105-25188c34d602 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.750855 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2a0c31fe-6738-4419-8105-25188c34d602 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/00fecc99-a30c-4d17-84ff-9c9a91a877c4 HTTP/1.1" status: 404 len: 333 time: 0.0365846 Mar 24 02:16:07.755032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59348) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.758435 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d24ed0-e9d3-4b74-b097-415a1f9cce03 req-d4a5c94f-eedd-419a-8186-5349cdc5f768 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:07.759933 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b4d24ed0-e9d3-4b74-b097-415a1f9cce03 req-d4a5c94f-eedd-419a-8186-5349cdc5f768 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.2145908 Mar 24 02:16:07.760988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:07.764199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:07.804377 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:07.812422 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f95421ab-9922-4edd-b66e-2179aa5ddf52 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.6947367 Mar 24 02:16:07.815302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59350) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.816459 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:07.822378 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-68ff4b5c-160a-49cd-9677-63415b45920b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.823116 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-68ff4b5c-160a-49cd-9677-63415b45920b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.825178 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:07.825784 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:07.828745 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-68ff4b5c-160a-49cd-9677-63415b45920b tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/f2c288fe-54ac-4876-8b72-9e75353078e1 HTTP/1.1" status: 404 len: 337 time: 0.0639994 Mar 24 02:16:07.830615 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59352) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.842977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=8cf5343c-f2c3-4fa0-85d5-2eca0176df46,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:07.885925 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-a1640960-7ead-447d-b549-f435f7e83cf4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:07.886971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a1640960-7ead-447d-b549-f435f7e83cf4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:07.891119 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a1640960-7ead-447d-b549-f435f7e83cf4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/1d2b302e-0646-4d13-8be3-bb6737db4c30 HTTP/1.1" status: 404 len: 337 time: 0.0571980 Mar 24 02:16:07.897584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59354) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.903422 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Checking segment: {'id': 'a5a2cef6-9f35-4b65-aa36-7ab6b7841312', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '3b457ad5-c60e-42c8-a04a-356fcf800a37'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:07.903856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network hostable DHCP agents. Network: 3b457ad5-c60e-42c8-a04a-356fcf800a37, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:07.905910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Router c6bd9e83-528f-458b-903e-02f2a5f99c3d is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:16:07.915711 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:07.946592 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ab057685-8805-4dae-b128-1f1b462b4520 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports?device_id=f6328e56-c489-492c-b183-d553d2d4b4f6 HTTP/1.1" status: 200 len: 205 time: 0.0468390 Mar 24 02:16:07.949853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59356) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:07.962546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-170d493f-757e-4ea2-b5e7-d5a957b4afc3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting subnet 26e1ee63-7d8e-4edb-a909-6a9a796c2d5b {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:07.964037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 3b457ad5-c60e-42c8-a04a-356fcf800a37 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:07.974242 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b4d24ed0-e9d3-4b74-b097-415a1f9cce03 req-0f0d9f8a-ccdc-460e-988c-fa72f2433c32 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2049158 Mar 24 02:16:08.020821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 3b457ad5-c60e-42c8-a04a-356fcf800a37) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:08.021485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-170d493f-757e-4ea2-b5e7-d5a957b4afc3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (26e1ee63-7d8e-4edb-a909-6a9a796c2d5b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.026065 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:08.027113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.039602 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2afab90-3c63-4d2d-abc0-78aefc4e1798 None None] Network 3b457ad5-c60e-42c8-a04a-356fcf800a37 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:08.046940 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-33c7945b-3d68-43e2-9272-556337d6895a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] delete failed (client error): The resource could not be found. Mar 24 02:16:08.047999 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-33c7945b-3d68-43e2-9272-556337d6895a tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/routers/f6328e56-c489-492c-b183-d553d2d4b4f6 HTTP/1.1" status: 404 len: 336 time: 0.0969474 Mar 24 02:16:08.051972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59360) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.100894 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-458e34ce-86e8-47b6-879d-785da72fd4d8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.101355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-458e34ce-86e8-47b6-879d-785da72fd4d8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.104429 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-458e34ce-86e8-47b6-879d-785da72fd4d8 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/d27abda3-e811-404d-adbf-44e0463872f5 HTTP/1.1" status: 404 len: 337 time: 0.0515263 Mar 24 02:16:08.115321 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c57e4726-4c1a-4aeb-971f-6ce62f9f2f0b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8374627 Mar 24 02:16:08.119040 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:05Z', 'revision_number': 9, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:08.125073 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59362) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.125432 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59364) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.136090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-170d493f-757e-4ea2-b5e7-d5a957b4afc3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (26e1ee63-7d8e-4edb-a909-6a9a796c2d5b), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.157422 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': '3b457ad5-c60e-42c8-a04a-356fcf800a37', 'name': 'tempest-PortsTestJSON-596821327', 'fixed_ips': [{'subnet_id': '8cf5343c-f2c3-4fa0-85d5-2eca0176df46', 'ip_address': '172.20.0.10'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:08.244286 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:16:08.253338 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:08.253865 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:08.263108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-3b457ad5-c60e-42c8-a04a-356fcf800a37', 'network_id': '3b457ad5-c60e-42c8-a04a-356fcf800a37', 'project_id': '59047855c41744dd95105383d31cd553', 'fixed_ips': [{'subnet_id': '8cf5343c-f2c3-4fa0-85d5-2eca0176df46'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:08.265259 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.277151 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9cdc2f59-4990-4c46-b0a7-32bdb3c2a5c7 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "GET /v2.0/ports?device_id=fb9fb294-ad4d-466a-87d0-9a9068b79455 HTTP/1.1" status: 200 len: 205 time: 0.1505203 Mar 24 02:16:08.294327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59366) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.315036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (cddfa930-bd7b-4fb5-8f6c-3296e0135ef7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.334405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ff96326-5ece-475b-b06a-ac2d050b2e13 req-4fc88815-cfe6-4768-ba75-4b554e32f0fa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:08.335712 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1ff96326-5ece-475b-b06a-ac2d050b2e13 req-4fc88815-cfe6-4768-ba75-4b554e32f0fa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 945 time: 0.1742516 Mar 24 02:16:08.338809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-170d493f-757e-4ea2-b5e7-d5a957b4afc3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (26e1ee63-7d8e-4edb-a909-6a9a796c2d5b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.346098 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:08.419511 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-812dc0e5-d0e6-479f-9d3b-b40dca4c5ed3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] delete failed (client error): The resource could not be found. Mar 24 02:16:08.420677 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-812dc0e5-d0e6-479f-9d3b-b40dca4c5ed3 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/routers/fb9fb294-ad4d-466a-87d0-9a9068b79455 HTTP/1.1" status: 404 len: 336 time: 0.1252937 Mar 24 02:16:08.421867 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:08.432008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.432659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59370) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.434383 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4858c427-0d53-4888-88d8-8de7936aacfc tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "PUT /v2.0/routers/c6bd9e83-528f-458b-903e-02f2a5f99c3d HTTP/1.1" status: 200 len: 879 time: 5.4025047 Mar 24 02:16:08.437616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59372) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.452331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d2c0cd6-0f07-4cf3-a8a8-36aedc034018 None None] Sync routers for ids ['c6bd9e83-528f-458b-903e-02f2a5f99c3d'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:08.513607 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d2c0cd6-0f07-4cf3-a8a8-36aedc034018 None None] Routers {'c6bd9e83-528f-458b-903e-02f2a5f99c3d'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:08.517725 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7d2c0cd6-0f07-4cf3-a8a8-36aedc034018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c6bd9e83-528f-458b-903e-02f2a5f99c3d'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:08.530108 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-0167e461-4eef-4dac-9826-1e9350564697 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.530585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0167e461-4eef-4dac-9826-1e9350564697 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.533674 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0167e461-4eef-4dac-9826-1e9350564697 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/9362b47d-ea99-4b80-a75f-89f0370e647a HTTP/1.1" status: 404 len: 337 time: 0.0682640 Mar 24 02:16:08.536675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59374) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.576339 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:05Z', 'revision_number': 9, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:08.600573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=cddfa930-bd7b-4fb5-8f6c-3296e0135ef7,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:08.604033 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-d0b572e3-9379-4ac6-a6c4-5d8604ed6f54 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.604350 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6548098b-90b6-4e61-8258-21b02b1e292f None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:05Z', 'revision_number': 9, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'a3d4d703-080d-4bed-82c7-4fbdbbfa5c03', 'name': '', 'network_id': '93c5002c-aaba-409a-ac62-41e827f93969', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:43:7b:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:19Z', 'updated_at': '2022-03-24T02:15:26Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '7a9cb681-7c90-4932-bab9-71e68608b7fe', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:08.604647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d0b572e3-9379-4ac6-a6c4-5d8604ed6f54 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.607764 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d0b572e3-9379-4ac6-a6c4-5d8604ed6f54 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/3086ab7d-8ae1-44ba-8477-48853d6e333b HTTP/1.1" status: 404 len: 337 time: 0.0632789 Mar 24 02:16:08.619807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59376) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.635374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7d2c0cd6-0f07-4cf3-a8a8-36aedc034018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:08.652805 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1ff96326-5ece-475b-b06a-ac2d050b2e13 req-dc8934d5-142b-4d4c-a3b3-76df8f9410ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2905331 Mar 24 02:16:08.659267 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Checking segment: {'id': 'e34d2fce-1c83-4d97-bdfa-d64b8b17b444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '7bcfafc7-9d55-4514-9694-bc396ba54674'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:08.659668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network hostable DHCP agents. Network: 7bcfafc7-9d55-4514-9694-bc396ba54674, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:08.665365 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-170d493f-757e-4ea2-b5e7-d5a957b4afc3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (26e1ee63-7d8e-4edb-a909-6a9a796c2d5b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.683102 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-8284ebfc-b25d-4920-a759-a2bea5f0893f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.683102 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8284ebfc-b25d-4920-a759-a2bea5f0893f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.689196 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8284ebfc-b25d-4920-a759-a2bea5f0893f tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/73aa2020-af9a-4d38-9155-f5a369b4a9e7 HTTP/1.1" status: 404 len: 333 time: 0.0647695 Mar 24 02:16:08.690286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6e1266-7e69-4f7c-9760-5a93adf1c66e req-d91a6e0a-9a07-438a-8b3f-2b95f1160399 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:08.692272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59378) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.695123 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7d6e1266-7e69-4f7c-9760-5a93adf1c66e req-d91a6e0a-9a07-438a-8b3f-2b95f1160399 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2217472 Mar 24 02:16:08.706925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d2c0cd6-0f07-4cf3-a8a8-36aedc034018 None None] Routers {'c6bd9e83-528f-458b-903e-02f2a5f99c3d'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:08.707559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7d2c0cd6-0f07-4cf3-a8a8-36aedc034018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c6bd9e83-528f-458b-903e-02f2a5f99c3d'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:08.720425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-170d493f-757e-4ea2-b5e7-d5a957b4afc3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Subnet': ['ID=26e1ee63-7d8e-4edb-a909-6a9a796c2d5b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:08.722567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-170d493f-757e-4ea2-b5e7-d5a957b4afc3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.728900 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-170d493f-757e-4ea2-b5e7-d5a957b4afc3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/26e1ee63-7d8e-4edb-a909-6a9a796c2d5b HTTP/1.1" status: 204 len: 168 time: 0.9068105 Mar 24 02:16:08.733280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59380) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.734737 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-e4523334-9006-4c1c-b40e-2fa606377795 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.735375 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e4523334-9006-4c1c-b40e-2fa606377795 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.741909 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e4523334-9006-4c1c-b40e-2fa606377795 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/2d62ad68-cfb0-40ad-a843-22efd731a467 HTTP/1.1" status: 404 len: 337 time: 0.0486765 Mar 24 02:16:08.746680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59382) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.753050 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcc050c7-a017-4418-9779-c231c62eddde None None] Network 97fcb308-ee86-471e-a60b-8b94d0aed9e6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:08.772035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Allocated IP 172.20.0.2 (3b457ad5-c60e-42c8-a04a-356fcf800a37/8cf5343c-f2c3-4fa0-85d5-2eca0176df46/dd78681b-2eea-404b-ac3d-8f588322aace) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:08.774398 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-b20e38c7-b4e6-462e-aa74-7244d30dd602 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.774780 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7d2c0cd6-0f07-4cf3-a8a8-36aedc034018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:08.774920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b20e38c7-b4e6-462e-aa74-7244d30dd602 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.775572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d2c0cd6-0f07-4cf3-a8a8-36aedc034018 None None] The sync data for ids ['c6bd9e83-528f-458b-903e-02f2a5f99c3d'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:08.780310 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b20e38c7-b4e6-462e-aa74-7244d30dd602 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/c08d4ace-f0bf-4492-a3f9-f49cb1c331d6 HTTP/1.1" status: 404 len: 333 time: 0.0302787 Mar 24 02:16:08.780512 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59384) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.788802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 7bcfafc7-9d55-4514-9694-bc396ba54674 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:08.827446 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b02640c1-c86c-4533-ad12-9a89870c795c tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/routers/c6bd9e83-528f-458b-903e-02f2a5f99c3d HTTP/1.1" status: 200 len: 920 time: 0.3885746 Mar 24 02:16:08.828760 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c47b37a-442f-40ad-b5d5-e98e8339bbc4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.829242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2c47b37a-442f-40ad-b5d5-e98e8339bbc4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.830586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59386) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.831381 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:08.834596 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2c47b37a-442f-40ad-b5d5-e98e8339bbc4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/1bb4f5b0-a007-4763-bc4d-79c61bcc0a53 HTTP/1.1" status: 404 len: 337 time: 0.0511303 Mar 24 02:16:08.836219 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59388) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.843275 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 7bcfafc7-9d55-4514-9694-bc396ba54674) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:08.860888 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6c74671-3119-4a67-a64c-b212ac03ccc4 None None] Network 7bcfafc7-9d55-4514-9694-bc396ba54674 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:08.870041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:08.870786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.877890 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-3cdb3023-95b8-42c8-8c58-ec8609d838cf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.879054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3cdb3023-95b8-42c8-8c58-ec8609d838cf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.885205 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3cdb3023-95b8-42c8-8c58-ec8609d838cf tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/02521872-da9a-4dc8-beff-07719679c5df HTTP/1.1" status: 404 len: 333 time: 0.0455766 Mar 24 02:16:08.888664 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7d6e1266-7e69-4f7c-9760-5a93adf1c66e req-072ed2d6-1366-4bef-a7e9-83af2dbcff48 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1704185 Mar 24 02:16:08.888987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59390) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.917993 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-15399bfb-44fa-4ab0-8d3e-1e4cfc23f562 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.918437 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-15399bfb-44fa-4ab0-8d3e-1e4cfc23f562 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.921795 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-15399bfb-44fa-4ab0-8d3e-1e4cfc23f562 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/b5f08dee-8285-4a00-baae-d1c98849f262 HTTP/1.1" status: 404 len: 337 time: 0.0313528 Mar 24 02:16:08.926027 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-802d6353-8ec1-419e-8f4f-688dc44abb9f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4058421 Mar 24 02:16:08.926677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59394) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.933664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59396) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.942192 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '7bcfafc7-9d55-4514-9694-bc396ba54674', 'security_groups': [], 'name': 'tempest-PortsIpV6TestJSON-404200840'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:08.952089 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-4d0ae62f-6880-45b8-8c41-fd8319d4d93d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.952664 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4d0ae62f-6880-45b8-8c41-fd8319d4d93d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.955777 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4d0ae62f-6880-45b8-8c41-fd8319d4d93d tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/bb524409-2554-4e0a-b0d7-5a59a769634f HTTP/1.1" status: 404 len: 333 time: 0.0281236 Mar 24 02:16:08.958385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59398) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:08.960153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (97fcb308-ee86-471e-a60b-8b94d0aed9e6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:08.993677 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-10c65331-6fe0-42c0-9c92-78587a90ceb6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:08.994135 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-10c65331-6fe0-42c0-9c92-78587a90ceb6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:08.997211 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-10c65331-6fe0-42c0-9c92-78587a90ceb6 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/92009ae8-4e82-4a33-9746-06bbf72cb55c HTTP/1.1" status: 404 len: 337 time: 0.0378807 Mar 24 02:16:09.000547 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59400) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.034829 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-42a4089c-c534-47cd-8e65-b7b19a9a9000 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:09.035673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-42a4089c-c534-47cd-8e65-b7b19a9a9000 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:09.040322 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-42a4089c-c534-47cd-8e65-b7b19a9a9000 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/1a3ac717-ddb0-4aa9-8a94-58851a486f53 HTTP/1.1" status: 404 len: 333 time: 0.0388234 Mar 24 02:16:09.042825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59404) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.084756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82790932-9d5a-419d-9a53-6f1976edc700 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:09.089394 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-82790932-9d5a-419d-9a53-6f1976edc700 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=c6bd9e83-528f-458b-903e-02f2a5f99c3d&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2535872 Mar 24 02:16:09.095208 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59406) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.145933 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7ff3440-b1dc-4c82-adc3-ceff70aecde4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:09.146500 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a7ff3440-b1dc-4c82-adc3-ceff70aecde4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:09.153239 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a7ff3440-b1dc-4c82-adc3-ceff70aecde4 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/aadc9290-5a16-421d-8b48-b81f496a068f HTTP/1.1" status: 404 len: 337 time: 0.1090720 Mar 24 02:16:09.156296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4122577-0002-48e1-acb4-611ba8dd29c5 None None] DHCP port deletion for 97fcb308-ee86-471e-a60b-8b94d0aed9e6 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:09.170001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59410) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.184280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-7bcfafc7-9d55-4514-9694-bc396ba54674', 'network_id': '7bcfafc7-9d55-4514-9694-bc396ba54674', 'project_id': '7b8dee850d65489ba8498576f69edde9', 'fixed_ips': [{'subnet_id': 'cddfa930-bd7b-4fb5-8f6c-3296e0135ef7'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:09.187319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.209920 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-a54d1ae4-8fd0-49b9-ac79-ee6e9af1962c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:09.210615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a54d1ae4-8fd0-49b9-ac79-ee6e9af1962c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:09.223560 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a54d1ae4-8fd0-49b9-ac79-ee6e9af1962c tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/a637b4a0-dbbc-433e-a7fc-981fa5888420 HTTP/1.1" status: 404 len: 333 time: 0.0523937 Mar 24 02:16:09.224269 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59412) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.255672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.323007 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 880d330d-275f-46c8-b909-e7a15ad8a7d5 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:09.372490 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-63fa27fa-fb7c-47e5-99f7-771c6c6e59e5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:09.372847 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-63fa27fa-fb7c-47e5-99f7-771c6c6e59e5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:09.379594 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-63fa27fa-fb7c-47e5-99f7-771c6c6e59e5 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/14372524-5236-4550-9b88-28763fa41de8 HTTP/1.1" status: 404 len: 337 time: 0.1005354 Mar 24 02:16:09.390642 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59414) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.416608 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Publish callbacks [] for port (dd78681b-2eea-404b-ac3d-8f588322aace), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.418419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3010794-f4e1-4300-baae-e2fbcc8be090 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:09.421901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c3035b-dd6f-4ae6-a8ab-f2a949813e93 req-98a8b560-bcd5-4c8c-a400-231c9958d15d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:09.423209 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a3010794-f4e1-4300-baae-e2fbcc8be090 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 881 time: 0.3208351 Mar 24 02:16:09.423985 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51c3035b-dd6f-4ae6-a8ab-f2a949813e93 req-98a8b560-bcd5-4c8c-a400-231c9958d15d tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.2693577 Mar 24 02:16:09.427705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59418) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.429278 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.443969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 2823099e-1b16-4672-9222-fa884b5d898f {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:09.444381 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2823099e-1b16-4672-9222-fa884b5d898f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.475078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Network 3b457ad5-c60e-42c8-a04a-356fcf800a37 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:09.486404 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-6da0e663-86a2-452a-a923-1a0c074ca4e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:09.487076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6da0e663-86a2-452a-a923-1a0c074ca4e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:09.489574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:09.492833 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6da0e663-86a2-452a-a923-1a0c074ca4e0 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/ports/fcda2b67-af67-4b8b-9561-7ab5a45396d6 HTTP/1.1" status: 404 len: 333 time: 0.0878251 Mar 24 02:16:09.495299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:09.497620 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eb6ea49-df9b-44a5-ac16-850a6baee07f req-32e5996c-6294-43c1-8c00-4c7209d30b49 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:09.499299 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4eb6ea49-df9b-44a5-ac16-850a6baee07f req-32e5996c-6294-43c1-8c00-4c7209d30b49 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2542646 Mar 24 02:16:09.499999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Allocated IP 2001:db8::2 (7bcfafc7-9d55-4514-9694-bc396ba54674/cddfa930-bd7b-4fb5-8f6c-3296e0135ef7/b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:09.501635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59422) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.508720 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:09.509331 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9ba2c0af-cf9c-4f80-8a9c-343564905592 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=c6bd9e83-528f-458b-903e-02f2a5f99c3d HTTP/1.1" status: 200 len: 205 time: 0.0638852 Mar 24 02:16:09.515176 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.517924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59424) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.535234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a4122577-0002-48e1-acb4-611ba8dd29c5 None None] Deleting port 2823099e-1b16-4672-9222-fa884b5d898f {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:09.535651 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a4122577-0002-48e1-acb4-611ba8dd29c5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2823099e-1b16-4672-9222-fa884b5d898f), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.567730 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Pushing event updated for resources: {'Port': ['ID=dd78681b-2eea-404b-ac3d-8f588322aace,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:09.584967 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port b678d21a-db3f-40e1-ac7d-3b435406dbb7 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:09.596155 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port 2823099e-1b16-4672-9222-fa884b5d898f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2823099e-1b16-4672-9222-fa884b5d898f,segment=NetworkSegment(927da624-ebed-4101-bcc4-f658632d156c),segment_id=927da624-ebed-4101-bcc4-f658632d156c)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:09.597469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2823099e-1b16-4672-9222-fa884b5d898f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.619765 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-13bd63c9-f1d2-4d7b-9783-c455f3cb6109 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:09.620225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-13bd63c9-f1d2-4d7b-9783-c455f3cb6109 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:09.625796 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-13bd63c9-f1d2-4d7b-9783-c455f3cb6109 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/subnets/c8d15af7-f453-4e4c-8e4a-4d846de18e0c HTTP/1.1" status: 404 len: 337 time: 0.1129813 Mar 24 02:16:09.628169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59426) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:09.671354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 2823099e-1b16-4672-9222-fa884b5d898f owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:09.677436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-febd85ae-1acc-4806-9c6f-9b6293dd141e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:09.680138 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-febd85ae-1acc-4806-9c6f-9b6293dd141e service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 1130 time: 0.3452747 Mar 24 02:16:09.718341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.10 (3b457ad5-c60e-42c8-a04a-356fcf800a37/8cf5343c-f2c3-4fa0-85d5-2eca0176df46/880d330d-275f-46c8-b909-e7a15ad8a7d5) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:09.776940 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51c3035b-dd6f-4ae6-a8ab-f2a949813e93 req-ae5a89d0-50f0-46cf-b059-038f527dab83 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3195407 Mar 24 02:16:09.837342 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4eb6ea49-df9b-44a5-ac16-850a6baee07f req-53ae877a-76c1-4c35-9836-8a9777305a06 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3184433 Mar 24 02:16:09.851604 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (6f3080fc-791f-4748-a0a2-9eff6ea2a609), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.864161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Attempting to bind port dd78681b-2eea-404b-ac3d-8f588322aace on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:09.864751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Attempting to bind port dd78681b-2eea-404b-ac3d-8f588322aace by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'a5a2cef6-9f35-4b65-aa36-7ab6b7841312', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '3b457ad5-c60e-42c8-a04a-356fcf800a37'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:09.865102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Attempting to bind port dd78681b-2eea-404b-ac3d-8f588322aace on network 3b457ad5-c60e-42c8-a04a-356fcf800a37 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:09.871935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a4122577-0002-48e1-acb4-611ba8dd29c5 None None] For port 2823099e-1b16-4672-9222-fa884b5d898f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2823099e-1b16-4672-9222-fa884b5d898f,segment=NetworkSegment(927da624-ebed-4101-bcc4-f658632d156c),segment_id=927da624-ebed-4101-bcc4-f658632d156c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:09.872339 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a4122577-0002-48e1-acb4-611ba8dd29c5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2823099e-1b16-4672-9222-fa884b5d898f), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.891175 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:09.891554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Checking segment: {'id': 'a5a2cef6-9f35-4b65-aa36-7ab6b7841312', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '3b457ad5-c60e-42c8-a04a-356fcf800a37'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:09.891961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.892354 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Bound using segment: {'id': 'a5a2cef6-9f35-4b65-aa36-7ab6b7841312', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '3b457ad5-c60e-42c8-a04a-356fcf800a37'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:09.892832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Bound port: dd78681b-2eea-404b-ac3d-8f588322aace, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a5a2cef6-9f35-4b65-aa36-7ab6b7841312', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '3b457ad5-c60e-42c8-a04a-356fcf800a37'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:09.893438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.906021 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (c6bd9e83-528f-458b-903e-02f2a5f99c3d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:09.906481 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a4122577-0002-48e1-acb4-611ba8dd29c5 None None] Calling delete_port for 2823099e-1b16-4672-9222-fa884b5d898f owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:10.096385 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Publish callbacks [] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.099692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] For port dd78681b-2eea-404b-ac3d-8f588322aace, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:10.104671 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] For port dd78681b-2eea-404b-ac3d-8f588322aace, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=dd78681b-2eea-404b-ac3d-8f588322aace,segment=NetworkSegment(a5a2cef6-9f35-4b65-aa36-7ab6b7841312),segment_id=a5a2cef6-9f35-4b65-aa36-7ab6b7841312)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:10.110806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a4122577-0002-48e1-acb4-611ba8dd29c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (2823099e-1b16-4672-9222-fa884b5d898f), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.119023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.139476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (880d330d-275f-46c8-b909-e7a15ad8a7d5), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.147248 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.156709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2823099e-1b16-4672-9222-fa884b5d898f no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:10.166724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4122577-0002-48e1-acb4-611ba8dd29c5 None None] Pushing event deleted for resources: {'Port': ['ID=2823099e-1b16-4672-9222-fa884b5d898f,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:10.189232 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (2823099e-1b16-4672-9222-fa884b5d898f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.196828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4122577-0002-48e1-acb4-611ba8dd29c5 None None] No DVR routers for this DVR port 2823099e-1b16-4672-9222-fa884b5d898f on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:10.232315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 2823099e-1b16-4672-9222-fa884b5d898f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:10.232685 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2823099e-1b16-4672-9222-fa884b5d898f not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:10.233069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:10.263028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:10.263028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3f9f9d5e-7262-4cb8-8f93-06abc7097f13 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:10.270048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Network 7bcfafc7-9d55-4514-9694-bc396ba54674 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:10.275357 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:10.278450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:10.291751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Pushing event updated for resources: {'Port': ['ID=b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:10.294559 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::22c (7bcfafc7-9d55-4514-9694-bc396ba54674/cddfa930-bd7b-4fb5-8f6c-3296e0135ef7/b678d21a-db3f-40e1-ac7d-3b435406dbb7) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:10.408906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Attempting to bind port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:10.409332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Attempting to bind port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'e34d2fce-1c83-4d97-bdfa-d64b8b17b444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '7bcfafc7-9d55-4514-9694-bc396ba54674'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:10.410233 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Attempting to bind port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d on network 7bcfafc7-9d55-4514-9694-bc396ba54674 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:10.417095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:10.417521 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Checking segment: {'id': 'e34d2fce-1c83-4d97-bdfa-d64b8b17b444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '7bcfafc7-9d55-4514-9694-bc396ba54674'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:10.417884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.418341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Bound using segment: {'id': 'e34d2fce-1c83-4d97-bdfa-d64b8b17b444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '7bcfafc7-9d55-4514-9694-bc396ba54674'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:10.418844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Bound port: b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e34d2fce-1c83-4d97-bdfa-d64b8b17b444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '7bcfafc7-9d55-4514-9694-bc396ba54674'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:10.419236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.421181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bcf7591-e7a2-428f-9d7f-c992cb50d6d2 None None] Pushing event updated for resources: {'Port': ['ID=dd78681b-2eea-404b-ac3d-8f588322aace,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:10.471264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No DVR routers for this DVR port 2823099e-1b16-4672-9222-fa884b5d898f on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:10.497032 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-ecb6cb11-eebe-4c22-96da-ed465634ae52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:10.498712 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-ecb6cb11-eebe-4c22-96da-ed465634ae52 service neutron] 10.222.0.30 "GET /v2.0/networks?id=597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 200 len: 913 time: 0.7821591 Mar 24 02:16:10.541277 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=2823099e-1b16-4672-9222-fa884b5d898f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:10.557120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (880d330d-275f-46c8-b909-e7a15ad8a7d5), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.561558 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] For port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:10.566358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] For port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d,segment=NetworkSegment(e34d2fce-1c83-4d97-bdfa-d64b8b17b444),segment_id=e34d2fce-1c83-4d97-bdfa-d64b8b17b444)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:10.576537 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.645516 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (b678d21a-db3f-40e1-ac7d-3b435406dbb7), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.663764 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (6f3080fc-791f-4748-a0a2-9eff6ea2a609), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.689242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6c13429-5ef9-4092-93f2-c2d3f2ce4860 req-e1400d9c-85ae-48ee-a3e8-c2cf9a10cd67 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:10.690192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d044aecf-7cc8-4bca-8d78-d7d2163eaf72 None None] Pushing event updated for resources: {'Port': ['ID=b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:10.696081 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6c13429-5ef9-4092-93f2-c2d3f2ce4860 req-e1400d9c-85ae-48ee-a3e8-c2cf9a10cd67 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 945 time: 0.8079185 Mar 24 02:16:10.759725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f3080fc-791f-4748-a0a2-9eff6ea2a609']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:10.763498 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-a21cf354-9841-40cf-bf3e-4ff1098c5f8b service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 200 len: 1001 time: 0.2471499 Mar 24 02:16:10.787402 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '10c9520a-ce90-4c32-a99e-00890d4b2069') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:10.787791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '10c9520a-ce90-4c32-a99e-00890d4b2069') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:10.817910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (c6bd9e83-528f-458b-903e-02f2a5f99c3d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.823439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (97fcb308-ee86-471e-a60b-8b94d0aed9e6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.826759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 3b457ad5-c60e-42c8-a04a-356fcf800a37 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:10.827644 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (10c9520a-ce90-4c32-a99e-00890d4b2069), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.900821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (10c9520a-ce90-4c32-a99e-00890d4b2069), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.917653 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6c13429-5ef9-4092-93f2-c2d3f2ce4860 req-206a984f-ea5e-4a9f-8d57-d38867c9ceba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2135909 Mar 24 02:16:10.918849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:10.919389 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (10c9520a-ce90-4c32-a99e-00890d4b2069), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:10.921455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=880d330d-275f-46c8-b909-e7a15ad8a7d5,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:10.948550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['97fcb308-ee86-471e-a60b-8b94d0aed9e6']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:10.957205 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:10.969677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '927da624-ebed-4101-bcc4-f658632d156c') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:10.969851 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '927da624-ebed-4101-bcc4-f658632d156c') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:10.980636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-76d4a2a3-687a-4694-899f-94289d2b1587 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:10.982278 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-76d4a2a3-687a-4694-899f-94289d2b1587 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=56374a24-4e35-434f-b4b8-860ef8289893 HTTP/1.1" status: 200 len: 851 time: 0.2072971 Mar 24 02:16:10.982589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (927da624-ebed-4101-bcc4-f658632d156c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.016862 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (927da624-ebed-4101-bcc4-f658632d156c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.024873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:11.025280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (927da624-ebed-4101-bcc4-f658632d156c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.118622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:11.119203 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:11.121508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:11.124031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b678d21a-db3f-40e1-ac7d-3b435406dbb7), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.155520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (97fcb308-ee86-471e-a60b-8b94d0aed9e6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.160876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.167116 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (6f3080fc-791f-4748-a0a2-9eff6ea2a609), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.167323 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/networks/97fcb308-ee86-471e-a60b-8b94d0aed9e6 HTTP/1.1" status: 204 len: 168 time: 2.4208896 Mar 24 02:16:11.168346 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59436) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:11.192898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.203401 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] 10.222.0.20 "DELETE /v2.0/networks/6f3080fc-791f-4748-a0a2-9eff6ea2a609 HTTP/1.1" status: 204 len: 168 time: 1.5646679 Mar 24 02:16:11.227962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abbe6946-0f92-4f40-a7a1-db5cf467fc8a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Network': ['ID=97fcb308-ee86-471e-a60b-8b94d0aed9e6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:11.251782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 7bcfafc7-9d55-4514-9694-bc396ba54674 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:11.259255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:11.262734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:11.268016 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:11.268719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.276304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:11.276988 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.279501 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=b678d21a-db3f-40e1-ac7d-3b435406dbb7,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:11.306368 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8c103d02-bee9-4467-857d-9f0f3af5c312 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 892 time: 2.3694646 Mar 24 02:16:11.311506 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59440) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:11.317397 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8a43f4ab-c795-4c2a-9805-f64de9468b7c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 3.1680615 Mar 24 02:16:11.330948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59442) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:11.343361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': '3b457ad5-c60e-42c8-a04a-356fcf800a37', 'name': 'tempest-PortsTestJSON-38513890', 'fixed_ips': [{'subnet_id': '8cf5343c-f2c3-4fa0-85d5-2eca0176df46', 'ip_address': '172.20.0.9'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:11.356685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb28185-69bd-4e58-995e-4ba6dc76ac1c req-ed0c4c28-64d5-4b5f-a313-1424e9ee875c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:11.365761 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9eb28185-69bd-4e58-995e-4ba6dc76ac1c req-ed0c4c28-64d5-4b5f-a313-1424e9ee875c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.4414787 Mar 24 02:16:11.410245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Deleting port 819e2239-aa79-4566-ac13-bba723f555a0 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:11.410610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (819e2239-aa79-4566-ac13-bba723f555a0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.518690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (819e2239-aa79-4566-ac13-bba723f555a0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:11.532719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Calling delete_port for 819e2239-aa79-4566-ac13-bba723f555a0 owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:11.654975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1534bc3-e3db-4a23-9913-9eae8f14db80 tempest-NetworksTestDHCPv6-1758329632 tempest-NetworksTestDHCPv6-1758329632-project] Pushing event deleted for resources: {'Network': ['ID=6f3080fc-791f-4748-a0a2-9eff6ea2a609,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:11.685817 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f077927b-4214-481e-8ef3-0dc083640bfc req-975319fb-9044-4adc-adf7-725bfa146571 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:11.687452 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f077927b-4214-481e-8ef3-0dc083640bfc req-975319fb-9044-4adc-adf7-725bfa146571 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.6345048 Mar 24 02:16:11.696015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59446) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:11.698327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-8df63bf9-5be9-46ae-9fba-399a9505f5da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:11.700060 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-8df63bf9-5be9-46ae-9fba-399a9505f5da service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=597625fc-4c02-4901-9b3e-46b781f61da1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.6371405 Mar 24 02:16:11.757660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-215b34c3-0206-409f-8e69-98167e211120 None None] Network 3b457ad5-c60e-42c8-a04a-356fcf800a37 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:11.839527 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9eb28185-69bd-4e58-995e-4ba6dc76ac1c req-9c6822d0-9d39-48b0-8c04-6ed5d436c363 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4727941 Mar 24 02:16:11.981996 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-83a161f9-0c14-41da-92c8-69089495af85 None None] Provisioning complete for port dd78681b-2eea-404b-ac3d-8f588322aace triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:11.982922 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83a161f9-0c14-41da-92c8-69089495af85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:12.155378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 4716cbf2-4cfd-4eec-91c2-c814fff2a832 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:16:12.165491 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f077927b-4214-481e-8ef3-0dc083640bfc req-7bd37e42-80cb-418e-bf3b-780af2847c1e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4584603 Mar 24 02:16:12.183579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (819e2239-aa79-4566-ac13-bba723f555a0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:12.392866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event deleted for resources: {'Port': ['ID=819e2239-aa79-4566-ac13-bba723f555a0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:12.397071 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-0e0a221a-0523-421d-b622-0c8918b577f8 service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6824765 Mar 24 02:16:12.413118 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e232f936-8891-4349-a35e-f909e48eec51 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=61b2614e46ca47e598c15c239d583ee4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7117879 Mar 24 02:16:12.428578 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59450) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:12.437947 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:12.454205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 4716cbf2-4cfd-4eec-91c2-c814fff2a832 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:12.467911 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'port_id': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'mac_address': 'fa:16:3e:cc:67:4f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 131, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:16:12.472143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:12.507251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-dce9ecb6-57be-477d-8678-1f4cef374389 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port b678d21a-db3f-40e1-ac7d-3b435406dbb7 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:12.507613 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dce9ecb6-57be-477d-8678-1f4cef374389 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b678d21a-db3f-40e1-ac7d-3b435406dbb7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:12.512758 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:12.522433 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:12.540802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-83a161f9-0c14-41da-92c8-69089495af85 None None] Current status of the port dd78681b-2eea-404b-ac3d-8f588322aace is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:12.541197 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83a161f9-0c14-41da-92c8-69089495af85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:12.613574 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port ee9c5a82-acaf-44ac-966a-90e6b8adc074 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:12.641255 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcc8679a-de36-4202-a8c3-830aed1185ce None None] Network 7bcfafc7-9d55-4514-9694-bc396ba54674 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:12.684248 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d25dc34-bcbd-4f44-b2b2-0840a6bc48fe req-41cb193b-d599-4680-8aca-6f89685df4b5 service neutron] 10.222.0.30 "GET /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2193613 Mar 24 02:16:12.695224 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551b2547-19a9-48bc-ae4b-780641e54f1a req-e3b05d07-7f72-4800-afe2-f58f0c17dd93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:12.703314 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-551b2547-19a9-48bc-ae4b-780641e54f1a req-e3b05d07-7f72-4800-afe2-f58f0c17dd93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 945 time: 0.7219598 Mar 24 02:16:12.735384 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 is: ACTIVE; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:12.736158 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:12.776550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-83a161f9-0c14-41da-92c8-69089495af85 None None] For port dd78681b-2eea-404b-ac3d-8f588322aace, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=dd78681b-2eea-404b-ac3d-8f588322aace,segment=NetworkSegment(a5a2cef6-9f35-4b65-aa36-7ab6b7841312),segment_id=a5a2cef6-9f35-4b65-aa36-7ab6b7841312)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:12.787976 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4716cbf2-4cfd-4eec-91c2-c814fff2a832 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:16:12.806733 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83a161f9-0c14-41da-92c8-69089495af85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:12.861134 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-551b2547-19a9-48bc-ae4b-780641e54f1a req-4ae8c988-941b-4312-ad19-76af982e6519 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1559632 Mar 24 02:16:12.869567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fabcac8b-094f-40c8-9063-2db1a2919885 req-5c7f8425-a8d1-4889-a35e-f7460b1c722a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:12.871657 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fabcac8b-094f-40c8-9063-2db1a2919885 req-5c7f8425-a8d1-4889-a35e-f7460b1c722a service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 1129 time: 0.5700958 Mar 24 02:16:12.877926 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (c6bd9e83-528f-458b-903e-02f2a5f99c3d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:12.881587 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.9 (3b457ad5-c60e-42c8-a04a-356fcf800a37/8cf5343c-f2c3-4fa0-85d5-2eca0176df46/ee9c5a82-acaf-44ac-966a-90e6b8adc074) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:12.924586 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59454) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:12.940427 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:12.943792 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:12.944365 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.023763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.080852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 is: ACTIVE; New status is: DOWN {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:13.081292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.109167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f5fc475c-d96a-4ce5-afa3-75515c2c6351 None None] Provisioning complete for port 880d330d-275f-46c8-b909-e7a15ad8a7d5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:13.109538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f5fc475c-d96a-4ce5-afa3-75515c2c6351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (880d330d-275f-46c8-b909-e7a15ad8a7d5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.134329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d60708df-451d-4514-94de-8051410308a7 admin admin] Publish callbacks [] for security_group (05660306-331a-4737-9a34-3ad56cbd2a03), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.161731 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83a161f9-0c14-41da-92c8-69089495af85 None None] Pushing event updated for resources: {'Port': ['ID=dd78681b-2eea-404b-ac3d-8f588322aace,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:13.172801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dce9ecb6-57be-477d-8678-1f4cef374389 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b678d21a-db3f-40e1-ac7d-3b435406dbb7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.190682 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (ee9c5a82-acaf-44ac-966a-90e6b8adc074), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.199104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-dce9ecb6-57be-477d-8678-1f4cef374389 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for b678d21a-db3f-40e1-ac7d-3b435406dbb7 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:13.223948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d60708df-451d-4514-94de-8051410308a7 admin admin] Publish callbacks [] for security_group (05660306-331a-4737-9a34-3ad56cbd2a03), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.254464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f5fc475c-d96a-4ce5-afa3-75515c2c6351 None None] Port 880d330d-275f-46c8-b909-e7a15ad8a7d5 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:13.261626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:13.262058 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.300179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:16:13.300802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:16:13.307866 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=4716cbf2-4cfd-4eec-91c2-c814fff2a832,revision_number=6']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:13.335874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f5fc475c-d96a-4ce5-afa3-75515c2c6351 None None] Provisioning complete for port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:13.336499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f5fc475c-d96a-4ce5-afa3-75515c2c6351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.367148 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (ee9c5a82-acaf-44ac-966a-90e6b8adc074), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.371061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d,segment=NetworkSegment(e34d2fce-1c83-4d97-bdfa-d64b8b17b444),segment_id=e34d2fce-1c83-4d97-bdfa-d64b8b17b444)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:13.380479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.381269 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device dd78681b-2eea-404b-ac3d-8f588322aace up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:13.437735 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['4716cbf2-4cfd-4eec-91c2-c814fff2a832'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:16:13.443573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (c6bd9e83-528f-458b-903e-02f2a5f99c3d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.446893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (c6bd9e83-528f-458b-903e-02f2a5f99c3d), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.454804 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d60708df-451d-4514-94de-8051410308a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (05660306-331a-4737-9a34-3ad56cbd2a03), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.458703 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d60708df-451d-4514-94de-8051410308a7 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.460237 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d60708df-451d-4514-94de-8051410308a7 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/05660306-331a-4737-9a34-3ad56cbd2a03 HTTP/1.1" status: 204 len: 168 time: 1.0220675 Mar 24 02:16:13.503433 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 3b457ad5-c60e-42c8-a04a-356fcf800a37 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:13.530263 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60708df-451d-4514-94de-8051410308a7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05660306-331a-4737-9a34-3ad56cbd2a03,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:13.535845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:13.538872 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:13.547061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=ee9c5a82-acaf-44ac-966a-90e6b8adc074,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:13.558732 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fabcac8b-094f-40c8-9063-2db1a2919885 req-bac20b77-0542-4000-95f5-5758507d1f13 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5980084 Mar 24 02:16:13.569966 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (c6bd9e83-528f-458b-903e-02f2a5f99c3d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.570554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Fanout notify agent at l3_agent the message router_deleted on router c6bd9e83-528f-458b-903e-02f2a5f99c3d {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:16:13.577813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ea26d59-f2c7-437d-a84b-d37023aceb89 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:13.582983 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9ea26d59-f2c7-437d-a84b-d37023aceb89 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 1124 time: 0.6210537 Mar 24 02:16:13.583621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59460) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:13.589047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.590085 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5ca33384-c3a7-4bae-ba64-b508995b3443 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/c6bd9e83-528f-458b-903e-02f2a5f99c3d HTTP/1.1" status: 204 len: 168 time: 4.0669982 Mar 24 02:16:13.612647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59462) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:13.617906 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address': '172.20.0.8'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:13.619840 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-97918d98-444a-43ec-a14c-6cd80ff14718 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-826159124', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:13.621673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:13.695186 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:13.696036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.699274 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47c12816-da06-49a6-8ef6-b6a01874bbb3 req-1acf670b-cfd2-4214-94fa-673a1ccee12f tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:13.703841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-97918d98-444a-43ec-a14c-6cd80ff14718 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (0aa843a0-da71-4529-b938-7ef07de1674f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.705028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-97918d98-444a-43ec-a14c-6cd80ff14718 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (0aa843a0-da71-4529-b938-7ef07de1674f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.706943 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-47c12816-da06-49a6-8ef6-b6a01874bbb3 req-1acf670b-cfd2-4214-94fa-673a1ccee12f tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 944 time: 0.7108841 Mar 24 02:16:13.710925 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dce9ecb6-57be-477d-8678-1f4cef374389 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b678d21a-db3f-40e1-ac7d-3b435406dbb7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.726075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-596c1846-21d6-421e-8285-40f07fa7d6d5 req-66feffde-76cf-4fb0-afa1-c4ecc9d6e043 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:13.727487 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-596c1846-21d6-421e-8285-40f07fa7d6d5 req-66feffde-76cf-4fb0-afa1-c4ecc9d6e043 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3533237 Mar 24 02:16:13.792791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce9ecb6-57be-477d-8678-1f4cef374389 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=b678d21a-db3f-40e1-ac7d-3b435406dbb7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:13.806830 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-326b407b-130c-483f-98ba-12eca2509c6b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 2.4728150 Mar 24 02:16:13.813199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59466) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:13.818645 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dce9ecb6-57be-477d-8678-1f4cef374389 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.830323 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dce9ecb6-57be-477d-8678-1f4cef374389 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/b678d21a-db3f-40e1-ac7d-3b435406dbb7 HTTP/1.1" status: 204 len: 168 time: 2.5084431 Mar 24 02:16:13.834705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59470) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:13.919705 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-e9e8bc34-ee73-408c-8b2d-0e8c4fcef25f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:16:13.926285 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e9e8bc34-ee73-408c-8b2d-0e8c4fcef25f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/b678d21a-db3f-40e1-ac7d-3b435406dbb7 HTTP/1.1" status: 404 len: 333 time: 0.0903695 Mar 24 02:16:13.926985 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59476) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:13.946158 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port dd78681b-2eea-404b-ac3d-8f588322aace triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:13.951538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:13.991714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.048723 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-97918d98-444a-43ec-a14c-6cd80ff14718 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (0aa843a0-da71-4529-b938-7ef07de1674f), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.055589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-97918d98-444a-43ec-a14c-6cd80ff14718 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (0aa843a0-da71-4529-b938-7ef07de1674f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.082183 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-97918d98-444a-43ec-a14c-6cd80ff14718 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.084340 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-97918d98-444a-43ec-a14c-6cd80ff14718 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.4683790 Mar 24 02:16:14.087668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59480) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:14.092440 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': True}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:14.179289 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f5fc475c-d96a-4ce5-afa3-75515c2c6351 None None] Current status of the port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:14.198000 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-47c12816-da06-49a6-8ef6-b6a01874bbb3 req-ed7a2bbe-4c04-41f8-a116-671c149f6cc0 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4901686 Mar 24 02:16:14.225707 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-596c1846-21d6-421e-8285-40f07fa7d6d5 req-7583e8e2-5cbc-403c-a283-b81a8614ecd1 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4532642 Mar 24 02:16:14.258585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de4e086-c479-4287-935c-8e2ad2df6038 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:14.260277 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8de4e086-c479-4287-935c-8e2ad2df6038 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.1 HTTP/1.1" status: 200 len: 922 time: 0.4480913 Mar 24 02:16:14.264955 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.269249 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59484) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:14.307075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f5fc475c-d96a-4ce5-afa3-75515c2c6351 None None] Provisioning complete for port dd78681b-2eea-404b-ac3d-8f588322aace triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:14.307460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f5fc475c-d96a-4ce5-afa3-75515c2c6351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.365015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 is: BUILD; New status is: DOWN {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:14.365409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.402759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (0aa843a0-da71-4529-b938-7ef07de1674f), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.412719 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 4716cbf2-4cfd-4eec-91c2-c814fff2a832 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:16:14.417756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-27b0e276-ddd1-4ef1-8a2b-b73e72a71440 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet cddfa930-bd7b-4fb5-8f6c-3296e0135ef7 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:14.431275 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-27b0e276-ddd1-4ef1-8a2b-b73e72a71440 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (cddfa930-bd7b-4fb5-8f6c-3296e0135ef7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.541930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f5fc475c-d96a-4ce5-afa3-75515c2c6351 None None] Current status of the port dd78681b-2eea-404b-ac3d-8f588322aace is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:14.543958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-27b0e276-ddd1-4ef1-8a2b-b73e72a71440 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (cddfa930-bd7b-4fb5-8f6c-3296e0135ef7), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.557721 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:14.573007 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port dd78681b-2eea-404b-ac3d-8f588322aace is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:14.576811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.588476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e74fc935-d5f4-44f0-87f0-b48bb100e99a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:14.594784 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e74fc935-d5f4-44f0-87f0-b48bb100e99a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:14.596498 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59492) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:14.601113 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e74fc935-d5f4-44f0-87f0-b48bb100e99a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:14.602986 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e74fc935-d5f4-44f0-87f0-b48bb100e99a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0. HTTP/1.1" status: 200 len: 2377 time: 0.3292484 Mar 24 02:16:14.608754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59496) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:14.706673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.722772 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=4716cbf2-4cfd-4eec-91c2-c814fff2a832,revision_number=7']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:14.729637 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:14.736616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-27b0e276-ddd1-4ef1-8a2b-b73e72a71440 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (cddfa930-bd7b-4fb5-8f6c-3296e0135ef7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.773268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Provisioning complete for port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:14.774041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.825944 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'networks': [{'name': 'tempest-network--1004790763'}, {'name': 'tempest-network--1349407725'}]} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:14.826416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'network': {'name': 'tempest-network--1004790763'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:14.826753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'network': {'name': 'tempest-network--1349407725'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:14.839595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.10 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/05627719-647a-445d-9114-ab2629d1d724) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:14.866416 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:14.867850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.924310 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Made reservation on behalf of 7ed879a56c604e41a8cd0eb1388b7896 for: {'network': 2} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:14.928602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.938202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (0aa843a0-da71-4529-b938-7ef07de1674f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.942065 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-27b0e276-ddd1-4ef1-8a2b-b73e72a71440 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (cddfa930-bd7b-4fb5-8f6c-3296e0135ef7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.943913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.968735 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.973512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Current status of the port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:14.979748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Could not find standard attr ID for object b678d21a-db3f-40e1-ac7d-3b435406dbb7. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:16:14.986224 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (05627719-647a-445d-9114-ab2629d1d724), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:14.996893 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.008245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27b0e276-ddd1-4ef1-8a2b-b73e72a71440 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=cddfa930-bd7b-4fb5-8f6c-3296e0135ef7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:15.013182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-27b0e276-ddd1-4ef1-8a2b-b73e72a71440 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.017044 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-27b0e276-ddd1-4ef1-8a2b-b73e72a71440 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/cddfa930-bd7b-4fb5-8f6c-3296e0135ef7 HTTP/1.1" status: 204 len: 168 time: 1.0736406 Mar 24 02:16:15.019707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c5e1983-66e8-42bc-b59e-c141aea571df None None] Network 7bcfafc7-9d55-4514-9694-bc396ba54674 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:15.021817 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Provisioning complete for port 880d330d-275f-46c8-b909-e7a15ad8a7d5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:15.022196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (880d330d-275f-46c8-b909-e7a15ad8a7d5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.024423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59498) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:15.059563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (05627719-647a-445d-9114-ab2629d1d724), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.137620 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:15.138956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device dd78681b-2eea-404b-ac3d-8f588322aace up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:15.140551 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Port 880d330d-275f-46c8-b909-e7a15ad8a7d5 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:15.162239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (7bcfafc7-9d55-4514-9694-bc396ba54674), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.186443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:15.194401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:15.197938 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:15.210365 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Provisioning complete for port ee9c5a82-acaf-44ac-966a-90e6b8adc074 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:15.210867 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ee9c5a82-acaf-44ac-966a-90e6b8adc074), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.251451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Allocated IP 172.26.2.41 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/8e8b2b49-6922-443a-adbf-c5c0aaf49166) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:15.254922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=05627719-647a-445d-9114-ab2629d1d724,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:15.312260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for security_group (39d75e96-c329-43ea-b66f-26ae924d6f39), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.320193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port dd78681b-2eea-404b-ac3d-8f588322aace triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:15.320581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.324740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-4946651e-0784-4449-8dd1-4e332377a5c7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port ee9c5a82-acaf-44ac-966a-90e6b8adc074 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:15.325094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4946651e-0784-4449-8dd1-4e332377a5c7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ee9c5a82-acaf-44ac-966a-90e6b8adc074), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.335446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (39d75e96-c329-43ea-b66f-26ae924d6f39), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.336046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.381086 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2754da64-f3f3-4e1e-91ca-d624de4650ee None None] Port ee9c5a82-acaf-44ac-966a-90e6b8adc074 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:15.433337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port dd78681b-2eea-404b-ac3d-8f588322aace is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:15.433738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:15.434014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.453995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'SecurityGroup': ['ID=39d75e96-c329-43ea-b66f-26ae924d6f39,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:15.464961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 140} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:15.476819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbe27d9b-d6a3-4d39-a9ed-2f1e2304d752 None None] DHCP port deletion for 7bcfafc7-9d55-4514-9694-bc396ba54674 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:15.523288 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (93c0d37d-b037-4222-b33e-6f7c0b4573dd), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.523550 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Added segment 93c0d37d-b037-4222-b33e-6f7c0b4573dd of type vlan for network 74e7c4ae-92eb-4141-8057-06a683d5e211 Mar 24 02:16:15.527837 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fbe27d9b-d6a3-4d39-a9ed-2f1e2304d752 None None] Deleting port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:15.528276 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fbe27d9b-d6a3-4d39-a9ed-2f1e2304d752 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.562004 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:15.562350 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.585018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for port (8e8b2b49-6922-443a-adbf-c5c0aaf49166), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.600502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] For port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d,segment=NetworkSegment(e34d2fce-1c83-4d97-bdfa-d64b8b17b444),segment_id=e34d2fce-1c83-4d97-bdfa-d64b8b17b444)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:15.600867 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.604910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-fbe27d9b-d6a3-4d39-a9ed-2f1e2304d752 None None] For port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d,segment=NetworkSegment(e34d2fce-1c83-4d97-bdfa-d64b8b17b444),segment_id=e34d2fce-1c83-4d97-bdfa-d64b8b17b444)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:15.605744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fbe27d9b-d6a3-4d39-a9ed-2f1e2304d752 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.614660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (74e7c4ae-92eb-4141-8057-06a683d5e211), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.619450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fbe27d9b-d6a3-4d39-a9ed-2f1e2304d752 None None] Calling delete_port for b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:15.626024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:15.712299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fbe27d9b-d6a3-4d39-a9ed-2f1e2304d752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.717730 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 135} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:15.724078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (8e8b2b49-6922-443a-adbf-c5c0aaf49166), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.726179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7408bb6-4bb2-4fa0-a9fb-ec559f7b3925 req-11b2d9ff-82eb-4270-ae3b-3f6e1562f879 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:15.727757 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f7408bb6-4bb2-4fa0-a9fb-ec559f7b3925 req-11b2d9ff-82eb-4270-ae3b-3f6e1562f879 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3803246 Mar 24 02:16:15.743377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bc7e10a-5ffe-4797-a767-6dcce865c625 req-492e5f99-ea70-45d9-ba98-a92901e52ce9 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:15.744869 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8bc7e10a-5ffe-4797-a767-6dcce865c625 req-492e5f99-ea70-45d9-ba98-a92901e52ce9 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 943 time: 0.4095619 Mar 24 02:16:15.747153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe27d9b-d6a3-4d39-a9ed-2f1e2304d752 None None] Pushing event deleted for resources: {'Port': ['ID=b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:15.755422 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbe27d9b-d6a3-4d39-a9ed-2f1e2304d752 None None] No DVR routers for this DVR port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:15.755553 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4946651e-0784-4449-8dd1-4e332377a5c7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ee9c5a82-acaf-44ac-966a-90e6b8adc074), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.782832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (ff33f2b8-a6b8-4fd0-b91c-8c69071b66f7), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.783062 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Added segment ff33f2b8-a6b8-4fd0-b91c-8c69071b66f7 of type vlan for network cf5a7195-0533-40d0-b149-deab48d8eda0 Mar 24 02:16:15.784839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event updated for resources: {'Port': ['ID=8e8b2b49-6922-443a-adbf-c5c0aaf49166,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:15.808620 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-4946651e-0784-4449-8dd1-4e332377a5c7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for ee9c5a82-acaf-44ac-966a-90e6b8adc074 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:15.821841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port a3d4d703-080d-4bed-82c7-4fbdbbfa5c03, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a3d4d703-080d-4bed-82c7-4fbdbbfa5c03,segment=NetworkSegment(b57e537a-4271-4ac0-97f0-35d217bd7835),segment_id=b57e537a-4271-4ac0-97f0-35d217bd7835)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:15.822271 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.828249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:15.842823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:15.846173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (cf5a7195-0533-40d0-b149-deab48d8eda0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.848450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:15.875825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:15.892974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:15.933310 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:15.939870 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No DVR routers for this DVR port b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:15.991868 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f7408bb6-4bb2-4fa0-a9fb-ec559f7b3925 req-656869c1-1e4f-4700-ab19-c7e1704ef57c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2460179 Mar 24 02:16:16.019286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (74e7c4ae-92eb-4141-8057-06a683d5e211), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.019732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (cf5a7195-0533-40d0-b149-deab48d8eda0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.024779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:16.029021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:16.029656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.058736 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8bc7e10a-5ffe-4797-a767-6dcce865c625 req-c7d1bc3c-89ba-476a-bb79-e977e2bca9a7 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2723174 Mar 24 02:16:16.101421 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59506) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:16.162581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 4716cbf2-4cfd-4eec-91c2-c814fff2a832 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:16.166681 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1320 time: 1.5669870 Mar 24 02:16:16.174147 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59508) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:16.175962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (7bcfafc7-9d55-4514-9694-bc396ba54674), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.223998 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:16.224393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.270731 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Network': ['ID=74e7c4ae-92eb-4141-8057-06a683d5e211,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:16.286912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7bcfafc7-9d55-4514-9694-bc396ba54674']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:16.300635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 74e7c4ae-92eb-4141-8057-06a683d5e211 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:16.371193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:16.371604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.405599 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:16:16.407948 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86a3577e-37f4-49cb-a0a6-ce2ac8eccf65" -d '{"events": [{"server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "name": "network-vif-plugged", "status": "completed", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:16:16.423456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:16.430712 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.480178 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:16:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c8877ee1-7372-4897-ba6b-e64bf84f874a x-openstack-request-id: req-c8877ee1-7372-4897-ba6b-e64bf84f874a {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:16:16.480544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "name": "network-vif-plugged", "status": "completed", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:16:16.480873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-c8877ee1-7372-4897-ba6b-e64bf84f874a {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:16:16.481438 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c8877ee1-7372-4897-ba6b-e64bf84f874a'] response: {'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'code': 200} Mar 24 02:16:16.491962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=4716cbf2-4cfd-4eec-91c2-c814fff2a832,revision_number=8']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:16.530161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (774a5962-6c17-496b-8d49-ec290d2538c5), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.607413 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8381010f-e618-49a8-b1b0-a5fe55bf02cd tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/floatingips/93b3d5f4-3404-4069-ba69-76c7b29011a1 HTTP/1.1" status: 200 len: 991 time: 0.5048749 Mar 24 02:16:16.636136 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0813437-f8e7-49ce-829a-f65b48260f04 req-1f46c5c6-7579-49d3-8d5e-8abfbf1b2ea9 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:16.637732 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d0813437-f8e7-49ce-829a-f65b48260f04 req-1f46c5c6-7579-49d3-8d5e-8abfbf1b2ea9 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.5689974 Mar 24 02:16:16.660935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:16.686569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:16.687060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b8ac3f33-23cc-4a2c-a9ca-d0c5a870aa1d not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:16.715684 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e34d2fce-1c83-4d97-bdfa-d64b8b17b444') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:16.716255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e34d2fce-1c83-4d97-bdfa-d64b8b17b444') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:16.737189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4946651e-0784-4449-8dd1-4e332377a5c7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ee9c5a82-acaf-44ac-966a-90e6b8adc074), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.770212 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (e34d2fce-1c83-4d97-bdfa-d64b8b17b444), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.796912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (05627719-647a-445d-9114-ab2629d1d724), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.804750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98fb39ab-5615-4ad3-985f-7d53ea6c9530 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Network': ['ID=cf5a7195-0533-40d0-b149-deab48d8eda0,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:16.807352 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e34d2fce-1c83-4d97-bdfa-d64b8b17b444), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.817693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network cf5a7195-0533-40d0-b149-deab48d8eda0 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:16.819562 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2cff45b-5733-4e9b-8d26-e43e6b194bf3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:16.824595 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2cff45b-5733-4e9b-8d26-e43e6b194bf3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:16.826753 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4946651e-0784-4449-8dd1-4e332377a5c7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=ee9c5a82-acaf-44ac-966a-90e6b8adc074,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:16.830063 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2cff45b-5733-4e9b-8d26-e43e6b194bf3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:16.835523 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2cff45b-5733-4e9b-8d26-e43e6b194bf3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:16.837276 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f2cff45b-5733-4e9b-8d26-e43e6b194bf3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2407 time: 0.6571429 Mar 24 02:16:16.843245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59512) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:16.848625 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Releasing vlan 111 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:16.849043 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (e34d2fce-1c83-4d97-bdfa-d64b8b17b444), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:16.852182 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:16.870935 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d0813437-f8e7-49ce-829a-f65b48260f04 req-7ad514c2-9a67-46b6-a51a-d62bc233531c tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2175019 Mar 24 02:16:16.942410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (0aa843a0-da71-4529-b938-7ef07de1674f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.945889 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (7bcfafc7-9d55-4514-9694-bc396ba54674), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.953160 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:16.970155 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/networks/7bcfafc7-9d55-4514-9694-bc396ba54674 HTTP/1.1" status: 204 len: 168 time: 1.9413860 Mar 24 02:16:17.002786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59516) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:17.014796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'name': 'tempest-PortsIpV6TestJSON-993725267'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:17.026619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4946651e-0784-4449-8dd1-4e332377a5c7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.030299 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4946651e-0784-4449-8dd1-4e332377a5c7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/ee9c5a82-acaf-44ac-966a-90e6b8adc074 HTTP/1.1" status: 204 len: 168 time: 2.4159033 Mar 24 02:16:17.046210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59518) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:17.053146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34a6b2e-572d-4814-ad50-571b52547c0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Network': ['ID=7bcfafc7-9d55-4514-9694-bc396ba54674,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:17.055635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a3d4d703-080d-4bed-82c7-4fbdbbfa5c03), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.160020 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-4b0e9815-21f1-4570-a317-02f7bca73ccc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:16:17.164038 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4b0e9815-21f1-4570-a317-02f7bca73ccc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/ee9c5a82-acaf-44ac-966a-90e6b8adc074 HTTP/1.1" status: 404 len: 333 time: 0.1140535 Mar 24 02:16:17.164604 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59522) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:17.178833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=a3d4d703-080d-4bed-82c7-4fbdbbfa5c03,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:17.255045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (74e7c4ae-92eb-4141-8057-06a683d5e211), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.300694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (0aa843a0-da71-4529-b938-7ef07de1674f), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.307271 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (0aa843a0-da71-4529-b938-7ef07de1674f), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.360762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-cffff234-07a0-49d0-abca-e716f5f56bc7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 880d330d-275f-46c8-b909-e7a15ad8a7d5 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:17.361110 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cffff234-07a0-49d0-abca-e716f5f56bc7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (880d330d-275f-46c8-b909-e7a15ad8a7d5), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.454184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:17.458230 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.476699 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71222f00-07da-410a-bb98-70c03d335d23 req-af650ef4-fae6-4235-a193-d3a8279a9669 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:17.478717 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-71222f00-07da-410a-bb98-70c03d335d23 req-af650ef4-fae6-4235-a193-d3a8279a9669 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3227603 Mar 24 02:16:17.506281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cffff234-07a0-49d0-abca-e716f5f56bc7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (880d330d-275f-46c8-b909-e7a15ad8a7d5), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.523863 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-cffff234-07a0-49d0-abca-e716f5f56bc7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 880d330d-275f-46c8-b909-e7a15ad8a7d5 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:17.590974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port 2e582bca-7946-4648-854f-c9a29c9c9575 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:17.593792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Router 0aa843a0-da71-4529-b938-7ef07de1674f is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:16:17.599165 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.621108 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (74e7c4ae-92eb-4141-8057-06a683d5e211), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.754050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cffff234-07a0-49d0-abca-e716f5f56bc7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (880d330d-275f-46c8-b909-e7a15ad8a7d5), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.763445 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:17.774663 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f0ee1a3-0a84-4b45-bc12-c510cdb6409b None None] Sync routers for ids ['0aa843a0-da71-4529-b938-7ef07de1674f'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:17.784216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (05627719-647a-445d-9114-ab2629d1d724), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.786099 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f0ee1a3-0a84-4b45-bc12-c510cdb6409b None None] Routers {'0aa843a0-da71-4529-b938-7ef07de1674f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:17.787141 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8f0ee1a3-0a84-4b45-bc12-c510cdb6409b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['0aa843a0-da71-4529-b938-7ef07de1674f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:17.791389 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.792622 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-aba7a605-5652-4fa8-9cf2-a2ad14861f11 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "PUT /v2.0/routers/0aa843a0-da71-4529-b938-7ef07de1674f HTTP/1.1" status: 200 len: 913 time: 3.7038291 Mar 24 02:16:17.795305 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cffff234-07a0-49d0-abca-e716f5f56bc7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=880d330d-275f-46c8-b909-e7a15ad8a7d5,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:17.797313 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59524) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:17.802857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74e7c4ae-92eb-4141-8057-06a683d5e211']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:17.814789 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-71222f00-07da-410a-bb98-70c03d335d23 req-1e4a4e9a-af3b-40ad-a4cb-a8ebc8dd8893 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3113134 Mar 24 02:16:17.831703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (05627719-647a-445d-9114-ab2629d1d724), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.848997 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8f0ee1a3-0a84-4b45-bc12-c510cdb6409b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:17.849743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '93c0d37d-b037-4222-b33e-6f7c0b4573dd') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:17.850037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '93c0d37d-b037-4222-b33e-6f7c0b4573dd') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:17.859476 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f0ee1a3-0a84-4b45-bc12-c510cdb6409b None None] Routers {'0aa843a0-da71-4529-b938-7ef07de1674f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:17.860320 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8f0ee1a3-0a84-4b45-bc12-c510cdb6409b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['0aa843a0-da71-4529-b938-7ef07de1674f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:17.901518 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8f0ee1a3-0a84-4b45-bc12-c510cdb6409b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:17.902340 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f0ee1a3-0a84-4b45-bc12-c510cdb6409b None None] The sync data for ids ['0aa843a0-da71-4529-b938-7ef07de1674f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:17.915667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (93c0d37d-b037-4222-b33e-6f7c0b4573dd), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.983412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cffff234-07a0-49d0-abca-e716f5f56bc7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.985274 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (93c0d37d-b037-4222-b33e-6f7c0b4573dd), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:17.991202 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cffff234-07a0-49d0-abca-e716f5f56bc7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/880d330d-275f-46c8-b909-e7a15ad8a7d5 HTTP/1.1" status: 204 len: 168 time: 0.8210976 Mar 24 02:16:17.991202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59526) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:18.003669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=05627719-647a-445d-9114-ab2629d1d724,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:18.024021 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-1d6feceb-4aca-4637-8b31-2251b889b597 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:16:18.027947 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1d6feceb-4aca-4637-8b31-2251b889b597 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/880d330d-275f-46c8-b909-e7a15ad8a7d5 HTTP/1.1" status: 404 len: 333 time: 0.0344305 Mar 24 02:16:18.031043 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c0d2d8bb-a22f-4764-a8a5-16b63629204a tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/routers/0aa843a0-da71-4529-b938-7ef07de1674f HTTP/1.1" status: 200 len: 919 time: 0.2326872 Mar 24 02:16:18.031660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59528) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:18.031985 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59530) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:18.037994 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Releasing vlan 140 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:18.038404 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (93c0d37d-b037-4222-b33e-6f7c0b4573dd), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:18.043895 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:18.102597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (774a5962-6c17-496b-8d49-ec290d2538c5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.116189 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-cccaa846-588c-420e-bf48-fa7f31ff5e1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet 8cf5343c-f2c3-4fa0-85d5-2eca0176df46 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:18.120724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cccaa846-588c-420e-bf48-fa7f31ff5e1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (8cf5343c-f2c3-4fa0-85d5-2eca0176df46), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.155307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b411cb93-de55-4523-afb4-dd3a4e6826ba tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:18.156835 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b411cb93-de55-4523-afb4-dd3a4e6826ba tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=0aa843a0-da71-4529-b938-7ef07de1674f&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1214399 Mar 24 02:16:18.160058 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59534) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:18.183364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cccaa846-588c-420e-bf48-fa7f31ff5e1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (8cf5343c-f2c3-4fa0-85d5-2eca0176df46), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.291455 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (2e582bca-7946-4648-854f-c9a29c9c9575), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.292874 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (74e7c4ae-92eb-4141-8057-06a683d5e211), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.296994 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.300820 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/networks/74e7c4ae-92eb-4141-8057-06a683d5e211 HTTP/1.1" status: 204 len: 168 time: 1.4495490 Mar 24 02:16:18.303524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59536) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:18.337336 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b70fdfac-796b-4548-af7e-1259a7028306 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Network': ['ID=74e7c4ae-92eb-4141-8057-06a683d5e211,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:18.358062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c480ab4-0011-4a70-8473-aa14928efd34 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:18.359404 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1c480ab4-0011-4a70-8473-aa14928efd34 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 881 time: 0.1984341 Mar 24 02:16:18.363507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:18.367510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59538) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:18.376755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cccaa846-588c-420e-bf48-fa7f31ff5e1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (8cf5343c-f2c3-4fa0-85d5-2eca0176df46), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.418195 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f3bc47d6-4974-4cc1-b077-df817624b03d tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=0aa843a0-da71-4529-b938-7ef07de1674f HTTP/1.1" status: 200 len: 205 time: 0.0459290 Mar 24 02:16:18.418874 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP 774a5962-6c17-496b-8d49-ec290d2538c5 associated. External IP: 172.26.2.10, port: 79123375-136b-4c1b-ba67-948e46e33a7c. Mar 24 02:16:18.421447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (cf5a7195-0533-40d0-b149-deab48d8eda0), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.422646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59540) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:18.496273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (2e582bca-7946-4648-854f-c9a29c9c9575), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.505769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cccaa846-588c-420e-bf48-fa7f31ff5e1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (8cf5343c-f2c3-4fa0-85d5-2eca0176df46), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.547994 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cccaa846-588c-420e-bf48-fa7f31ff5e1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=8cf5343c-f2c3-4fa0-85d5-2eca0176df46,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:18.554141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (cf5a7195-0533-40d0-b149-deab48d8eda0), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.557421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cccaa846-588c-420e-bf48-fa7f31ff5e1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.560578 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71504c7b-2432-4d2e-9031-10d0e23a30a1 None None] Network 3b457ad5-c60e-42c8-a04a-356fcf800a37 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:18.561124 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cccaa846-588c-420e-bf48-fa7f31ff5e1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/8cf5343c-f2c3-4fa0-85d5-2eca0176df46 HTTP/1.1" status: 204 len: 168 time: 0.5271688 Mar 24 02:16:18.566363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59542) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:18.627455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cf5a7195-0533-40d0-b149-deab48d8eda0']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:18.644025 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ff33f2b8-a6b8-4fd0-b91c-8c69071b66f7') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:18.644425 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ff33f2b8-a6b8-4fd0-b91c-8c69071b66f7') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:18.663140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (ff33f2b8-a6b8-4fd0-b91c-8c69071b66f7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.680437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (3b457ad5-c60e-42c8-a04a-356fcf800a37), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.686668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (ff33f2b8-a6b8-4fd0-b91c-8c69071b66f7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.696362 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Releasing vlan 135 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:18.696556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (ff33f2b8-a6b8-4fd0-b91c-8c69071b66f7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:18.699831 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:18.761126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2f60b8d-6305-4262-a30f-77856f88c7a9 None None] DHCP port deletion for 3b457ad5-c60e-42c8-a04a-356fcf800a37 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:18.787627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (cf5a7195-0533-40d0-b149-deab48d8eda0), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.795266 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.798758 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/networks/cf5a7195-0533-40d0-b149-deab48d8eda0 HTTP/1.1" status: 204 len: 168 time: 0.4942684 Mar 24 02:16:18.802408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59544) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:18.819769 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a2f60b8d-6305-4262-a30f-77856f88c7a9 None None] Deleting port dd78681b-2eea-404b-ac3d-8f588322aace {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:18.820247 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a2f60b8d-6305-4262-a30f-77856f88c7a9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.823402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fefa26af-df14-4f59-9511-838d9c06ede3 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Network': ['ID=cf5a7195-0533-40d0-b149-deab48d8eda0,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:18.881697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port dd78681b-2eea-404b-ac3d-8f588322aace {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:18.882191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.892843 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a2f60b8d-6305-4262-a30f-77856f88c7a9 None None] For port dd78681b-2eea-404b-ac3d-8f588322aace, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=dd78681b-2eea-404b-ac3d-8f588322aace,segment=NetworkSegment(a5a2cef6-9f35-4b65-aa36-7ab6b7841312),segment_id=a5a2cef6-9f35-4b65-aa36-7ab6b7841312)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:18.893342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a2f60b8d-6305-4262-a30f-77856f88c7a9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.910389 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a2f60b8d-6305-4262-a30f-77856f88c7a9 None None] Calling delete_port for dd78681b-2eea-404b-ac3d-8f588322aace owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:18.971348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] For port dd78681b-2eea-404b-ac3d-8f588322aace, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=dd78681b-2eea-404b-ac3d-8f588322aace,segment=NetworkSegment(a5a2cef6-9f35-4b65-aa36-7ab6b7841312),segment_id=a5a2cef6-9f35-4b65-aa36-7ab6b7841312)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:18.972234 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.993019 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a2f60b8d-6305-4262-a30f-77856f88c7a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:18.993242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-929cd8f6-683d-4c3a-8058-7d059e31c290 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:18.998620 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-929cd8f6-683d-4c3a-8058-7d059e31c290 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:19.003729 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-929cd8f6-683d-4c3a-8058-7d059e31c290 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.1886132 Mar 24 02:16:19.003729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for dd78681b-2eea-404b-ac3d-8f588322aace owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:19.004018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59548) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:19.011266 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-2131110841'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:19.024616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2f60b8d-6305-4262-a30f-77856f88c7a9 None None] Pushing event deleted for resources: {'Port': ['ID=dd78681b-2eea-404b-ac3d-8f588322aace,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:19.028503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2f60b8d-6305-4262-a30f-77856f88c7a9 None None] No DVR routers for this DVR port dd78681b-2eea-404b-ac3d-8f588322aace on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:19.068950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Made reservation on behalf of 7ed879a56c604e41a8cd0eb1388b7896 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:19.070163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:19.072515 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.090058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:19.098770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=2e582bca-7946-4648-854f-c9a29c9c9575,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:19.101672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:19.106831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:19.107593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.111755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 125} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:19.130079 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (2cab21bc-3244-4678-9948-1136ddf34db0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.130351 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Added segment 2cab21bc-3244-4678-9948-1136ddf34db0 of type vlan for network 2daa5d56-33c5-4efa-a898-dd1d5e9f7005 Mar 24 02:16:19.157674 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:19.162371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (dd78681b-2eea-404b-ac3d-8f588322aace), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.170627 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:19.175273 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c5cbaaad-090e-4279-97a5-5ca72fa52231 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 2.1647921 Mar 24 02:16:19.182566 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3ac08c79-17c4-44fa-bac3-21620b2089e3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.0103047 Mar 24 02:16:19.183316 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:19.184091 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:19.192559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df782759-7ca1-4271-bd9d-ac024986dc43 req-a6c0bfa2-ae5b-4471-9109-b09492f1943d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:19.194085 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-df782759-7ca1-4271-bd9d-ac024986dc43 req-a6c0bfa2-ae5b-4471-9109-b09492f1943d tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2317202 Mar 24 02:16:19.194608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59550) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:19.194925 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59552) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:19.199139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (2daa5d56-33c5-4efa-a898-dd1d5e9f7005), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.201463 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=dd78681b-2eea-404b-ac3d-8f588322aace,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:19.215295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (0aa843a0-da71-4529-b938-7ef07de1674f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.218170 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No DVR routers for this DVR port dd78681b-2eea-404b-ac3d-8f588322aace on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:19.279643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:19.304432 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (2daa5d56-33c5-4efa-a898-dd1d5e9f7005), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.309848 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:19.310065 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.328408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (3b457ad5-c60e-42c8-a04a-356fcf800a37), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.396800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3b457ad5-c60e-42c8-a04a-356fcf800a37']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:19.404261 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.3968687 Mar 24 02:16:19.409012 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59554) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:19.418543 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1407854296'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:19.423460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a5a2cef6-9f35-4b65-aa36-7ab6b7841312') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:19.423761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a5a2cef6-9f35-4b65-aa36-7ab6b7841312') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:19.439247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (a5a2cef6-9f35-4b65-aa36-7ab6b7841312), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.442918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-399dd5cc-8600-4fd6-b66c-6310c57220aa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Network': ['ID=2daa5d56-33c5-4efa-a898-dd1d5e9f7005,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:19.460323 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 2daa5d56-33c5-4efa-a898-dd1d5e9f7005 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:19.464889 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (a5a2cef6-9f35-4b65-aa36-7ab6b7841312), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.467856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Made reservation on behalf of 7ed879a56c604e41a8cd0eb1388b7896 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:19.470187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-8f305d57-4c70-41e7-8da2-d261155252f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting subnet 7a9cb681-7c90-4932-bab9-71e68608b7fe {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:19.471293 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.485841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Releasing vlan 103 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:19.486279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (a5a2cef6-9f35-4b65-aa36-7ab6b7841312), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:19.490113 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:19.492185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f305d57-4c70-41e7-8da2-d261155252f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (7a9cb681-7c90-4932-bab9-71e68608b7fe), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.566131 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 134} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:19.570542 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-df782759-7ca1-4271-bd9d-ac024986dc43 req-351d9195-28f3-4e3d-8cd3-51b2dae2d52e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3318815 Mar 24 02:16:19.578713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f305d57-4c70-41e7-8da2-d261155252f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (7a9cb681-7c90-4932-bab9-71e68608b7fe), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.598475 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3d3b3379-b523-4505-82ef-f6123cb1438d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.598475 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Added segment 3d3b3379-b523-4505-82ef-f6123cb1438d of type vlan for network c0a7519a-e2e8-4b92-8554-774adb1b1045 Mar 24 02:16:19.637832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (0aa843a0-da71-4529-b938-7ef07de1674f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.651765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 1f63a954-e411-4138-b423-94a29a3b7505 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:19.654475 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (c0a7519a-e2e8-4b92-8554-774adb1b1045), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.683888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (3b457ad5-c60e-42c8-a04a-356fcf800a37), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.695283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.700172 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/networks/3b457ad5-c60e-42c8-a04a-356fcf800a37 HTTP/1.1" status: 204 len: 168 time: 1.1326685 Mar 24 02:16:19.700753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (c0a7519a-e2e8-4b92-8554-774adb1b1045), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.708691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:19.709571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.713640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59556) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:19.722744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-388002725'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:19.724814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b2390b55-064a-4a1f-8403-51cde7631b1d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 2e582bca-7946-4648-854f-c9a29c9c9575 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:19.725431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2390b55-064a-4a1f-8403-51cde7631b1d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2e582bca-7946-4648-854f-c9a29c9c9575), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.744328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8d5b171-b199-432f-a8fa-223dd0ad18f7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Network': ['ID=3b457ad5-c60e-42c8-a04a-356fcf800a37,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:19.750834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:16Z', 'revision_number': 10, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:19.772620 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.3600349 Mar 24 02:16:19.786160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:16:19.795585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:19.796579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:19.801006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59558) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:19.814539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'ports': [{'network_id': '2daa5d56-33c5-4efa-a898-dd1d5e9f7005', 'name': 'tempest-port--1469516647', 'admin_state_up': True}, {'network_id': 'c0a7519a-e2e8-4b92-8554-774adb1b1045', 'admin_state_up': False}]} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:19.814842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'port': {'network_id': '2daa5d56-33c5-4efa-a898-dd1d5e9f7005', 'name': 'tempest-port--1469516647', 'admin_state_up': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:19.815832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'port': {'network_id': 'c0a7519a-e2e8-4b92-8554-774adb1b1045', 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:19.828872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2390b55-064a-4a1f-8403-51cde7631b1d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2e582bca-7946-4648-854f-c9a29c9c9575), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:19.846153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b2390b55-064a-4a1f-8403-51cde7631b1d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 2e582bca-7946-4648-854f-c9a29c9c9575 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:19.902466 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:20.142153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:16Z', 'revision_number': 10, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:20.150578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f305d57-4c70-41e7-8da2-d261155252f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (7a9cb681-7c90-4932-bab9-71e68608b7fe), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.177958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94d991ef-b8ae-459a-b22d-04778247501b None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:16Z', 'revision_number': 10, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None, '_interfaces': [{'id': 'bdc0750a-cabb-4e17-bcb5-ee00d873a4b6', 'name': '', 'network_id': '2b9b3266-75a3-4535-a81d-5ca19fed980f', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'mac_address': 'fa:16:3e:8c:cd:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'device_owner': 'network:router_interface', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:09Z', 'updated_at': '2022-03-24T02:15:18Z', 'revision_number': 5, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'subnets': [{'id': '88bf3d71-7761-47c5-902c-89ab60fdf88d', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:20.232410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:20.235730 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.258539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e041da8d-5cd1-4c4d-a85e-34e448931340 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Network': ['ID=c0a7519a-e2e8-4b92-8554-774adb1b1045,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:20.266277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-9a7288e7-98be-45ea-9d22-567b3fa5face tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:20.267857 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-9a7288e7-98be-45ea-9d22-567b3fa5face tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.30 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.3852205 Mar 24 02:16:20.272253 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network c0a7519a-e2e8-4b92-8554-774adb1b1045 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:20.278310 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Deleting port 8e8b2b49-6922-443a-adbf-c5c0aaf49166 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:20.278896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (8e8b2b49-6922-443a-adbf-c5c0aaf49166), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.286755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 126} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:20.306205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2390b55-064a-4a1f-8403-51cde7631b1d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (2e582bca-7946-4648-854f-c9a29c9c9575), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.337632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (30be06be-bf5f-46c8-9dbf-98fbff324f57), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.337971 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Added segment 30be06be-bf5f-46c8-9dbf-98fbff324f57 of type vlan for network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 Mar 24 02:16:20.398700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.401862 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2978799a-f6eb-4e13-985f-9744766465fb req-ae1d4c84-7369-495e-9159-931f69d2b63d service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3653126 Mar 24 02:16:20.408946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:20.415545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2390b55-064a-4a1f-8403-51cde7631b1d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=2e582bca-7946-4648-854f-c9a29c9c9575,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:20.417705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f305d57-4c70-41e7-8da2-d261155252f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (7a9cb681-7c90-4932-bab9-71e68608b7fe), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.436627 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] Sync routers for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:20.443003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Made reservation on behalf of 7ed879a56c604e41a8cd0eb1388b7896 for: {'port': 2} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:20.448792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.450563 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:20.452141 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:20.468758 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.477141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2390b55-064a-4a1f-8403-51cde7631b1d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.477994 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.482683 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b2390b55-064a-4a1f-8403-51cde7631b1d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/2e582bca-7946-4648-854f-c9a29c9c9575 HTTP/1.1" status: 204 len: 168 time: 1.2841527 Mar 24 02:16:20.483134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:20.483721 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.488816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59560) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:20.502229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'mac_address': 'fa:16:3e:0a:82:c0', 'name': 'tempest-PortsIpV6TestJSON-848480631'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:20.519434 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15011e72-f33e-400a-9649-4990aa1637bd None None] Network 93c5002c-aaba-409a-ac62-41e827f93969 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:20.520194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f305d57-4c70-41e7-8da2-d261155252f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Subnet': ['ID=7a9cb681-7c90-4932-bab9-71e68608b7fe,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:20.522578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f305d57-4c70-41e7-8da2-d261155252f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.525790 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8f305d57-4c70-41e7-8da2-d261155252f3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/7a9cb681-7c90-4932-bab9-71e68608b7fe HTTP/1.1" status: 204 len: 168 time: 1.3284566 Mar 24 02:16:20.531300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59562) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:20.533921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.588140 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:20.633655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (8e8b2b49-6922-443a-adbf-c5c0aaf49166), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.711226 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-62d0d1c8-0171-46bf-a5ce-7e3a490b8b60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 7.0988798 Mar 24 02:16:20.714357 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.9987106 Mar 24 02:16:20.715750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Calling delete_port for 8e8b2b49-6922-443a-adbf-c5c0aaf49166 owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:20.720314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59566) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:20.721089 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59568) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:20.726166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:16:20.727676 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': '65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:20.739304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8" -d '{"events": [{"name": "network-changed", "server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:16:20.765548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device dd78681b-2eea-404b-ac3d-8f588322aace no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:20.830480 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: dd78681b-2eea-404b-ac3d-8f588322aace {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:20.831604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device dd78681b-2eea-404b-ac3d-8f588322aace not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:20.831855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:20.867398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:20.867758 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a3d4d703-080d-4bed-82c7-4fbdbbfa5c03 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:20.885321 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (93c5002c-aaba-409a-ac62-41e827f93969), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.890050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:16:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f118f6d7-0060-4a0d-ba84-58fc2c2f3f33 x-openstack-request-id: req-f118f6d7-0060-4a0d-ba84-58fc2c2f3f33 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:16:20.890344 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:16:20.891337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-f118f6d7-0060-4a0d-ba84-58fc2c2f3f33 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:16:20.891337 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f118f6d7-0060-4a0d-ba84-58fc2c2f3f33'] response: {'name': 'network-changed', 'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c', 'status': 'completed', 'code': 200} Mar 24 02:16:20.898636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2978799a-f6eb-4e13-985f-9744766465fb req-da0ff80c-0e0b-4439-861e-04836ddeaa80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:20.900898 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2978799a-f6eb-4e13-985f-9744766465fb req-da0ff80c-0e0b-4439-861e-04836ddeaa80 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=615b57fe01bd445f87fb9f1a86851430&device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 1129 time: 0.3965075 Mar 24 02:16:20.903375 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901d9bbf-aa49-4d6a-b2cb-dea02a0ef339 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Network': ['ID=65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:20.935752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Deleting port 23c422ed-55e0-408f-95ff-bc9d2619a936 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:20.936091 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:20.940355 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:20.951884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c14b04b-3079-4ae0-bfd6-102ada8e4871 req-89743e29-d704-4f6d-8bd8-dfae9437c31a tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:20.960201 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c14b04b-3079-4ae0-bfd6-102ada8e4871 req-89743e29-d704-4f6d-8bd8-dfae9437c31a tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.2587430 Mar 24 02:16:21.043647 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3f639e95-803f-4648-ac50-220cf052ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/774a5962-6c17-496b-8d49-ec290d2538c5 HTTP/1.1" status: 200 len: 990 time: 0.3214622 Mar 24 02:16:21.055905 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:15:34Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '774a5962-6c17-496b-8d49-ec290d2538c5', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.10', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 792, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:16:15Z', 'updated_at': '2022-03-24T02:16:15Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:21.062623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d1cb473-2fd0-4a55-86fc-2b545eb8af22 None None] DHCP port deletion for 93c5002c-aaba-409a-ac62-41e827f93969 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:21.076214 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] device_id is not set on port 4f0dd19a-8ffc-4b27-a447-e13ce05d6937 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:21.079117 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:21.083307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.086168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:21.112723 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] Checking router: 1f63a954-e411-4138-b423-94a29a3b7505 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:16:21.129791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7d1cb473-2fd0-4a55-86fc-2b545eb8af22 None None] Deleting port 6698fb88-e677-43ca-b552-2988e9a178d0 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:21.130166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d1cb473-2fd0-4a55-86fc-2b545eb8af22 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.133401 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:21.134406 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:21.143199 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c14b04b-3079-4ae0-bfd6-102ada8e4871 req-98ee0f86-29a6-4eef-86d6-aaeaee5c45f0 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1819713 Mar 24 02:16:21.197921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-1407eef9-1ab1-414f-b5e4-76e9b2e7cd59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:21.199496 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-1407eef9-1ab1-414f-b5e4-76e9b2e7cd59 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 1129 time: 0.2699082 Mar 24 02:16:21.226795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7d1cb473-2fd0-4a55-86fc-2b545eb8af22 None None] For port 6698fb88-e677-43ca-b552-2988e9a178d0, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=6698fb88-e677-43ca-b552-2988e9a178d0,segment=NetworkSegment(b57e537a-4271-4ac0-97f0-35d217bd7835),segment_id=b57e537a-4271-4ac0-97f0-35d217bd7835)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:21.227131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d1cb473-2fd0-4a55-86fc-2b545eb8af22 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.243351 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7d1cb473-2fd0-4a55-86fc-2b545eb8af22 None None] Calling delete_port for 6698fb88-e677-43ca-b552-2988e9a178d0 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:21.297141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.332307 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:21.344456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7d1cb473-2fd0-4a55-86fc-2b545eb8af22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.349672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port 6b930bed-5300-4712-88d2-6a5da7d86d4f yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:21.379555 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d1cb473-2fd0-4a55-86fc-2b545eb8af22 None None] Pushing event deleted for resources: {'Port': ['ID=6698fb88-e677-43ca-b552-2988e9a178d0,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:21.386368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d1cb473-2fd0-4a55-86fc-2b545eb8af22 None None] No DVR routers for this DVR port 6698fb88-e677-43ca-b552-2988e9a178d0 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:21.536643 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-15ccc2f9-d8f2-4e2c-b624-ff5783025b04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:21.538497 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-15ccc2f9-d8f2-4e2c-b624-ff5783025b04 service neutron] 10.222.0.30 "GET /v2.0/networks?id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d HTTP/1.1" status: 200 len: 897 time: 0.3252127 Mar 24 02:16:21.546306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for port (4f0dd19a-8ffc-4b27-a447-e13ce05d6937), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.621866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] For port 23c422ed-55e0-408f-95ff-bc9d2619a936, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=23c422ed-55e0-408f-95ff-bc9d2619a936,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:21.622538 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.626269 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2978799a-f6eb-4e13-985f-9744766465fb req-61015a4f-a82a-4f38-acf0-e8dfb01352ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:21.628897 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2978799a-f6eb-4e13-985f-9744766465fb req-61015a4f-a82a-4f38-acf0-e8dfb01352ed service neutron] 10.222.0.30 "GET /v2.0/networks?id=1ff12164-ce98-442e-81ee-e22f78c3a0ff HTTP/1.1" status: 200 len: 898 time: 0.6962972 Mar 24 02:16:21.635422 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:15:34Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '774a5962-6c17-496b-8d49-ec290d2538c5', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.10', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 792, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:16:15Z', 'updated_at': '2022-03-24T02:16:15Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:21.662332 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3abeeb6f-9b1c-4e7c-acca-fb599ad59748 None None] The sync data for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv is: [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:15:34Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '774a5962-6c17-496b-8d49-ec290d2538c5', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.10', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 792, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:16:15Z', 'updated_at': '2022-03-24T02:16:15Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:21.736831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 6698fb88-e677-43ca-b552-2988e9a178d0 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:21.737712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.759672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (eba982ea-a9c2-4a26-a298-c06e00d7fafc), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.775746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] device_id is not set on port e5b55931-71d5-4456-8994-ca0e8441697f yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:21.833519 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-b0beeca6-c8d9-4c82-a8f0-e5166eb91624 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=79123375-136b-4c1b-ba67-948e46e33a7c HTTP/1.1" status: 200 len: 998 time: 0.2827842 Mar 24 02:16:21.836321 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (6b930bed-5300-4712-88d2-6a5da7d86d4f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.903819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-142cec72-2136-4d6a-96fa-14b175c61837 None None] New status for floating IP 774a5962-6c17-496b-8d49-ec290d2538c5: ACTIVE {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:16:21.910593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=eba982ea-a9c2-4a26-a298-c06e00d7fafc,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:21.945768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port 6698fb88-e677-43ca-b552-2988e9a178d0, host dv-neutron-834874-3-hyperv, got binding levels [] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:21.946133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.948994 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (8e8b2b49-6922-443a-adbf-c5c0aaf49166), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:21.953054 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2978799a-f6eb-4e13-985f-9744766465fb req-567e6917-6908-4764-9e88-afad35c4b8d3 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832 HTTP/1.1" status: 200 len: 1001 time: 0.3105874 Mar 24 02:16:21.957349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-b1aac9d3-6a52-465a-a9cc-234eff197825 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:21.958844 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-b1aac9d3-6a52-465a-a9cc-234eff197825 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=852aacbf-87d9-49af-b73c-786b9253307e HTTP/1.1" status: 200 len: 835 time: 0.1157112 Mar 24 02:16:21.965389 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Checking segment: {'id': '30be06be-bf5f-46c8-9dbf-98fbff324f57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:21.965759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network hostable DHCP agents. Network: 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:21.982630 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 6698fb88-e677-43ca-b552-2988e9a178d0 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:21.989858 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.ipam_backend_mixin [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Port 6698fb88-e677-43ca-b552-2988e9a178d0 was not found and therefore no delete operation was performed {{(pid=104037) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:571}} Mar 24 02:16:22.013685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6b930bed-5300-4712-88d2-6a5da7d86d4f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.044880 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event deleted for resources: {'Port': ['ID=8e8b2b49-6922-443a-adbf-c5c0aaf49166,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:22.046765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (6698fb88-e677-43ca-b552-2988e9a178d0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.065064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59572) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:22.137948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=6698fb88-e677-43ca-b552-2988e9a178d0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:22.140845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:22.154626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:22.164925 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:22.167988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2978799a-f6eb-4e13-985f-9744766465fb req-34349f1b-cbf3-4410-84a9-7d7f281536cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.169230 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2978799a-f6eb-4e13-985f-9744766465fb req-34349f1b-cbf3-4410-84a9-7d7f281536cb service neutron] 10.222.0.30 "GET /v2.0/subnets?id=44e52247-2dfd-4416-b8c9-7ab69363e1f2 HTTP/1.1" status: 200 len: 834 time: 0.2068145 Mar 24 02:16:22.171894 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=6b930bed-5300-4712-88d2-6a5da7d86d4f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:22.174265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:22.175759 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No DVR routers for this DVR port 6698fb88-e677-43ca-b552-2988e9a178d0 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:22.179576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.180194 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.189691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for port (e5b55931-71d5-4456-8994-ca0e8441697f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.213417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:22.221169 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-c009348b-c747-40b7-b72d-9b2093632fe9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.223484 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-c009348b-c747-40b7-b72d-9b2093632fe9 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.2525053 Mar 24 02:16:22.228125 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.229000 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.229476 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff55c948-9ad2-48f7-a928-d8cce83219ec None None] Network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:22.234829 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ab39fb58-27b9-4e75-8653-07b15a394d78 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 1.7410085 Mar 24 02:16:22.244845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59576) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:22.246987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.247372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (55088382-7ea7-41f1-a0cb-71a22f16598d), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.248491 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Floating IP 55088382-7ea7-41f1-a0cb-71a22f16598d disassociated. External IP: 172.26.2.33, port: 23c422ed-55e0-408f-95ff-bc9d2619a936. Mar 24 02:16:22.248491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Calling delete_port for 23c422ed-55e0-408f-95ff-bc9d2619a936 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:22.249567 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-83184083-67e3-411c-a41a-aa0982d9266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/774a5962-6c17-496b-8d49-ec290d2538c5 HTTP/1.1" status: 200 len: 992 time: 0.1823168 Mar 24 02:16:22.319302 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0e64ab5b-9b34-43f1-a4f6-bb37ca8bc078 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5954103 Mar 24 02:16:22.323660 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59578) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:22.342463 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (4f0dd19a-8ffc-4b27-a447-e13ce05d6937), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.350167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (0aa843a0-da71-4529-b938-7ef07de1674f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.360526 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27', 'network_id': '65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27', 'project_id': '59047855c41744dd95105383d31cd553', 'fixed_ips': [{'subnet_id': 'eba982ea-a9c2-4a26-a298-c06e00d7fafc'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:22.360905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-011dc3d4-19f2-470d-97e7-48999ecb9285 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'router': {'name': 'tempest-PortsTestJSON-router-2062197184', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:22.361550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.412002 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-12457670-af1c-4c95-8d70-0fff8ee70937 service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1720238 Mar 24 02:16:22.427346 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Port': ['ID=4f0dd19a-8ffc-4b27-a447-e13ce05d6937,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:22.484226 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Checking segment: {'id': '2cab21bc-3244-4678-9948-1136ddf34db0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '2daa5d56-33c5-4efa-a898-dd1d5e9f7005'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:22.484584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Network hostable DHCP agents. Network: 2daa5d56-33c5-4efa-a898-dd1d5e9f7005, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:22.517765 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Allocated IP 172.20.0.2 (65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27/eba982ea-a9c2-4a26-a298-c06e00d7fafc/0f08083a-2625-4d65-a5a8-d5e9a706fba7) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:22.520038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Network 2daa5d56-33c5-4efa-a898-dd1d5e9f7005 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:22.536266 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-104ada71-4497-4572-9fdb-94668d7f77bb service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1180015 Mar 24 02:16:22.538417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 2daa5d56-33c5-4efa-a898-dd1d5e9f7005) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:22.541782 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (93c5002c-aaba-409a-ac62-41e827f93969), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.542345 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:22.543356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (e5b55931-71d5-4456-8994-ca0e8441697f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.572544 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8952dc8e-a074-4687-8034-7c9d17514008 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.573796 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8952dc8e-a074-4687-8034-7c9d17514008 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/6b930bed-5300-4712-88d2-6a5da7d86d4f HTTP/1.1" status: 200 len: 844 time: 0.3210735 Mar 24 02:16:22.576763 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59580) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:22.586482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a818347-8043-4045-bae2-7b1fc10a7d7c None None] Network 2daa5d56-33c5-4efa-a898-dd1d5e9f7005 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:22.601572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (0aa843a0-da71-4529-b938-7ef07de1674f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.611279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (0aa843a0-da71-4529-b938-7ef07de1674f), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.635518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-011dc3d4-19f2-470d-97e7-48999ecb9285 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (7d884862-0b03-425b-8c51-b5475b62ebb4), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.635518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-011dc3d4-19f2-470d-97e7-48999ecb9285 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (7d884862-0b03-425b-8c51-b5475b62ebb4), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.636290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Port': ['ID=e5b55931-71d5-4456-8994-ca0e8441697f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:22.641533 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['93c5002c-aaba-409a-ac62-41e827f93969']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:22.649217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2978799a-f6eb-4e13-985f-9744766465fb req-2581966e-bcec-48c3-a9b0-52691027276d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.650871 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2978799a-f6eb-4e13-985f-9744766465fb req-2581966e-bcec-48c3-a9b0-52691027276d service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1ff12164-ce98-442e-81ee-e22f78c3a0ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.4651983 Mar 24 02:16:22.665816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b57e537a-4271-4ac0-97f0-35d217bd7835') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:22.666405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b57e537a-4271-4ac0-97f0-35d217bd7835') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:22.679605 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (b57e537a-4271-4ac0-97f0-35d217bd7835), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.688548 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Checking segment: {'id': '3d3b3379-b523-4505-82ef-f6123cb1438d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c0a7519a-e2e8-4b92-8554-774adb1b1045'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:22.689152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Network hostable DHCP agents. Network: c0a7519a-e2e8-4b92-8554-774adb1b1045, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:22.696888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b57e537a-4271-4ac0-97f0-35d217bd7835), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.718568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Network c0a7519a-e2e8-4b92-8554-774adb1b1045 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:22.723005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6698fb88-e677-43ca-b552-2988e9a178d0 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:22.734567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-d9f045e9-34dd-41f2-aa86-8fde35f5f12e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 6b930bed-5300-4712-88d2-6a5da7d86d4f {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:22.734966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d9f045e9-34dd-41f2-aa86-8fde35f5f12e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6b930bed-5300-4712-88d2-6a5da7d86d4f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.740184 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, c0a7519a-e2e8-4b92-8554-774adb1b1045) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:22.758351 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dab148fb-42f6-4cb1-b3f6-2d33b60de690 None None] Network c0a7519a-e2e8-4b92-8554-774adb1b1045 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:22.764447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 6698fb88-e677-43ca-b552-2988e9a178d0 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:22.764788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 6698fb88-e677-43ca-b552-2988e9a178d0 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:22.782901 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:22.788037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.792465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.793122 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.795043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Releasing vlan 123 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:22.795341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (b57e537a-4271-4ac0-97f0-35d217bd7835), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.807721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38eb1089-62e3-4a65-8179-093ef2cf6fcb req-dafe9aa2-7a66-47c9-b484-cd79e3ca5a4e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.815105 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-38eb1089-62e3-4a65-8179-093ef2cf6fcb req-dafe9aa2-7a66-47c9-b484-cd79e3ca5a4e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 946 time: 0.5522451 Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:22.818308 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:22.831715 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-436ce139-07af-48a0-8fb1-81ea5a5eae7f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 3.0289216 Mar 24 02:16:22.834539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59582) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:22.847659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d9f045e9-34dd-41f2-aa86-8fde35f5f12e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6b930bed-5300-4712-88d2-6a5da7d86d4f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.879682 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-d9f045e9-34dd-41f2-aa86-8fde35f5f12e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 6b930bed-5300-4712-88d2-6a5da7d86d4f owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:22.910314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (0aa843a0-da71-4529-b938-7ef07de1674f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.910906 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Fanout notify agent at l3_agent the message router_deleted on router 0aa843a0-da71-4529-b938-7ef07de1674f {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:16:22.915953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Publish callbacks [] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.927827 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.935710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:22.941690 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9b4529af-ea9d-4d84-815c-ba3a1034a3b6 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/0aa843a0-da71-4529-b938-7ef07de1674f HTTP/1.1" status: 204 len: 168 time: 4.5176473 Mar 24 02:16:22.946103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59584) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:22.957009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1954b32-28a9-443e-85a6-a84aa8e97237 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.962497 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1954b32-28a9-443e-85a6-a84aa8e97237 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:22.967524 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a1954b32-28a9-443e-85a6-a84aa8e97237 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.1292377 Mar 24 02:16:22.971887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-938edbf9-4a3c-4764-a31a-c763c5f39d77 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1413270182', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:22.976855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:22.978759 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:16:22.980727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59586) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:22.985028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:22.988037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:22.990177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Pushing event updated for resources: {'Port': ['ID=0f08083a-2625-4d65-a5a8-d5e9a706fba7,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:23.012949 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-011dc3d4-19f2-470d-97e7-48999ecb9285 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for router_controller (7d884862-0b03-425b-8c51-b5475b62ebb4), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.026836 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-38eb1089-62e3-4a65-8179-093ef2cf6fcb req-344ba30f-b518-4abd-bdd0-295a85d9e60b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups?id=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2090170 Mar 24 02:16:23.055006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Attempting to bind port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:23.055383 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Attempting to bind port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '30be06be-bf5f-46c8-9dbf-98fbff324f57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:23.055867 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Attempting to bind port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 on network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:23.062511 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2978799a-f6eb-4e13-985f-9744766465fb req-25687f2f-4fb0-41c7-b5ef-9f52a1a52357 service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3179977 Mar 24 02:16:23.064751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:23.066141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Checking segment: {'id': '30be06be-bf5f-46c8-9dbf-98fbff324f57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:23.066928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.067559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Bound using segment: {'id': '30be06be-bf5f-46c8-9dbf-98fbff324f57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:23.068270 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Bound port: 0f08083a-2625-4d65-a5a8-d5e9a706fba7, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '30be06be-bf5f-46c8-9dbf-98fbff324f57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:23.068871 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.070304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-938edbf9-4a3c-4764-a31a-c763c5f39d77 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.071450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-938edbf9-4a3c-4764-a31a-c763c5f39d77 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.085011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-011dc3d4-19f2-470d-97e7-48999ecb9285 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (7d884862-0b03-425b-8c51-b5475b62ebb4), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.093879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (93c5002c-aaba-409a-ac62-41e827f93969), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.098902 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.102854 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/networks/93c5002c-aaba-409a-ac62-41e827f93969 HTTP/1.1" status: 204 len: 168 time: 2.5659227 Mar 24 02:16:23.108002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59588) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:23.156229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] For port 0f08083a-2625-4d65-a5a8-d5e9a706fba7, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:23.160371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] For port 0f08083a-2625-4d65-a5a8-d5e9a706fba7, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0f08083a-2625-4d65-a5a8-d5e9a706fba7,segment=NetworkSegment(30be06be-bf5f-46c8-9dbf-98fbff324f57),segment_id=30be06be-bf5f-46c8-9dbf-98fbff324f57)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:23.172317 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.186855 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-423fd8e6-d0b0-4efe-b310-664cee77fcfb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Network': ['ID=93c5002c-aaba-409a-ac62-41e827f93969,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:23.203077 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-011dc3d4-19f2-470d-97e7-48999ecb9285 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.204688 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-011dc3d4-19f2-470d-97e7-48999ecb9285 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 702 time: 0.8590281 Mar 24 02:16:23.211564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59590) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:23.218319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'network_id': '65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27', 'name': 'tempest-PortsTestJSON-38105215'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:23.226096 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d9f045e9-34dd-41f2-aa86-8fde35f5f12e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6b930bed-5300-4712-88d2-6a5da7d86d4f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.235952 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (23c422ed-55e0-408f-95ff-bc9d2619a936), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.241802 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-938edbf9-4a3c-4764-a31a-c763c5f39d77 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.248214 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68deb3cf-c7af-4dad-81fa-85d57116d1ac None None] Pushing event updated for resources: {'Port': ['ID=0f08083a-2625-4d65-a5a8-d5e9a706fba7,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:23.283097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-938edbf9-4a3c-4764-a31a-c763c5f39d77 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.293120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9f045e9-34dd-41f2-aa86-8fde35f5f12e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=6b930bed-5300-4712-88d2-6a5da7d86d4f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:23.301461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d9f045e9-34dd-41f2-aa86-8fde35f5f12e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.304697 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d9f045e9-34dd-41f2-aa86-8fde35f5f12e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/6b930bed-5300-4712-88d2-6a5da7d86d4f HTTP/1.1" status: 204 len: 168 time: 0.7266281 Mar 24 02:16:23.309213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59592) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:23.325323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Pushing event deleted for resources: {'Port': ['ID=23c422ed-55e0-408f-95ff-bc9d2619a936,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:23.347535 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-938edbf9-4a3c-4764-a31a-c763c5f39d77 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.348590 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-938edbf9-4a3c-4764-a31a-c763c5f39d77 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.4015157 Mar 24 02:16:23.354763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59594) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:23.359388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-303cb5f2-29ff-4943-9134-c1a7b3c2e07d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Deleting port 4f0dd19a-8ffc-4b27-a447-e13ce05d6937 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:23.360244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-303cb5f2-29ff-4943-9134-c1a7b3c2e07d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4f0dd19a-8ffc-4b27-a447-e13ce05d6937), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.363142 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-1228dc29-daf7-45a2-9790-4bdf2cd3d323 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:16:23.364567 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1228dc29-daf7-45a2-9790-4bdf2cd3d323 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/6b930bed-5300-4712-88d2-6a5da7d86d4f HTTP/1.1" status: 404 len: 333 time: 0.0526359 Mar 24 02:16:23.385715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'enable_snat': False}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:23.416299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59596) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:23.468721 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2978799a-f6eb-4e13-985f-9744766465fb req-2ec053b0-57bc-45ae-9bf1-df26db2e83ac service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3789475 Mar 24 02:16:23.473633 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'name': 'tempest-PortsIpV6TestJSON-1322524231'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:23.623341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-303cb5f2-29ff-4943-9134-c1a7b3c2e07d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4f0dd19a-8ffc-4b27-a447-e13ce05d6937), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.657540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-303cb5f2-29ff-4943-9134-c1a7b3c2e07d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Calling delete_port for 4f0dd19a-8ffc-4b27-a447-e13ce05d6937 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:23.757929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:23.761317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:23.819552 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port 5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:23.887531 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-303cb5f2-29ff-4943-9134-c1a7b3c2e07d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (4f0dd19a-8ffc-4b27-a447-e13ce05d6937), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.076888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:24.080367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.108446 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.129898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 23c1ee13-387a-4c11-8171-4e13a4c2b098 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:24.173371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 23c422ed-55e0-408f-95ff-bc9d2619a936 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:24.183109 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3137a0a2-12a0-4b29-a2a1-d525147c97eb req-934bff8b-9a40-4229-a795-82275b167796 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 210 time: 0.0567310 Mar 24 02:16:24.216082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Router 9c57e851-60dd-408a-bb81-1858bda320e9 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:24.224072 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 23c422ed-55e0-408f-95ff-bc9d2619a936 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:24.224539 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 23c422ed-55e0-408f-95ff-bc9d2619a936 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:24.278059 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-303cb5f2-29ff-4943-9134-c1a7b3c2e07d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Port': ['ID=4f0dd19a-8ffc-4b27-a447-e13ce05d6937,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:24.305011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-303cb5f2-29ff-4943-9134-c1a7b3c2e07d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.310501 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-303cb5f2-29ff-4943-9134-c1a7b3c2e07d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/ports/4f0dd19a-8ffc-4b27-a447-e13ce05d6937 HTTP/1.1" status: 204 len: 168 time: 1.3263872 Mar 24 02:16:24.314805 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59600) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:24.427877 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.6 (65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27/eba982ea-a9c2-4a26-a298-c06e00d7fafc/23c1ee13-387a-4c11-8171-4e13a4c2b098) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:24.482439 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:24.484889 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.496375 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] Sync routers for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:24.506418 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:24.507515 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:24.536908 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.544652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e28f9398-85f2-44c2-a4b5-af8728dac45e None None] Network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:24.564980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] No DVR routers for this DVR port 23c422ed-55e0-408f-95ff-bc9d2619a936 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:24.572406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.575928 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fb0dfe26-4373-4e83-a2be-85f3ee923859 req-8ac1570a-ab34-4821-af64-5fab8817b74b tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.30 "DELETE /v2.0/ports/23c422ed-55e0-408f-95ff-bc9d2619a936 HTTP/1.1" status: 204 len: 173 time: 4.2997930 Mar 24 02:16:24.576401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'name': 'network-vif-deleted', 'tag': '23c422ed-55e0-408f-95ff-bc9d2619a936'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:16:24.578719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4404b8e2-501b-40dc-a19a-13e2070a8802" -d '{"events": [{"server_uuid": "0a447b1e-7d9a-43d6-8a64-8ff70a04f466", "name": "network-vif-deleted", "tag": "23c422ed-55e0-408f-95ff-bc9d2619a936"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:16:24.621380 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-9f2ae6e1-78fc-48d2-a98c-44fd439a9b20 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Deleting port e5b55931-71d5-4456-8994-ca0e8441697f {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:24.621960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f2ae6e1-78fc-48d2-a98c-44fd439a9b20 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e5b55931-71d5-4456-8994-ca0e8441697f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.629163 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5934ec34-f484-490d-a0b5-f2f7df9da3c7 None None] Provisioning complete for port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:24.629579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5934ec34-f484-490d-a0b5-f2f7df9da3c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.681970 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:24.715708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:16:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-116b9777-0fbe-4957-b089-a30500766b73 x-openstack-request-id: req-116b9777-0fbe-4957-b089-a30500766b73 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:16:24.716391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0a447b1e-7d9a-43d6-8a64-8ff70a04f466", "name": "network-vif-deleted", "tag": "23c422ed-55e0-408f-95ff-bc9d2619a936", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:16:24.716804 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-116b9777-0fbe-4957-b089-a30500766b73 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:16:24.730187 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-116b9777-0fbe-4957-b089-a30500766b73'] response: {'server_uuid': '0a447b1e-7d9a-43d6-8a64-8ff70a04f466', 'name': 'network-vif-deleted', 'tag': '23c422ed-55e0-408f-95ff-bc9d2619a936', 'status': 'completed', 'code': 200} Mar 24 02:16:24.749712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.808010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:24.825057 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f2ae6e1-78fc-48d2-a98c-44fd439a9b20 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e5b55931-71d5-4456-8994-ca0e8441697f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.827960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:24.841419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:24.846584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:24.847206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.865040 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-9f2ae6e1-78fc-48d2-a98c-44fd439a9b20 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Calling delete_port for e5b55931-71d5-4456-8994-ca0e8441697f owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:24.883623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0f08083a-2625-4d65-a5a8-d5e9a706fba7 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:24.930319 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 1.5123944 Mar 24 02:16:24.930586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-358ba893-2f3b-4d33-9231-c2e857cdc36e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:24.933789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59604) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:24.948060 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.976284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9341a389-53e9-4748-b6b8-28fbae7ff3db tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:24.987681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.988495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:24.989617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.991331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5934ec34-f484-490d-a0b5-f2f7df9da3c7 None None] Current status of the port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:24.992000 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:24.992541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5934ec34-f484-490d-a0b5-f2f7df9da3c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.038917 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-5934ec34-f484-490d-a0b5-f2f7df9da3c7 None None] For port 0f08083a-2625-4d65-a5a8-d5e9a706fba7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0f08083a-2625-4d65-a5a8-d5e9a706fba7,segment=NetworkSegment(30be06be-bf5f-46c8-9dbf-98fbff324f57),segment_id=30be06be-bf5f-46c8-9dbf-98fbff324f57)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:25.064612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5934ec34-f484-490d-a0b5-f2f7df9da3c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.179141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.194124 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9341a389-53e9-4748-b6b8-28fbae7ff3db tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.231323 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5934ec34-f484-490d-a0b5-f2f7df9da3c7 None None] Pushing event updated for resources: {'Port': ['ID=0f08083a-2625-4d65-a5a8-d5e9a706fba7,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:25.238163 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c5cac64d-ded1-48e1-8266-93907d3009e3 None None] Provisioning complete for port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:25.238868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5cac64d-ded1-48e1-8266-93907d3009e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.325360 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3a5a51e0-3aa4-497c-9582-6700ad4f221e', 'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'mac_address': 'fa:16:3e:e4:34:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:05Z', 'revision_number': 5, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'subnets': [{'id': '56374a24-4e35-434f-b4b8-860ef8289893', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:25.333388 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Allocated IP 172.26.2.23 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/5e13531c-8cfc-4d9b-8823-8370e89cba2d) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:25.346119 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:25.348390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=23c1ee13-387a-4c11-8171-4e13a4c2b098,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:25.355512 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:25.358227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:25.413233 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] Checking router: 9c57e851-60dd-408a-bb81-1858bda320e9 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:16:25.415977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f2ae6e1-78fc-48d2-a98c-44fd439a9b20 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (e5b55931-71d5-4456-8994-ca0e8441697f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.436171 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:25.437159 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:25.457943 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:25.458631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.483747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2ae6e1-78fc-48d2-a98c-44fd439a9b20 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Port': ['ID=e5b55931-71d5-4456-8994-ca0e8441697f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:25.488129 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c79a2682-99d8-42ec-85f9-0dc3a1c45523 req-76f2bcb5-8285-439d-97a5-6ed1dc67e61e tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/ports?device_id=0a447b1e-7d9a-43d6-8a64-8ff70a04f466 HTTP/1.1" status: 200 len: 210 time: 0.1012108 Mar 24 02:16:25.522614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9f2ae6e1-78fc-48d2-a98c-44fd439a9b20 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.525927 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9f2ae6e1-78fc-48d2-a98c-44fd439a9b20 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/ports/e5b55931-71d5-4456-8994-ca0e8441697f HTTP/1.1" status: 204 len: 168 time: 1.2099144 Mar 24 02:16:25.528718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59608) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:25.542277 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:25.551927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9341a389-53e9-4748-b6b8-28fbae7ff3db tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.563070 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9341a389-53e9-4748-b6b8-28fbae7ff3db tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.603493 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c5cac64d-ded1-48e1-8266-93907d3009e3 None None] Current status of the port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:25.629549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-9341a389-53e9-4748-b6b8-28fbae7ff3db tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] In _notify_port_updated(), no bound segment for port 5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a on network 8ec9fea4-b38d-4612-9d1d-87145ce2366f {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:16:25.634686 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9341a389-53e9-4748-b6b8-28fbae7ff3db tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:25.635317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9341a389-53e9-4748-b6b8-28fbae7ff3db tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.636665 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9341a389-53e9-4748-b6b8-28fbae7ff3db tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "PUT /v2.0/ports/5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a HTTP/1.1" status: 200 len: 818 time: 0.7004845 Mar 24 02:16:25.636948 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-457e2296-fb4c-4ef2-8d50-68fadd0c5997 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 2.4237821 Mar 24 02:16:25.641077 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59610) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:25.641619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59612) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:25.642137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:25.642489 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.649319 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:25.680954 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3eb99e67-88d4-41ff-a884-374b0ac55a1d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0587599 Mar 24 02:16:25.692715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59616) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:25.697611 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-101541607'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:25.708592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9341a389-53e9-4748-b6b8-28fbae7ff3db tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:25.741201 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Made reservation on behalf of 7ed879a56c604e41a8cd0eb1388b7896 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:25.744516 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.783946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port bdc0750a-cabb-4e17-bcb5-ee00d873a4b6, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=bdc0750a-cabb-4e17-bcb5-ee00d873a4b6,segment=NetworkSegment(9ca3f463-7da4-494a-9476-e461158b9b02),segment_id=9ca3f463-7da4-494a-9476-e461158b9b02)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:25.785344 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.792578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for port (5e13531c-8cfc-4d9b-8823-8370e89cba2d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.793994 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 105} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:25.805260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:25.814331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (8e19689b-fe85-4181-9e33-f7f7477864a4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.814711 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Added segment 8e19689b-fe85-4181-9e33-f7f7477864a4 of type vlan for network 874174ed-3f33-4330-a533-5366863cb45b Mar 24 02:16:25.828914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-401857de-a11d-49d9-ba96-c1b3d3ff518e None None] Provisioning complete for port 23c1ee13-387a-4c11-8171-4e13a4c2b098 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:25.829457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-401857de-a11d-49d9-ba96-c1b3d3ff518e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.875001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-401857de-a11d-49d9-ba96-c1b3d3ff518e None None] Port 23c1ee13-387a-4c11-8171-4e13a4c2b098 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:25.897055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (874174ed-3f33-4330-a533-5366863cb45b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.903361 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3a5a51e0-3aa4-497c-9582-6700ad4f221e', 'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'mac_address': 'fa:16:3e:e4:34:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:05Z', 'revision_number': 5, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'subnets': [{'id': '56374a24-4e35-434f-b4b8-860ef8289893', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:25.934669 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbfade35-a7eb-4dda-a4a7-eebf708639ec None None] The sync data for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv is: [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:11:58Z', 'revision_number': 4, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3a5a51e0-3aa4-497c-9582-6700ad4f221e', 'name': '', 'network_id': '597625fc-4c02-4901-9b3e-46b781f61da1', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'mac_address': 'fa:16:3e:e4:34:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '56374a24-4e35-434f-b4b8-860ef8289893', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:56Z', 'updated_at': '2022-03-24T02:12:05Z', 'revision_number': 5, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'subnets': [{'id': '56374a24-4e35-434f-b4b8-860ef8289893', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:25.937417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (874174ed-3f33-4330-a533-5366863cb45b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:25.943068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:25.943487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.051845 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.3577635 Mar 24 02:16:26.057485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59618) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:26.065180 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-76166115'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:26.066160 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cbf6a40-4b50-42b9-b091-110435c91199 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Network': ['ID=874174ed-3f33-4330-a533-5366863cb45b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:26.071921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3b21e73a-b78a-42d3-a4e6-74c9c30325d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:26.072257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b21e73a-b78a-42d3-a4e6-74c9c30325d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.076565 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 874174ed-3f33-4330-a533-5366863cb45b details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:26.124031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (bdc0750a-cabb-4e17-bcb5-ee00d873a4b6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.153294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5e13531c-8cfc-4d9b-8823-8370e89cba2d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.189215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Made reservation on behalf of 7ed879a56c604e41a8cd0eb1388b7896 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:26.189846 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=bdc0750a-cabb-4e17-bcb5-ee00d873a4b6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:26.192708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.228090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b21e73a-b78a-42d3-a4e6-74c9c30325d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.241468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3b21e73a-b78a-42d3-a4e6-74c9c30325d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:26.306287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (d36063bd-d604-40b2-9839-addfdc6c944c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.312614 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4324ef46-1747-45a6-bf5a-0ba3e51ba387 None None] New status for floating IP 55088382-7ea7-41f1-a0cb-71a22f16598d: DOWN {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:16:26.327921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:26.341668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:26.343561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Pushing event updated for resources: {'Port': ['ID=5e13531c-8cfc-4d9b-8823-8370e89cba2d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:26.345816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:26.397682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 127} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:26.442660 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.442923 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Added segment 1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4 of type vlan for network c85bdd53-60b3-467b-85a9-f43bd640a016 Mar 24 02:16:26.523546 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:26.590662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (c85bdd53-60b3-467b-85a9-f43bd640a016), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.602718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.607593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59624) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:26.615755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:26.623033 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1d8f9d07-354a-450c-b151-7f1e4fca366d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5119648 Mar 24 02:16:26.623304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59626) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:26.628839 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:26.644232 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:26.644467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b21e73a-b78a-42d3-a4e6-74c9c30325d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.644876 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:26.707278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-d8cf6833-e0f9-4d3d-b15d-b46a3aad13be tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting subnet 88bf3d71-7761-47c5-902c-89ab60fdf88d {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:26.711134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8cf6833-e0f9-4d3d-b15d-b46a3aad13be tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (88bf3d71-7761-47c5-902c-89ab60fdf88d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.721163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b21e73a-b78a-42d3-a4e6-74c9c30325d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:26.741196 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:26.760256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (c85bdd53-60b3-467b-85a9-f43bd640a016), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.765429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:26.766085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.769524 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b21e73a-b78a-42d3-a4e6-74c9c30325d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.774256 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3b21e73a-b78a-42d3-a4e6-74c9c30325d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a HTTP/1.1" status: 204 len: 168 time: 1.1269414 Mar 24 02:16:26.776122 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59628) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:26.791958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8cf6833-e0f9-4d3d-b15d-b46a3aad13be tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (88bf3d71-7761-47c5-902c-89ab60fdf88d), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.799130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0f08083a-2625-4d65-a5a8-d5e9a706fba7 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:26.801818 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:26Z', 'revision_number': 11, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:26.829659 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:16:26.839407 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:26.840020 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:26.860175 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:26.860723 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:26.929443 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:26.957881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:26.964263 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11394e34-f43c-4e47-a0bb-e773c576d0fd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:26.965819 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-11394e34-f43c-4e47-a0bb-e773c576d0fd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 847 time: 0.1359015 Mar 24 02:16:26.968772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59630) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:26.998109 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:26Z', 'revision_number': 11, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:27.000923 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-576e4ac4-a6e8-40b5-bc56-20de8018f6d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:16:27.006600 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-576e4ac4-a6e8-40b5-bc56-20de8018f6d5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/5ea9ef9f-c7ba-42bf-8c40-593f7a14dd1a HTTP/1.1" status: 404 len: 333 time: 0.0325830 Mar 24 02:16:27.006600 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59632) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:27.013468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-911850507'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:27.020162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8cf6833-e0f9-4d3d-b15d-b46a3aad13be tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (88bf3d71-7761-47c5-902c-89ab60fdf88d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.028477 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17b989e8-ccf6-4a88-9bbf-619c8c981728 None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:26Z', 'revision_number': 11, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:27.072749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:27.077316 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.120309 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 110} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:27.126132 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8cf6833-e0f9-4d3d-b15d-b46a3aad13be tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (88bf3d71-7761-47c5-902c-89ab60fdf88d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.158138 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e221dabf-7df8-487c-8fe4-ce9f8e5ce00b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.158479 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Added segment e221dabf-7df8-487c-8fe4-ce9f8e5ce00b of type vlan for network b5bcebeb-7196-456e-9a13-3b81957731cd Mar 24 02:16:27.163415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8cf6833-e0f9-4d3d-b15d-b46a3aad13be tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.166683 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d8cf6833-e0f9-4d3d-b15d-b46a3aad13be tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/88bf3d71-7761-47c5-902c-89ab60fdf88d HTTP/1.1" status: 204 len: 168 time: 0.5425096 Mar 24 02:16:27.172504 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd75747b-ee47-4e20-b288-c5568af0d25e None None] Network 2b9b3266-75a3-4535-a81d-5ca19fed980f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:27.175969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8cf6833-e0f9-4d3d-b15d-b46a3aad13be tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Subnet': ['ID=88bf3d71-7761-47c5-902c-89ab60fdf88d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:27.179501 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59634) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:27.276561 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (b5bcebeb-7196-456e-9a13-3b81957731cd), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.294125 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.2354133 Mar 24 02:16:27.312875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (2b9b3266-75a3-4535-a81d-5ca19fed980f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.324223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dac443-eadf-497e-94cc-dc429fc34488 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Network': ['ID=c85bdd53-60b3-467b-85a9-f43bd640a016,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:27.332402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (b5bcebeb-7196-456e-9a13-3b81957731cd), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.337573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:27.338329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.338987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fcf328e9-3ff7-4932-add8-3aaf99767fea tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group (2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.347706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network c85bdd53-60b3-467b-85a9-f43bd640a016 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:27.428888 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.4216237 Mar 24 02:16:27.440783 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59636) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:27.441127 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59638) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:27.447960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'subnets': [{'network_id': '874174ed-3f33-4330-a533-5366863cb45b', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1032498898', 'ip_version': 4}, {'network_id': 'c85bdd53-60b3-467b-85a9-f43bd640a016', 'cidr': '172.20.0.16/28', 'ip_version': 4}]} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:27.448294 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'subnet': {'network_id': '874174ed-3f33-4330-a533-5366863cb45b', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1032498898', 'ip_version': 4}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:27.448825 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Request body: {'subnet': {'network_id': 'c85bdd53-60b3-467b-85a9-f43bd640a016', 'cidr': '172.20.0.16/28', 'ip_version': 4}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:27.455880 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:27.473797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad51fc20-ed94-4e99-8c89-8883b8847894 None None] DHCP port deletion for 2b9b3266-75a3-4535-a81d-5ca19fed980f request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:27.497082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fcf328e9-3ff7-4932-add8-3aaf99767fea tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group (2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.512193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1525de58-c24b-432c-8e2b-957d3b6e0459 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.529506 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router_gateway (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.541963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ad51fc20-ed94-4e99-8c89-8883b8847894 None None] Deleting port 19421d72-7afc-4c39-bbc3-6d060a8307ae {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:27.542329 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ad51fc20-ed94-4e99-8c89-8883b8847894 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.622167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad955148-b8fa-4e21-a031-ec7ff28f44a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Network': ['ID=b5bcebeb-7196-456e-9a13-3b81957731cd,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:27.652215 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network b5bcebeb-7196-456e-9a13-3b81957731cd details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:27.668628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.674049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fcf328e9-3ff7-4932-add8-3aaf99767fea tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.676434 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Deleting port 19421d72-7afc-4c39-bbc3-6d060a8307ae {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:27.676774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.677564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fcf328e9-3ff7-4932-add8-3aaf99767fea tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.678845 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fcf328e9-3ff7-4932-add8-3aaf99767fea tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "DELETE /v2.0/security-groups/2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4 HTTP/1.1" status: 204 len: 168 time: 1.0674880 Mar 24 02:16:27.683775 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.688498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59640) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:27.730659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcf328e9-3ff7-4932-add8-3aaf99767fea tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:27.737566 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ad51fc20-ed94-4e99-8c89-8883b8847894 None None] For port 19421d72-7afc-4c39-bbc3-6d060a8307ae, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=19421d72-7afc-4c39-bbc3-6d060a8307ae,segment=NetworkSegment(9ca3f463-7da4-494a-9476-e461158b9b02),segment_id=9ca3f463-7da4-494a-9476-e461158b9b02)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:27.738549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ad51fc20-ed94-4e99-8c89-8883b8847894 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.750661 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-c2babb9c-88a5-4573-b851-3ccf30b5ea78 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] show failed (client error): The resource could not be found. Mar 24 02:16:27.751832 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c2babb9c-88a5-4573-b851-3ccf30b5ea78 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "GET /v2.0/security-groups/2c91fd94-a07d-48c8-bb23-cbc9c26a7fa4 HTTP/1.1" status: 404 len: 347 time: 0.0595055 Mar 24 02:16:27.757810 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59642) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:27.758478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ad51fc20-ed94-4e99-8c89-8883b8847894 None None] Calling delete_port for 19421d72-7afc-4c39-bbc3-6d060a8307ae owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:27.797717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:27.802395 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.864581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ad51fc20-ed94-4e99-8c89-8883b8847894 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.884661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad51fc20-ed94-4e99-8c89-8883b8847894 None None] No DVR routers for this DVR port 19421d72-7afc-4c39-bbc3-6d060a8307ae on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:27.894563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] For port 19421d72-7afc-4c39-bbc3-6d060a8307ae, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=19421d72-7afc-4c39-bbc3-6d060a8307ae,segment=NetworkSegment(9ca3f463-7da4-494a-9476-e461158b9b02),segment_id=9ca3f463-7da4-494a-9476-e461158b9b02)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:27.894563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.897177 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Made reservation on behalf of 7ed879a56c604e41a8cd0eb1388b7896 for: {'subnet': 2} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:27.900456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.900791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:27.921256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=23c1ee13-387a-4c11-8171-4e13a4c2b098,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:27.936306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad51fc20-ed94-4e99-8c89-8883b8847894 None None] Pushing event deleted for resources: {'Port': ['ID=19421d72-7afc-4c39-bbc3-6d060a8307ae,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:27.969191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Calling delete_port for 19421d72-7afc-4c39-bbc3-6d060a8307ae owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:28.078385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.087226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.127265 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-e330a54b-244b-476b-a882-1e64ed330314 None None] Provisioning complete for port 23c1ee13-387a-4c11-8171-4e13a4c2b098 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:28.127759 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e330a54b-244b-476b-a882-1e64ed330314 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.170505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e330a54b-244b-476b-a882-1e64ed330314 None None] Port 23c1ee13-387a-4c11-8171-4e13a4c2b098 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:28.211362 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Deleting port 7530a9ed-de50-4a2c-af9d-42d050ea9a38 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:28.211700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (7530a9ed-de50-4a2c-af9d-42d050ea9a38), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.234142 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (19421d72-7afc-4c39-bbc3-6d060a8307ae), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.286368 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (7d884862-0b03-425b-8c51-b5475b62ebb4), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.293806 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Port': ['ID=19421d72-7afc-4c39-bbc3-6d060a8307ae,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:28.295634 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No DVR routers for this DVR port 19421d72-7afc-4c39-bbc3-6d060a8307ae on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:28.332963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (832612c5-f8b1-4313-969a-7a9490b97979), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.397684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (7530a9ed-de50-4a2c-af9d-42d050ea9a38), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.398284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for floatingip (7530a9ed-de50-4a2c-af9d-42d050ea9a38), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.425573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Calling delete_port for 7530a9ed-de50-4a2c-af9d-42d050ea9a38 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:28.526693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.532480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Router 18d553cf-62f8-4aff-ae2a-ea1f1f195c9d is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:16:28.685202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:28.712254 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:28.713192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device bdc0750a-cabb-4e17-bcb5-ee00d873a4b6 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:28.713710 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 19421d72-7afc-4c39-bbc3-6d060a8307ae no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:28.733227 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 19421d72-7afc-4c39-bbc3-6d060a8307ae {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:28.733709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 19421d72-7afc-4c39-bbc3-6d060a8307ae not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:28.810799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (2b9b3266-75a3-4535-a81d-5ca19fed980f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.820112 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=832612c5-f8b1-4313-969a-7a9490b97979,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:28.834127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:28.839189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (7530a9ed-de50-4a2c-af9d-42d050ea9a38), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.844262 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fce0c03-f9d7-4dd1-8472-75bcb883d1d3 None None] Sync routers for ids ['18d553cf-62f8-4aff-ae2a-ea1f1f195c9d'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:28.852552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.853775 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d1ea7054-44cd-450a-9703-fe9e6119c6d9 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "PUT /v2.0/routers/18d553cf-62f8-4aff-ae2a-ea1f1f195c9d HTTP/1.1" status: 200 len: 915 time: 5.4910324 Mar 24 02:16:28.860402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fce0c03-f9d7-4dd1-8472-75bcb883d1d3 None None] Routers {'18d553cf-62f8-4aff-ae2a-ea1f1f195c9d'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:28.860655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2b9b3266-75a3-4535-a81d-5ca19fed980f']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:28.861375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-8fce0c03-f9d7-4dd1-8472-75bcb883d1d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['18d553cf-62f8-4aff-ae2a-ea1f1f195c9d'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:28.863475 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59644) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:28.881301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9ca3f463-7da4-494a-9476-e461158b9b02') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:28.881604 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9ca3f463-7da4-494a-9476-e461158b9b02') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:28.899928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-8fce0c03-f9d7-4dd1-8472-75bcb883d1d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:28.908367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Pushing event deleted for resources: {'Port': ['ID=7530a9ed-de50-4a2c-af9d-42d050ea9a38,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:28.908909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fce0c03-f9d7-4dd1-8472-75bcb883d1d3 None None] Routers {'18d553cf-62f8-4aff-ae2a-ea1f1f195c9d'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:28.909529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-8fce0c03-f9d7-4dd1-8472-75bcb883d1d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['18d553cf-62f8-4aff-ae2a-ea1f1f195c9d'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:28.943470 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-8fce0c03-f9d7-4dd1-8472-75bcb883d1d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:28.944192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fce0c03-f9d7-4dd1-8472-75bcb883d1d3 None None] The sync data for ids ['18d553cf-62f8-4aff-ae2a-ea1f1f195c9d'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:28.952383 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Checking segment: {'id': 'e221dabf-7df8-487c-8fe4-ce9f8e5ce00b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:28.952757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network hostable DHCP agents. Network: b5bcebeb-7196-456e-9a13-3b81957731cd, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:28.955951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (9ca3f463-7da4-494a-9476-e461158b9b02), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:28.985355 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (9ca3f463-7da4-494a-9476-e461158b9b02), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.013002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks [] for floatingip (55088382-7ea7-41f1-a0cb-71a22f16598d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.015518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.018343 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8f79f3ea-f0e6-4be4-bfd8-05a3fe7ecfb6 tempest-ServerActionsTestJSON-864517406 tempest-ServerActionsTestJSON-864517406-project] 10.222.0.20 "DELETE /v2.0/floatingips/55088382-7ea7-41f1-a0cb-71a22f16598d HTTP/1.1" status: 204 len: 168 time: 1.2381370 Mar 24 02:16:29.020261 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59646) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:29.025139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Releasing vlan 128 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:29.025538 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (9ca3f463-7da4-494a-9476-e461158b9b02), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:29.028536 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:29.091566 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network b5bcebeb-7196-456e-9a13-3b81957731cd is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:29.101530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.109443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.121421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, b5bcebeb-7196-456e-9a13-3b81957731cd) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:29.129821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:29.130423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.131809 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74c72905-f37c-455c-bbab-effebe39b564 None None] Network b5bcebeb-7196-456e-9a13-3b81957731cd requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:29.155522 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8b262917-a14d-4bcc-83fc-b2254a613076 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/routers/18d553cf-62f8-4aff-ae2a-ea1f1f195c9d HTTP/1.1" status: 200 len: 921 time: 0.2884219 Mar 24 02:16:29.159477 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (2b9b3266-75a3-4535-a81d-5ca19fed980f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.160386 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59648) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:29.177834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.181024 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/networks/2b9b3266-75a3-4535-a81d-5ca19fed980f HTTP/1.1" status: 204 len: 168 time: 2.0007260 Mar 24 02:16:29.197674 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59650) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:29.202588 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'routes': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:29.206285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6f20400-7259-4ba6-9a3c-27b0acfee9eb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Pushing event deleted for resources: {'Network': ['ID=2b9b3266-75a3-4535-a81d-5ca19fed980f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:29.213214 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e3925259-e539-4c98-acef-681059ddcf99 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.7684977 Mar 24 02:16:29.214582 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (f72f7b9f-70e2-4e04-abba-6f8da1164acc), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.215346 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59652) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:29.255303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2a80ab70-f952-4ab3-bebe-b9c5da0c1046 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:29.268113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-b5bcebeb-7196-456e-9a13-3b81957731cd', 'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd', 'project_id': '7b8dee850d65489ba8498576f69edde9', 'fixed_ips': [{'subnet_id': '832612c5-f8b1-4313-969a-7a9490b97979'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:29.269031 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.416518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Allocated IP 2001:db8::2 (b5bcebeb-7196-456e-9a13-3b81957731cd/832612c5-f8b1-4313-969a-7a9490b97979/d697b65f-6ccd-4dc8-a008-bccc8a61f35a) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:29.474030 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Subnet': ['ID=f72f7b9f-70e2-4e04-abba-6f8da1164acc,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:29.520018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.extraroute_db [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Added routes are [] {{(pid=104036) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Mar 24 02:16:29.520377 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.extraroute_db [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Removed routes are [] {{(pid=104036) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Mar 24 02:16:29.520668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.573058 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Checking segment: {'id': '8e19689b-fe85-4181-9e33-f7f7477864a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '874174ed-3f33-4330-a533-5366863cb45b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:29.573459 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Network hostable DHCP agents. Network: 874174ed-3f33-4330-a533-5366863cb45b, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:29.591263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=23c1ee13-387a-4c11-8171-4e13a4c2b098,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:29.593684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (7d884862-0b03-425b-8c51-b5475b62ebb4), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.600141 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Publish callbacks [] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.608348 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.633738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a80ab70-f952-4ab3-bebe-b9c5da0c1046 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:29.637205 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a80ab70-f952-4ab3-bebe-b9c5da0c1046 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.654244 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Network b5bcebeb-7196-456e-9a13-3b81957731cd is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:29.660244 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:29.666443 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:29.673865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Pushing event updated for resources: {'Port': ['ID=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:29.697979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-695002e7-d034-44eb-9af0-d24c41cf6113 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:29.699557 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-695002e7-d034-44eb-9af0-d24c41cf6113 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=18d553cf-62f8-4aff-ae2a-ea1f1f195c9d&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.5360787 Mar 24 02:16:29.727307 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59654) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:29.735287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Attempting to bind port d697b65f-6ccd-4dc8-a008-bccc8a61f35a on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:29.735287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Attempting to bind port d697b65f-6ccd-4dc8-a008-bccc8a61f35a by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'e221dabf-7df8-487c-8fe4-ce9f8e5ce00b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:29.735916 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Attempting to bind port d697b65f-6ccd-4dc8-a008-bccc8a61f35a on network b5bcebeb-7196-456e-9a13-3b81957731cd {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:29.736014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Network 874174ed-3f33-4330-a533-5366863cb45b is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:29.741258 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:29.741455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Checking segment: {'id': 'e221dabf-7df8-487c-8fe4-ce9f8e5ce00b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:29.741977 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.742180 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Bound using segment: {'id': 'e221dabf-7df8-487c-8fe4-ce9f8e5ce00b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:29.742675 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Bound port: d697b65f-6ccd-4dc8-a008-bccc8a61f35a, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e221dabf-7df8-487c-8fe4-ce9f8e5ce00b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:29.743291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.757372 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.762189 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 874174ed-3f33-4330-a533-5366863cb45b) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:29.767978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.770160 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (733f508b-9460-4d27-8ef6-825a90661690), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.789496 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8d23518-9547-499f-923c-f0fbe5ddef2e None None] Network 874174ed-3f33-4330-a533-5366863cb45b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:29.876838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0f7a2ee-a20a-4163-8ad1-0496c032a2e6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:29.877195 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] For port d697b65f-6ccd-4dc8-a008-bccc8a61f35a, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:29.878263 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f0f7a2ee-a20a-4163-8ad1-0496c032a2e6 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/networks/87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 881 time: 0.1500041 Mar 24 02:16:29.883314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59656) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:29.886311 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] For port d697b65f-6ccd-4dc8-a008-bccc8a61f35a, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,segment=NetworkSegment(e221dabf-7df8-487c-8fe4-ce9f8e5ce00b),segment_id=e221dabf-7df8-487c-8fe4-ce9f8e5ce00b)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:29.898349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:29.900581 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:29.923467 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.ipam_backend_mixin [None req-2a80ab70-f952-4ab3-bebe-b9c5da0c1046 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 832612c5-f8b1-4313-969a-7a9490b97979 (CIDR: 2001:db8::/64) Mar 24 02:16:29.924323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event updated for resources: {'Subnet': ['ID=733f508b-9460-4d27-8ef6-825a90661690,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:29.935035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:29.938105 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a80ab70-f952-4ab3-bebe-b9c5da0c1046 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:16:29.938325 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9bfa16a6-9567-4af1-928c-71d395b83a12 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=18d553cf-62f8-4aff-ae2a-ea1f1f195c9d HTTP/1.1" status: 200 len: 205 time: 0.0536885 Mar 24 02:16:29.938711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2a80ab70-f952-4ab3-bebe-b9c5da0c1046 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:29.943164 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59658) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:29.954585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router d36063bd-d604-40b2-9839-addfdc6c944c has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:30.016235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d458b7d-c4d4-4d09-9550-098499144bdb None None] Pushing event updated for resources: {'Port': ['ID=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:30.048033 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2a80ab70-f952-4ab3-bebe-b9c5da0c1046 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.7989469 Mar 24 02:16:30.051160 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59660) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:30.068365 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-874174ed-3f33-4330-a533-5366863cb45b', 'network_id': '874174ed-3f33-4330-a533-5366863cb45b', 'project_id': '7ed879a56c604e41a8cd0eb1388b7896', 'fixed_ips': [{'subnet_id': 'f72f7b9f-70e2-4e04-abba-6f8da1164acc'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:30.069384 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.069757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:30.118933 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Checking segment: {'id': '1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'c85bdd53-60b3-467b-85a9-f43bd640a016'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:30.119295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Network hostable DHCP agents. Network: c85bdd53-60b3-467b-85a9-f43bd640a016, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:30.123224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.227094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Router 7d884862-0b03-425b-8c51-b5475b62ebb4 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:16:30.296000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Allocated IP 172.20.0.2 (874174ed-3f33-4330-a533-5366863cb45b/f72f7b9f-70e2-4e04-abba-6f8da1164acc/c0044818-8b56-440a-a0bb-26a7235b9375) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:30.378566 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Network c85bdd53-60b3-467b-85a9-f43bd640a016 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:30.383108 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:30.387316 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:30.389234 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5da2f441-cf88-4016-89e1-709723b09b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "PUT /v2.0/routers/7d884862-0b03-425b-8c51-b5475b62ebb4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7422125 Mar 24 02:16:30.392536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (9c57e851-60dd-408a-bb81-1858bda320e9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.395263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59662) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:30.403832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.405363 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0871c234-bd89-4d44-ac15-038b1f7b9675 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c HTTP/1.1" status: 200 len: 704 time: 1.2067409 Mar 24 02:16:30.405891 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-549db80b-6154-4dc7-b91c-fba29b3721ff None None] Sync routers for ids ['7d884862-0b03-425b-8c51-b5475b62ebb4'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:30.410074 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59664) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:30.420441 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-549db80b-6154-4dc7-b91c-fba29b3721ff None None] Routers {'7d884862-0b03-425b-8c51-b5475b62ebb4'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:30.421434 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-549db80b-6154-4dc7-b91c-fba29b3721ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7d884862-0b03-425b-8c51-b5475b62ebb4'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:30.449763 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8df50885-2629-4359-a31f-cfd3589f19f7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=d36063bd-d604-40b2-9839-addfdc6c944c HTTP/1.1" status: 200 len: 205 time: 0.0312648 Mar 24 02:16:30.457478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59666) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:30.459835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, c85bdd53-60b3-467b-85a9-f43bd640a016) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:30.478829 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-549db80b-6154-4dc7-b91c-fba29b3721ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:30.486762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:30.487270 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:30.487902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.491886 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-549db80b-6154-4dc7-b91c-fba29b3721ff None None] Routers {'7d884862-0b03-425b-8c51-b5475b62ebb4'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:30.494622 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-549db80b-6154-4dc7-b91c-fba29b3721ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7d884862-0b03-425b-8c51-b5475b62ebb4'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:30.542022 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-549db80b-6154-4dc7-b91c-fba29b3721ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:30.542767 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-549db80b-6154-4dc7-b91c-fba29b3721ff None None] The sync data for ids ['7d884862-0b03-425b-8c51-b5475b62ebb4'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:30.601184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92d8a392-c8fc-477b-a241-4d1c4c055142 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:30.613737 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9738bb78-bf2a-4613-bad1-0542cb61598d tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1426 time: 3.1624517 Mar 24 02:16:30.613984 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-92d8a392-c8fc-477b-a241-4d1c4c055142 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports?device_id=7d884862-0b03-425b-8c51-b5475b62ebb4 HTTP/1.1" status: 200 len: 980 time: 0.2114964 Mar 24 02:16:30.613984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59668) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:30.613984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59670) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:30.623015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ce2be1bd-ff0b-4cb6-bdd1-4714fcfec47d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (d36063bd-d604-40b2-9839-addfdc6c944c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.627391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.702473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:30.711211 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b44879a-cea8-4365-8b7f-dd8e18a1799f None None] Network c85bdd53-60b3-467b-85a9-f43bd640a016 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:30.715191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.720865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] Sync routers for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:30.782055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4d2a5862-1100-498f-a01e-91efd8d63a82 None None] Provisioning complete for port 23c1ee13-387a-4c11-8171-4e13a4c2b098 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:30.782775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4d2a5862-1100-498f-a01e-91efd8d63a82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.821673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f710375-ccce-40f1-9d73-fa06617a598f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:30.822358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d697b65f-6ccd-4dc8-a008-bccc8a61f35a up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:30.823125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f710375-ccce-40f1-9d73-fa06617a598f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:30.824434 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f710375-ccce-40f1-9d73-fa06617a598f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:30.826028 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3f710375-ccce-40f1-9d73-fa06617a598f tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2052 time: 0.1962061 Mar 24 02:16:30.852799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59672) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:30.877322 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:30.878631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:30.897766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a9320b28-faf7-4a4f-b040-5795f0d3b90c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:30.998392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Publish callbacks [] for port (c0044818-8b56-440a-a0bb-26a7235b9375), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.007031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-1c500c56-3138-4512-bdd6-41661c9612fe tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Deleting subnet f72f7b9f-70e2-4e04-abba-6f8da1164acc {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:31.016650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.025841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1c500c56-3138-4512-bdd6-41661c9612fe tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for subnet (f72f7b9f-70e2-4e04-abba-6f8da1164acc), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.032041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (c0044818-8b56-440a-a0bb-26a7235b9375), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.033945 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4d2a5862-1100-498f-a01e-91efd8d63a82 None None] Port 23c1ee13-387a-4c11-8171-4e13a4c2b098 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:31.038885 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:31.139873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:26Z', 'revision_number': 11, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:31.145707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1c500c56-3138-4512-bdd6-41661c9612fe tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (f72f7b9f-70e2-4e04-abba-6f8da1164acc), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.189539 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Network 874174ed-3f33-4330-a533-5366863cb45b is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:31.213631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:31.217429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] Checking router: d36063bd-d604-40b2-9839-addfdc6c944c for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:16:31.220824 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:31.233754 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Pushing event updated for resources: {'Port': ['ID=c0044818-8b56-440a-a0bb-26a7235b9375,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:31.244830 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-c85bdd53-60b3-467b-85a9-f43bd640a016', 'network_id': 'c85bdd53-60b3-467b-85a9-f43bd640a016', 'project_id': '7ed879a56c604e41a8cd0eb1388b7896', 'fixed_ips': [{'subnet_id': '733f508b-9460-4d27-8ef6-825a90661690'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:31.245763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.262136 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d697b65f-6ccd-4dc8-a008-bccc8a61f35a triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:31.262620 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.302885 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] Routers {'d36063bd-d604-40b2-9839-addfdc6c944c'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:31.303615 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d36063bd-d604-40b2-9839-addfdc6c944c'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:31.317245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ce2be1bd-ff0b-4cb6-bdd1-4714fcfec47d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.320300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ce2be1bd-ff0b-4cb6-bdd1-4714fcfec47d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (d36063bd-d604-40b2-9839-addfdc6c944c), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.329745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1c500c56-3138-4512-bdd6-41661c9612fe tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (f72f7b9f-70e2-4e04-abba-6f8da1164acc), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.450803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ce2be1bd-ff0b-4cb6-bdd1-4714fcfec47d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (d36063bd-d604-40b2-9839-addfdc6c944c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.452560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce2be1bd-ff0b-4cb6-bdd1-4714fcfec47d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Fanout notify agent at l3_agent the message router_deleted on router d36063bd-d604-40b2-9839-addfdc6c944c {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:16:31.478430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] Set router d36063bd-d604-40b2-9839-addfdc6c944c gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:31.481375 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ce2be1bd-ff0b-4cb6-bdd1-4714fcfec47d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.482268 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Deleting port 3a5a51e0-3aa4-497c-9582-6700ad4f221e {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:31.482770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.483106 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ce2be1bd-ff0b-4cb6-bdd1-4714fcfec47d tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c HTTP/1.1" status: 204 len: 168 time: 1.0236681 Mar 24 02:16:31.487667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1c500c56-3138-4512-bdd6-41661c9612fe tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (f72f7b9f-70e2-4e04-abba-6f8da1164acc), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.487884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59674) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:31.491040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Attempting to bind port c0044818-8b56-440a-a0bb-26a7235b9375 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:31.491420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Attempting to bind port c0044818-8b56-440a-a0bb-26a7235b9375 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '8e19689b-fe85-4181-9e33-f7f7477864a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '874174ed-3f33-4330-a533-5366863cb45b'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:31.491785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Attempting to bind port c0044818-8b56-440a-a0bb-26a7235b9375 on network 874174ed-3f33-4330-a533-5366863cb45b {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:31.496406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-33d4ae58-fbae-40dc-94ce-b831fad61328 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1977085009', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:31.499540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Deleting port 5e13531c-8cfc-4d9b-8823-8370e89cba2d {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:31.500057 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5e13531c-8cfc-4d9b-8823-8370e89cba2d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.565997 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa1d1e94-341a-4ca2-a508-b16e532f9596 None None] Network b5bcebeb-7196-456e-9a13-3b81957731cd requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:31.573801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c500c56-3138-4512-bdd6-41661c9612fe tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Subnet': ['ID=f72f7b9f-70e2-4e04-abba-6f8da1164acc,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:31.585206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:31.585581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Checking segment: {'id': '8e19689b-fe85-4181-9e33-f7f7477864a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '874174ed-3f33-4330-a533-5366863cb45b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:31.585985 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.586382 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Bound using segment: {'id': '8e19689b-fe85-4181-9e33-f7f7477864a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '874174ed-3f33-4330-a533-5366863cb45b'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:31.586902 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Bound port: c0044818-8b56-440a-a0bb-26a7235b9375, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e19689b-fe85-4181-9e33-f7f7477864a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '874174ed-3f33-4330-a533-5366863cb45b'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:31.587286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c0044818-8b56-440a-a0bb-26a7235b9375), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.589215 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:26Z', 'revision_number': 11, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:31.592617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1c500c56-3138-4512-bdd6-41661c9612fe tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.596158 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1c500c56-3138-4512-bdd6-41661c9612fe tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/subnets/f72f7b9f-70e2-4e04-abba-6f8da1164acc HTTP/1.1" status: 204 len: 168 time: 0.7420001 Mar 24 02:16:31.599093 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59676) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:31.619613 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33d4ae58-fbae-40dc-94ce-b831fad61328 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.621301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33d4ae58-fbae-40dc-94ce-b831fad61328 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.669676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40461295-ac5f-4093-985e-f5420396ce5d None None] The sync data for ids ['d36063bd-d604-40b2-9839-addfdc6c944c'] in dv-neutron-834874-3-hyperv is: [{'id': 'd36063bd-d604-40b2-9839-addfdc6c944c', 'name': 'tempest-RoutersIpV6Test-router-552916328', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:05Z', 'updated_at': '2022-03-24T02:16:26Z', 'revision_number': 11, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:31.689399 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5e13531c-8cfc-4d9b-8823-8370e89cba2d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.702034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-66e1b3b9-9f4f-48db-a138-06a150545a94 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Deleting subnet 733f508b-9460-4d27-8ef6-825a90661690 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:31.729513 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Calling delete_port for 5e13531c-8cfc-4d9b-8823-8370e89cba2d owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:31.769040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a21bf4e7-3294-4816-b646-d4d39aa1ea91 None None] Provisioning complete for port d697b65f-6ccd-4dc8-a008-bccc8a61f35a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:31.769401 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a21bf4e7-3294-4816-b646-d4d39aa1ea91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.844401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.850489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d697b65f-6ccd-4dc8-a008-bccc8a61f35a is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:31.850489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.854046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Allocated IP 172.20.0.18 (c85bdd53-60b3-467b-85a9-f43bd640a016/733f508b-9460-4d27-8ef6-825a90661690/25f49554-2686-4c7a-ab6d-5a80d178bf36) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:31.887536 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] For port c0044818-8b56-440a-a0bb-26a7235b9375, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:31.897985 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network b5bcebeb-7196-456e-9a13-3b81957731cd is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:31.906921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:31.921667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] For port c0044818-8b56-440a-a0bb-26a7235b9375, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c0044818-8b56-440a-a0bb-26a7235b9375,segment=NetworkSegment(8e19689b-fe85-4181-9e33-f7f7477864a4),segment_id=8e19689b-fe85-4181-9e33-f7f7477864a4)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:31.946028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:31.946713 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.973227 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:31.980692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c0044818-8b56-440a-a0bb-26a7235b9375), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:31.982614 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-609b02ac-714b-4d2f-a864-e64a14504ea3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.9190114 Mar 24 02:16:31.985527 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59678) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:31.992771 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd', 'fixed_ips': [{'subnet_id': '832612c5-f8b1-4313-969a-7a9490b97979'}, {'subnet_id': '5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa'}], 'name': 'tempest-PortsIpV6TestJSON-357430479'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:32.036308 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d697b65f-6ccd-4dc8-a008-bccc8a61f35a, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,segment=NetworkSegment(e221dabf-7df8-487c-8fe4-ce9f8e5ce00b),segment_id=e221dabf-7df8-487c-8fe4-ce9f8e5ce00b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:32.057238 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.124162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] For port 3a5a51e0-3aa4-497c-9582-6700ad4f221e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3a5a51e0-3aa4-497c-9582-6700ad4f221e,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:32.124899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.133925 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (5e13531c-8cfc-4d9b-8823-8370e89cba2d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.167680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33d4ae58-fbae-40dc-94ce-b831fad61328 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.168626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Calling delete_port for 3a5a51e0-3aa4-497c-9582-6700ad4f221e owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:32.171208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (7d884862-0b03-425b-8c51-b5475b62ebb4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.178546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33d4ae58-fbae-40dc-94ce-b831fad61328 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.179593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event deleted for resources: {'Port': ['ID=5e13531c-8cfc-4d9b-8823-8370e89cba2d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:32.234309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327382d3-c3e5-4d9a-8add-276d26b682be None None] Pushing event updated for resources: {'Port': ['ID=c0044818-8b56-440a-a0bb-26a7235b9375,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:32.260349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:32.324799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33d4ae58-fbae-40dc-94ce-b831fad61328 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.329217 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-33d4ae58-fbae-40dc-94ce-b831fad61328 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.8362861 Mar 24 02:16:32.330003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59680) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:32.337067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a913a229-d09d-4dbc-885f-3c9c3443e50f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Request body: {'router': {'admin_state_up': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:32.393390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.479561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ab862c2-c29a-42a6-84fc-542336bc70e6 None None] Network b5bcebeb-7196-456e-9a13-3b81957731cd requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:32.560618 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a21bf4e7-3294-4816-b646-d4d39aa1ea91 None None] Current status of the port d697b65f-6ccd-4dc8-a008-bccc8a61f35a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:32.608466 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3a5a51e0-3aa4-497c-9582-6700ad4f221e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.608640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.615017 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.619395 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.619879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea6836d3-9808-4ece-b082-5697a0fe5577 None None] Network 874174ed-3f33-4330-a533-5366863cb45b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:32.630043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.641689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Pushing event deleted for resources: {'Port': ['ID=3a5a51e0-3aa4-497c-9582-6700ad4f221e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:32.699428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port ac55636d-05b0-427e-819a-3f1e8335d3af yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:32.719087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 23c1ee13-387a-4c11-8171-4e13a4c2b098 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:32.719515 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.724306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:32.741705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Publish callbacks [] for port (25f49554-2686-4c7a-ab6d-5a80d178bf36), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.761417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (25f49554-2686-4c7a-ab6d-5a80d178bf36), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.770010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66e1b3b9-9f4f-48db-a138-06a150545a94 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for subnet (733f508b-9460-4d27-8ef6-825a90661690), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.770337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-344ff803-915e-435d-9515-893e3d5ad976 None None] Provisioning complete for port d697b65f-6ccd-4dc8-a008-bccc8a61f35a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:32.770745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-344ff803-915e-435d-9515-893e3d5ad976 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.802668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (18d553cf-62f8-4aff-ae2a-ea1f1f195c9d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.803304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Fanout notify agent at l3_agent the message router_deleted on router 18d553cf-62f8-4aff-ae2a-ea1f1f195c9d {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:16:32.817819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.818924 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7261631c-59d2-4f98-8897-3c91bd20fb1e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/18d553cf-62f8-4aff-ae2a-ea1f1f195c9d HTTP/1.1" status: 204 len: 168 time: 2.8748291 Mar 24 02:16:32.840803 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59682) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:32.860809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a913a229-d09d-4dbc-885f-3c9c3443e50f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.879931 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1441502596', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:32.884863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Network c85bdd53-60b3-467b-85a9-f43bd640a016 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:32.890746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66e1b3b9-9f4f-48db-a138-06a150545a94 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (733f508b-9460-4d27-8ef6-825a90661690), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.904429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:32.919823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a913a229-d09d-4dbc-885f-3c9c3443e50f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:32.926930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:32.948822 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Pushing event updated for resources: {'Port': ['ID=25f49554-2686-4c7a-ab6d-5a80d178bf36,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:32.975297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (9c57e851-60dd-408a-bb81-1858bda320e9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.005492 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (753e4246-fa2c-4d05-b7ab-cb00c73407bb), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.007012 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (753e4246-fa2c-4d05-b7ab-cb00c73407bb), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.012418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.037136 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Attempting to bind port 25f49554-2686-4c7a-ab6d-5a80d178bf36 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:33.037529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Attempting to bind port 25f49554-2686-4c7a-ab6d-5a80d178bf36 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'c85bdd53-60b3-467b-85a9-f43bd640a016'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:33.037970 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Attempting to bind port 25f49554-2686-4c7a-ab6d-5a80d178bf36 on network c85bdd53-60b3-467b-85a9-f43bd640a016 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:33.054232 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:33.054638 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Checking segment: {'id': '1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'c85bdd53-60b3-467b-85a9-f43bd640a016'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:33.055055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.055540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Bound using segment: {'id': '1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'c85bdd53-60b3-467b-85a9-f43bd640a016'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:33.056043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Bound port: 25f49554-2686-4c7a-ab6d-5a80d178bf36, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'c85bdd53-60b3-467b-85a9-f43bd640a016'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:33.056420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (25f49554-2686-4c7a-ab6d-5a80d178bf36), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.057393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 23c1ee13-387a-4c11-8171-4e13a4c2b098 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:33.156246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-344ff803-915e-435d-9515-893e3d5ad976 None None] Current status of the port d697b65f-6ccd-4dc8-a008-bccc8a61f35a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:33.169705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66e1b3b9-9f4f-48db-a138-06a150545a94 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (733f508b-9460-4d27-8ef6-825a90661690), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.203982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a26cb499-0de7-40c8-b76a-b9d6ec285c17 None None] Update dhcp port {'port': {'network_id': 'b5bcebeb-7196-456e-9a13-3b81957731cd', 'fixed_ips': [{'subnet_id': '832612c5-f8b1-4313-969a-7a9490b97979', 'ip_address': '2001:db8::2'}, {'subnet_id': '5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': 'd697b65f-6ccd-4dc8-a008-bccc8a61f35a'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:16:33.231374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (753e4246-fa2c-4d05-b7ab-cb00c73407bb), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.236766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a26cb499-0de7-40c8-b76a-b9d6ec285c17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.263903 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a913a229-d09d-4dbc-885f-3c9c3443e50f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Router 0dfff8b1-c688-4f21-96fa-3ded4d48b00f is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:16:33.397936 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] For port 25f49554-2686-4c7a-ab6d-5a80d178bf36, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:33.405789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66e1b3b9-9f4f-48db-a138-06a150545a94 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (733f508b-9460-4d27-8ef6-825a90661690), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.415231 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] For port 25f49554-2686-4c7a-ab6d-5a80d178bf36, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=25f49554-2686-4c7a-ab6d-5a80d178bf36,segment=NetworkSegment(1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4),segment_id=1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:33.415653 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a913a229-d09d-4dbc-885f-3c9c3443e50f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:33.425972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (25f49554-2686-4c7a-ab6d-5a80d178bf36), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.427954 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b74b204-d274-429c-90fb-954172ed443b None None] Sync routers for ids ['0dfff8b1-c688-4f21-96fa-3ded4d48b00f'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:33.437519 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a913a229-d09d-4dbc-885f-3c9c3443e50f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.438763 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a913a229-d09d-4dbc-885f-3c9c3443e50f tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "PUT /v2.0/routers/0dfff8b1-c688-4f21-96fa-3ded4d48b00f HTTP/1.1" status: 200 len: 698 time: 1.1054399 Mar 24 02:16:33.443922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59684) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:33.445451 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b74b204-d274-429c-90fb-954172ed443b None None] Routers {'0dfff8b1-c688-4f21-96fa-3ded4d48b00f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:33.446245 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-7b74b204-d274-429c-90fb-954172ed443b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['0dfff8b1-c688-4f21-96fa-3ded4d48b00f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:33.469862 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66e1b3b9-9f4f-48db-a138-06a150545a94 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Subnet': ['ID=733f508b-9460-4d27-8ef6-825a90661690,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:33.482913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66e1b3b9-9f4f-48db-a138-06a150545a94 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.486398 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-66e1b3b9-9f4f-48db-a138-06a150545a94 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/subnets/733f508b-9460-4d27-8ef6-825a90661690 HTTP/1.1" status: 204 len: 168 time: 1.8863413 Mar 24 02:16:33.494208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec893411-b2ee-40c8-a89c-ca5950e8c41f None None] Pushing event updated for resources: {'Port': ['ID=25f49554-2686-4c7a-ab6d-5a80d178bf36,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:33.494912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59686) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:33.513464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::3a1 (b5bcebeb-7196-456e-9a13-3b81957731cd/832612c5-f8b1-4313-969a-7a9490b97979/ac55636d-05b0-427e-819a-3f1e8335d3af) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:33.548798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8:0:1::321 (b5bcebeb-7196-456e-9a13-3b81957731cd/5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa/ac55636d-05b0-427e-819a-3f1e8335d3af) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:33.571633 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-7b74b204-d274-429c-90fb-954172ed443b None None] Set router 0dfff8b1-c688-4f21-96fa-3ded4d48b00f gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:33.602781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (753e4246-fa2c-4d05-b7ab-cb00c73407bb), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.615382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d83b56c8-0113-4492-88a1-93ba12dfcaa5 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:33.617710 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d83b56c8-0113-4492-88a1-93ba12dfcaa5 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1064427 Mar 24 02:16:33.622952 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59688) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:33.637579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-79d6b3fd-0d35-4e29-9f40-448a55aa999a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/routers/0dfff8b1-c688-4f21-96fa-3ded4d48b00f HTTP/1.1" status: 200 len: 704 time: 0.1902926 Mar 24 02:16:33.644548 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59690) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:33.664631 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-7b74b204-d274-429c-90fb-954172ed443b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0dfff8b1-c688-4f21-96fa-3ded4d48b00f', 'name': 'tempest-RoutersIpV6Test-router-1977085009', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:16:31Z', 'updated_at': '2022-03-24T02:16:32Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:33.713544 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b74b204-d274-429c-90fb-954172ed443b None None] Checking router: 0dfff8b1-c688-4f21-96fa-3ded4d48b00f for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:16:33.716938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.726888 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b74b204-d274-429c-90fb-954172ed443b None None] Routers {'0dfff8b1-c688-4f21-96fa-3ded4d48b00f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:33.729178 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-7b74b204-d274-429c-90fb-954172ed443b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['0dfff8b1-c688-4f21-96fa-3ded4d48b00f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:33.778959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (c85bdd53-60b3-467b-85a9-f43bd640a016), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.793493 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b0f69770-6327-40e7-989d-085efd3fb6c3 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=0dfff8b1-c688-4f21-96fa-3ded4d48b00f HTTP/1.1" status: 200 len: 205 time: 0.1442409 Mar 24 02:16:33.800144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59692) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:33.854971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Router 9c57e851-60dd-408a-bb81-1858bda320e9 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:33.864109 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (23c1ee13-387a-4c11-8171-4e13a4c2b098), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.952101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.957612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9a0a5a-786c-4bd4-962f-5c6981993ab9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:33.988593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=23c1ee13-387a-4c11-8171-4e13a4c2b098,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:33.994604 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-7b74b204-d274-429c-90fb-954172ed443b None None] Set router 0dfff8b1-c688-4f21-96fa-3ded4d48b00f gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:34.050262 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-7b74b204-d274-429c-90fb-954172ed443b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0dfff8b1-c688-4f21-96fa-3ded4d48b00f', 'name': 'tempest-RoutersIpV6Test-router-1977085009', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:16:31Z', 'updated_at': '2022-03-24T02:16:32Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:34.082990 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b74b204-d274-429c-90fb-954172ed443b None None] The sync data for ids ['0dfff8b1-c688-4f21-96fa-3ded4d48b00f'] in dv-neutron-834874-3-hyperv is: [{'id': '0dfff8b1-c688-4f21-96fa-3ded4d48b00f', 'name': 'tempest-RoutersIpV6Test-router-1977085009', 'tenant_id': 'ad85d379c34c467487816ef2bb559f24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:16:31Z', 'updated_at': '2022-03-24T02:16:32Z', 'revision_number': 2, 'project_id': 'ad85d379c34c467487816ef2bb559f24', 'gw_port_host': None}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:34.186101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.194759 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-a26cb499-0de7-40c8-b76a-b9d6ec285c17 None None] Allocated IP 2001:db8:0:1::2 (b5bcebeb-7196-456e-9a13-3b81957731cd/5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa/d697b65f-6ccd-4dc8-a008-bccc8a61f35a) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:34.243799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9a0a5a-786c-4bd4-962f-5c6981993ab9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.248035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Deleting port 25f49554-2686-4c7a-ab6d-5a80d178bf36 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:34.248372 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (25f49554-2686-4c7a-ab6d-5a80d178bf36), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.250690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9a0a5a-786c-4bd4-962f-5c6981993ab9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router_controller (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.287229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network b5bcebeb-7196-456e-9a13-3b81957731cd is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:34.352584 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a26cb499-0de7-40c8-b76a-b9d6ec285c17 None None] For port d697b65f-6ccd-4dc8-a008-bccc8a61f35a, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,segment=NetworkSegment(e221dabf-7df8-487c-8fe4-ce9f8e5ce00b),segment_id=e221dabf-7df8-487c-8fe4-ce9f8e5ce00b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:34.362797 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:34.365454 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:34.371289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:34.371979 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.390133 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=ac55636d-05b0-427e-819a-3f1e8335d3af,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:34.418821 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-05c36348-9742-452b-ae15-09f0d8bd2756 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1016 time: 2.4289300 Mar 24 02:16:34.420314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59694) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:34.424690 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a26cb499-0de7-40c8-b76a-b9d6ec285c17 None None] Publish callbacks [] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.425483 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9a0a5a-786c-4bd4-962f-5c6981993ab9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (0dfff8b1-c688-4f21-96fa-3ded4d48b00f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.426062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d9a0a5a-786c-4bd4-962f-5c6981993ab9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Fanout notify agent at l3_agent the message router_deleted on router 0dfff8b1-c688-4f21-96fa-3ded4d48b00f {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:16:34.434264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '832612c5-f8b1-4313-969a-7a9490b97979'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:34.435430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a26cb499-0de7-40c8-b76a-b9d6ec285c17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.443948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9a0a5a-786c-4bd4-962f-5c6981993ab9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.450474 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6d9a0a5a-786c-4bd4-962f-5c6981993ab9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/0dfff8b1-c688-4f21-96fa-3ded4d48b00f HTTP/1.1" status: 204 len: 168 time: 0.6453650 Mar 24 02:16:34.460193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59696) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:34.511075 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a26cb499-0de7-40c8-b76a-b9d6ec285c17 None None] Pushing event updated for resources: {'Port': ['ID=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:34.529938 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-077ad608-2312-49b4-b654-014165701dd1 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=0dfff8b1-c688-4f21-96fa-3ded4d48b00f HTTP/1.1" status: 200 len: 205 time: 0.0698972 Mar 24 02:16:34.534196 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59698) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:34.543544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] For port 25f49554-2686-4c7a-ab6d-5a80d178bf36, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=25f49554-2686-4c7a-ab6d-5a80d178bf36,segment=NetworkSegment(1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4),segment_id=1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:34.543941 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (25f49554-2686-4c7a-ab6d-5a80d178bf36), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.602298 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-80ae0841-0b18-44f9-b0db-9b1badcabbcc tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] delete failed (client error): The resource could not be found. Mar 24 02:16:34.603384 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-80ae0841-0b18-44f9-b0db-9b1badcabbcc tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/0dfff8b1-c688-4f21-96fa-3ded4d48b00f HTTP/1.1" status: 404 len: 336 time: 0.0662956 Mar 24 02:16:34.604362 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Calling delete_port for 25f49554-2686-4c7a-ab6d-5a80d178bf36 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:34.628452 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59700) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:34.680673 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-fc6a5ce8-9632-460b-9c6b-ac0a853f59ac tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:34.681122 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fc6a5ce8-9632-460b-9c6b-ac0a853f59ac tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:34.686096 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fc6a5ce8-9632-460b-9c6b-ac0a853f59ac tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/a7c72fce-ef84-4709-a1ef-6dc870f90812 HTTP/1.1" status: 404 len: 337 time: 0.0547364 Mar 24 02:16:34.692052 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59702) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:34.694441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.778771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (7d884862-0b03-425b-8c51-b5475b62ebb4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.781443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:34.792611 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c7f0eb07-c082-46c8-b0f7-ec8ea6425084 admin admin] 10.222.0.20 "PUT /v2.0/routers/9c57e851-60dd-408a-bb81-1858bda320e9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7691960 Mar 24 02:16:34.797554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59704) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:34.798412 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] Sync routers for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:34.821313 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:34.822760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:34.822893 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c2284e1-3da0-4e83-8e35-4a704a6a55af tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:34.823452 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2c2284e1-3da0-4e83-8e35-4a704a6a55af tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:34.827584 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2c2284e1-3da0-4e83-8e35-4a704a6a55af tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/26e1ee63-7d8e-4edb-a909-6a9a796c2d5b HTTP/1.1" status: 404 len: 337 time: 0.1304564 Mar 24 02:16:34.835584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (25f49554-2686-4c7a-ab6d-5a80d178bf36), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:34.854728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59706) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:34.883396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] No DVR routers for this DVR port 25f49554-2686-4c7a-ab6d-5a80d178bf36 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:35.006197 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (753e4246-fa2c-4d05-b7ab-cb00c73407bb), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:35.017181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f0ff2c1-271e-4f73-8eb5-38d97ed7187e None None] Network c85bdd53-60b3-467b-85a9-f43bd640a016 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:35.019861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d697b65f-6ccd-4dc8-a008-bccc8a61f35a up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:35.036689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:35.141357 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f7b29527-a2d5-4a4d-993b-99f140909b87 None None] Could not find standard attr ID for object 25f49554-2686-4c7a-ab6d-5a80d178bf36. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:16:35.179750 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:35.255083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Router 7d884862-0b03-425b-8c51-b5475b62ebb4 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:35.280680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks [] for router (9c57e851-60dd-408a-bb81-1858bda320e9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:35.304526 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Delete allocated IP 2001:db8:0:1::321 (b5bcebeb-7196-456e-9a13-3b81957731cd/5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa) {{(pid=104036) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Mar 24 02:16:35.355462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Allocated IP 172.26.2.67 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/b92fd0e6-70ba-4c1f-a8c1-d561140f1290) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:35.437360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Port': ['ID=25f49554-2686-4c7a-ab6d-5a80d178bf36,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:35.465564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d697b65f-6ccd-4dc8-a008-bccc8a61f35a triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:35.466160 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-613a48de-5c1f-47b1-b303-eec423808147 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:35.466270 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-613a48de-5c1f-47b1-b303-eec423808147 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:35.467045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:35.469640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdcf0b47-836a-4688-a0d5-9de47f704200 None None] DHCP port deletion for c85bdd53-60b3-467b-85a9-f43bd640a016 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:35.474791 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-613a48de-5c1f-47b1-b303-eec423808147 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/7a9cb681-7c90-4932-bab9-71e68608b7fe HTTP/1.1" status: 404 len: 337 time: 0.5999210 Mar 24 02:16:35.477891 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59708) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:35.535638 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-686d122f-15d0-4e07-b6fd-f6fe948fe32e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:35.536124 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-686d122f-15d0-4e07-b6fd-f6fe948fe32e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:35.541665 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-686d122f-15d0-4e07-b6fd-f6fe948fe32e tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/88bf3d71-7761-47c5-902c-89ab60fdf88d HTTP/1.1" status: 404 len: 337 time: 0.0583222 Mar 24 02:16:35.543008 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59710) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:35.590912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:35.603592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:35.610682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:16:32Z', 'revision_number': 5, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:35.658176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] Checking router: 9c57e851-60dd-408a-bb81-1858bda320e9 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:16:35.661655 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-de5071b8-0e10-4560-9fea-5e880dd4aceb None None] Provisioning complete for port d697b65f-6ccd-4dc8-a008-bccc8a61f35a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:35.662033 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de5071b8-0e10-4560-9fea-5e880dd4aceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:35.674753 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7480b069-3b5b-4d52-940c-e9ac9a9662e9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=d36063bd-d604-40b2-9839-addfdc6c944c HTTP/1.1" status: 200 len: 205 time: 0.1281757 Mar 24 02:16:35.711921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59712) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:35.728858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] Routers {'9c57e851-60dd-408a-bb81-1858bda320e9'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:35.729513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['9c57e851-60dd-408a-bb81-1858bda320e9'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:35.762438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for port (b92fd0e6-70ba-4c1f-a8c1-d561140f1290), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:35.865258 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-352d72af-07f3-4456-b9d9-1c410fe3e1cf tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] delete failed (client error): The resource could not be found. Mar 24 02:16:35.869145 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-352d72af-07f3-4456-b9d9-1c410fe3e1cf tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/d36063bd-d604-40b2-9839-addfdc6c944c HTTP/1.1" status: 404 len: 336 time: 0.0786979 Mar 24 02:16:35.869739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59714) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:35.906201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:35.908264 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (b92fd0e6-70ba-4c1f-a8c1-d561140f1290), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:35.919594 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75332bc0-fe9d-4c52-9343-f3649e078444 None None] Sync routers for ids ['7d884862-0b03-425b-8c51-b5475b62ebb4'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:35.923314 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d72babf2-6003-4643-ab69-4db723ff7523 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "PUT /v2.0/routers/7d884862-0b03-425b-8c51-b5475b62ebb4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3094468 Mar 24 02:16:35.929953 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cff8e87b-5f47-481f-9333-50dcc49524e7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=3aca5599-104a-44a7-bb92-9274c219499f HTTP/1.1" status: 200 len: 205 time: 0.0550349 Mar 24 02:16:35.935010 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75332bc0-fe9d-4c52-9343-f3649e078444 None None] Routers {'7d884862-0b03-425b-8c51-b5475b62ebb4'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:35.935919 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-75332bc0-fe9d-4c52-9343-f3649e078444 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7d884862-0b03-425b-8c51-b5475b62ebb4'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:35.939327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:35.945395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59716) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:35.945747 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59718) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:35.946712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:35.978335 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-75332bc0-fe9d-4c52-9343-f3649e078444 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:35.989651 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75332bc0-fe9d-4c52-9343-f3649e078444 None None] Routers {'7d884862-0b03-425b-8c51-b5475b62ebb4'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:35.990565 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-75332bc0-fe9d-4c52-9343-f3649e078444 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7d884862-0b03-425b-8c51-b5475b62ebb4'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:35.999900 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:36.002467 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-3ede347a-fc65-4752-979a-a5d51d6ceea7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:16:36.004041 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3ede347a-fc65-4752-979a-a5d51d6ceea7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/23c1ee13-387a-4c11-8171-4e13a4c2b098 HTTP/1.1" status: 404 len: 333 time: 0.0552008 Mar 24 02:16:36.029048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a587843e-756a-4675-b78c-46ea0cfd2220 None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:16:36.031881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d697b65f-6ccd-4dc8-a008-bccc8a61f35a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:36.033350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 25f49554-2686-4c7a-ab6d-5a80d178bf36 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:36.034724 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-75332bc0-fe9d-4c52-9343-f3649e078444 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:36.035557 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75332bc0-fe9d-4c52-9343-f3649e078444 None None] The sync data for ids ['7d884862-0b03-425b-8c51-b5475b62ebb4'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:36.041104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59720) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:36.054392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (c85bdd53-60b3-467b-85a9-f43bd640a016), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.072291 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-633c4d6c-c99c-41fb-bd8c-974b944d9905 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] delete failed (client error): The resource could not be found. Mar 24 02:16:36.074973 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-633c4d6c-c99c-41fb-bd8c-974b944d9905 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/3aca5599-104a-44a7-bb92-9274c219499f HTTP/1.1" status: 404 len: 336 time: 0.1007636 Mar 24 02:16:36.076782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] In _notify_port_updated(), no bound segment for port ac55636d-05b0-427e-819a-3f1e8335d3af on network b5bcebeb-7196-456e-9a13-3b81957731cd {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:16:36.079115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59722) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:36.083966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:36.084776 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.090772 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "PUT /v2.0/ports/ac55636d-05b0-427e-819a-3f1e8335d3af HTTP/1.1" status: 200 len: 925 time: 1.6574697 Mar 24 02:16:36.093102 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59724) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:36.099396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 25f49554-2686-4c7a-ab6d-5a80d178bf36 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:36.099752 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 25f49554-2686-4c7a-ab6d-5a80d178bf36 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Mar 24 02:16:36.103578 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '832612c5-f8b1-4313-969a-7a9490b97979'}, {'subnet_id': '5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:36.119483 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c85bdd53-60b3-467b-85a9-f43bd640a016']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:36.129404 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks [] for router_gateway (9c57e851-60dd-408a-bb81-1858bda320e9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.152079 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da819ae5-ae6a-46de-8281-250731953b63 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=ac55636d-05b0-427e-819a-3f1e8335d3af,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:36.153500 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Port 25f49554-2686-4c7a-ab6d-5a80d178bf36 not found, will not notify nova. {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Mar 24 02:16:36.157506 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:36.157506 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:36.176695 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.202239 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-26380608-2f4f-427a-bd12-c7e87a440dc9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:36.202744 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-26380608-2f4f-427a-bd12-c7e87a440dc9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:36.209096 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-26380608-2f4f-427a-bd12-c7e87a440dc9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/8f09cd00-d5bb-4486-93b9-502ef7b01957 HTTP/1.1" status: 404 len: 337 time: 0.0840549 Mar 24 02:16:36.211827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event updated for resources: {'Port': ['ID=b92fd0e6-70ba-4c1f-a8c1-d561140f1290,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:36.218551 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59726) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:36.226589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.238253 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Releasing vlan 127 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:36.238640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (1754ca9b-23e9-4ca7-b5f2-44fe55dde5d4), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:36.242303 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:36.266688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] Set router 9c57e851-60dd-408a-bb81-1858bda320e9 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:16:36.280740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.339450 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7c0d481-b432-4ce4-bfd0-d2fd77786d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for router (7d884862-0b03-425b-8c51-b5475b62ebb4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.342018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (c85bdd53-60b3-467b-85a9-f43bd640a016), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.347584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.350592 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6d06acbc-a81e-49b6-bf84-0b41b3cd31ee tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=2e755dda-98d1-4713-a810-541b5f12235b HTTP/1.1" status: 200 len: 205 time: 0.1273892 Mar 24 02:16:36.353678 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/networks/c85bdd53-60b3-467b-85a9-f43bd640a016 HTTP/1.1" status: 204 len: 168 time: 2.7294922 Mar 24 02:16:36.354318 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59728) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:36.354668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59730) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:36.356161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-de5071b8-0e10-4560-9fea-5e880dd4aceb None None] Current status of the port d697b65f-6ccd-4dc8-a008-bccc8a61f35a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:36.399266 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df615d6-b666-425a-a345-40017a326995 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Network': ['ID=c85bdd53-60b3-467b-85a9-f43bd640a016,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:36.400422 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a587843e-756a-4675-b78c-46ea0cfd2220 None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:16:36.506654 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-a4e7dcee-729b-4e61-8df8-fe657173c2f9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] delete failed (client error): The resource could not be found. Mar 24 02:16:36.510233 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a4e7dcee-729b-4e61-8df8-fe657173c2f9 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/2e755dda-98d1-4713-a810-541b5f12235b HTTP/1.1" status: 404 len: 336 time: 0.1354043 Mar 24 02:16:36.511026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6e27b1b1-6619-45a1-8067-fba833a0df5d None None] Provisioning complete for port ac55636d-05b0-427e-819a-3f1e8335d3af triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:36.511554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6e27b1b1-6619-45a1-8067-fba833a0df5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.519701 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59732) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:36.557801 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-aa32d09d-e84d-4df4-91c9-aa03747e2eb5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=b7625b45-c8e2-4384-becd-84c71dc4e270 HTTP/1.1" status: 200 len: 205 time: 0.0327694 Mar 24 02:16:36.560740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59734) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:36.587902 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6e27b1b1-6619-45a1-8067-fba833a0df5d None None] Port ac55636d-05b0-427e-819a-3f1e8335d3af cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:36.608448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (874174ed-3f33-4330-a533-5366863cb45b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.635927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7c0d481-b432-4ce4-bfd0-d2fd77786d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (7d884862-0b03-425b-8c51-b5475b62ebb4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.698123 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 25f49554-2686-4c7a-ab6d-5a80d178bf36 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:36.726124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 25f49554-2686-4c7a-ab6d-5a80d178bf36 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:36.726847 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 25f49554-2686-4c7a-ab6d-5a80d178bf36 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:36.729191 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:16:32Z', 'revision_number': 5, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:36.762448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Deleting port c0044818-8b56-440a-a0bb-26a7235b9375 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:36.762815 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c0044818-8b56-440a-a0bb-26a7235b9375), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.791468 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05200b3a-9dc2-4632-8b23-62dd35781b9c None None] The sync data for ids ['9c57e851-60dd-408a-bb81-1858bda320e9'] in dv-neutron-834874-3-hyperv is: [{'id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'name': 'tempest-ServerActionsTestJSON-2127636339-router', 'tenant_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164'}], 'enable_snat': True}, 'gw_port_id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:11:51Z', 'updated_at': '2022-03-24T02:16:32Z', 'revision_number': 5, 'project_id': '2be0ccfa2a914550be8f84da5cb7afe4', 'gw_port': {'id': 'df5a15e4-1066-41f3-b75b-6ab6d45ff057', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:55:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c57e851-60dd-408a-bb81-1858bda320e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:11:52Z', 'updated_at': '2022-03-24T02:12:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:36.846466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8:0:1::346 (b5bcebeb-7196-456e-9a13-3b81957731cd/5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa/ac55636d-05b0-427e-819a-3f1e8335d3af) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:36.871560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] For port c0044818-8b56-440a-a0bb-26a7235b9375, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c0044818-8b56-440a-a0bb-26a7235b9375,segment=NetworkSegment(8e19689b-fe85-4181-9e33-f7f7477864a4),segment_id=8e19689b-fe85-4181-9e33-f7f7477864a4)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:36.871940 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c0044818-8b56-440a-a0bb-26a7235b9375), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:36.924583 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Calling delete_port for c0044818-8b56-440a-a0bb-26a7235b9375 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:37.014997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7c0d481-b432-4ce4-bfd0-d2fd77786d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for router_controller (7d884862-0b03-425b-8c51-b5475b62ebb4), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.025755 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-fa3e9435-1daf-4e14-8905-1e59b5c76bdb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] delete failed (client error): The resource could not be found. Mar 24 02:16:37.029251 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fa3e9435-1daf-4e14-8905-1e59b5c76bdb tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/b7625b45-c8e2-4384-becd-84c71dc4e270 HTTP/1.1" status: 404 len: 336 time: 0.4636481 Mar 24 02:16:37.030557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59736) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.069292 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-b4bf2716-1828-4370-ae19-e205da745854 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:37.069755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b4bf2716-1828-4370-ae19-e205da745854 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:37.072888 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b4bf2716-1828-4370-ae19-e205da745854 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/71bcd0f2-d2a9-49de-abca-c367b71a913d HTTP/1.1" status: 404 len: 337 time: 0.0413454 Mar 24 02:16:37.074831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Deleting port df5a15e4-1066-41f3-b75b-6ab6d45ff057 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:37.075129 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.077685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59738) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.096046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.104664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.105519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7c0d481-b432-4ce4-bfd0-d2fd77786d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (7d884862-0b03-425b-8c51-b5475b62ebb4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.106062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7c0d481-b432-4ce4-bfd0-d2fd77786d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Fanout notify agent at l3_agent the message router_deleted on router 7d884862-0b03-425b-8c51-b5475b62ebb4 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:16:37.109288 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (c0044818-8b56-440a-a0bb-26a7235b9375), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.114207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7c0d481-b432-4ce4-bfd0-d2fd77786d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.120383 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b7c0d481-b432-4ce4-bfd0-d2fd77786d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/routers/7d884862-0b03-425b-8c51-b5475b62ebb4 HTTP/1.1" status: 204 len: 168 time: 1.0739017 Mar 24 02:16:37.124490 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59740) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.128159 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8df27e94-0d65-4f66-8eb9-aa8c2c40eaec None None] Provisioning complete for port ac55636d-05b0-427e-819a-3f1e8335d3af triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:37.129173 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8df27e94-0d65-4f66-8eb9-aa8c2c40eaec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.174144 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-01a8944e-d938-4ad1-bc84-e715f32a3fc5 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=b8e596ba-618f-41f8-bbbe-bb5dd1173dcb HTTP/1.1" status: 200 len: 205 time: 0.0930545 Mar 24 02:16:37.178263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59742) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.180407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8df27e94-0d65-4f66-8eb9-aa8c2c40eaec None None] Port ac55636d-05b0-427e-819a-3f1e8335d3af cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:37.185164 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Port': ['ID=c0044818-8b56-440a-a0bb-26a7235b9375,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:37.215421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] No DVR routers for this DVR port c0044818-8b56-440a-a0bb-26a7235b9375 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:37.228062 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-c037263c-b83a-4fdf-b063-275944d35ac7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] delete failed (client error): The resource could not be found. Mar 24 02:16:37.229104 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c037263c-b83a-4fdf-b063-275944d35ac7 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/b8e596ba-618f-41f8-bbbe-bb5dd1173dcb HTTP/1.1" status: 404 len: 336 time: 0.0462818 Mar 24 02:16:37.232769 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59744) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.251704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] In _notify_port_updated(), no bound segment for port ac55636d-05b0-427e-819a-3f1e8335d3af on network b5bcebeb-7196-456e-9a13-3b81957731cd {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:16:37.256823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:37.257689 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.259371 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "PUT /v2.0/ports/ac55636d-05b0-427e-819a-3f1e8335d3af HTTP/1.1" status: 200 len: 1011 time: 1.1608255 Mar 24 02:16:37.270887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59746) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.273345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (753e4246-fa2c-4d05-b7ab-cb00c73407bb), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.284619 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-d0485cc8-b166-41ae-a1c6-2b6f23c9eece tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:37.285055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d0485cc8-b166-41ae-a1c6-2b6f23c9eece tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:37.288047 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d0485cc8-b166-41ae-a1c6-2b6f23c9eece tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/e0adc6a6-7058-4e9b-a2d4-16c1d9161eda HTTP/1.1" status: 404 len: 337 time: 0.0529444 Mar 24 02:16:37.320733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-c441c5e1-7e04-497f-a2b3-7082c8fc3aab tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet eba982ea-a9c2-4a26-a298-c06e00d7fafc {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:37.380239 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59748) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.391929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c441c5e1-7e04-497f-a2b3-7082c8fc3aab tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (eba982ea-a9c2-4a26-a298-c06e00d7fafc), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.427687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (874174ed-3f33-4330-a533-5366863cb45b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.452441 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f0778e94-933c-4683-9b53-2eedb60eda6b tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "GET /v2.0/ports?device_id=2f78564e-0ab3-4c6e-8e01-d720fac2db18 HTTP/1.1" status: 200 len: 205 time: 0.0688319 Mar 24 02:16:37.457608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] For port df5a15e4-1066-41f3-b75b-6ab6d45ff057, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=df5a15e4-1066-41f3-b75b-6ab6d45ff057,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:37.457784 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59750) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.457976 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.476525 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e012830-de1e-4c04-a6a0-477cf7718acb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=ac55636d-05b0-427e-819a-3f1e8335d3af,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:37.483187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Calling delete_port for df5a15e4-1066-41f3-b75b-6ab6d45ff057 owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:37.506848 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9f977b77-d70d-42dc-aee4-ccc2bed6dab9 None None] Provisioning complete for port ac55636d-05b0-427e-819a-3f1e8335d3af triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:37.507281 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9f977b77-d70d-42dc-aee4-ccc2bed6dab9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.514495 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['874174ed-3f33-4330-a533-5366863cb45b']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:37.529092 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-d753ef99-de3f-4c34-82f0-a1a01ea890e6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] delete failed (client error): The resource could not be found. Mar 24 02:16:37.530640 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d753ef99-de3f-4c34-82f0-a1a01ea890e6 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/routers/2f78564e-0ab3-4c6e-8e01-d720fac2db18 HTTP/1.1" status: 404 len: 336 time: 0.0698154 Mar 24 02:16:37.534461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c441c5e1-7e04-497f-a2b3-7082c8fc3aab tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (eba982ea-a9c2-4a26-a298-c06e00d7fafc), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.535077 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59752) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.545920 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9f977b77-d70d-42dc-aee4-ccc2bed6dab9 None None] Port ac55636d-05b0-427e-819a-3f1e8335d3af cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:37.561573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e19689b-fe85-4181-9e33-f7f7477864a4') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:37.561870 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e19689b-fe85-4181-9e33-f7f7477864a4') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:37.578547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (8e19689b-fe85-4181-9e33-f7f7477864a4), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.600520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (8e19689b-fe85-4181-9e33-f7f7477864a4), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.608233 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-e1b06015-8ebe-4593-87e6-479bd5cd244a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:37.608701 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e1b06015-8ebe-4593-87e6-479bd5cd244a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:37.614129 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e1b06015-8ebe-4593-87e6-479bd5cd244a tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/7be7dde7-21ee-46c4-996c-e9d6dea102c7 HTTP/1.1" status: 404 len: 337 time: 0.0459294 Mar 24 02:16:37.615727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59754) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.626800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:37.627208 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (8e19689b-fe85-4181-9e33-f7f7477864a4), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:37.630728 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:37.698705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c441c5e1-7e04-497f-a2b3-7082c8fc3aab tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (eba982ea-a9c2-4a26-a298-c06e00d7fafc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.721737 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (874174ed-3f33-4330-a533-5366863cb45b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.726562 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.732022 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/networks/874174ed-3f33-4330-a533-5366863cb45b HTTP/1.1" status: 204 len: 168 time: 1.3564649 Mar 24 02:16:37.732482 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-d5cc2c95-2465-44d1-8d13-340c6fd27075 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:37.732482 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d5cc2c95-2465-44d1-8d13-340c6fd27075 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:37.735223 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d5cc2c95-2465-44d1-8d13-340c6fd27075 tempest-RoutersIpV6Test-734694753 tempest-RoutersIpV6Test-734694753-project] 10.222.0.20 "DELETE /v2.0/subnets/222f25e2-9089-4c48-b74a-f3cca2685179 HTTP/1.1" status: 404 len: 337 time: 0.1178422 Mar 24 02:16:37.739205 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59756) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.754633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c512cbfc-767e-454f-a24e-c0d0a6b936f1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port ac55636d-05b0-427e-819a-3f1e8335d3af {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:37.754982 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c512cbfc-767e-454f-a24e-c0d0a6b936f1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.796245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e9ba5b0-df01-4fa6-9753-d074cf0bc1c4 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Network': ['ID=874174ed-3f33-4330-a533-5366863cb45b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:37.844648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (c0a7519a-e2e8-4b92-8554-774adb1b1045), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.856280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c441c5e1-7e04-497f-a2b3-7082c8fc3aab tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (eba982ea-a9c2-4a26-a298-c06e00d7fafc), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.899634 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (753e4246-fa2c-4d05-b7ab-cb00c73407bb), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.912469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c441c5e1-7e04-497f-a2b3-7082c8fc3aab tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=eba982ea-a9c2-4a26-a298-c06e00d7fafc,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:37.919975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c441c5e1-7e04-497f-a2b3-7082c8fc3aab tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:37.923187 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c441c5e1-7e04-497f-a2b3-7082c8fc3aab tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/eba982ea-a9c2-4a26-a298-c06e00d7fafc HTTP/1.1" status: 204 len: 168 time: 0.7963781 Mar 24 02:16:37.926313 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59760) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:37.928597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dfedc20-b4dd-408e-91d1-1efefcfb8632 None None] Network 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:38.036765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c512cbfc-767e-454f-a24e-c0d0a6b936f1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.039778 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (c0a7519a-e2e8-4b92-8554-774adb1b1045), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.054394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59764) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:38.072481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.076467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c512cbfc-767e-454f-a24e-c0d0a6b936f1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for ac55636d-05b0-427e-819a-3f1e8335d3af owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:38.084280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c0a7519a-e2e8-4b92-8554-774adb1b1045']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.096265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (df5a15e4-1066-41f3-b75b-6ab6d45ff057), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.098618 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d3b3379-b523-4505-82ef-f6123cb1438d') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.098917 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d3b3379-b523-4505-82ef-f6123cb1438d') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.110254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (3d3b3379-b523-4505-82ef-f6123cb1438d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.151244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3d3b3379-b523-4505-82ef-f6123cb1438d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.159264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Releasing vlan 134 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:38.159549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (3d3b3379-b523-4505-82ef-f6123cb1438d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:38.163703 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:38.168229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Pushing event deleted for resources: {'Port': ['ID=df5a15e4-1066-41f3-b75b-6ab6d45ff057,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:38.172127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1479515c-0d55-4362-87cf-c3575adbf2e3 None None] DHCP port deletion for 65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:38.237963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1479515c-0d55-4362-87cf-c3575adbf2e3 None None] Deleting port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:38.239241 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1479515c-0d55-4362-87cf-c3575adbf2e3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.245912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (c0a7519a-e2e8-4b92-8554-774adb1b1045), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.254249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.259959 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/networks/c0a7519a-e2e8-4b92-8554-774adb1b1045 HTTP/1.1" status: 204 len: 168 time: 0.5178668 Mar 24 02:16:38.260734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59768) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:38.263479 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:38.263816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.311572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (9c57e851-60dd-408a-bb81-1858bda320e9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.316104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c960bc86-8a95-4bc2-9273-aad135f1f5fa tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Network': ['ID=c0a7519a-e2e8-4b92-8554-774adb1b1045,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:38.316854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1479515c-0d55-4362-87cf-c3575adbf2e3 None None] For port 0f08083a-2625-4d65-a5a8-d5e9a706fba7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0f08083a-2625-4d65-a5a8-d5e9a706fba7,segment=NetworkSegment(30be06be-bf5f-46c8-9dbf-98fbff324f57),segment_id=30be06be-bf5f-46c8-9dbf-98fbff324f57)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:38.318031 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1479515c-0d55-4362-87cf-c3575adbf2e3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.332311 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1479515c-0d55-4362-87cf-c3575adbf2e3 None None] Calling delete_port for 0f08083a-2625-4d65-a5a8-d5e9a706fba7 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:38.402034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] For port 0f08083a-2625-4d65-a5a8-d5e9a706fba7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0f08083a-2625-4d65-a5a8-d5e9a706fba7,segment=NetworkSegment(30be06be-bf5f-46c8-9dbf-98fbff324f57),segment_id=30be06be-bf5f-46c8-9dbf-98fbff324f57)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:38.402303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.417811 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (2daa5d56-33c5-4efa-a898-dd1d5e9f7005), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.423646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 0f08083a-2625-4d65-a5a8-d5e9a706fba7 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:38.445901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1479515c-0d55-4362-87cf-c3575adbf2e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.458893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (9c57e851-60dd-408a-bb81-1858bda320e9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.468261 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6729b24f-f7c4-4532-95cd-0ae454a494ef admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=ad85d379c34c467487816ef2bb559f24&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4065573 Mar 24 02:16:38.469525 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks [] for router_controller (9c57e851-60dd-408a-bb81-1858bda320e9), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.472151 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59770) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:38.473800 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Router 753e4246-fa2c-4d05-b7ab-cb00c73407bb is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:16:38.484494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1479515c-0d55-4362-87cf-c3575adbf2e3 None None] Pushing event deleted for resources: {'Port': ['ID=0f08083a-2625-4d65-a5a8-d5e9a706fba7,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:38.492973 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1479515c-0d55-4362-87cf-c3575adbf2e3 None None] No DVR routers for this DVR port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:38.536816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (9c57e851-60dd-408a-bb81-1858bda320e9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.537392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9c57e851-60dd-408a-bb81-1858bda320e9 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:16:38.594012 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (2daa5d56-33c5-4efa-a898-dd1d5e9f7005), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.595681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.597589 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3d0afb80-5fd7-425a-8fd7-2ab5c00ad55b admin admin] 10.222.0.20 "DELETE /v2.0/routers/9c57e851-60dd-408a-bb81-1858bda320e9 HTTP/1.1" status: 204 len: 168 time: 3.7990706 Mar 24 02:16:38.605604 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59772) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:38.669147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c512cbfc-767e-454f-a24e-c0d0a6b936f1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ac55636d-05b0-427e-819a-3f1e8335d3af), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.674982 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2daa5d56-33c5-4efa-a898-dd1d5e9f7005']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.691993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0f08083a-2625-4d65-a5a8-d5e9a706fba7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.699126 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abf3bde9-7811-4ac8-9ffa-6ac2c7c51c12 admin admin] Publish callbacks [] for security_group (a32a8910-fb7a-4b58-8732-2f89ae4ca1e9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.703043 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2cab21bc-3244-4678-9948-1136ddf34db0') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.703437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2cab21bc-3244-4678-9948-1136ddf34db0') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.733379 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c512cbfc-767e-454f-a24e-c0d0a6b936f1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=ac55636d-05b0-427e-819a-3f1e8335d3af,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:38.745159 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=0f08083a-2625-4d65-a5a8-d5e9a706fba7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:38.749507 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (2cab21bc-3244-4678-9948-1136ddf34db0), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.758348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No DVR routers for this DVR port 0f08083a-2625-4d65-a5a8-d5e9a706fba7 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:38.764526 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-eda765d9-fc7b-4340-a89c-5f6ab923a114 admin admin] Deleting subnet 56374a24-4e35-434f-b4b8-860ef8289893 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:38.777555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eda765d9-fc7b-4340-a89c-5f6ab923a114 admin admin] Publish callbacks [] for subnet (56374a24-4e35-434f-b4b8-860ef8289893), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.812316 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c512cbfc-767e-454f-a24e-c0d0a6b936f1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.818198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abf3bde9-7811-4ac8-9ffa-6ac2c7c51c12 admin admin] Publish callbacks [] for security_group (a32a8910-fb7a-4b58-8732-2f89ae4ca1e9), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.818661 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c512cbfc-767e-454f-a24e-c0d0a6b936f1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/ac55636d-05b0-427e-819a-3f1e8335d3af HTTP/1.1" status: 204 len: 168 time: 1.5410926 Mar 24 02:16:38.819312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59774) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:38.824980 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (2cab21bc-3244-4678-9948-1136ddf34db0), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.853741 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Releasing vlan 125 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:38.854150 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (2cab21bc-3244-4678-9948-1136ddf34db0), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.854971 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-3fc9b7b7-16dd-4eec-8f81-60efb613a7dd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:16:38.856421 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3fc9b7b7-16dd-4eec-8f81-60efb613a7dd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/ac55636d-05b0-427e-819a-3f1e8335d3af HTTP/1.1" status: 404 len: 333 time: 0.0343158 Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:38.857359 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:38.859978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:38.865165 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59776) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:38.870419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d847d20-8cfb-47c3-b027-4ac86356c1ab None None] Sync routers for ids ['753e4246-fa2c-4d05-b7ab-cb00c73407bb'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:38.883750 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d847d20-8cfb-47c3-b027-4ac86356c1ab None None] Routers {'753e4246-fa2c-4d05-b7ab-cb00c73407bb'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:38.885413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5d847d20-8cfb-47c3-b027-4ac86356c1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['753e4246-fa2c-4d05-b7ab-cb00c73407bb'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.924111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-44c43134-ed78-4325-b58c-68099fdc142c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet 5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:38.927513 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-44c43134-ed78-4325-b58c-68099fdc142c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.933884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5d847d20-8cfb-47c3-b027-4ac86356c1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.945440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d847d20-8cfb-47c3-b027-4ac86356c1ab None None] Routers {'753e4246-fa2c-4d05-b7ab-cb00c73407bb'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:38.946391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5d847d20-8cfb-47c3-b027-4ac86356c1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['753e4246-fa2c-4d05-b7ab-cb00c73407bb'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.963924 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eda765d9-fc7b-4340-a89c-5f6ab923a114 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (56374a24-4e35-434f-b4b8-860ef8289893), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.969797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-44c43134-ed78-4325-b58c-68099fdc142c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:38.990017 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5d847d20-8cfb-47c3-b027-4ac86356c1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:38.990836 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d847d20-8cfb-47c3-b027-4ac86356c1ab None None] The sync data for ids ['753e4246-fa2c-4d05-b7ab-cb00c73407bb'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:38.997063 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.019825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.020968 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d34b55c3-e680-414c-b50c-7a70fc13ad3f tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 6.1791191 Mar 24 02:16:39.023791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59778) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:39.026459 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (2daa5d56-33c5-4efa-a898-dd1d5e9f7005), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.029565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:39.030601 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:39.047209 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.052726 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] 10.222.0.20 "DELETE /v2.0/networks/2daa5d56-33c5-4efa-a898-dd1d5e9f7005 HTTP/1.1" status: 204 len: 168 time: 0.7888381 Mar 24 02:16:39.065820 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '30be06be-bf5f-46c8-9dbf-98fbff324f57') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:39.066134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '30be06be-bf5f-46c8-9dbf-98fbff324f57') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:39.079108 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70a94d89-6182-4508-a874-ead5c961e7e9 tempest-BulkNetworkOpsTest-940710537 tempest-BulkNetworkOpsTest-940710537-project] Pushing event deleted for resources: {'Network': ['ID=2daa5d56-33c5-4efa-a898-dd1d5e9f7005,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:39.089299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (30be06be-bf5f-46c8-9dbf-98fbff324f57), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.110853 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3a5a51e0-3aa4-497c-9582-6700ad4f221e no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:39.129348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abf3bde9-7811-4ac8-9ffa-6ac2c7c51c12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a32a8910-fb7a-4b58-8732-2f89ae4ca1e9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.132429 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abf3bde9-7811-4ac8-9ffa-6ac2c7c51c12 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.133079 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-abf3bde9-7811-4ac8-9ffa-6ac2c7c51c12 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/a32a8910-fb7a-4b58-8732-2f89ae4ca1e9 HTTP/1.1" status: 204 len: 168 time: 0.6443684 Mar 24 02:16:39.149705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (30be06be-bf5f-46c8-9dbf-98fbff324f57), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.155562 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf3bde9-7811-4ac8-9ffa-6ac2c7c51c12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a32a8910-fb7a-4b58-8732-2f89ae4ca1e9,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:39.166117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-44c43134-ed78-4325-b58c-68099fdc142c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.166751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Releasing vlan 126 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:39.166751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (30be06be-bf5f-46c8-9dbf-98fbff324f57), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:39.166971 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:39.206662 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 3a5a51e0-3aa4-497c-9582-6700ad4f221e {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:39.207654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3a5a51e0-3aa4-497c-9582-6700ad4f221e not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:39.208460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0f08083a-2625-4d65-a5a8-d5e9a706fba7 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:39.231921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eda765d9-fc7b-4340-a89c-5f6ab923a114 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (56374a24-4e35-434f-b4b8-860ef8289893), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.260092 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 0f08083a-2625-4d65-a5a8-d5e9a706fba7 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:39.261345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0f08083a-2625-4d65-a5a8-d5e9a706fba7 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:39.285592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.293316 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.296787 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/networks/65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27 HTTP/1.1" status: 204 len: 168 time: 1.3694353 Mar 24 02:16:39.302280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59784) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:39.348389 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a270cb50-ec6b-4b2a-a128-837cf6cd038f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Network': ['ID=65ebdca7-1e70-4ee0-bc3a-1c01bd1e8f27,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:39.366261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eda765d9-fc7b-4340-a89c-5f6ab923a114 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (56374a24-4e35-434f-b4b8-860ef8289893), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.377220 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8fd2123-aa04-4913-90fa-8635f9de4f71 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:39.379465 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f8fd2123-aa04-4913-90fa-8635f9de4f71 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/fb6aa634-7dc1-40b2-a10c-14a092dbd732 HTTP/1.1" status: 200 len: 841 time: 0.0693774 Mar 24 02:16:39.386252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59790) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:39.399409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-44c43134-ed78-4325-b58c-68099fdc142c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.405824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda765d9-fc7b-4340-a89c-5f6ab923a114 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=56374a24-4e35-434f-b4b8-860ef8289893,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:39.408218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-eda765d9-fc7b-4340-a89c-5f6ab923a114 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.412385 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-eda765d9-fc7b-4340-a89c-5f6ab923a114 admin admin] 10.222.0.20 "DELETE /v2.0/subnets/56374a24-4e35-434f-b4b8-860ef8289893 HTTP/1.1" status: 204 len: 168 time: 0.8055220 Mar 24 02:16:39.414876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59792) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:39.419814 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34e0ade7-d8de-473f-a024-5cae35ffd5fa None None] Network 597625fc-4c02-4901-9b3e-46b781f61da1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:39.493591 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (597625fc-4c02-4901-9b3e-46b781f61da1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.495954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59794) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:39.527226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44c43134-ed78-4325-b58c-68099fdc142c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:39.532341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-44c43134-ed78-4325-b58c-68099fdc142c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.535623 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-44c43134-ed78-4325-b58c-68099fdc142c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa HTTP/1.1" status: 204 len: 168 time: 0.6678159 Mar 24 02:16:39.539283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59800) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:39.574874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1b74213-17e1-466b-a025-bad371347ed1 None None] Network b5bcebeb-7196-456e-9a13-3b81957731cd requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:39.617011 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-efa7b3cd-0b0b-4afe-af59-36517f726793 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/fb6aa634-7dc1-40b2-a10c-14a092dbd732?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.2301195 Mar 24 02:16:39.622858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-e161e184-bec4-4c50-a82a-e1dd7b29a59f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet 832612c5-f8b1-4313-969a-7a9490b97979 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:39.631152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59804) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:39.634314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e161e184-bec4-4c50-a82a-e1dd7b29a59f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (832612c5-f8b1-4313-969a-7a9490b97979), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.640244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:39.768972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ab309ab-0d50-446b-a9c1-4483edb82e25 None None] DHCP port deletion for 597625fc-4c02-4901-9b3e-46b781f61da1 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:39.772677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (753e4246-fa2c-4d05-b7ab-cb00c73407bb), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.798173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_gateway (753e4246-fa2c-4d05-b7ab-cb00c73407bb), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.858400 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6ab309ab-0d50-446b-a9c1-4483edb82e25 None None] Deleting port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:39.858811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6ab309ab-0d50-446b-a9c1-4483edb82e25 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.872156 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-493d54d7-786d-48c1-a0d0-57a0bce1f87f admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=7ed879a56c604e41a8cd0eb1388b7896&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3572352 Mar 24 02:16:39.872807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59810) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:39.962863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6ab309ab-0d50-446b-a9c1-4483edb82e25 None None] For port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:39.964001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6ab309ab-0d50-446b-a9c1-4483edb82e25 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.978129 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e48fb1c0-b3a5-4ccd-886e-3438eb27f48a admin admin] Publish callbacks [] for security_group (39d75e96-c329-43ea-b66f-26ae924d6f39), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:39.982475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Deleting port b92fd0e6-70ba-4c1f-a8c1-d561140f1290 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:39.982835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b92fd0e6-70ba-4c1f-a8c1-d561140f1290), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.001995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6ab309ab-0d50-446b-a9c1-4483edb82e25 None None] Calling delete_port for 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:40.056992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e48fb1c0-b3a5-4ccd-886e-3438eb27f48a admin admin] Publish callbacks [] for security_group (39d75e96-c329-43ea-b66f-26ae924d6f39), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.131183 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Deleting port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:40.131524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.137418 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6ab309ab-0d50-446b-a9c1-4483edb82e25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.157159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b92fd0e6-70ba-4c1f-a8c1-d561140f1290), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.170858 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Calling delete_port for b92fd0e6-70ba-4c1f-a8c1-d561140f1290 owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:40.185156 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ab309ab-0d50-446b-a9c1-4483edb82e25 None None] Pushing event deleted for resources: {'Port': ['ID=38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:40.188805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ab309ab-0d50-446b-a9c1-4483edb82e25 None None] No DVR routers for this DVR port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:40.259648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e48fb1c0-b3a5-4ccd-886e-3438eb27f48a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (39d75e96-c329-43ea-b66f-26ae924d6f39), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.261685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e161e184-bec4-4c50-a82a-e1dd7b29a59f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (832612c5-f8b1-4313-969a-7a9490b97979), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.262542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e48fb1c0-b3a5-4ccd-886e-3438eb27f48a admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.264851 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e48fb1c0-b3a5-4ccd-886e-3438eb27f48a admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/39d75e96-c329-43ea-b66f-26ae924d6f39 HTTP/1.1" status: 204 len: 168 time: 0.3890202 Mar 24 02:16:40.298104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e48fb1c0-b3a5-4ccd-886e-3438eb27f48a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39d75e96-c329-43ea-b66f-26ae924d6f39,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:40.298961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59822) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:40.322917 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] For port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b,segment=NetworkSegment(3634fb13-0e49-49bf-a115-a9f2198a6323),segment_id=3634fb13-0e49-49bf-a115-a9f2198a6323)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:40.323281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.360502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Calling delete_port for 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:40.383806 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:40.393437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.501219 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (b92fd0e6-70ba-4c1f-a8c1-d561140f1290), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.515699 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dc983a8d-5374-4489-ad26-a3bcc007d376 tempest-ServiceProvidersTest-1637696140 tempest-ServiceProvidersTest-1637696140-project] 10.222.0.20 "GET /v2.0/service-providers HTTP/1.1" status: 200 len: 498 time: 0.2108333 Mar 24 02:16:40.539044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Pushing event deleted for resources: {'Port': ['ID=b92fd0e6-70ba-4c1f-a8c1-d561140f1290,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:40.565141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e161e184-bec4-4c50-a82a-e1dd7b29a59f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (832612c5-f8b1-4313-969a-7a9490b97979), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.644621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (753e4246-fa2c-4d05-b7ab-cb00c73407bb), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.665620 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.719900 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e161e184-bec4-4c50-a82a-e1dd7b29a59f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (832612c5-f8b1-4313-969a-7a9490b97979), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.740405 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Pushing event deleted for resources: {'Port': ['ID=38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:40.750707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce6dda6e-6e66-472c-a029-f87245de156a None None] Network b5bcebeb-7196-456e-9a13-3b81957731cd requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:40.756628 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:40.789530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e161e184-bec4-4c50-a82a-e1dd7b29a59f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:40.794977 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e161e184-bec4-4c50-a82a-e1dd7b29a59f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/832612c5-f8b1-4313-969a-7a9490b97979 HTTP/1.1" status: 204 len: 168 time: 1.2539380 Mar 24 02:16:40.796314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] No DVR routers for this DVR port 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:40.798396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59832) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:40.823574 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e161e184-bec4-4c50-a82a-e1dd7b29a59f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=832612c5-f8b1-4313-969a-7a9490b97979,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:40.836190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:40.836560 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 38af4c08-3f3c-4e0a-aa1d-0fda25f3fb1b not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:40.836984 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device df5a15e4-1066-41f3-b75b-6ab6d45ff057 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:40.992529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59840) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:41.060886 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (597625fc-4c02-4901-9b3e-46b781f61da1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.087796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['597625fc-4c02-4901-9b3e-46b781f61da1']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:41.110774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (b5bcebeb-7196-456e-9a13-3b81957731cd), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.114619 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3634fb13-0e49-49bf-a115-a9f2198a6323') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:41.114871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3634fb13-0e49-49bf-a115-a9f2198a6323') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:41.132153 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: df5a15e4-1066-41f3-b75b-6ab6d45ff057 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:41.132791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device df5a15e4-1066-41f3-b75b-6ab6d45ff057 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:41.139895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (3634fb13-0e49-49bf-a115-a9f2198a6323), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.146055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-09e7c6bf-6185-4de5-a98a-55111795c701 None None] Provisioning complete for port d697b65f-6ccd-4dc8-a008-bccc8a61f35a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:41.146431 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-09e7c6bf-6185-4de5-a98a-55111795c701 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.209618 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3634fb13-0e49-49bf-a115-a9f2198a6323), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.242644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (9b01bd06-549f-4756-86ba-eebb1d450eb6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.255230 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Releasing vlan 147 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:41.255642 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (3634fb13-0e49-49bf-a115-a9f2198a6323), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:41.263201 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:41.297799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (753e4246-fa2c-4d05-b7ab-cb00c73407bb), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.301486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (753e4246-fa2c-4d05-b7ab-cb00c73407bb), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.337800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:41.340327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-09e7c6bf-6185-4de5-a98a-55111795c701 None None] Current status of the port d697b65f-6ccd-4dc8-a008-bccc8a61f35a is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:41.366417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-73b19581-37e7-4572-be00-865a6e4ab2dd admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.375075 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:41.386260 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-873036c3-4a09-4277-af54-648b6a13cc10 None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:41.394734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:41.395549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.417840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Router 753e4246-fa2c-4d05-b7ab-cb00c73407bb has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:41.444246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=9b01bd06-549f-4756-86ba-eebb1d450eb6,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:41.456412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (597625fc-4c02-4901-9b3e-46b781f61da1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.460819 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b50ef4c8-6553-4143-aa0c-d90cf8e31a42 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8280897 Mar 24 02:16:41.466452 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59854) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:41.470448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.474404 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] 10.222.0.20 "DELETE /v2.0/networks/597625fc-4c02-4901-9b3e-46b781f61da1 HTTP/1.1" status: 204 len: 168 time: 2.0584009 Mar 24 02:16:41.481566 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3d61e9db-d04b-415e-94da-18c203f9eb63 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'security_group': {'name': 'tempest-secgroup-691188553'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:41.488864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65fa44c8-2d18-477b-9b87-3fee5ab0c62a None None] DHCP port deletion for b5bcebeb-7196-456e-9a13-3b81957731cd request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:41.504905 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port d697b65f-6ccd-4dc8-a008-bccc8a61f35a {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:41.505247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.548737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:41.561861 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff969826-f37a-45bf-bb79-2e7487ec40a5 None None] Sync routers for ids ['753e4246-fa2c-4d05-b7ab-cb00c73407bb'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:41.570258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.572031 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7be17039-f0f6-4729-ada2-36d7f6722e3e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "PUT /v2.0/routers/753e4246-fa2c-4d05-b7ab-cb00c73407bb HTTP/1.1" status: 200 len: 706 time: 2.5468946 Mar 24 02:16:41.574280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59858) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:41.575880 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] For port d697b65f-6ccd-4dc8-a008-bccc8a61f35a, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,segment=NetworkSegment(e221dabf-7df8-487c-8fe4-ce9f8e5ce00b),segment_id=e221dabf-7df8-487c-8fe4-ce9f8e5ce00b)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:41.576823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.580168 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff969826-f37a-45bf-bb79-2e7487ec40a5 None None] Routers {'753e4246-fa2c-4d05-b7ab-cb00c73407bb'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:41.582876 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ff969826-f37a-45bf-bb79-2e7487ec40a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['753e4246-fa2c-4d05-b7ab-cb00c73407bb'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:41.591837 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for d697b65f-6ccd-4dc8-a008-bccc8a61f35a owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:41.642396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-65fa44c8-2d18-477b-9b87-3fee5ab0c62a None None] Deleting port d697b65f-6ccd-4dc8-a008-bccc8a61f35a {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:41.642962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65fa44c8-2d18-477b-9b87-3fee5ab0c62a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.645859 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ff969826-f37a-45bf-bb79-2e7487ec40a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:41.655399 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff969826-f37a-45bf-bb79-2e7487ec40a5 None None] Routers {'753e4246-fa2c-4d05-b7ab-cb00c73407bb'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:41.656263 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ff969826-f37a-45bf-bb79-2e7487ec40a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['753e4246-fa2c-4d05-b7ab-cb00c73407bb'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:41.682433 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4f7b8856-56e2-4852-89b6-e899780ed3fa tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/routers/753e4246-fa2c-4d05-b7ab-cb00c73407bb HTTP/1.1" status: 200 len: 741 time: 0.1061695 Mar 24 02:16:41.683158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59860) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:41.685134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59862) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:41.698570 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ff969826-f37a-45bf-bb79-2e7487ec40a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:41.698898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e41ca7b5-e6fe-48cb-b617-5ef1e9e1a519 admin admin] Pushing event deleted for resources: {'Network': ['ID=597625fc-4c02-4901-9b3e-46b781f61da1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:41.700147 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff969826-f37a-45bf-bb79-2e7487ec40a5 None None] The sync data for ids ['753e4246-fa2c-4d05-b7ab-cb00c73407bb'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:41.714723 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3d61e9db-d04b-415e-94da-18c203f9eb63 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.746749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-65fa44c8-2d18-477b-9b87-3fee5ab0c62a None None] For port d697b65f-6ccd-4dc8-a008-bccc8a61f35a, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,segment=NetworkSegment(e221dabf-7df8-487c-8fe4-ce9f8e5ce00b),segment_id=e221dabf-7df8-487c-8fe4-ce9f8e5ce00b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:41.747112 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65fa44c8-2d18-477b-9b87-3fee5ab0c62a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.765536 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-65fa44c8-2d18-477b-9b87-3fee5ab0c62a None None] Calling delete_port for d697b65f-6ccd-4dc8-a008-bccc8a61f35a owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:41.769673 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bd7c2b6b-9290-4ebc-a08a-44380263c932 tempest-RoutersAdminTest-1130162624 tempest-RoutersAdminTest-1130162624-project-admin] 10.222.0.20 "GET /v2.0/ports?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&device_id=753e4246-fa2c-4d05-b7ab-cb00c73407bb HTTP/1.1" status: 200 len: 205 time: 0.0834618 Mar 24 02:16:41.772636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59866) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:41.802640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59868) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:41.832362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'project_id': '59047855c41744dd95105383d31cd553', 'fixed_ips': [{'subnet_id': '9b01bd06-549f-4756-86ba-eebb1d450eb6'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:41.833224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.843326 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-85f13473-3a9d-4acf-ae91-216a83dad50e tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=753e4246-fa2c-4d05-b7ab-cb00c73407bb HTTP/1.1" status: 200 len: 205 time: 0.0677290 Mar 24 02:16:41.846205 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59870) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:41.868959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.908134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-73b19581-37e7-4572-be00-865a6e4ab2dd admin admin] Publish callbacks [] for security_group (adc586e6-6fd2-4d21-9459-2e8d91b5b605), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.961930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65fa44c8-2d18-477b-9b87-3fee5ab0c62a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (d697b65f-6ccd-4dc8-a008-bccc8a61f35a), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.971047 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-73b19581-37e7-4572-be00-865a6e4ab2dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (adc586e6-6fd2-4d21-9459-2e8d91b5b605), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:41.989565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'network': {'name': 'tempest-RoutersTest-661944929'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:41.996522 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.008023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:42.012506 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.016435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No DVR routers for this DVR port d697b65f-6ccd-4dc8-a008-bccc8a61f35a on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:42.022147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.025424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3d61e9db-d04b-415e-94da-18c203f9eb63 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (b39665bc-2946-4cba-b961-bd96250a34d9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.025610 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65fa44c8-2d18-477b-9b87-3fee5ab0c62a None None] No DVR routers for this DVR port d697b65f-6ccd-4dc8-a008-bccc8a61f35a on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:42.033206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65fa44c8-2d18-477b-9b87-3fee5ab0c62a None None] Pushing event deleted for resources: {'Port': ['ID=d697b65f-6ccd-4dc8-a008-bccc8a61f35a,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.045438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3d61e9db-d04b-415e-94da-18c203f9eb63 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b39665bc-2946-4cba-b961-bd96250a34d9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.064077 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Allocated IP 172.20.0.2 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/9b01bd06-549f-4756-86ba-eebb1d450eb6/ce65f7b4-05fd-4b15-85ea-55ec88abec23) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:42.072278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bd1e42d-019d-4639-8192-95028e66ed9c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (753e4246-fa2c-4d05-b7ab-cb00c73407bb), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.076032 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a6545095-8ef9-44f2-b245-b7f91aba34c1 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=2be0ccfa2a914550be8f84da5cb7afe4&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2707746 Mar 24 02:16:42.079594 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59872) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.126850 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-73b19581-37e7-4572-be00-865a6e4ab2dd admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=92585768bdd14237bb678e0b79f9508b&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0360935 Mar 24 02:16:42.130714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59874) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.176780 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for security_group (ce27d226-d193-4136-9669-e00f6d2aeb5c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.188724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (ce27d226-d193-4136-9669-e00f6d2aeb5c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.199594 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3d61e9db-d04b-415e-94da-18c203f9eb63 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.200850 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3d61e9db-d04b-415e-94da-18c203f9eb63 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.7251337 Mar 24 02:16:42.201658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73b19581-37e7-4572-be00-865a6e4ab2dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=adc586e6-6fd2-4d21-9459-2e8d91b5b605,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.210962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59876) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.217544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8c9d5326-3f73-4fc1-90c4-46dccc2988ec tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'security_group': {'name': 'tempest-secgroup-1099141618'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:42.236203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 146} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:42.238498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f17fd2d0-c4ed-4451-a113-963225ac0090 admin admin] Publish callbacks [] for security_group (524237e9-a95b-45e4-a4bb-df2e94b5d3d8), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.253547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (b5bcebeb-7196-456e-9a13-3b81957731cd), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.261185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Publish callbacks [] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.266609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (2656a5df-b5cc-4af8-936e-3937dd14f7f7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.267066 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added segment 2656a5df-b5cc-4af8-936e-3937dd14f7f7 of type vlan for network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 Mar 24 02:16:42.267948 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.289019 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ce27d226-d193-4136-9669-e00f6d2aeb5c,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.309967 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:42.310354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39891352-f574-452b-b760-1b9d1ba64e58 admin admin] Publish callbacks [] for security_group (adc586e6-6fd2-4d21-9459-2e8d91b5b605), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.320363 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:42.320771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f17fd2d0-c4ed-4451-a113-963225ac0090 admin admin] Publish callbacks [] for security_group (524237e9-a95b-45e4-a4bb-df2e94b5d3d8), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.325661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:42.329108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Pushing event updated for resources: {'Port': ['ID=ce65f7b4-05fd-4b15-85ea-55ec88abec23,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.370616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b5bcebeb-7196-456e-9a13-3b81957731cd']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:42.381241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c9d5326-3f73-4fc1-90c4-46dccc2988ec tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.383277 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d61e9db-d04b-415e-94da-18c203f9eb63 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b39665bc-2946-4cba-b961-bd96250a34d9,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.391798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e221dabf-7df8-487c-8fe4-ce9f8e5ce00b') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:42.392358 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e221dabf-7df8-487c-8fe4-ce9f8e5ce00b') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:42.394954 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Attempting to bind port ce65f7b4-05fd-4b15-85ea-55ec88abec23 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:42.395331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Attempting to bind port ce65f7b4-05fd-4b15-85ea-55ec88abec23 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'cb1f6bda-0ce9-4c9a-968a-d29295cb534c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:42.395698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Attempting to bind port ce65f7b4-05fd-4b15-85ea-55ec88abec23 on network c8466e8e-4c16-4f91-aa0d-8651c7d4116a {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:42.400089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39891352-f574-452b-b760-1b9d1ba64e58 admin admin] Publish callbacks [] for security_group (adc586e6-6fd2-4d21-9459-2e8d91b5b605), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.401088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:42.401463 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Checking segment: {'id': 'cb1f6bda-0ce9-4c9a-968a-d29295cb534c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:42.401864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.402874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Bound using segment: {'id': 'cb1f6bda-0ce9-4c9a-968a-d29295cb534c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:42.403094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (0a45dd11-0f24-42f0-8f86-d44d7fcd25a4), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.403362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Bound port: ce65f7b4-05fd-4b15-85ea-55ec88abec23, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cb1f6bda-0ce9-4c9a-968a-d29295cb534c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:42.403746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.409008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bd1e42d-019d-4639-8192-95028e66ed9c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (753e4246-fa2c-4d05-b7ab-cb00c73407bb), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.414255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bd1e42d-019d-4639-8192-95028e66ed9c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router_controller (753e4246-fa2c-4d05-b7ab-cb00c73407bb), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.419854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (e221dabf-7df8-487c-8fe4-ce9f8e5ce00b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.467572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (0a45dd11-0f24-42f0-8f86-d44d7fcd25a4), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.474723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:42.475491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.487543 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e221dabf-7df8-487c-8fe4-ce9f8e5ce00b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.499609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Releasing vlan 110 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:42.500285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (e221dabf-7df8-487c-8fe4-ce9f8e5ce00b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:42.504012 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:42.520263 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bd1e42d-019d-4639-8192-95028e66ed9c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (753e4246-fa2c-4d05-b7ab-cb00c73407bb), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.521111 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5bd1e42d-019d-4639-8192-95028e66ed9c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Fanout notify agent at l3_agent the message router_deleted on router 753e4246-fa2c-4d05-b7ab-cb00c73407bb {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:16:42.532140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] For port ce65f7b4-05fd-4b15-85ea-55ec88abec23, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:42.559278 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.8749337 Mar 24 02:16:42.560020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f17fd2d0-c4ed-4451-a113-963225ac0090 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (524237e9-a95b-45e4-a4bb-df2e94b5d3d8), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.562533 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f17fd2d0-c4ed-4451-a113-963225ac0090 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.563572 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f17fd2d0-c4ed-4451-a113-963225ac0090 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/524237e9-a95b-45e4-a4bb-df2e94b5d3d8 HTTP/1.1" status: 204 len: 168 time: 0.4834116 Mar 24 02:16:42.564370 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59878) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.564505 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bd1e42d-019d-4639-8192-95028e66ed9c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.566323 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5bd1e42d-019d-4639-8192-95028e66ed9c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/753e4246-fa2c-4d05-b7ab-cb00c73407bb HTTP/1.1" status: 204 len: 168 time: 0.7164240 Mar 24 02:16:42.574459 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59882) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.585443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'network': {'name': 'tempest-RoutersTest-1320732737'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:42.593789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f17fd2d0-c4ed-4451-a113-963225ac0090 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=524237e9-a95b-45e4-a4bb-df2e94b5d3d8,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.604085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39891352-f574-452b-b760-1b9d1ba64e58 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (adc586e6-6fd2-4d21-9459-2e8d91b5b605), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.606765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39891352-f574-452b-b760-1b9d1ba64e58 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.622114 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-39891352-f574-452b-b760-1b9d1ba64e58 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/adc586e6-6fd2-4d21-9459-2e8d91b5b605 HTTP/1.1" status: 204 len: 168 time: 0.4765503 Mar 24 02:16:42.626675 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f184db08-3783-4656-8c39-7d185985ed1c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=753e4246-fa2c-4d05-b7ab-cb00c73407bb HTTP/1.1" status: 200 len: 205 time: 0.0508919 Mar 24 02:16:42.630154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59886) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.653689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39891352-f574-452b-b760-1b9d1ba64e58 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=adc586e6-6fd2-4d21-9459-2e8d91b5b605,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.665435 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-090eb8c3-4c72-4d5f-b836-aec0158cdbef tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Network': ['ID=0a45dd11-0f24-42f0-8f86-d44d7fcd25a4,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.684183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] For port ce65f7b4-05fd-4b15-85ea-55ec88abec23, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ce65f7b4-05fd-4b15-85ea-55ec88abec23,segment=NetworkSegment(cb1f6bda-0ce9-4c9a-968a-d29295cb534c),segment_id=cb1f6bda-0ce9-4c9a-968a-d29295cb534c)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:42.691336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (b5bcebeb-7196-456e-9a13-3b81957731cd), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.698845 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:42.703257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:42.707383 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.710166 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-90676cb9-7da4-4014-82c5-1ed0f67591dd tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] delete failed (client error): The resource could not be found. Mar 24 02:16:42.713728 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-90676cb9-7da4-4014-82c5-1ed0f67591dd tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/753e4246-fa2c-4d05-b7ab-cb00c73407bb HTTP/1.1" status: 404 len: 336 time: 0.0799043 Mar 24 02:16:42.719014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59890) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.720004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.726984 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/networks/b5bcebeb-7196-456e-9a13-3b81957731cd HTTP/1.1" status: 204 len: 168 time: 1.9012794 Mar 24 02:16:42.744391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c9d5326-3f73-4fc1-90c4-46dccc2988ec tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (45497b2f-24fd-4728-8987-5a24010bb63f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.754750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59892) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.768379 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c9d5326-3f73-4fc1-90c4-46dccc2988ec tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (45497b2f-24fd-4728-8987-5a24010bb63f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.770871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaf0c0a9-4977-4979-ba43-baf27e62180e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Network': ['ID=b5bcebeb-7196-456e-9a13-3b81957731cd,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.795941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 114} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:42.815698 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6effc050-5282-4463-84b9-d799f9ca4114 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=18d553cf-62f8-4aff-ae2a-ea1f1f195c9d HTTP/1.1" status: 200 len: 205 time: 0.0800939 Mar 24 02:16:42.815803 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.815803 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added segment 9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7 of type vlan for network 5c876cac-460f-4279-a9ce-553b32670a9f Mar 24 02:16:42.817259 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59894) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.820167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.834746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d697b65f-6ccd-4dc8-a008-bccc8a61f35a no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:42.835578 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c9d5326-3f73-4fc1-90c4-46dccc2988ec tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.836810 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8c9d5326-3f73-4fc1-90c4-46dccc2988ec tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.6227214 Mar 24 02:16:42.842062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59896) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.850787 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-12738370', 'security_groups': ['45497b2f-24fd-4728-8987-5a24010bb63f'], 'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '9b01bd06-549f-4756-86ba-eebb1d450eb6'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:42.869332 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c9d5326-3f73-4fc1-90c4-46dccc2988ec tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'SecurityGroup': ['ID=45497b2f-24fd-4728-8987-5a24010bb63f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.897864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a7de805-b474-4fdc-8749-f44230438440 None None] Pushing event updated for resources: {'Port': ['ID=ce65f7b4-05fd-4b15-85ea-55ec88abec23,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:42.927879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (5c876cac-460f-4279-a9ce-553b32670a9f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:42.928414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e245df7-e123-4155-b667-79482ffae6c3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:42.933426 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7e245df7-e123-4155-b667-79482ffae6c3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 847 time: 0.1742461 Mar 24 02:16:42.933722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59898) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:42.937081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d697b65f-6ccd-4dc8-a008-bccc8a61f35a {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:42.937439 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d697b65f-6ccd-4dc8-a008-bccc8a61f35a not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:43.041361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:43.068284 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-f388bf7a-97c9-40ee-86cd-0f364295c64d tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] delete failed (client error): The resource could not be found. Mar 24 02:16:43.071298 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f388bf7a-97c9-40ee-86cd-0f364295c64d tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/18d553cf-62f8-4aff-ae2a-ea1f1f195c9d HTTP/1.1" status: 404 len: 336 time: 0.2530599 Mar 24 02:16:43.074307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59906) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.074746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (5c876cac-460f-4279-a9ce-553b32670a9f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.085655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:43.087861 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.149561 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d691c0ac-7a57-4662-920b-0746d681b746 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.2141194 Mar 24 02:16:43.153582 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-991c508b-3356-4f21-aba6-54bf7ad41b1d tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=0aa843a0-da71-4529-b938-7ef07de1674f HTTP/1.1" status: 200 len: 205 time: 0.0780704 Mar 24 02:16:43.154149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59910) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.157238 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59912) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.172347 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-981482910'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:43.172700 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.5888424 Mar 24 02:16:43.172700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59916) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.185050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'subnet': {'network_id': '0a45dd11-0f24-42f0-8f86-d44d7fcd25a4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:43.210803 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-138d37db-5117-418d-9894-8c0d62a20d71 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Network': ['ID=5c876cac-460f-4279-a9ce-553b32670a9f,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:43.221848 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 5c876cac-460f-4279-a9ce-553b32670a9f details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:43.238890 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-2edbfd58-0e40-4a48-a2fb-d103753977a1 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] delete failed (client error): The resource could not be found. Mar 24 02:16:43.239766 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2edbfd58-0e40-4a48-a2fb-d103753977a1 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/0aa843a0-da71-4529-b938-7ef07de1674f HTTP/1.1" status: 404 len: 336 time: 0.0716825 Mar 24 02:16:43.248006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59922) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.300693 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e2755411-ff1a-4ca4-b6cb-8017fe791f94 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=c6bd9e83-528f-458b-903e-02f2a5f99c3d HTTP/1.1" status: 200 len: 205 time: 0.0500689 Mar 24 02:16:43.305958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59926) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.370227 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:43.374439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.381619 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.408436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port ad434e1a-08a3-4990-93b1-502ccaf2dd2d yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:43.427579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:43.432145 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.469348 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-25b47043-09d0-4df0-8fcb-e848cd9e176c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] delete failed (client error): The resource could not be found. Mar 24 02:16:43.474886 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-25b47043-09d0-4df0-8fcb-e848cd9e176c tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/c6bd9e83-528f-458b-903e-02f2a5f99c3d HTTP/1.1" status: 404 len: 336 time: 0.1630585 Mar 24 02:16:43.475819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59930) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.537359 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-beba93f4-3e18-464b-aad3-07187d7732f9 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=279dd154-f36b-433d-8d99-f38b264f38d1 HTTP/1.1" status: 200 len: 205 time: 0.0471461 Mar 24 02:16:43.539857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59934) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.573391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 104} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:43.587385 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-95aa93da-a51d-41f7-8bb4-2f12895f6e66 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] delete failed (client error): The resource could not be found. Mar 24 02:16:43.588463 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-95aa93da-a51d-41f7-8bb4-2f12895f6e66 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/279dd154-f36b-433d-8d99-f38b264f38d1 HTTP/1.1" status: 404 len: 336 time: 0.0463545 Mar 24 02:16:43.592921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59940) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.602404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.602905 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Added segment a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43 of type vlan for network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 Mar 24 02:16:43.633387 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7f97c73a-8d94-4cb0-91ff-9a30cdeb7179 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c9b2d33-abdb-40bb-ae90-72bc0a776f29 HTTP/1.1" status: 200 len: 205 time: 0.0390651 Mar 24 02:16:43.636477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59942) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.687489 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (04bfbc97-7961-45cf-8c53-6628dcdd7c28), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.688579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-3eb0e517-0dc9-44b1-bdcb-46eb46139893 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] delete failed (client error): The resource could not be found. Mar 24 02:16:43.691155 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3eb0e517-0dc9-44b1-bdcb-46eb46139893 tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/routers/8c9b2d33-abdb-40bb-ae90-72bc0a776f29 HTTP/1.1" status: 404 len: 336 time: 0.0537431 Mar 24 02:16:43.694900 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59946) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.733426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.7 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/9b01bd06-549f-4756-86ba-eebb1d450eb6/ad434e1a-08a3-4990-93b1-502ccaf2dd2d) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:43.737607 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-66185c26-965b-410e-b729-6cd9be3d101a tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] DELETE failed (client error): The resource could not be found. Mar 24 02:16:43.738065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-66185c26-965b-410e-b729-6cd9be3d101a tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:43.741153 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-66185c26-965b-410e-b729-6cd9be3d101a tempest-RoutersAdminTest-1327013510 tempest-RoutersAdminTest-1327013510-project] 10.222.0.20 "DELETE /v2.0/subnets/8ca3c91b-2add-4279-a908-10cba8e1fd3a HTTP/1.1" status: 404 len: 337 time: 0.0451641 Mar 24 02:16:43.756824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (04bfbc97-7961-45cf-8c53-6628dcdd7c28), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.763062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:43.763710 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.805673 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.6480794 Mar 24 02:16:43.809094 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59954) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:43.842062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '04bfbc97-7961-45cf-8c53-6628dcdd7c28', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:43.846243 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (8d3c3070-7bf8-454a-81a0-f94828e5d1b4), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:43.935830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Subnet': ['ID=8d3c3070-7bf8-454a-81a0-f94828e5d1b4,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:43.942239 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Checking segment: {'id': '2656a5df-b5cc-4af8-936e-3937dd14f7f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '0a45dd11-0f24-42f0-8f86-d44d7fcd25a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:43.943080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network hostable DHCP agents. Network: 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:43.963149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:43.979685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:43.984974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d797ac-9c55-4ff1-bdbe-a9298964ddb2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Network': ['ID=04bfbc97-7961-45cf-8c53-6628dcdd7c28,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:43.986188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:43.993554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01e11727-b57f-4afe-9c56-273ac8fbbc30 None None] Network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:43.998615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.008774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:44.034383 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c9cb8122-3a20-4485-8448-d8ae50105c1a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8603868 Mar 24 02:16:44.043498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59962) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:44.052434 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'subnet': {'network_id': '5c876cac-460f-4279-a9ce-553b32670a9f', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:44.099897 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:44.112451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.200287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59966) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:44.259885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:44.264285 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.307701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-0a45dd11-0f24-42f0-8f86-d44d7fcd25a4', 'network_id': '0a45dd11-0f24-42f0-8f86-d44d7fcd25a4', 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'fixed_ips': [{'subnet_id': '8d3c3070-7bf8-454a-81a0-f94828e5d1b4'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:44.309042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.309639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (ad434e1a-08a3-4990-93b1-502ccaf2dd2d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.431340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (ad434e1a-08a3-4990-93b1-502ccaf2dd2d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.505728 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Allocated IP 172.20.0.2 (0a45dd11-0f24-42f0-8f86-d44d7fcd25a4/8d3c3070-7bf8-454a-81a0-f94828e5d1b4/0558abf2-2d79-4c5a-b772-ed329fada168) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:44.507085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=ad434e1a-08a3-4990-93b1-502ccaf2dd2d,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:44.524830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:44.529096 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:44.533372 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:44.556468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b341c4af-8e0a-4fbf-b663-2a8945af1500 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.664934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:44.669391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.677730 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (dc00a534-aed7-41fa-ad57-69f513f5a472), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.759743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (03b7d30a-5d44-4916-9c45-ac41eaae3a7f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.779001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:44.781246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:44.806493 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59980) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:44.817992 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6760f9b3-3d3f-490c-9f7e-3c22ab93ab40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 1.9737918 Mar 24 02:16:44.850917 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 59982) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:44.854470 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Subnet': ['ID=03b7d30a-5d44-4916-9c45-ac41eaae3a7f,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:44.866766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b004b8c5-4798-4664-bac4-3e510c8c44fb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:44.867157 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=dc00a534-aed7-41fa-ad57-69f513f5a472,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:44.916251 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ce65f7b4-05fd-4b15-85ea-55ec88abec23 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:44.925630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Checking segment: {'id': 'a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '04bfbc97-7961-45cf-8c53-6628dcdd7c28'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:44.926019 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network hostable DHCP agents. Network: 04bfbc97-7961-45cf-8c53-6628dcdd7c28, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:44.966121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:44.981431 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 04bfbc97-7961-45cf-8c53-6628dcdd7c28) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:44.987753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:44.988359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.015696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d74c2d9-f2ef-4be8-b729-b18d2ae58fa7 None None] Network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:45.019894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Checking segment: {'id': '9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '5c876cac-460f-4279-a9ce-553b32670a9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:45.020727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network hostable DHCP agents. Network: 5c876cac-460f-4279-a9ce-553b32670a9f, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:45.029294 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-33ba6ffa-3ee3-4daf-8a7f-f994d96c1d73 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1914003 Mar 24 02:16:45.034102 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59988) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:45.047241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '04bfbc97-7961-45cf-8c53-6628dcdd7c28', 'name': 'tempest-PortsIpV6TestJSON-1284814876'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:45.057021 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b341c4af-8e0a-4fbf-b663-2a8945af1500 admin admin] Publish callbacks [] for security_group (2cbfad9d-d00f-4400-813b-b3208a03018c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.076223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b341c4af-8e0a-4fbf-b663-2a8945af1500 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2cbfad9d-d00f-4400-813b-b3208a03018c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.131504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Request body: {'network': {'name': 'tempest-TagsTest-test-network-1133268434'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:45.138661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.164093 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:45.164505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.182764 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 5c876cac-460f-4279-a9ce-553b32670a9f is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:45.185023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b341c4af-8e0a-4fbf-b663-2a8945af1500 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cbfad9d-d00f-4400-813b-b3208a03018c,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:45.198664 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b341c4af-8e0a-4fbf-b663-2a8945af1500 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=b77396d15b78402aa1f8253967e93603&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9961269 Mar 24 02:16:45.202928 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59992) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:45.206488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 5c876cac-460f-4279-a9ce-553b32670a9f) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:45.215880 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Publish callbacks [] for port (0558abf2-2d79-4c5a-b772-ed329fada168), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.216431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:45.217144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.224398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Made reservation on behalf of 694e705aed8b4192a55c9781044e07fa for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:45.228561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb9b4d45-f4e6-4b18-9736-f749b869fc28 None None] Network 5c876cac-460f-4279-a9ce-553b32670a9f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:45.228729 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.229222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:45.233399 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.247540 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.251210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b004b8c5-4798-4664-bac4-3e510c8c44fb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:45.255478 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b004b8c5-4798-4664-bac4-3e510c8c44fb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.262053 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.281009 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-798387c4-157f-4ce3-bc45-a7433d578e14 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2336919 Mar 24 02:16:45.299971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 59996) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:45.326439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-224c6db1-209b-483a-b21e-ff63a0539994 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-2102057315', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:45.345640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:45.346356 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.356205 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-734ed9c0-8970-469f-bcd6-054b57bf7be0 admin admin] Publish callbacks [] for security_group (2cbfad9d-d00f-4400-813b-b3208a03018c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.359934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Pushing event updated for resources: {'Port': ['ID=0558abf2-2d79-4c5a-b772-ed329fada168,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:45.361628 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-224c6db1-209b-483a-b21e-ff63a0539994 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (f61a0f8a-856d-44d1-b428-62e6b517c4c8), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.362761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-224c6db1-209b-483a-b21e-ff63a0539994 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (f61a0f8a-856d-44d1-b428-62e6b517c4c8), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.390807 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.ipam_backend_mixin [None req-b004b8c5-4798-4664-bac4-3e510c8c44fb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 9b01bd06-549f-4756-86ba-eebb1d450eb6 (CIDR: 172.20.0.0/28) Mar 24 02:16:45.400032 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-b004b8c5-4798-4664-bac4-3e510c8c44fb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:16:45.400648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b004b8c5-4798-4664-bac4-3e510c8c44fb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:45.434160 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b004b8c5-4798-4664-bac4-3e510c8c44fb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5752904 Mar 24 02:16:45.437699 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60002) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:45.442604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:45.448128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:45.455573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-224c6db1-209b-483a-b21e-ff63a0539994 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (f61a0f8a-856d-44d1-b428-62e6b517c4c8), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.459718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks [] for security_group (b4353663-7334-446c-8ef3-72fb906b19fb), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.471983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port e43de564-0962-4cc1-8ab0-18d90af4a87c yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:45.476856 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:45.479197 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-04bfbc97-7961-45cf-8c53-6628dcdd7c28', 'network_id': '04bfbc97-7961-45cf-8c53-6628dcdd7c28', 'project_id': '7b8dee850d65489ba8498576f69edde9', 'fixed_ips': [{'subnet_id': 'dc00a534-aed7-41fa-ad57-69f513f5a472'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:45.480358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.494616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:45.499423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b4353663-7334-446c-8ef3-72fb906b19fb), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.548059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 123} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:45.560467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d49da388-356d-490b-9f11-39404d931b1a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.561155 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Added segment d49da388-356d-490b-9f11-39404d931b1a of type vlan for network 613da851-19bf-4a2d-880a-1fc141b0c0a6 Mar 24 02:16:45.614394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (613da851-19bf-4a2d-880a-1fc141b0c0a6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.642105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b4353663-7334-446c-8ef3-72fb906b19fb,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:45.700119 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (613da851-19bf-4a2d-880a-1fc141b0c0a6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.705059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:45.706545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.726621 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] For port ce65f7b4-05fd-4b15-85ea-55ec88abec23, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ce65f7b4-05fd-4b15-85ea-55ec88abec23,segment=NetworkSegment(cb1f6bda-0ce9-4c9a-968a-d29295cb534c),segment_id=cb1f6bda-0ce9-4c9a-968a-d29295cb534c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:45.767573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Attempting to bind port 0558abf2-2d79-4c5a-b772-ed329fada168 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:45.768870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Attempting to bind port 0558abf2-2d79-4c5a-b772-ed329fada168 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '2656a5df-b5cc-4af8-936e-3937dd14f7f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '0a45dd11-0f24-42f0-8f86-d44d7fcd25a4'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:45.769482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Attempting to bind port 0558abf2-2d79-4c5a-b772-ed329fada168 on network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:45.772283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.794460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Pushing event updated for resources: {'Network': ['ID=613da851-19bf-4a2d-880a-1fc141b0c0a6,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:45.801245 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-554f073f-259b-4b30-9c38-9b71d98892bb tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 776 time: 0.9915185 Mar 24 02:16:45.804546 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:45.805754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60010) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:45.806014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60012) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:45.806851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.812653 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-b126746c-cff1-48c9-9479-38e26a17fb29 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6', 'tempest-TagsTest-Tag-1113394068') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:45.859662 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 613da851-19bf-4a2d-880a-1fc141b0c0a6 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:45.861654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-5c876cac-460f-4279-a9ce-553b32670a9f', 'network_id': '5c876cac-460f-4279-a9ce-553b32670a9f', 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'fixed_ips': [{'subnet_id': '03b7d30a-5d44-4916-9c45-ac41eaae3a7f'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:45.862653 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.884870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:45.885446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Checking segment: {'id': '2656a5df-b5cc-4af8-936e-3937dd14f7f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '0a45dd11-0f24-42f0-8f86-d44d7fcd25a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:45.885951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.886509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Bound using segment: {'id': '2656a5df-b5cc-4af8-936e-3937dd14f7f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '0a45dd11-0f24-42f0-8f86-d44d7fcd25a4'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:45.887223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Bound port: 0558abf2-2d79-4c5a-b772-ed329fada168, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2656a5df-b5cc-4af8-936e-3937dd14f7f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '0a45dd11-0f24-42f0-8f86-d44d7fcd25a4'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:45.887715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:45.890686 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:45.895692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.039002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] Provisioning complete for port fb6aa634-7dc1-40b2-a10c-14a092dbd732 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:46.039654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.043696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::1a2 (04bfbc97-7961-45cf-8c53-6628dcdd7c28/dc00a534-aed7-41fa-ad57-69f513f5a472/e43de564-0962-4cc1-8ab0-18d90af4a87c) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:46.055831 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-224c6db1-209b-483a-b21e-ff63a0539994 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (f61a0f8a-856d-44d1-b428-62e6b517c4c8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.071436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:46.082259 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-734ed9c0-8970-469f-bcd6-054b57bf7be0 admin admin] Publish callbacks [] for security_group (2cbfad9d-d00f-4400-813b-b3208a03018c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.098091 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-224c6db1-209b-483a-b21e-ff63a0539994 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.099314 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-224c6db1-209b-483a-b21e-ff63a0539994 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.7767646 Mar 24 02:16:46.102966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60016) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:46.120341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.209590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] Pushing event updated for resources: {'Port': ['ID=ce65f7b4-05fd-4b15-85ea-55ec88abec23,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:46.242135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9eb48940-9b41-4c5c-a126-ce6b5dbde5e0 None None] Port fb6aa634-7dc1-40b2-a10c-14a092dbd732 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:46.242353 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b126746c-cff1-48c9-9479-38e26a17fb29 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "PUT /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags/tempest-TagsTest-Tag-1113394068 HTTP/1.1" status: 201 len: 201 time: 0.4341056 Mar 24 02:16:46.246421 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60018) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:46.251095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:16:46.251314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-7e366968-0565-4c8b-ba3a-32022d54926d tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6', 'tempest-TagsTest-Tag-1113394068') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:46.251937 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:16:46.293861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] For port 0558abf2-2d79-4c5a-b772-ed329fada168, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:46.300452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (682aa15b-b73a-4fc1-88f6-425543336542), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.312047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] For port 0558abf2-2d79-4c5a-b772-ed329fada168, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0558abf2-2d79-4c5a-b772-ed329fada168,segment=NetworkSegment(2656a5df-b5cc-4af8-936e-3937dd14f7f7),segment_id=2656a5df-b5cc-4af8-936e-3937dd14f7f7)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:46.323724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Allocated IP 172.21.0.2 (5c876cac-460f-4279-a9ce-553b32670a9f/03b7d30a-5d44-4916-9c45-ac41eaae3a7f/3e889e2b-f799-4c81-9ef1-b11645cb6543) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:46.327116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.394088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:46.400079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=682aa15b-b73a-4fc1-88f6-425543336542,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:46.403619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:46.406253 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:46.406883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.432051 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7e366968-0565-4c8b-ba3a-32022d54926d tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "GET /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags/tempest-TagsTest-Tag-1113394068 HTTP/1.1" status: 204 len: 168 time: 0.1845436 Mar 24 02:16:46.436890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60020) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:46.438141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.444137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-6f605fb2-4554-4e2c-a679-943bad1e2172 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:46.457247 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8014495b-f2cc-4abc-9616-02e2a4180eb7 None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:46.457459 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2ef81726-f657-4bfa-ac0d-279c0ffde701 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.0184493 Mar 24 02:16:46.457941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60022) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:46.466560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-888163161', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '682aa15b-b73a-4fc1-88f6-425543336542'}], 'security_groups': ['b39665bc-2946-4cba-b961-bd96250a34d9']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:46.485902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-734ed9c0-8970-469f-bcd6-054b57bf7be0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2cbfad9d-d00f-4400-813b-b3208a03018c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.488558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-734ed9c0-8970-469f-bcd6-054b57bf7be0 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.492414 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-734ed9c0-8970-469f-bcd6-054b57bf7be0 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/2cbfad9d-d00f-4400-813b-b3208a03018c HTTP/1.1" status: 204 len: 168 time: 1.2883935 Mar 24 02:16:46.558823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-734ed9c0-8970-469f-bcd6-054b57bf7be0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cbfad9d-d00f-4400-813b-b3208a03018c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:46.601469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.631800 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1815dbd4-b788-4555-898e-fa998e7b1ac1 None None] Provisioning complete for port ad434e1a-08a3-4990-93b1-502ccaf2dd2d triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:46.632376 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1815dbd4-b788-4555-898e-fa998e7b1ac1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ad434e1a-08a3-4990-93b1-502ccaf2dd2d), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.639027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89bf74e4-1796-4b62-b000-e8104aa8b108 None None] Pushing event updated for resources: {'Port': ['ID=0558abf2-2d79-4c5a-b772-ed329fada168,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:46.654216 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (e43de564-0962-4cc1-8ab0-18d90af4a87c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.759115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Allocated IP 172.26.2.38 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/777a3610-d046-4096-80c3-b7a8e6faf3a7) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:46.854052 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:46.876374 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6f605fb2-4554-4e2c-a679-943bad1e2172 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "GET /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags HTTP/1.1" status: 200 len: 238 time: 0.4354677 Mar 24 02:16:46.876632 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1815dbd4-b788-4555-898e-fa998e7b1ac1 None None] Port ad434e1a-08a3-4990-93b1-502ccaf2dd2d cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:46.908743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60028) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:46.914441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Publish callbacks [] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.931070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-41134f43-d820-434e-8c8e-17ca0a6beefe tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6', {'tags': ['tempest-TagsTest-Tag-1101327188', 'tempest-TagsTest-Tag-132198884', 'tempest-TagsTest-Tag-472172205']}) {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:46.972519 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (e43de564-0962-4cc1-8ab0-18d90af4a87c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:46.993922 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.002304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ad434e1a-08a3-4990-93b1-502ccaf2dd2d), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.073135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60030) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:47.101222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:47.122124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Network 5c876cac-460f-4279-a9ce-553b32670a9f is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:47.124563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:47.131289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:47.136839 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:47.137095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:47.137540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.140234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:47.141286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.20.0.1 (0a45dd11-0f24-42f0-8f86-d44d7fcd25a4/8d3c3070-7bf8-454a-81a0-f94828e5d1b4/099eedfc-ff72-4619-9755-f018599ed44c) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:47.146139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=e43de564-0962-4cc1-8ab0-18d90af4a87c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:47.166212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Allocated IP 2001:db8::2 (04bfbc97-7961-45cf-8c53-6628dcdd7c28/dc00a534-aed7-41fa-ad57-69f513f5a472/4533ba23-9b66-46e8-92bf-72caa725a46c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:47.174098 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Pushing event updated for resources: {'Port': ['ID=3e889e2b-f799-4c81-9ef1-b11645cb6543,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:47.204599 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8133b89f-214e-4a21-8e1b-439e9a5a5861 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.1645546 Mar 24 02:16:47.228365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60032) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:47.262721 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '04bfbc97-7961-45cf-8c53-6628dcdd7c28', 'name': 'tempest-PortsIpV6TestJSON-1841479332'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:47.270916 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-20ea63b0-4cf3-4430-b646-563153b7b232 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=65b8f224365f41ae9e617e104bd7afce&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1895764 Mar 24 02:16:47.272762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60034) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:47.298486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ce65f7b4-05fd-4b15-85ea-55ec88abec23 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:47.377633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Attempting to bind port 3e889e2b-f799-4c81-9ef1-b11645cb6543 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:47.378091 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Attempting to bind port 3e889e2b-f799-4c81-9ef1-b11645cb6543 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '5c876cac-460f-4279-a9ce-553b32670a9f'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:47.378626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Attempting to bind port 3e889e2b-f799-4c81-9ef1-b11645cb6543 on network 5c876cac-460f-4279-a9ce-553b32670a9f {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:47.399512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:47.400295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Checking segment: {'id': '9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '5c876cac-460f-4279-a9ce-553b32670a9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:47.400917 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.401516 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Bound using segment: {'id': '9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '5c876cac-460f-4279-a9ce-553b32670a9f'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:47.402187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Bound port: 3e889e2b-f799-4c81-9ef1-b11645cb6543, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '5c876cac-460f-4279-a9ce-553b32670a9f'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:47.402832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.453099 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e6e68e2-8c2a-4a7c-996f-df6fc930e914 None None] Update dhcp port {'port': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'fixed_ips': [{'subnet_id': '9b01bd06-549f-4756-86ba-eebb1d450eb6', 'ip_address': '172.20.0.2'}, {'subnet_id': '682aa15b-b73a-4fc1-88f6-425543336542'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': 'ce65f7b4-05fd-4b15-85ea-55ec88abec23'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:16:47.466207 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (099eedfc-ff72-4619-9755-f018599ed44c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.478998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3e8650e-4339-494f-9f70-85e67c312655 admin admin] Publish callbacks [] for security_group (59a1a59a-a7f3-46ca-b9b1-639140d57896), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.519177 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3e8650e-4339-494f-9f70-85e67c312655 admin admin] Publish callbacks [] for security_group (59a1a59a-a7f3-46ca-b9b1-639140d57896), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.557464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:47.558340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.571328 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9e6e68e2-8c2a-4a7c-996f-df6fc930e914 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.585601 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:47.590290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.608489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Publish callbacks [] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.612735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (099eedfc-ff72-4619-9755-f018599ed44c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.626009 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] For port 3e889e2b-f799-4c81-9ef1-b11645cb6543, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:47.634117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] For port 3e889e2b-f799-4c81-9ef1-b11645cb6543, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3e889e2b-f799-4c81-9ef1-b11645cb6543,segment=NetworkSegment(9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7),segment_id=9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:47.641507 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.651751 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-41134f43-d820-434e-8c8e-17ca0a6beefe tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "PUT /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags HTTP/1.1" status: 200 len: 307 time: 0.7421999 Mar 24 02:16:47.658271 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60036) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:47.663594 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-fa4dce72-8a9f-4e76-bb8f-f9ee22c50146 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6', 'tempest-TagsTest-Tag-1101327188') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:47.669978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for port (777a3610-d046-4096-80c3-b7a8e6faf3a7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.692954 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.695279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=099eedfc-ff72-4619-9755-f018599ed44c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:47.722097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:47.744460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:47.806349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:47.808934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:47.819938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Pushing event updated for resources: {'Port': ['ID=4533ba23-9b66-46e8-92bf-72caa725a46c,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:47.890904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::1b6 (04bfbc97-7961-45cf-8c53-6628dcdd7c28/dc00a534-aed7-41fa-ad57-69f513f5a472/af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:47.923245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (777a3610-d046-4096-80c3-b7a8e6faf3a7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.962489 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3e8650e-4339-494f-9f70-85e67c312655 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (59a1a59a-a7f3-46ca-b9b1-639140d57896), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.965222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3e8650e-4339-494f-9f70-85e67c312655 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:47.969213 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f3e8650e-4339-494f-9f70-85e67c312655 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/59a1a59a-a7f3-46ca-b9b1-639140d57896 HTTP/1.1" status: 204 len: 168 time: 0.6915989 Mar 24 02:16:47.972017 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:47.980661 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fa4dce72-8a9f-4e76-bb8f-f9ee22c50146 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "DELETE /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags/tempest-TagsTest-Tag-1101327188 HTTP/1.1" status: 204 len: 168 time: 0.3205016 Mar 24 02:16:47.985565 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60040) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:47.995809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-dd5d5b32-0722-4043-a7b3-6b32afbbf50b tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6', 'tempest-TagsTest-Tag-1101327188') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:48.003835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:48.011027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3e8650e-4339-494f-9f70-85e67c312655 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59a1a59a-a7f3-46ca-b9b1-639140d57896,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:48.012740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:48.013063 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:48.029087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:48.047589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:48.095301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event updated for resources: {'Port': ['ID=777a3610-d046-4096-80c3-b7a8e6faf3a7,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:48.105648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (f61a0f8a-856d-44d1-b428-62e6b517c4c8), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.111282 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Delete allocated IP 172.20.0.7 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/9b01bd06-549f-4756-86ba-eebb1d450eb6) {{(pid=104037) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Mar 24 02:16:48.160498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.23 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/682aa15b-b73a-4fc1-88f6-425543336542/ad434e1a-08a3-4990-93b1-502ccaf2dd2d) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:48.215083 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0c566ea-ac31-481c-85bf-15cf5363ce18 None None] Network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:48.370767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:48.372397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0558abf2-2d79-4c5a-b772-ed329fada168 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:48.391220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for floatingip (38d63644-7364-4f09-b991-87552d318343), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.396293 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (099eedfc-ff72-4619-9755-f018599ed44c), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.489897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (777a3610-d046-4096-80c3-b7a8e6faf3a7), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.490630 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ded2db-2187-4060-b252-1a29ad34a96c None None] Pushing event updated for resources: {'Port': ['ID=3e889e2b-f799-4c81-9ef1-b11645cb6543,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:48.504492 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Attempting to bind port 4533ba23-9b66-46e8-92bf-72caa725a46c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:48.505183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Attempting to bind port 4533ba23-9b66-46e8-92bf-72caa725a46c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '04bfbc97-7961-45cf-8c53-6628dcdd7c28'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:48.505693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Attempting to bind port 4533ba23-9b66-46e8-92bf-72caa725a46c on network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:48.512772 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-90da6d9f-d66d-4af0-8a73-ee5ca2c23f3c None None] Provisioning complete for port 0558abf2-2d79-4c5a-b772-ed329fada168 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:48.513330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90da6d9f-d66d-4af0-8a73-ee5ca2c23f3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.530071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.550584 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-dd5d5b32-0722-4043-a7b3-6b32afbbf50b tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] show failed (client error): The resource could not be found. Mar 24 02:16:48.553202 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dd5d5b32-0722-4043-a7b3-6b32afbbf50b tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "GET /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags/tempest-TagsTest-Tag-1101327188 HTTP/1.1" status: 404 len: 326 time: 0.5627661 Mar 24 02:16:48.559539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60052) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:48.571515 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-8b0cebc0-367a-4585-8b02-9874ef83741d tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6', 'tempest-TagsTest-Tag-132198884') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:48.574340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:48.574741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Checking segment: {'id': 'a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '04bfbc97-7961-45cf-8c53-6628dcdd7c28'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:48.575154 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.575538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Bound using segment: {'id': 'a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '04bfbc97-7961-45cf-8c53-6628dcdd7c28'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:48.576016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Bound port: 4533ba23-9b66-46e8-92bf-72caa725a46c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '04bfbc97-7961-45cf-8c53-6628dcdd7c28'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:48.576394 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.592792 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (ad434e1a-08a3-4990-93b1-502ccaf2dd2d), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.656444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (ad434e1a-08a3-4990-93b1-502ccaf2dd2d), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.692023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 0558abf2-2d79-4c5a-b772-ed329fada168 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:48.692421 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.726225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.785147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-9e6e68e2-8c2a-4a7c-996f-df6fc930e914 None None] Allocated IP 172.20.0.18 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/682aa15b-b73a-4fc1-88f6-425543336542/ce65f7b4-05fd-4b15-85ea-55ec88abec23) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:48.826209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] For port 4533ba23-9b66-46e8-92bf-72caa725a46c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:48.855499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-90da6d9f-d66d-4af0-8a73-ee5ca2c23f3c None None] Current status of the port 0558abf2-2d79-4c5a-b772-ed329fada168 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:48.855499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90da6d9f-d66d-4af0-8a73-ee5ca2c23f3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:48.900761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=ad434e1a-08a3-4990-93b1-502ccaf2dd2d,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:48.934645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] For port 4533ba23-9b66-46e8-92bf-72caa725a46c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4533ba23-9b66-46e8-92bf-72caa725a46c,segment=NetworkSegment(a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43),segment_id=a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:48.968793 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.004296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:49.005616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] In _notify_port_updated(), no bound segment for port ad434e1a-08a3-4990-93b1-502ccaf2dd2d on network c8466e8e-4c16-4f91-aa0d-8651c7d4116a {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:16:49.019195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:49.019875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.024089 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eb14ab82-416b-458a-9829-c3f51bac6d6e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "PUT /v2.0/ports/ad434e1a-08a3-4990-93b1-502ccaf2dd2d HTTP/1.1" status: 200 len: 920 time: 2.5635231 Mar 24 02:16:49.024712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60062) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.063997 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8b0cebc0-367a-4585-8b02-9874ef83741d tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "GET /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags/tempest-TagsTest-Tag-132198884 HTTP/1.1" status: 204 len: 168 time: 0.4967587 Mar 24 02:16:49.069547 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60066) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.077572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (099eedfc-ff72-4619-9755-f018599ed44c), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.083169 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-90da6d9f-d66d-4af0-8a73-ee5ca2c23f3c None None] For port 0558abf2-2d79-4c5a-b772-ed329fada168, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0558abf2-2d79-4c5a-b772-ed329fada168,segment=NetworkSegment(2656a5df-b5cc-4af8-936e-3937dd14f7f7),segment_id=2656a5df-b5cc-4af8-936e-3937dd14f7f7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:49.095971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:49.104384 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:49.105279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-8a667d6e-3412-46f2-ad37-67a9fcb0adee tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6', 'tempest-TagsTest-Tag-472172205') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:49.122107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:49.124556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.128950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc73f05b-2956-46e2-9aef-fa7eb3363162 None None] Pushing event updated for resources: {'Port': ['ID=4533ba23-9b66-46e8-92bf-72caa725a46c,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:49.129867 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for port (777a3610-d046-4096-80c3-b7a8e6faf3a7), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.140844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-90da6d9f-d66d-4af0-8a73-ee5ca2c23f3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.142173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (099eedfc-ff72-4619-9755-f018599ed44c), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.159898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:49.188198 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (777a3610-d046-4096-80c3-b7a8e6faf3a7), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.321946 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-875bfecf-8c01-458b-ac12-5d7f5d0d374b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.0923266 Mar 24 02:16:49.332443 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60070) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.359558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (f61a0f8a-856d-44d1-b428-62e6b517c4c8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.359803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9e6e68e2-8c2a-4a7c-996f-df6fc930e914 None None] For port ce65f7b4-05fd-4b15-85ea-55ec88abec23, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ce65f7b4-05fd-4b15-85ea-55ec88abec23,segment=NetworkSegment(cb1f6bda-0ce9-4c9a-968a-d29295cb534c),segment_id=cb1f6bda-0ce9-4c9a-968a-d29295cb534c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:49.403563 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 0558abf2-2d79-4c5a-b772-ed329fada168 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:49.404699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=099eedfc-ff72-4619-9755-f018599ed44c,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:49.433554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-320f9fa6-9d44-4f8d-9357-62b6656795fa None None] Provisioning complete for port 0558abf2-2d79-4c5a-b772-ed329fada168 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:49.434043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-320f9fa6-9d44-4f8d-9357-62b6656795fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.481076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event updated for resources: {'Port': ['ID=777a3610-d046-4096-80c3-b7a8e6faf3a7,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:49.498711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (38d63644-7364-4f09-b991-87552d318343), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.506248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60072) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.541517 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90da6d9f-d66d-4af0-8a73-ee5ca2c23f3c None None] Pushing event updated for resources: {'Port': ['ID=0558abf2-2d79-4c5a-b772-ed329fada168,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:49.557272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.563687 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b4d0a205-486c-4c3b-80fa-049dba9c77c5 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.7519915 Mar 24 02:16:49.564584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60076) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.572475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Request body: {'network': {'name': 'tempest-FloatingIPAdminTestJSON-test-network-1780078217'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:49.600262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-e31e4e62-8ec9-4e84-9401-a78da29824db tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port ad434e1a-08a3-4990-93b1-502ccaf2dd2d {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:49.600704 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e31e4e62-8ec9-4e84-9401-a78da29824db tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ad434e1a-08a3-4990-93b1-502ccaf2dd2d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.612718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9e6e68e2-8c2a-4a7c-996f-df6fc930e914 None None] Publish callbacks [] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.622116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9e6e68e2-8c2a-4a7c-996f-df6fc930e914 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.622282 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:49.625239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:49.692541 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8a667d6e-3412-46f2-ad37-67a9fcb0adee tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "GET /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags/tempest-TagsTest-Tag-472172205 HTTP/1.1" status: 204 len: 168 time: 0.6169629 Mar 24 02:16:49.700557 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60078) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.711023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-e0f60240-0641-400f-909f-9b8809691062 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:49.736777 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e423a4f-a611-4828-b3cf-2b2247a762ac None None] Network 5c876cac-460f-4279-a9ce-553b32670a9f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:49.743581 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3e889e2b-f799-4c81-9ef1-b11645cb6543 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:49.812550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-181825fb-f6dd-4bd1-9e5a-e67dbc4b04a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:49.818335 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-181825fb-f6dd-4bd1-9e5a-e67dbc4b04a7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports?fixed_ips=ip_address%3D2001%3Adb8%3A%3A1a2 HTTP/1.1" status: 200 len: 929 time: 0.4821093 Mar 24 02:16:49.818828 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60080) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.837611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-c8b050ee-9fd1-4fb9-be88-3c8fd4152c52 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:49.841473 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c8b050ee-9fd1-4fb9-be88-3c8fd4152c52 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.3311393 Mar 24 02:16:49.859912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60082) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.862470 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Made reservation on behalf of 3561433150a34016ae3a3844285683ef for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:49.867064 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.887130 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-be927a32-249e-45e4-815c-e3aa823dd016 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/address-group returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:49.888277 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-be927a32-249e-45e4-815c-e3aa823dd016 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/address-group HTTP/1.1" status: 200 len: 353 time: 0.0269101 Mar 24 02:16:49.893756 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60084) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.897051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.922837 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-320f9fa6-9d44-4f8d-9357-62b6656795fa None None] Current status of the port 0558abf2-2d79-4c5a-b772-ed329fada168 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:49.936671 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e31e4e62-8ec9-4e84-9401-a78da29824db tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ad434e1a-08a3-4990-93b1-502ccaf2dd2d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:49.955868 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-e31e4e62-8ec9-4e84-9401-a78da29824db tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for ad434e1a-08a3-4990-93b1-502ccaf2dd2d owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:49.965425 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router f61a0f8a-856d-44d1-b428-62e6b517c4c8 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:16:49.965916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-de481b1f-497e-42dc-b169-ce77fe8ce049 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/address-scope returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:49.968322 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-de481b1f-497e-42dc-b169-ce77fe8ce049 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/address-scope HTTP/1.1" status: 200 len: 357 time: 0.0682416 Mar 24 02:16:49.971281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60086) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.975134 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e6e68e2-8c2a-4a7c-996f-df6fc930e914 None None] Pushing event updated for resources: {'Port': ['ID=ce65f7b4-05fd-4b15-85ea-55ec88abec23,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:49.980619 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-2dcf4ad1-3db2-4373-98d2-b849030550e1 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/router-admin-state-down-before-update returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:49.984859 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2dcf4ad1-3db2-4373-98d2-b849030550e1 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/router-admin-state-down-before-update HTTP/1.1" status: 200 len: 506 time: 0.0091894 Mar 24 02:16:49.988954 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60088) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:49.995774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-320f9fa6-9d44-4f8d-9357-62b6656795fa None None] Provisioning complete for port 099eedfc-ff72-4619-9755-f018599ed44c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:49.996143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-320f9fa6-9d44-4f8d-9357-62b6656795fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (099eedfc-ff72-4619-9755-f018599ed44c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.002416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-1e751c29-b7bf-44d9-9d61-6158710b5e76 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/agent returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.006495 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1e751c29-b7bf-44d9-9d61-6158710b5e76 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/agent HTTP/1.1" status: 200 len: 347 time: 0.0123818 Mar 24 02:16:50.009263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60090) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.016388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e2bb9d2e-80e3-432d-a65d-45113142daab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:50.016575 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e2bb9d2e-80e3-432d-a65d-45113142daab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.045590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3e889e2b-f799-4c81-9ef1-b11645cb6543 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:50.045966 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.074238 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-20c932db-e9a6-47e9-983c-69e798122208 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/agent-resources-synced returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.075443 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-20c932db-e9a6-47e9-983c-69e798122208 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/agent-resources-synced HTTP/1.1" status: 200 len: 417 time: 0.0585539 Mar 24 02:16:50.085497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-320f9fa6-9d44-4f8d-9357-62b6656795fa None None] Port 099eedfc-ff72-4619-9755-f018599ed44c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:50.087490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60092) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.097294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-89497b3f-8258-43d2-b663-ee53cb7f0617 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/allowed-address-pairs returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.098682 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-89497b3f-8258-43d2-b663-ee53cb7f0617 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/allowed-address-pairs HTTP/1.1" status: 200 len: 378 time: 0.0058441 Mar 24 02:16:50.104621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60094) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.112750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-ae884525-7c7d-48f9-9ab5-135d29a2825a tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/auto-allocated-topology returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.113810 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ae884525-7c7d-48f9-9ab5-135d29a2825a tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/auto-allocated-topology HTTP/1.1" status: 200 len: 394 time: 0.0072932 Mar 24 02:16:50.124207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60096) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.130830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-08bb8e82-c83d-48eb-a292-a24274eab85d tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/availability_zone returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.131873 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-08bb8e82-c83d-48eb-a292-a24274eab85d tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/availability_zone HTTP/1.1" status: 200 len: 372 time: 0.0046275 Mar 24 02:16:50.172762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60098) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.178349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3e889e2b-f799-4c81-9ef1-b11645cb6543 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:50.178739 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.186179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-4c0f9fbb-7f7e-4747-978b-1c37bf53ec28 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/availability_zone_filter returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.187255 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4c0f9fbb-7f7e-4747-978b-1c37bf53ec28 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/availability_zone_filter HTTP/1.1" status: 200 len: 414 time: 0.0135322 Mar 24 02:16:50.194294 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e0f60240-0641-400f-909f-9b8809691062 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "DELETE /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags HTTP/1.1" status: 204 len: 168 time: 0.4924273 Mar 24 02:16:50.196789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60100) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.197136 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60102) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.202374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.tag.tag_plugin [None req-d82513e4-bf42-4331-ab35-5c223b9f86f3 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6', 'tempest-TagsTest-Tag-132198884') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:50.209157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-22b2d797-529e-4e07-a50b-36cb97f1cc14 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/default-subnetpools returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.210150 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-22b2d797-529e-4e07-a50b-36cb97f1cc14 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/default-subnetpools HTTP/1.1" status: 200 len: 405 time: 0.0121341 Mar 24 02:16:50.222879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60104) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.228298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-21571724-6f32-4f3b-8b42-7757c7b22445 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/dhcp_agent_scheduler returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.229290 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-21571724-6f32-4f3b-8b42-7757c7b22445 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/dhcp_agent_scheduler HTTP/1.1" status: 200 len: 381 time: 0.0054693 Mar 24 02:16:50.235955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60106) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.250011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-7f325bcf-3b3f-49da-8689-0204713bd302 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/dvr returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.251480 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7f325bcf-3b3f-49da-8689-0204713bd302 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/dvr HTTP/1.1" status: 200 len: 387 time: 0.0092537 Mar 24 02:16:50.254886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60108) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.255210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e2bb9d2e-80e3-432d-a65d-45113142daab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.262551 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-241621c3-af6c-485e-b033-d48db8c2a6f4 None None] Provisioning complete for port 3e889e2b-f799-4c81-9ef1-b11645cb6543 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:50.263219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-241621c3-af6c-485e-b033-d48db8c2a6f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.290932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e2bb9d2e-80e3-432d-a65d-45113142daab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:50.318551 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 3e889e2b-f799-4c81-9ef1-b11645cb6543, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3e889e2b-f799-4c81-9ef1-b11645cb6543,segment=NetworkSegment(9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7),segment_id=9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:50.325491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-63ee5f8c-bf67-41df-8e8a-6322ad6f5e9c tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/empty-string-filtering returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.329105 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-63ee5f8c-bf67-41df-8e8a-6322ad6f5e9c tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/empty-string-filtering HTTP/1.1" status: 200 len: 413 time: 0.0676503 Mar 24 02:16:50.332863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.335014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:50.336505 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60110) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.345518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-8ec7fdc9-c9e3-4513-b872-4ca44f91c7f6 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/external-net returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.346552 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8ec7fdc9-c9e3-4513-b872-4ca44f91c7f6 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/external-net HTTP/1.1" status: 200 len: 394 time: 0.0058255 Mar 24 02:16:50.351788 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-130ceda6-d980-41e1-80b3-5aa57d81f26d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/f61a0f8a-856d-44d1-b428-62e6b517c4c8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2450850 Mar 24 02:16:50.352417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60112) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.394570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60114) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.428611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=3e889e2b-f799-4c81-9ef1-b11645cb6543,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:50.431240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-919f74c2-2414-400d-a92f-a492dd2b686b None None] Sync routers for ids ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:50.463358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-919f74c2-2414-400d-a92f-a492dd2b686b None None] Routers {'f61a0f8a-856d-44d1-b428-62e6b517c4c8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:50.463996 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-919f74c2-2414-400d-a92f-a492dd2b686b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:50.465990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-383df891-e872-4fbc-bb68-4c59a461ee38 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/extra_dhcp_opt returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.467359 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-383df891-e872-4fbc-bb68-4c59a461ee38 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/extra_dhcp_opt HTTP/1.1" status: 200 len: 498 time: 0.1122208 Mar 24 02:16:50.470850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60116) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.477971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-6ec1714c-78e0-4e99-bc0d-42d8da6427fc tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/extraroute returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.479808 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6ec1714c-78e0-4e99-bc0d-42d8da6427fc tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/extraroute HTTP/1.1" status: 200 len: 375 time: 0.0086272 Mar 24 02:16:50.483161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60118) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.489024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-b08f29bc-93f1-4108-a93c-31ae99903b4a tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/extraroute-atomic returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.490909 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b08f29bc-93f1-4108-a93c-31ae99903b4a tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/extraroute-atomic HTTP/1.1" status: 200 len: 444 time: 0.0059340 Mar 24 02:16:50.494709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60120) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.504477 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-d7fc85e4-d22b-433f-a349-ca1c2da9e72c tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/filter-validation returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.506370 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d7fc85e4-d22b-433f-a349-ca1c2da9e72c tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/filter-validation HTTP/1.1" status: 200 len: 392 time: 0.0119731 Mar 24 02:16:50.513003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60122) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.524550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-919f74c2-2414-400d-a92f-a492dd2b686b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:50.536665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-919f74c2-2414-400d-a92f-a492dd2b686b None None] Routers {'f61a0f8a-856d-44d1-b428-62e6b517c4c8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:50.537453 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-919f74c2-2414-400d-a92f-a492dd2b686b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:50.541689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for security_group (8f68d962-62e9-4956-bff3-fc60eadeea81), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.549031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-1c1110a3-7c99-42c2-8497-948517fa4fee tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/fip-port-details returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.550200 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1c1110a3-7c99-42c2-8497-948517fa4fee tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/fip-port-details HTTP/1.1" status: 200 len: 406 time: 0.0362301 Mar 24 02:16:50.553675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60124) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.560597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9657ea0b-1642-46f6-9039-b422d7948c19 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:50.562812 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-843d7293-08bc-42a5-9530-f5fccf6de264 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/flavors returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.564519 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-843d7293-08bc-42a5-9530-f5fccf6de264 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/flavors HTTP/1.1" status: 200 len: 387 time: 0.0091205 Mar 24 02:16:50.565438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60126) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.571345 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9657ea0b-1642-46f6-9039-b422d7948c19 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports/099eedfc-ff72-4619-9755-f018599ed44c HTTP/1.1" status: 200 len: 910 time: 0.1687424 Mar 24 02:16:50.572371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60128) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.574555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8f68d962-62e9-4956-bff3-fc60eadeea81), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.584595 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-533a15eb-16ba-4eec-954e-450335d1a2e8 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/floatingip-pools returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.586246 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-533a15eb-16ba-4eec-954e-450335d1a2e8 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/floatingip-pools HTTP/1.1" status: 200 len: 382 time: 0.0061674 Mar 24 02:16:50.591913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60130) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.593229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e31e4e62-8ec9-4e84-9401-a78da29824db tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ad434e1a-08a3-4990-93b1-502ccaf2dd2d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.600714 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-919f74c2-2414-400d-a92f-a492dd2b686b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:50.601380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-919f74c2-2414-400d-a92f-a492dd2b686b None None] The sync data for ids ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:50.609519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-b63714ea-5527-4a9c-9845-8eb88ba74037 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/ip-substring-filtering returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.610511 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b63714ea-5527-4a9c-9845-8eb88ba74037 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/ip-substring-filtering HTTP/1.1" status: 200 len: 416 time: 0.0079930 Mar 24 02:16:50.623589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-241621c3-af6c-485e-b033-d48db8c2a6f4 None None] Current status of the port 3e889e2b-f799-4c81-9ef1-b11645cb6543 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:50.626740 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-d82513e4-bf42-4331-ab35-5c223b9f86f3 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] show failed (client error): The resource could not be found. Mar 24 02:16:50.628758 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d82513e4-bf42-4331-ab35-5c223b9f86f3 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "GET /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags/tempest-TagsTest-Tag-132198884 HTTP/1.1" status: 404 len: 325 time: 0.4291782 Mar 24 02:16:50.633487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60132) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.634481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60134) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.641548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-241621c3-af6c-485e-b033-d48db8c2a6f4 None None] Provisioning complete for port 099eedfc-ff72-4619-9755-f018599ed44c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:50.641931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-241621c3-af6c-485e-b033-d48db8c2a6f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (099eedfc-ff72-4619-9755-f018599ed44c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.680435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-f7e56dbe-3ee9-4616-824f-69ee61dbf85e tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/router returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.684514 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f7e56dbe-3ee9-4616-824f-69ee61dbf85e tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/router HTTP/1.1" status: 200 len: 450 time: 0.0193956 Mar 24 02:16:50.684717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e31e4e62-8ec9-4e84-9401-a78da29824db tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=ad434e1a-08a3-4990-93b1-502ccaf2dd2d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:50.686354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60136) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.687613 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-81f8aec7-0b40-46ac-bba7-92032046aa91 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6', 'tempest-TagsTest-Tag-472172205') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:50.705224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-241621c3-af6c-485e-b033-d48db8c2a6f4 None None] Port 099eedfc-ff72-4619-9755-f018599ed44c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:50.710014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-2297fed3-e123-4b74-9c49-e1c0abf5cc9f tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/ext-gw-mode returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.711112 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2297fed3-e123-4b74-9c49-e1c0abf5cc9f tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/ext-gw-mode HTTP/1.1" status: 200 len: 462 time: 0.0146289 Mar 24 02:16:50.713823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60138) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.714541 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8f68d962-62e9-4956-bff3-fc60eadeea81,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:50.721210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-2861cb15-50ff-4b07-a7ac-7fb2ef94e1c1 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/l3-ha returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.722483 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2861cb15-50ff-4b07-a7ac-7fb2ef94e1c1 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/l3-ha HTTP/1.1" status: 200 len: 360 time: 0.0049882 Mar 24 02:16:50.741178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60140) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.755335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-e89881b5-0cac-4593-b227-cb7bb96c771f tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/l3-flavors returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.758014 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e89881b5-0cac-4593-b227-cb7bb96c771f tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/l3-flavors HTTP/1.1" status: 200 len: 366 time: 0.0133200 Mar 24 02:16:50.782793 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60142) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.787183 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-e2852c85-cf65-4eb0-99ce-8e14700624aa tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/l3-port-ip-change-not-allowed returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.788204 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e2852c85-cf65-4eb0-99ce-8e14700624aa tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/l3-port-ip-change-not-allowed HTTP/1.1" status: 200 len: 439 time: 0.0045500 Mar 24 02:16:50.791249 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60144) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.796453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-8ecf9b25-0d31-4657-be94-18b56fd9a776 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/l3_agent_scheduler returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.796995 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8ecf9b25-0d31-4657-be94-18b56fd9a776 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/l3_agent_scheduler HTTP/1.1" status: 200 len: 374 time: 0.0045331 Mar 24 02:16:50.803667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60146) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.808001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-e1d65bef-b58d-478d-a1a1-fb5d7c6d7795 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/metering returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.809113 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e1d65bef-b58d-478d-a1a1-fb5d7c6d7795 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/metering HTTP/1.1" status: 200 len: 357 time: 0.0045161 Mar 24 02:16:50.822443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60148) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.830297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-5b438dad-b6d3-4870-8432-4f315f986a31 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/metering_source_and_destination_fields returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.831384 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5b438dad-b6d3-4870-8432-4f315f986a31 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/metering_source_and_destination_fields HTTP/1.1" status: 200 len: 515 time: 0.0081356 Mar 24 02:16:50.837976 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-59aed728-3221-496f-920e-1a7fa0e206bd None None] Provisioning complete for port 3e889e2b-f799-4c81-9ef1-b11645cb6543 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:50.838846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-59aed728-3221-496f-920e-1a7fa0e206bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.847021 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60150) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.851169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-ee24e096-9c10-4b92-8c8a-66171a4869b4 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/multi-provider returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.856200 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ee24e096-9c10-4b92-8c8a-66171a4869b4 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/multi-provider HTTP/1.1" status: 200 len: 406 time: 0.0083308 Mar 24 02:16:50.859348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60152) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.864893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-34d71aaa-4dbb-487c-b2ce-d0b759876443 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/net-mtu returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.868372 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-34d71aaa-4dbb-487c-b2ce-d0b759876443 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/net-mtu HTTP/1.1" status: 200 len: 370 time: 0.0055325 Mar 24 02:16:50.870931 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60154) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.880696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-27a516eb-99c4-4b43-8c09-f41ec4774005 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/net-mtu-writable returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.884859 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-27a516eb-99c4-4b43-8c09-f41ec4774005 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/net-mtu-writable HTTP/1.1" status: 200 len: 401 time: 0.0098839 Mar 24 02:16:50.885528 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60156) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.890609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-55279dac-48de-4745-ac9e-2e4423b2af89 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/network_availability_zone returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.894907 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-55279dac-48de-4745-ac9e-2e4423b2af89 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/network_availability_zone HTTP/1.1" status: 200 len: 394 time: 0.0051057 Mar 24 02:16:50.896172 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60158) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.903403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-fc64c246-5167-4671-a223-fcce2ec54c79 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/network-ip-availability returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.906798 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fc64c246-5167-4671-a223-fcce2ec54c79 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/network-ip-availability HTTP/1.1" status: 200 len: 410 time: 0.0064561 Mar 24 02:16:50.910139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e31e4e62-8ec9-4e84-9401-a78da29824db tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:50.914420 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e31e4e62-8ec9-4e84-9401-a78da29824db tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/ad434e1a-08a3-4990-93b1-502ccaf2dd2d HTTP/1.1" status: 204 len: 168 time: 1.8754570 Mar 24 02:16:50.918171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60160) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.918386 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60162) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.924190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-5adcf039-b610-45ec-b56c-fff4e28447d9 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/pagination returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.928907 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5adcf039-b610-45ec-b56c-fff4e28447d9 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/pagination HTTP/1.1" status: 200 len: 386 time: 0.0090551 Mar 24 02:16:50.940582 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60164) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.947495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-1d8a34f9-809d-4a7d-8614-abbf68f6be79 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/port-device-profile returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.952311 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1d8a34f9-809d-4a7d-8614-abbf68f6be79 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/port-device-profile HTTP/1.1" status: 200 len: 383 time: 0.0093744 Mar 24 02:16:50.952875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60166) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.972433 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-59aed728-3221-496f-920e-1a7fa0e206bd None None] Current status of the port 3e889e2b-f799-4c81-9ef1-b11645cb6543 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:50.975742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab3a73e5-20e0-432e-84ac-de860b249fca None None] Network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:50.976983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-2cfc955e-c438-4115-8c7c-0eeb386b1a20 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/port-mac-address-regenerate returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.980396 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2cfc955e-c438-4115-8c7c-0eeb386b1a20 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/port-mac-address-regenerate HTTP/1.1" status: 200 len: 403 time: 0.0047429 Mar 24 02:16:50.980396 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-1bc7b1f6-e001-42e5-9897-17f8b9c097f9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:16:50.983443 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1bc7b1f6-e001-42e5-9897-17f8b9c097f9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/ad434e1a-08a3-4990-93b1-502ccaf2dd2d HTTP/1.1" status: 404 len: 333 time: 0.0514648 Mar 24 02:16:50.983443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60168) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.987239 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-544c967b-fe9a-495f-98c9-eaf5531f86d7 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/port-numa-affinity-policy returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:50.990453 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-544c967b-fe9a-495f-98c9-eaf5531f86d7 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/port-numa-affinity-policy HTTP/1.1" status: 200 len: 392 time: 0.0052464 Mar 24 02:16:50.990453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60170) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:50.996120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60172) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.000108 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-190eff26-2419-48d3-9703-7f6d5152a74f tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/binding returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.003571 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-190eff26-2419-48d3-9703-7f6d5152a74f tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/binding HTTP/1.1" status: 200 len: 387 time: 0.0040421 Mar 24 02:16:51.007873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60174) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.013703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-2aa4087b-7a9b-4019-9e8d-0ef0d3390b12 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/binding-extended returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.017214 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2aa4087b-7a9b-4019-9e8d-0ef0d3390b12 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/binding-extended HTTP/1.1" status: 200 len: 406 time: 0.0061862 Mar 24 02:16:51.018571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60176) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.022656 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-6793e803-b1f7-40da-a755-6161950b9225 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/port-security returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.026040 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6793e803-b1f7-40da-a755-6161950b9225 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/port-security HTTP/1.1" status: 200 len: 354 time: 0.0043612 Mar 24 02:16:51.029256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60178) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.036736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-2d53aa77-9ab0-40dd-9681-b13bea851d87 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/project-id returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.040477 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2d53aa77-9ab0-40dd-9681-b13bea851d87 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/project-id HTTP/1.1" status: 200 len: 398 time: 0.0081809 Mar 24 02:16:51.041542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60182) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.047031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-731557c6-9d97-43d9-8d72-128f5ed74e10 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/provider returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.050596 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-731557c6-9d97-43d9-8d72-128f5ed74e10 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/provider HTTP/1.1" status: 200 len: 385 time: 0.0055552 Mar 24 02:16:51.053006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60184) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.059110 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-a856b03a-891f-499f-81da-de1fc214e776 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/quota-check-limit returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.060915 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a856b03a-891f-499f-81da-de1fc214e776 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/quota-check-limit HTTP/1.1" status: 200 len: 420 time: 0.0063198 Mar 24 02:16:51.063535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60186) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.069353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-e8220e0c-27f1-4abc-9a4a-974728edaf3d tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/quotas returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.072769 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e8220e0c-27f1-4abc-9a4a-974728edaf3d tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/quotas HTTP/1.1" status: 200 len: 386 time: 0.0054159 Mar 24 02:16:51.075141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60188) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.082896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-e52cc2b5-7470-44d1-ae47-f753004f337f tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/quota_details returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.086456 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e52cc2b5-7470-44d1-ae47-f753004f337f tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/quota_details HTTP/1.1" status: 200 len: 407 time: 0.0079856 Mar 24 02:16:51.091169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60190) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.098475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-e82bce1e-33f9-4759-bfda-05810d0ee173 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/rbac-policies returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.101821 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e82bce1e-33f9-4759-bfda-05810d0ee173 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/rbac-policies HTTP/1.1" status: 200 len: 417 time: 0.0066864 Mar 24 02:16:51.102281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60192) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.106463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-fcbe2ba1-fe11-4b51-8965-0474306eeead tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/rbac-address-group returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.108109 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fcbe2ba1-fe11-4b51-8965-0474306eeead tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/rbac-address-group HTTP/1.1" status: 200 len: 392 time: 0.0042441 Mar 24 02:16:51.110117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8455666d-5a6c-47b0-a327-9e9ae134faa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (45497b2f-24fd-4728-8987-5a24010bb63f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.111875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60194) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.120403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-ac35d5a7-804a-483f-a883-cc7b7dfbf0ab tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/rbac-address-scope returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.120403 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ac35d5a7-804a-483f-a883-cc7b7dfbf0ab tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/rbac-address-scope HTTP/1.1" status: 200 len: 384 time: 0.0051818 Mar 24 02:16:51.122887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60196) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.134593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-39400407-99ff-4e45-a8e0-ddfbe8190563 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/rbac-security-groups returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.137873 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-39400407-99ff-4e45-a8e0-ddfbe8190563 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/rbac-security-groups HTTP/1.1" status: 200 len: 404 time: 0.0126324 Mar 24 02:16:51.145926 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60198) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.147156 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 130} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:51.153143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-4de620d7-6e5e-4028-a9ae-642717ce5056 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/rbac-subnetpool returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.156519 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4de620d7-6e5e-4028-a9ae-642717ce5056 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/rbac-subnetpool HTTP/1.1" status: 200 len: 375 time: 0.0070739 Mar 24 02:16:51.156519 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e2bb9d2e-80e3-432d-a65d-45113142daab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.157997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60200) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.165377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-5447a291-53c9-4191-a418-de7c5d3467e6 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/revision-if-match returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.168717 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5447a291-53c9-4191-a418-de7c5d3467e6 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/revision-if-match HTTP/1.1" status: 200 len: 441 time: 0.0080361 Mar 24 02:16:51.170180 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60202) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.174735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8455666d-5a6c-47b0-a327-9e9ae134faa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (45497b2f-24fd-4728-8987-5a24010bb63f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.178545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (592adf92-627d-4865-92b2-f4769d1654a7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.178888 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Added segment 592adf92-627d-4865-92b2-f4769d1654a7 of type vlan for network dac30f63-f492-4007-bccd-3d53a7b4a3ec Mar 24 02:16:51.182825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-0c9ca613-e45b-487d-ad4b-952c175d7ec5 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/standard-attr-revisions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.186571 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0c9ca613-e45b-487d-ad4b-952c175d7ec5 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/standard-attr-revisions HTTP/1.1" status: 200 len: 423 time: 0.0111940 Mar 24 02:16:51.191010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2bb9d2e-80e3-432d-a65d-45113142daab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:51.198039 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60204) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.210026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-2b74bbfa-91ce-4d1a-bcc3-d298470019ce tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/router_availability_zone returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.212509 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2b74bbfa-91ce-4d1a-bcc3-d298470019ce tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/router_availability_zone HTTP/1.1" status: 200 len: 391 time: 0.0080562 Mar 24 02:16:51.219011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60206) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.222980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Provisioning complete for port 4533ba23-9b66-46e8-92bf-72caa725a46c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:51.223423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.248885 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-f7db0dc7-f55a-4860-ade6-9ef42fefdcc6 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/security-groups-normalized-cidr returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.254356 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f7db0dc7-f55a-4860-ade6-9ef42fefdcc6 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/security-groups-normalized-cidr HTTP/1.1" status: 200 len: 445 time: 0.0240622 Mar 24 02:16:51.254508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60208) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.255421 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (dac30f63-f492-4007-bccd-3d53a7b4a3ec), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.263137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-e918d1b8-ce8a-4bdf-8d33-f5d0d6eb1a6b tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/port-security-groups-filtering returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.266686 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e918d1b8-ce8a-4bdf-8d33-f5d0d6eb1a6b tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/port-security-groups-filtering HTTP/1.1" status: 200 len: 422 time: 0.0059490 Mar 24 02:16:51.269391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60210) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.273692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-f88f1438-0add-429f-a633-bf268c0522e8 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/security-groups-remote-address-group returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.277110 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f88f1438-0add-429f-a633-bf268c0522e8 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/security-groups-remote-address-group HTTP/1.1" status: 200 len: 448 time: 0.0044169 Mar 24 02:16:51.282747 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60212) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.286957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e2bb9d2e-80e3-432d-a65d-45113142daab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.292584 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e2bb9d2e-80e3-432d-a65d-45113142daab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb HTTP/1.1" status: 204 len: 168 time: 1.4669757 Mar 24 02:16:51.292761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-6dd82398-eef0-45e0-a176-f2e6b021f927 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/security-groups-shared-filtering returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.294945 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6dd82398-eef0-45e0-a176-f2e6b021f927 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/security-groups-shared-filtering HTTP/1.1" status: 200 len: 435 time: 0.0083842 Mar 24 02:16:51.306469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60214) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.307371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60216) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.324496 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-81f8aec7-0b40-46ac-bba7-92032046aa91 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] show failed (client error): The resource could not be found. Mar 24 02:16:51.328020 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-81f8aec7-0b40-46ac-bba7-92032046aa91 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "GET /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags/tempest-TagsTest-Tag-472172205 HTTP/1.1" status: 404 len: 325 time: 0.6592247 Mar 24 02:16:51.329261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60218) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.333172 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.tag.tag_plugin [None req-c1995dcf-ed19-48e2-8187-78eb50995ad2 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '613da851-19bf-4a2d-880a-1fc141b0c0a6') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:51.355189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-812e467d-9c48-4e9c-9c16-3f5535589ee1 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/security-group returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.355475 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Current status of the port 4533ba23-9b66-46e8-92bf-72caa725a46c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:51.356063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.359262 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-812e467d-9c48-4e9c-9c16-3f5535589ee1 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/security-group HTTP/1.1" status: 200 len: 364 time: 0.0196941 Mar 24 02:16:51.359262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8455666d-5a6c-47b0-a327-9e9ae134faa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (45497b2f-24fd-4728-8987-5a24010bb63f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.361908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8455666d-5a6c-47b0-a327-9e9ae134faa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.364038 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8455666d-5a6c-47b0-a327-9e9ae134faa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/security-groups/45497b2f-24fd-4728-8987-5a24010bb63f HTTP/1.1" status: 204 len: 168 time: 0.3740525 Mar 24 02:16:51.366530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60220) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.366984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60222) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.378889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (dac30f63-f492-4007-bccd-3d53a7b4a3ec), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.385163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:51.385917 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.410742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] For port 4533ba23-9b66-46e8-92bf-72caa725a46c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4533ba23-9b66-46e8-92bf-72caa725a46c,segment=NetworkSegment(a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43),segment_id=a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:51.422047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-ff94705f-3412-402b-a557-71e84c050802 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/service-type returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.422312 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.423904 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ff94705f-3412-402b-a557-71e84c050802 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/service-type HTTP/1.1" status: 200 len: 415 time: 0.0345452 Mar 24 02:16:51.427029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8455666d-5a6c-47b0-a327-9e9ae134faa7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=45497b2f-24fd-4728-8987-5a24010bb63f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:51.443883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60224) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.446667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Could not find standard attr ID for object ad434e1a-08a3-4990-93b1-502ccaf2dd2d. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:16:51.468735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-91677775-8a67-4162-b397-7e7443760dcd tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/sorting returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.471354 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-91677775-8a67-4162-b397-7e7443760dcd tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/sorting HTTP/1.1" status: 200 len: 377 time: 0.0223153 Mar 24 02:16:51.497739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60226) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.501079 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-596b1fe1-4f98-48d8-933c-031abd0fe0e7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:16:51.504256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-ae0fe58e-0725-4efa-b4a7-b3c3fbc8d5ad tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/standard-attr-description returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.505446 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ae0fe58e-0725-4efa-b4a7-b3c3fbc8d5ad tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/standard-attr-description HTTP/1.1" status: 200 len: 408 time: 0.0061002 Mar 24 02:16:51.511135 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-596b1fe1-4f98-48d8-933c-031abd0fe0e7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb HTTP/1.1" status: 404 len: 333 time: 0.1757927 Mar 24 02:16:51.515370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60228) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.515913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60230) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.522505 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-7d9a69cb-320b-4524-a037-d2e7c793f975 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/stateful-security-group returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.523703 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7d9a69cb-320b-4524-a037-d2e7c793f975 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/stateful-security-group HTTP/1.1" status: 200 len: 402 time: 0.0056877 Mar 24 02:16:51.533018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:51.537828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.574617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60232) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.586341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Pushing event updated for resources: {'Port': ['ID=4533ba23-9b66-46e8-92bf-72caa725a46c,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:51.586631 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-1ddf01ad-3d0e-4d94-861e-4e13dd066133 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/subnet_onboard returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.592708 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1ddf01ad-3d0e-4d94-861e-4e13dd066133 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/subnet_onboard HTTP/1.1" status: 200 len: 391 time: 0.0068583 Mar 24 02:16:51.592838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60234) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.620794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-aee43a88-1eb6-4e1f-a9e1-a8bda9f09fd6 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/subnet-service-types returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.621907 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-aee43a88-1eb6-4e1f-a9e1-a8bda9f09fd6 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/subnet-service-types HTTP/1.1" status: 200 len: 400 time: 0.0281153 Mar 24 02:16:51.624735 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c1995dcf-ed19-48e2-8187-78eb50995ad2 tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "DELETE /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6/tags HTTP/1.1" status: 204 len: 168 time: 0.2954915 Mar 24 02:16:51.628980 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60236) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.633079 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60238) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.636143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-5179a93c-0f22-4002-b39e-c87469315641 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/subnet_allocation returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.637446 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5179a93c-0f22-4002-b39e-c87469315641 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/subnet_allocation HTTP/1.1" status: 200 len: 388 time: 0.0049474 Mar 24 02:16:51.648772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60240) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.663047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [None req-c282db57-c552-4ef0-833d-6cf80f52b279 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/subnetpool-prefix-ops returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.663047 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c282db57-c552-4ef0-833d-6cf80f52b279 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/subnetpool-prefix-ops HTTP/1.1" status: 200 len: 418 time: 0.0051918 Mar 24 02:16:51.663262 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60242) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.674022 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 2.1060505 Mar 24 02:16:51.681071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60244) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.682406 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:51.688801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Request body: {'subnet': {'network_id': 'dac30f63-f492-4007-bccd-3d53a7b4a3ec', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:51.699775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Provisioning complete for port fb6aa634-7dc1-40b2-a10c-14a092dbd732 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:51.700771 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.710161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-b3b05ff1-37a3-444f-bb1d-39166b273ef0 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/standard-attr-tag returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.712048 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b3b05ff1-37a3-444f-bb1d-39166b273ef0 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/standard-attr-tag HTTP/1.1" status: 200 len: 537 time: 0.0460253 Mar 24 02:16:51.749576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60246) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:51.754959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [None req-30441cb3-8cb6-466c-a400-5e9a1aca0de2 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] http://10.222.0.20:9696/v2.0/extensions/standard-attr-timestamp returned with HTTP 200 {{(pid=104036) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:16:51.755948 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-30441cb3-8cb6-466c-a400-5e9a1aca0de2 tempest-ExtensionsTestJSON-655898271 tempest-ExtensionsTestJSON-655898271-project] 10.222.0.20 "GET /v2.0/extensions/standard-attr-timestamp HTTP/1.1" status: 200 len: 449 time: 0.0054243 Mar 24 02:16:51.779474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c89dc3cc-ec11-4140-8234-82ee036e4c73 None None] Port fb6aa634-7dc1-40b2-a10c-14a092dbd732 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:51.822393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ce65f7b4-05fd-4b15-85ea-55ec88abec23 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:51.859966 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07d33a4a-21cb-4b25-983d-2376760ae67d tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event updated for resources: {'Network': ['ID=dac30f63-f492-4007-bccd-3d53a7b4a3ec,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:51.886086 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network dac30f63-f492-4007-bccd-3d53a7b4a3ec details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:51.889074 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (613da851-19bf-4a2d-880a-1fc141b0c0a6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.898682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00ad7a74-b20f-43e0-bc0d-5d84d5d888b3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (b39665bc-2946-4cba-b961-bd96250a34d9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.931065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Made reservation on behalf of 3561433150a34016ae3a3844285683ef for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:51.932561 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-9945e45a-7671-45ef-94f1-68a8e34044c7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port e43de564-0962-4cc1-8ab0-18d90af4a87c {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:51.933180 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9945e45a-7671-45ef-94f1-68a8e34044c7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e43de564-0962-4cc1-8ab0-18d90af4a87c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.935331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.952995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00ad7a74-b20f-43e0-bc0d-5d84d5d888b3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (b39665bc-2946-4cba-b961-bd96250a34d9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:51.958052 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0c0a5d16-d873-463f-8aaa-2fdfdd5b22c7 None None] Could not find standard attr ID for object ad434e1a-08a3-4990-93b1-502ccaf2dd2d. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:16:52.024672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:52.025708 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.065667 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.122578 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5d5e697a-03a8-4c06-a44a-1136103129f8 None None] Provisioning complete for port 4533ba23-9b66-46e8-92bf-72caa725a46c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:52.122954 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5d5e697a-03a8-4c06-a44a-1136103129f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.187003 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:52.188298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3e889e2b-f799-4c81-9ef1-b11645cb6543 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:52.206611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00ad7a74-b20f-43e0-bc0d-5d84d5d888b3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b39665bc-2946-4cba-b961-bd96250a34d9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.216569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-00ad7a74-b20f-43e0-bc0d-5d84d5d888b3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.222584 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-00ad7a74-b20f-43e0-bc0d-5d84d5d888b3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/security-groups/b39665bc-2946-4cba-b961-bd96250a34d9 HTTP/1.1" status: 204 len: 168 time: 0.8316433 Mar 24 02:16:52.233832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60252) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:52.263703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ad7a74-b20f-43e0-bc0d-5d84d5d888b3 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b39665bc-2946-4cba-b961-bd96250a34d9,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:52.294013 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3e889e2b-f799-4c81-9ef1-b11645cb6543 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:52.294382 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.315628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60254) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:52.332547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (613da851-19bf-4a2d-880a-1fc141b0c0a6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.343001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5d5e697a-03a8-4c06-a44a-1136103129f8 None None] Current status of the port 4533ba23-9b66-46e8-92bf-72caa725a46c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:52.366283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5d5e697a-03a8-4c06-a44a-1136103129f8 None None] Provisioning complete for port e43de564-0962-4cc1-8ab0-18d90af4a87c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:52.366685 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5d5e697a-03a8-4c06-a44a-1136103129f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e43de564-0962-4cc1-8ab0-18d90af4a87c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.380504 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9945e45a-7671-45ef-94f1-68a8e34044c7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e43de564-0962-4cc1-8ab0-18d90af4a87c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.383045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (8e134c73-a965-43b5-984b-b2c8e4957f37), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.396741 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['613da851-19bf-4a2d-880a-1fc141b0c0a6']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:52.415460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-9945e45a-7671-45ef-94f1-68a8e34044c7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for e43de564-0962-4cc1-8ab0-18d90af4a87c owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:52.421871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-c7bbb206-a51c-4fb2-9ce4-7106f530e158 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet 9b01bd06-549f-4756-86ba-eebb1d450eb6 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:52.428297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd49da388-356d-490b-9f11-39404d931b1a') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:52.428963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd49da388-356d-490b-9f11-39404d931b1a') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:52.431791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5d5e697a-03a8-4c06-a44a-1136103129f8 None None] Port e43de564-0962-4cc1-8ab0-18d90af4a87c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:52.433959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c7bbb206-a51c-4fb2-9ce4-7106f530e158 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (9b01bd06-549f-4756-86ba-eebb1d450eb6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.445965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3e889e2b-f799-4c81-9ef1-b11645cb6543 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:52.447082 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4533ba23-9b66-46e8-92bf-72caa725a46c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:52.499043 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (d49da388-356d-490b-9f11-39404d931b1a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.501914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 4533ba23-9b66-46e8-92bf-72caa725a46c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:52.502561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.527404 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Checking segment: {'id': '592adf92-627d-4865-92b2-f4769d1654a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'dac30f63-f492-4007-bccd-3d53a7b4a3ec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:52.527772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Network hostable DHCP agents. Network: dac30f63-f492-4007-bccd-3d53a7b4a3ec, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:52.532897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event updated for resources: {'Subnet': ['ID=8e134c73-a965-43b5-984b-b2c8e4957f37,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:52.543730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-422fe536-f70c-41d5-8f7a-8baff18ccf02 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.569430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-27442ea4-4a51-480a-96d6-ee2d92e2fc67 None None] Provisioning complete for port e43de564-0962-4cc1-8ab0-18d90af4a87c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:52.569797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-27442ea4-4a51-480a-96d6-ee2d92e2fc67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e43de564-0962-4cc1-8ab0-18d90af4a87c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.635263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-422fe536-f70c-41d5-8f7a-8baff18ccf02 admin admin] Publish callbacks [] for security_group (87f77e41-44f8-4d99-9156-c699f270a294), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.639597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-27442ea4-4a51-480a-96d6-ee2d92e2fc67 None None] Port e43de564-0962-4cc1-8ab0-18d90af4a87c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:52.642751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 4533ba23-9b66-46e8-92bf-72caa725a46c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:52.643533 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-422fe536-f70c-41d5-8f7a-8baff18ccf02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (87f77e41-44f8-4d99-9156-c699f270a294), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.644625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0558abf2-2d79-4c5a-b772-ed329fada168 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:52.649684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Network dac30f63-f492-4007-bccd-3d53a7b4a3ec is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:52.685002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, dac30f63-f492-4007-bccd-3d53a7b4a3ec) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:52.695976 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-422fe536-f70c-41d5-8f7a-8baff18ccf02 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=62fd6cb2c13a4c18910fdaf1a59bdf6b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3792648 Mar 24 02:16:52.697840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:52.698666 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.701005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60258) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:52.701852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64124649-695a-4361-9b7b-f158f2242536 None None] Network dac30f63-f492-4007-bccd-3d53a7b4a3ec requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:52.706767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-422fe536-f70c-41d5-8f7a-8baff18ccf02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87f77e41-44f8-4d99-9156-c699f270a294,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:52.754712 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ff00ad11-6565-4019-8ef5-454709e58922 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0720494 Mar 24 02:16:52.755192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60262) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:52.773773 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Request body: {'router': {'name': 'tempest-FloatingIPAdminTestJSON-router-1990585700', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:52.813122 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 0558abf2-2d79-4c5a-b772-ed329fada168 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:52.813544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.822838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b73274fc-462f-405b-8bf5-aebac92d2dff admin admin] Publish callbacks [] for security_group (87f77e41-44f8-4d99-9156-c699f270a294), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.834094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (7bdf989e-5118-40f2-8477-89f182dcc10b), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.835657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (7bdf989e-5118-40f2-8477-89f182dcc10b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.837893 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c7bbb206-a51c-4fb2-9ce4-7106f530e158 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (9b01bd06-549f-4756-86ba-eebb1d450eb6), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.865938 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9945e45a-7671-45ef-94f1-68a8e34044c7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (e43de564-0962-4cc1-8ab0-18d90af4a87c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.882020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d49da388-356d-490b-9f11-39404d931b1a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.883974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4bae48ee-53c1-437c-9090-3e389642cf19 None None] Could not find standard attr ID for object af4a6aa6-18fa-4763-a44b-47f0e8f6c0cb. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:16:52.893564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for router_controller (7bdf989e-5118-40f2-8477-89f182dcc10b), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.911531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-dac30f63-f492-4007-bccd-3d53a7b4a3ec', 'network_id': 'dac30f63-f492-4007-bccd-3d53a7b4a3ec', 'project_id': '3561433150a34016ae3a3844285683ef', 'fixed_ips': [{'subnet_id': '8e134c73-a965-43b5-984b-b2c8e4957f37'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:52.912464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.988012 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c7bbb206-a51c-4fb2-9ce4-7106f530e158 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (9b01bd06-549f-4756-86ba-eebb1d450eb6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:52.992012 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b73274fc-462f-405b-8bf5-aebac92d2dff admin admin] Publish callbacks [] for security_group (87f77e41-44f8-4d99-9156-c699f270a294), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.045798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9945e45a-7671-45ef-94f1-68a8e34044c7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=e43de564-0962-4cc1-8ab0-18d90af4a87c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:53.054799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Releasing vlan 123 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:53.055202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (d49da388-356d-490b-9f11-39404d931b1a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:53.058894 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:53.073542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for router_gateway (7bdf989e-5118-40f2-8477-89f182dcc10b), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.088938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 0558abf2-2d79-4c5a-b772-ed329fada168 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:53.177082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9945e45a-7671-45ef-94f1-68a8e34044c7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.184546 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9945e45a-7671-45ef-94f1-68a8e34044c7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/e43de564-0962-4cc1-8ab0-18d90af4a87c HTTP/1.1" status: 204 len: 168 time: 1.6636949 Mar 24 02:16:53.184927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60268) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:53.195811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Allocated IP 172.20.0.2 (dac30f63-f492-4007-bccd-3d53a7b4a3ec/8e134c73-a965-43b5-984b-b2c8e4957f37/a124448b-6e8e-4e33-b837-ee975de76cf5) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:53.201263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b73274fc-462f-405b-8bf5-aebac92d2dff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (87f77e41-44f8-4d99-9156-c699f270a294), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.204333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b73274fc-462f-405b-8bf5-aebac92d2dff admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.206189 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b73274fc-462f-405b-8bf5-aebac92d2dff admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/87f77e41-44f8-4d99-9156-c699f270a294 HTTP/1.1" status: 204 len: 168 time: 0.5016508 Mar 24 02:16:53.212182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c7bbb206-a51c-4fb2-9ce4-7106f530e158 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (9b01bd06-549f-4756-86ba-eebb1d450eb6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.244542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b73274fc-462f-405b-8bf5-aebac92d2dff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87f77e41-44f8-4d99-9156-c699f270a294,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:53.257924 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-f425b113-32ca-437a-a7f1-3f4325fb8f94 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:16:53.261932 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f425b113-32ca-437a-a7f1-3f4325fb8f94 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/e43de564-0962-4cc1-8ab0-18d90af4a87c HTTP/1.1" status: 404 len: 333 time: 0.0732920 Mar 24 02:16:53.262145 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60272) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:53.266979 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.21.0.1 (5c876cac-460f-4279-a9ce-553b32670a9f/03b7d30a-5d44-4916-9c45-ac41eaae3a7f/6ab3e15c-ed75-4ec2-848d-10f6785825d1) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:53.269872 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7bbb206-a51c-4fb2-9ce4-7106f530e158 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=9b01bd06-549f-4756-86ba-eebb1d450eb6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:53.282588 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (613da851-19bf-4a2d-880a-1fc141b0c0a6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.286704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c7bbb206-a51c-4fb2-9ce4-7106f530e158 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.293417 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c7bbb206-a51c-4fb2-9ce4-7106f530e158 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/9b01bd06-549f-4756-86ba-eebb1d450eb6 HTTP/1.1" status: 204 len: 168 time: 1.0553374 Mar 24 02:16:53.299308 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60274) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:53.341449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:53.456157 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.456344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Publish callbacks [] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.462113 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] 10.222.0.20 "DELETE /v2.0/networks/613da851-19bf-4a2d-880a-1fc141b0c0a6 HTTP/1.1" status: 204 len: 168 time: 1.8216910 Mar 24 02:16:53.463385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d886b9e2-81d9-4b54-9cd0-98561a4b135c tempest-TagsTest-418290697 tempest-TagsTest-418290697-project] Pushing event deleted for resources: {'Network': ['ID=613da851-19bf-4a2d-880a-1fc141b0c0a6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:53.477485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f66e0e00-2d80-4695-a89d-763827cf058b None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:53.489536 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.543540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:53.547309 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.641471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4533ba23-9b66-46e8-92bf-72caa725a46c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:53.665547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.762622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.833174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Network dac30f63-f492-4007-bccd-3d53a7b4a3ec is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:53.836537 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 5c876cac-460f-4279-a9ce-553b32670a9f is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:53.839753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=6ab3e15c-ed75-4ec2-848d-10f6785825d1,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:53.845636 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:53.850314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:53.878273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-d6acdcd9-d067-41aa-8be3-ecf4f6c621f0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet dc00a534-aed7-41fa-ad57-69f513f5a472 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:16:53.882806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6acdcd9-d067-41aa-8be3-ecf4f6c621f0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (dc00a534-aed7-41fa-ad57-69f513f5a472), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.932612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for router_gateway (7bdf989e-5118-40f2-8477-89f182dcc10b), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.945980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Pushing event updated for resources: {'Port': ['ID=a124448b-6e8e-4e33-b837-ee975de76cf5,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:53.950362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:53.960967 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (f61a0f8a-856d-44d1-b428-62e6b517c4c8), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.968920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:53.982834 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6acdcd9-d067-41aa-8be3-ecf4f6c621f0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (dc00a534-aed7-41fa-ad57-69f513f5a472), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.010949 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:54.064983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60290) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:54.097744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 4533ba23-9b66-46e8-92bf-72caa725a46c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:54.098557 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.120221 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (4c962225-fd8e-450d-8d75-fb9db27325aa), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.197095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:54.215554 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:54.227416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:54.227742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.239027 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6acdcd9-d067-41aa-8be3-ecf4f6c621f0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (dc00a534-aed7-41fa-ad57-69f513f5a472), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.266174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Attempting to bind port a124448b-6e8e-4e33-b837-ee975de76cf5 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:54.266636 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Attempting to bind port a124448b-6e8e-4e33-b837-ee975de76cf5 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '592adf92-627d-4865-92b2-f4769d1654a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'dac30f63-f492-4007-bccd-3d53a7b4a3ec'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:54.267565 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Attempting to bind port a124448b-6e8e-4e33-b837-ee975de76cf5 on network dac30f63-f492-4007-bccd-3d53a7b4a3ec {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:54.268237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Allocated IP 172.26.2.120 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/ff1a1949-f877-4444-80e6-2f7014ba47e6) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:54.291547 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9545648 Mar 24 02:16:54.292129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a06347-e47c-4bda-9b42-8fd0907716fd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=4c962225-fd8e-450d-8d75-fb9db27325aa,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:54.294278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.294465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60302) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:54.304262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-72dd0886-a7c5-4cd2-aa55-dfc4aeb3a84b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'security_group': {'name': 'tempest-secgroup-1890194369'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:54.344980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:54.345414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Checking segment: {'id': '592adf92-627d-4865-92b2-f4769d1654a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'dac30f63-f492-4007-bccd-3d53a7b4a3ec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:54.345855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.346795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Bound using segment: {'id': '592adf92-627d-4865-92b2-f4769d1654a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'dac30f63-f492-4007-bccd-3d53a7b4a3ec'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:54.347634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Bound port: a124448b-6e8e-4e33-b837-ee975de76cf5, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '592adf92-627d-4865-92b2-f4769d1654a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'dac30f63-f492-4007-bccd-3d53a7b4a3ec'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:54.347634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.404412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-72dd0886-a7c5-4cd2-aa55-dfc4aeb3a84b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.465409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ad2ada54-f1e3-446a-95f0-d138b4a732f1 None None] Provisioning complete for port 6ab3e15c-ed75-4ec2-848d-10f6785825d1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:54.465409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ad2ada54-f1e3-446a-95f0-d138b4a732f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.497787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6acdcd9-d067-41aa-8be3-ecf4f6c621f0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (dc00a534-aed7-41fa-ad57-69f513f5a472), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.511451 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60304) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:54.552001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ad2ada54-f1e3-446a-95f0-d138b4a732f1 None None] Port 6ab3e15c-ed75-4ec2-848d-10f6785825d1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:54.572850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 4533ba23-9b66-46e8-92bf-72caa725a46c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:54.580337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6acdcd9-d067-41aa-8be3-ecf4f6c621f0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=dc00a534-aed7-41fa-ad57-69f513f5a472,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:54.604296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec661f8b-c7e2-4e45-954f-9b8824f2df31 None None] Network 04bfbc97-7961-45cf-8c53-6628dcdd7c28 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:54.605867 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6acdcd9-d067-41aa-8be3-ecf4f6c621f0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.612660 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d6acdcd9-d067-41aa-8be3-ecf4f6c621f0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/dc00a534-aed7-41fa-ad57-69f513f5a472 HTTP/1.1" status: 204 len: 168 time: 1.3460767 Mar 24 02:16:54.613638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60310) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:54.666674 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for port (ff1a1949-f877-4444-80e6-2f7014ba47e6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.675632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-72dd0886-a7c5-4cd2-aa55-dfc4aeb3a84b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (b4d4a867-4c02-4343-af9b-2e659677c400), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.684642 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'networks': [{'name': 'tempest-network--419495922'}, {'name': 'tempest-network--1201515820'}]} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:54.685014 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] For port a124448b-6e8e-4e33-b837-ee975de76cf5, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:54.685118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'network': {'name': 'tempest-network--419495922'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:54.685592 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'network': {'name': 'tempest-network--1201515820'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:54.696009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-72dd0886-a7c5-4cd2-aa55-dfc4aeb3a84b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b4d4a867-4c02-4343-af9b-2e659677c400), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.748839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (04bfbc97-7961-45cf-8c53-6628dcdd7c28), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.758654 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-29f857e2-b9b0-4684-930a-acf7a08f004c admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=694e705aed8b4192a55c9781044e07fa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6892717 Mar 24 02:16:54.762050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-72dd0886-a7c5-4cd2-aa55-dfc4aeb3a84b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.763405 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-72dd0886-a7c5-4cd2-aa55-dfc4aeb3a84b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.4663100 Mar 24 02:16:54.766701 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60312) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:54.766994 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60314) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:54.789444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4e83283d-1c48-420b-a9de-d782194086d8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'security_group': {'name': 'tempest-secgroup-2030088007'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:54.794381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Made reservation on behalf of 1939716dbdc043268b56130159aff4ba for: {'network': 2} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:54.800290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.811060 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72dd0886-a7c5-4cd2-aa55-dfc4aeb3a84b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b4d4a867-4c02-4343-af9b-2e659677c400,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:54.817882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.853138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ff1a1949-f877-4444-80e6-2f7014ba47e6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.882686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] For port a124448b-6e8e-4e33-b837-ee975de76cf5, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a124448b-6e8e-4e33-b837-ee975de76cf5,segment=NetworkSegment(592adf92-627d-4865-92b2-f4769d1654a7),segment_id=592adf92-627d-4865-92b2-f4769d1654a7)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:54.898208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.909745 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.913150 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4e83283d-1c48-420b-a9de-d782194086d8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.934655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:54.936455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:54.951056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:54.953732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:54.967513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3e17c05-f1c7-41c5-8e6f-862ea445b097 None None] Pushing event updated for resources: {'Port': ['ID=a124448b-6e8e-4e33-b837-ee975de76cf5,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:55.023737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event updated for resources: {'Port': ['ID=ff1a1949-f877-4444-80e6-2f7014ba47e6,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:55.068732 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] DHCP port deletion for 04bfbc97-7961-45cf-8c53-6628dcdd7c28 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:16:55.070711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d92a8bde-d730-418a-ba7a-472aac150a6b admin admin] Publish callbacks [] for security_group (b4353663-7334-446c-8ef3-72fb906b19fb), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.120932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4e83283d-1c48-420b-a9de-d782194086d8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (f4335630-e745-425b-a33c-1bfc99a1c11c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.121143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for security_group (6bf05dec-246a-4ca3-abb5-f692231fbd88), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.150214 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4e83283d-1c48-420b-a9de-d782194086d8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f4335630-e745-425b-a33c-1bfc99a1c11c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.152252 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Deleting port 4533ba23-9b66-46e8-92bf-72caa725a46c {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:55.152640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.155471 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d92a8bde-d730-418a-ba7a-472aac150a6b admin admin] Publish callbacks [] for security_group (b4353663-7334-446c-8ef3-72fb906b19fb), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.162678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=6ab3e15c-ed75-4ec2-848d-10f6785825d1,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:55.169617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (6bf05dec-246a-4ca3-abb5-f692231fbd88), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.170085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.184769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (f61a0f8a-856d-44d1-b428-62e6b517c4c8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.187066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.187419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.187763 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.188103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.188436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.188774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.189106 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.189728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.190058 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.190385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.190750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.191074 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.191400 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.191724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.192048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.215141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 4533ba23-9b66-46e8-92bf-72caa725a46c {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:55.216017 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.244873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] For port 4533ba23-9b66-46e8-92bf-72caa725a46c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4533ba23-9b66-46e8-92bf-72caa725a46c,segment=NetworkSegment(a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43),segment_id=a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:55.245272 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.262802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Calling delete_port for 4533ba23-9b66-46e8-92bf-72caa725a46c owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:55.282153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 101} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:55.294240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6bf05dec-246a-4ca3-abb5-f692231fbd88,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:55.316050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0f76ec56-297f-4223-8b5e-5ef8475457b5), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.316300 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Added segment 0f76ec56-297f-4223-8b5e-5ef8475457b5 of type vlan for network c28e7d92-e75c-4778-9106-83baa60eb63f Mar 24 02:16:55.323503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4e83283d-1c48-420b-a9de-d782194086d8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.327861 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4e83283d-1c48-420b-a9de-d782194086d8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.5416782 Mar 24 02:16:55.329325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60316) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:55.337239 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1d8595b2-63e8-4d8e-997f-4aae9534a1e5 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'security_group': {'name': 'tempest-secgroup-2113639493'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:55.355652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9572dbf3-e83c-4eba-94bd-e90910fa9f50 None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:55.436823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.464067 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] No DVR routers for this DVR port 4533ba23-9b66-46e8-92bf-72caa725a46c on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:55.495988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (c28e7d92-e75c-4778-9106-83baa60eb63f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.504205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Pushing event deleted for resources: {'Port': ['ID=4533ba23-9b66-46e8-92bf-72caa725a46c,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:55.515057 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.515408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.515747 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.516370 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.516866 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.517697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.518986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.519520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.520436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.520999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.521398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.521791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.522179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.522588 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.523069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87ead326-41ec-4709-85a6-b6488ec476e1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:55.529961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ba9380cb-8ab0-43c6-b38f-b346c6f0eea6 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:55.530616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ba9380cb-8ab0-43c6-b38f-b346c6f0eea6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.562504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1d8595b2-63e8-4d8e-997f-4aae9534a1e5 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.642811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a124448b-6e8e-4e33-b837-ee975de76cf5 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:55.663744 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 136} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:55.681786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for router_gateway (7bdf989e-5118-40f2-8477-89f182dcc10b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.757429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3210112e-da73-4f50-8d7d-cd7bc41fe177), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.757774 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Added segment 3210112e-da73-4f50-8d7d-cd7bc41fe177 of type vlan for network a7e59ba3-9f71-4e65-9e1d-d82620176b8e Mar 24 02:16:55.763862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a124448b-6e8e-4e33-b837-ee975de76cf5 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:55.764228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.765973 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ba9380cb-8ab0-43c6-b38f-b346c6f0eea6 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:55.836194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1d8595b2-63e8-4d8e-997f-4aae9534a1e5 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (f7200025-4892-400f-b60f-f992c8c86483), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.837975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (a7e59ba3-9f71-4e65-9e1d-d82620176b8e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.849119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e83283d-1c48-420b-a9de-d782194086d8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f4335630-e745-425b-a33c-1bfc99a1c11c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:55.849699 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1d8595b2-63e8-4d8e-997f-4aae9534a1e5 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f7200025-4892-400f-b60f-f992c8c86483), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.854034 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ba9380cb-8ab0-43c6-b38f-b346c6f0eea6 None None] Provisioning complete for port fb6aa634-7dc1-40b2-a10c-14a092dbd732 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:55.854219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ba9380cb-8ab0-43c6-b38f-b346c6f0eea6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.893479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b735029-df4b-426f-a2f7-4efa408be226 None None] Update dhcp port {'port': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'fixed_ips': [{'subnet_id': '682aa15b-b73a-4fc1-88f6-425543336542', 'ip_address': '172.20.0.18'}, {'subnet_id': '4c962225-fd8e-450d-8d75-fb9db27325aa'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': 'ce65f7b4-05fd-4b15-85ea-55ec88abec23'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:16:55.913256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1d8595b2-63e8-4d8e-997f-4aae9534a1e5 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.914693 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1d8595b2-63e8-4d8e-997f-4aae9534a1e5 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.5826666 Mar 24 02:16:55.920248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60320) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:55.920911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d8595b2-63e8-4d8e-997f-4aae9534a1e5 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f7200025-4892-400f-b60f-f992c8c86483,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:55.928322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1657576981', 'security_groups': ['f7200025-4892-400f-b60f-f992c8c86483'], 'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '4c962225-fd8e-450d-8d75-fb9db27325aa'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:55.933633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (c28e7d92-e75c-4778-9106-83baa60eb63f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.934137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (a7e59ba3-9f71-4e65-9e1d-d82620176b8e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.937425 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] For port 4533ba23-9b66-46e8-92bf-72caa725a46c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4533ba23-9b66-46e8-92bf-72caa725a46c,segment=NetworkSegment(a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43),segment_id=a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:55.937789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.939677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:55.944755 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:55.945525 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.947812 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ba9380cb-8ab0-43c6-b38f-b346c6f0eea6 None None] Port fb6aa634-7dc1-40b2-a10c-14a092dbd732 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:55.955082 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b735029-df4b-426f-a2f7-4efa408be226 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.964492 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 4533ba23-9b66-46e8-92bf-72caa725a46c owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:55.983164 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d92a8bde-d730-418a-ba7a-472aac150a6b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b4353663-7334-446c-8ef3-72fb906b19fb), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.986026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d92a8bde-d730-418a-ba7a-472aac150a6b admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:55.987953 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d92a8bde-d730-418a-ba7a-472aac150a6b admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/b4353663-7334-446c-8ef3-72fb906b19fb HTTP/1.1" status: 204 len: 168 time: 1.2131450 Mar 24 02:16:56.028264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a124448b-6e8e-4e33-b837-ee975de76cf5 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:56.028844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.036365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d92a8bde-d730-418a-ba7a-472aac150a6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4353663-7334-446c-8ef3-72fb906b19fb,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:56.039464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 5c876cac-460f-4279-a9ce-553b32670a9f is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:56.043993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:56.142069 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1319 time: 1.6234536 Mar 24 02:16:56.149320 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60324) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:56.159919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port a124448b-6e8e-4e33-b837-ee975de76cf5, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a124448b-6e8e-4e33-b837-ee975de76cf5,segment=NetworkSegment(592adf92-627d-4865-92b2-f4769d1654a7),segment_id=592adf92-627d-4865-92b2-f4769d1654a7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:56.203539 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.243203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (4533ba23-9b66-46e8-92bf-72caa725a46c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.289432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=a124448b-6e8e-4e33-b837-ee975de76cf5,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:56.296642 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4533ba23-9b66-46e8-92bf-72caa725a46c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:16:56.307370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router f61a0f8a-856d-44d1-b428-62e6b517c4c8 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:16:56.327529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No DVR routers for this DVR port 4533ba23-9b66-46e8-92bf-72caa725a46c on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:16:56.338741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 4533ba23-9b66-46e8-92bf-72caa725a46c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:16:56.339534 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4533ba23-9b66-46e8-92bf-72caa725a46c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:16:56.381060 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Network': ['ID=c28e7d92-e75c-4778-9106-83baa60eb63f,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:56.445826 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=4533ba23-9b66-46e8-92bf-72caa725a46c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:56.453770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-1b735029-df4b-426f-a2f7-4efa408be226 None None] Allocated IP 172.20.0.2 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/4c962225-fd8e-450d-8d75-fb9db27325aa/ce65f7b4-05fd-4b15-85ea-55ec88abec23) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:56.483601 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network c28e7d92-e75c-4778-9106-83baa60eb63f details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:56.623557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:56.626697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-124aa787-c696-47b1-96a6-e71a17acb8e7 None None] Provisioning complete for port 6ab3e15c-ed75-4ec2-848d-10f6785825d1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:56.627719 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-124aa787-c696-47b1-96a6-e71a17acb8e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.636246 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-865ed342-f7bf-44da-b39c-dc15410b01c9 None None] Sync routers for ids ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:56.643336 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4b831fa4-607f-4b0f-b42c-868d4e5d8081 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/f61a0f8a-856d-44d1-b428-62e6b517c4c8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0717404 Mar 24 02:16:56.645035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60326) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:56.649518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Network': ['ID=a7e59ba3-9f71-4e65-9e1d-d82620176b8e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:56.651185 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-865ed342-f7bf-44da-b39c-dc15410b01c9 None None] Routers {'f61a0f8a-856d-44d1-b428-62e6b517c4c8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:56.656098 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-865ed342-f7bf-44da-b39c-dc15410b01c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:56.671079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (7bdf989e-5118-40f2-8477-89f182dcc10b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.695545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.695988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.696414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.697067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.697657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.698175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.698741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.699422 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.701880 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.702348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.702835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.703278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.703716 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.704689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.704689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8f85a6-7eb4-46ad-9bbc-0a6e6c33c94d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:16:56.719769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (04bfbc97-7961-45cf-8c53-6628dcdd7c28), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.720826 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-865ed342-f7bf-44da-b39c-dc15410b01c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:56.724120 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1b735029-df4b-426f-a2f7-4efa408be226 None None] For port ce65f7b4-05fd-4b15-85ea-55ec88abec23, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ce65f7b4-05fd-4b15-85ea-55ec88abec23,segment=NetworkSegment(cb1f6bda-0ce9-4c9a-968a-d29295cb534c),segment_id=cb1f6bda-0ce9-4c9a-968a-d29295cb534c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:16:56.729194 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-124aa787-c696-47b1-96a6-e71a17acb8e7 None None] Port 6ab3e15c-ed75-4ec2-848d-10f6785825d1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:56.730924 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network a7e59ba3-9f71-4e65-9e1d-d82620176b8e details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:56.747311 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-865ed342-f7bf-44da-b39c-dc15410b01c9 None None] Routers {'f61a0f8a-856d-44d1-b428-62e6b517c4c8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:56.748256 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-865ed342-f7bf-44da-b39c-dc15410b01c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:56.751787 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5258f9c9-f73c-4a19-9458-8038f9656971 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:56.753495 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5258f9c9-f73c-4a19-9458-8038f9656971 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports/6ab3e15c-ed75-4ec2-848d-10f6785825d1 HTTP/1.1" status: 200 len: 910 time: 0.1074400 Mar 24 02:16:56.761697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60328) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:56.764000 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-107f1ca7-7068-48eb-805d-80e398154dc8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:56.765476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['04bfbc97-7961-45cf-8c53-6628dcdd7c28']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:56.773808 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-107f1ca7-7068-48eb-805d-80e398154dc8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:56.780460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-107f1ca7-7068-48eb-805d-80e398154dc8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:56.786339 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-107f1ca7-7068-48eb-805d-80e398154dc8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:56.788344 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-107f1ca7-7068-48eb-805d-80e398154dc8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2406 time: 0.6308005 Mar 24 02:16:56.803111 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-865ed342-f7bf-44da-b39c-dc15410b01c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:56.803326 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-460c79e5-1229-4a5e-880f-2bc242214228 None None] Network dac30f63-f492-4007-bccd-3d53a7b4a3ec requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:56.803778 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-865ed342-f7bf-44da-b39c-dc15410b01c9 None None] The sync data for ids ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:56.818424 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60330) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:56.819362 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:56.861832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:56.862487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:56.875996 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.880161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b735029-df4b-426f-a2f7-4efa408be226 None None] Publish callbacks [] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.903387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b735029-df4b-426f-a2f7-4efa408be226 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.904368 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.913761 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-bbec7d1a-b33d-4bdd-85d2-9379d4aab595 None None] Provisioning complete for port a124448b-6e8e-4e33-b837-ee975de76cf5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:56.914128 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bbec7d1a-b33d-4bdd-85d2-9379d4aab595 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.949406 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Releasing vlan 104 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:56.949809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (a0b3efcb-0c1c-412c-ad3b-edbb9cdbad43), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:56.952840 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:56.990958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (c28e7d92-e75c-4778-9106-83baa60eb63f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.020017 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.063680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b735029-df4b-426f-a2f7-4efa408be226 None None] Pushing event updated for resources: {'Port': ['ID=ce65f7b4-05fd-4b15-85ea-55ec88abec23,revision_number=6']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:57.069241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] device_id is not set on port 40e220bc-f2eb-434e-947c-992328993fce yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:57.078350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (04bfbc97-7961-45cf-8c53-6628dcdd7c28), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.092395 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.099433 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/networks/04bfbc97-7961-45cf-8c53-6628dcdd7c28 HTTP/1.1" status: 204 len: 168 time: 2.4774618 Mar 24 02:16:57.112240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60332) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:57.119871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1713939607'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:57.128574 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfdbcc26-d7a1-42e3-a6e9-abc4d8dddcbd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Network': ['ID=04bfbc97-7961-45cf-8c53-6628dcdd7c28,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:57.144340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-bbec7d1a-b33d-4bdd-85d2-9379d4aab595 None None] Current status of the port a124448b-6e8e-4e33-b837-ee975de76cf5 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:57.179711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:57.182927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.227729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 148} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:57.264646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (bb85b57f-68dd-4064-91f1-4496122b6072), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.265048 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Added segment bb85b57f-68dd-4064-91f1-4496122b6072 of type vlan for network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c Mar 24 02:16:57.312819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (20b14bc9-aab9-4b3b-88d7-f5d73c3e321c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.352402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (f61a0f8a-856d-44d1-b428-62e6b517c4c8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.356433 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (20b14bc9-aab9-4b3b-88d7-f5d73c3e321c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.362142 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:57.362960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.385248 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6e2000f2-6e7d-4eb9-81d3-bc2ec73bb54c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.500103 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.3840015 Mar 24 02:16:57.502421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60334) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:57.513784 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '20b14bc9-aab9-4b3b-88d7-f5d73c3e321c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:57.521779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1104d895-78ef-4422-b3ef-640124dc36a1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Network': ['ID=20b14bc9-aab9-4b3b-88d7-f5d73c3e321c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:57.547921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:57.560071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (c28e7d92-e75c-4778-9106-83baa60eb63f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.573541 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Router 7bdf989e-5118-40f2-8477-89f182dcc10b is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:16:57.625849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c28e7d92-e75c-4778-9106-83baa60eb63f']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:57.647078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0f76ec56-297f-4223-8b5e-5ef8475457b5') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:57.647376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0f76ec56-297f-4223-8b5e-5ef8475457b5') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:57.652804 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a124448b-6e8e-4e33-b837-ee975de76cf5 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:57.695388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:57.699100 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.730929 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (0f76ec56-297f-4223-8b5e-5ef8475457b5), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.741713 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-60155032-4bd7-4e3a-a53b-9376b61e6630 None None] Provisioning complete for port a124448b-6e8e-4e33-b837-ee975de76cf5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:57.742234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60155032-4bd7-4e3a-a53b-9376b61e6630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.752636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0f76ec56-297f-4223-8b5e-5ef8475457b5), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.782694 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a124448b-6e8e-4e33-b837-ee975de76cf5 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:57.783229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.790504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Releasing vlan 101 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:57.791150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (0f76ec56-297f-4223-8b5e-5ef8475457b5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:57.794407 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:57.876963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.7 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/4c962225-fd8e-450d-8d75-fb9db27325aa/40e220bc-f2eb-434e-947c-992328993fce) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:57.897473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 6ab3e15c-ed75-4ec2-848d-10f6785825d1 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:16:57.897995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.904742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-60155032-4bd7-4e3a-a53b-9376b61e6630 None None] Current status of the port a124448b-6e8e-4e33-b837-ee975de76cf5 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:57.914025 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (c28e7d92-e75c-4778-9106-83baa60eb63f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.918381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:57.924612 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/networks/c28e7d92-e75c-4778-9106-83baa60eb63f HTTP/1.1" status: 204 len: 168 time: 1.1008427 Mar 24 02:16:57.925214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60336) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:57.952638 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:16:57.970085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f56ce42e-8639-4609-b41e-3fcff64e12cf None None] Sync routers for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:16:57.973789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a124448b-6e8e-4e33-b837-ee975de76cf5 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:57.974882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ce65f7b4-05fd-4b15-85ea-55ec88abec23 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:16:58.005754 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f56ce42e-8639-4609-b41e-3fcff64e12cf None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:58.006263 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-f56ce42e-8639-4609-b41e-3fcff64e12cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:58.010404 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48ff56a6-4bd7-40dc-b5eb-3df631b4c777 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Network': ['ID=c28e7d92-e75c-4778-9106-83baa60eb63f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:58.039422 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.043344 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.045287 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bb787291-7fc0-4839-a9d2-a0f041facd88 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 892 time: 5.2779121 Mar 24 02:16:58.048153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60338) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:58.053426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-f56ce42e-8639-4609-b41e-3fcff64e12cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:58.076688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-bbf62adb-2853-4237-9579-d2a48ad48825 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:58.076958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (a7e59ba3-9f71-4e65-9e1d-d82620176b8e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.077100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bbf62adb-2853-4237-9579-d2a48ad48825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.081065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f56ce42e-8639-4609-b41e-3fcff64e12cf None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:16:58.081703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-f56ce42e-8639-4609-b41e-3fcff64e12cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:58.087080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 6ab3e15c-ed75-4ec2-848d-10f6785825d1 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:16:58.137420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-f56ce42e-8639-4609-b41e-3fcff64e12cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:58.138056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f56ce42e-8639-4609-b41e-3fcff64e12cf None None] The sync data for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:16:58.144154 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:58.145124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.223306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (f84cb7fe-4be1-41a6-8681-a1b8155acbdc), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.237477 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-bbf62adb-2853-4237-9579-d2a48ad48825 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:58.258334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (a7e59ba3-9f71-4e65-9e1d-d82620176b8e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.275444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (40e220bc-f2eb-434e-947c-992328993fce), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.275707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-bbf62adb-2853-4237-9579-d2a48ad48825 None None] Provisioning complete for port fb6aa634-7dc1-40b2-a10c-14a092dbd732 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:58.275924 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bbf62adb-2853-4237-9579-d2a48ad48825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.277928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:16:58.290458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a7e59ba3-9f71-4e65-9e1d-d82620176b8e']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:58.303483 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3210112e-da73-4f50-8d7d-cd7bc41fe177') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:58.303776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3210112e-da73-4f50-8d7d-cd7bc41fe177') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:16:58.312169 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-bbf62adb-2853-4237-9579-d2a48ad48825 None None] Port fb6aa634-7dc1-40b2-a10c-14a092dbd732 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:58.318295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (3210112e-da73-4f50-8d7d-cd7bc41fe177), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.338858 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3210112e-da73-4f50-8d7d-cd7bc41fe177), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.345557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=f84cb7fe-4be1-41a6-8681-a1b8155acbdc,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:58.347487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Releasing vlan 136 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:16:58.348470 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (3210112e-da73-4f50-8d7d-cd7bc41fe177), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:16:58.350883 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:16:58.361270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (40e220bc-f2eb-434e-947c-992328993fce), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.445004 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:58.448708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:58.454894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:58.457739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (a7e59ba3-9f71-4e65-9e1d-d82620176b8e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.474444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Checking segment: {'id': 'bb85b57f-68dd-4064-91f1-4496122b6072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '20b14bc9-aab9-4b3b-88d7-f5d73c3e321c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:58.474826 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network hostable DHCP agents. Network: 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:16:58.485485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.488754 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/networks/a7e59ba3-9f71-4e65-9e1d-d82620176b8e HTTP/1.1" status: 204 len: 168 time: 0.5561941 Mar 24 02:16:58.489661 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=40e220bc-f2eb-434e-947c-992328993fce,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:58.495313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60340) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:58.523027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:16:58.559990 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9864fc0b-c7f2-4e4d-acaf-944d2ba283ec tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Network': ['ID=a7e59ba3-9f71-4e65-9e1d-d82620176b8e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:58.560855 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:58.567393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:58.567996 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.585152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38d79a81-4276-4dfb-b1bf-627b26c08586 None None] Network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:16:58.592117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:58.592948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.614845 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b902b4c6-0de3-432e-84c8-859737d189e2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1094100 Mar 24 02:16:58.617601 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-95265ffa-ad0a-42fc-9e9d-e0992540ccbe tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.6940591 Mar 24 02:16:58.618898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60342) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:58.620462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60344) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:58.625075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ee124b46-0a7b-43c9-a2dd-e8923bf566a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:58.626194 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '20b14bc9-aab9-4b3b-88d7-f5d73c3e321c', 'name': 'tempest-PortsIpV6TestJSON-249431366', 'fixed_ips': [{'subnet_id': 'f84cb7fe-4be1-41a6-8681-a1b8155acbdc', 'ip_address': '2001:db8::10'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:58.633815 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (6ab3e15c-ed75-4ec2-848d-10f6785825d1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.702444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43a26af1-9e0d-4ac3-b6db-39d8f7fc18f5 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:58.708509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43a26af1-9e0d-4ac3-b6db-39d8f7fc18f5 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:58.710156 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-43a26af1-9e0d-4ac3-b6db-39d8f7fc18f5 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.2138953 Mar 24 02:16:58.716294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60346) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:58.723081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-414774413'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:58.733768 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-20b14bc9-aab9-4b3b-88d7-f5d73c3e321c', 'network_id': '20b14bc9-aab9-4b3b-88d7-f5d73c3e321c', 'project_id': '7b8dee850d65489ba8498576f69edde9', 'fixed_ips': [{'subnet_id': 'f84cb7fe-4be1-41a6-8681-a1b8155acbdc'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:16:58.734665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.765297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Made reservation on behalf of 1939716dbdc043268b56130159aff4ba for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:58.769204 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.777022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=6ab3e15c-ed75-4ec2-848d-10f6785825d1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:58.811406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 140} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:58.828283 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (6bcf4c0f-553f-407b-8ca4-53868b254a01), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.828666 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Added segment 6bcf4c0f-553f-407b-8ca4-53868b254a01 of type vlan for network 872dad4e-7fbd-403e-abf3-561b46f676c3 Mar 24 02:16:58.830827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee124b46-0a7b-43c9-a2dd-e8923bf566a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:58.835354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ee124b46-0a7b-43c9-a2dd-e8923bf566a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:58.961425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (872dad4e-7fbd-403e-abf3-561b46f676c3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.017588 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.ipam_backend_mixin [None req-ee124b46-0a7b-43c9-a2dd-e8923bf566a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 4c962225-fd8e-450d-8d75-fb9db27325aa (CIDR: 172.20.0.0/28) Mar 24 02:16:59.020506 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (872dad4e-7fbd-403e-abf3-561b46f676c3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.026081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:59.026924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.036057 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-ee124b46-0a7b-43c9-a2dd-e8923bf566a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:16:59.036959 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ee124b46-0a7b-43c9-a2dd-e8923bf566a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:59.081753 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2c85e385-31e4-48e5-bd34-b1f81a64487b None None] Provisioning complete for port 40e220bc-f2eb-434e-947c-992328993fce triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:16:59.082159 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2c85e385-31e4-48e5-bd34-b1f81a64487b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (40e220bc-f2eb-434e-947c-992328993fce), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.112727 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.3922253 Mar 24 02:16:59.114664 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60352) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:59.126165 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ee124b46-0a7b-43c9-a2dd-e8923bf566a7 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5039380 Mar 24 02:16:59.137981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-677119207'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:59.142560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60354) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:59.145727 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2c85e385-31e4-48e5-bd34-b1f81a64487b None None] Port 40e220bc-f2eb-434e-947c-992328993fce cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:16:59.148579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7c4f6b85-6b32-47c9-bd92-db95d335572a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:59.156048 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1269cfc-e654-42cd-89c6-1a74f5909ff3 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Network': ['ID=872dad4e-7fbd-403e-abf3-561b46f676c3,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:59.160124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Allocated IP 2001:db8::2 (20b14bc9-aab9-4b3b-88d7-f5d73c3e321c/f84cb7fe-4be1-41a6-8681-a1b8155acbdc/8694bd93-399e-4a1b-bfa9-f345ae0bb256) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:16:59.183488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 872dad4e-7fbd-403e-abf3-561b46f676c3 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:59.225542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Made reservation on behalf of 1939716dbdc043268b56130159aff4ba for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:59.229684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.280476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 137} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:16:59.296831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d90407cf-0b66-4c63-b467-f8a660731fb0), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.297615 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Added segment d90407cf-0b66-4c63-b467-f8a660731fb0 of type vlan for network 008a18e0-29c4-42c2-ae40-9b61e574a8f6 Mar 24 02:16:59.344765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c4f6b85-6b32-47c9-bd92-db95d335572a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:59.348901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7c4f6b85-6b32-47c9-bd92-db95d335572a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.355245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (008a18e0-29c4-42c2-ae40-9b61e574a8f6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.414892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:59.417040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Publish callbacks [] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.425666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.437075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (008a18e0-29c4-42c2-ae40-9b61e574a8f6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.442809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:16:59.443684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.469143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:16:59.474276 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:16:59.477028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:16:59.488964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (f61a0f8a-856d-44d1-b428-62e6b517c4c8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.497729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Pushing event updated for resources: {'Port': ['ID=8694bd93-399e-4a1b-bfa9-f345ae0bb256,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:59.538411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Network': ['ID=008a18e0-29c4-42c2-ae40-9b61e574a8f6,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:59.546192 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-560d2999-7f62-41e1-b923-bbc059dfecc4 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.4302449 Mar 24 02:16:59.549801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60356) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:59.553106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Attempting to bind port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:16:59.553504 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Attempting to bind port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'bb85b57f-68dd-4064-91f1-4496122b6072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '20b14bc9-aab9-4b3b-88d7-f5d73c3e321c'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:16:59.553916 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Attempting to bind port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 on network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:16:59.555440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'ports': [{'network_id': '872dad4e-7fbd-403e-abf3-561b46f676c3', 'name': 'tempest-port--1873092404', 'admin_state_up': True}, {'network_id': '008a18e0-29c4-42c2-ae40-9b61e574a8f6', 'admin_state_up': False}]} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:59.555850 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'port': {'network_id': '872dad4e-7fbd-403e-abf3-561b46f676c3', 'name': 'tempest-port--1873092404', 'admin_state_up': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:59.556440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'port': {'network_id': '008a18e0-29c4-42c2-ae40-9b61e574a8f6', 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:59.559108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 008a18e0-29c4-42c2-ae40-9b61e574a8f6 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:16:59.562930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 16, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:16:59.562930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Checking segment: {'id': 'bb85b57f-68dd-4064-91f1-4496122b6072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '20b14bc9-aab9-4b3b-88d7-f5d73c3e321c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:16:59.563196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.563754 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Bound using segment: {'id': 'bb85b57f-68dd-4064-91f1-4496122b6072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '20b14bc9-aab9-4b3b-88d7-f5d73c3e321c'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:16:59.564224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Bound port: 8694bd93-399e-4a1b-bfa9-f345ae0bb256, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bb85b57f-68dd-4064-91f1-4496122b6072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '20b14bc9-aab9-4b3b-88d7-f5d73c3e321c'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:16:59.564900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.565385 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.ipam_backend_mixin [None req-7c4f6b85-6b32-47c9-bd92-db95d335572a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Validation for CIDR: 172.20.0.16/28 failed - overlaps with subnet 682aa15b-b73a-4fc1-88f6-425543336542 (CIDR: 172.20.0.16/28) Mar 24 02:16:59.606877 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-7c4f6b85-6b32-47c9-bd92-db95d335572a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:16:59.607640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7c4f6b85-6b32-47c9-bd92-db95d335572a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:16:59.618325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.624803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.639053 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7c4f6b85-6b32-47c9-bd92-db95d335572a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 425 time: 0.4953952 Mar 24 02:16:59.645330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60358) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:16:59.652024 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'subnet': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'cidr': '172.20.0.32/28', 'ip_version': 4, 'gateway_ip': '172.20.0.33'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:16:59.667291 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port eb128083-aba4-4ab0-aee0-4e3050e767ca yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:16:59.691575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] For port 8694bd93-399e-4a1b-bfa9-f345ae0bb256, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:16:59.694668 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] For port 8694bd93-399e-4a1b-bfa9-f345ae0bb256, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8694bd93-399e-4a1b-bfa9-f345ae0bb256,segment=NetworkSegment(bb85b57f-68dd-4064-91f1-4496122b6072),segment_id=bb85b57f-68dd-4064-91f1-4496122b6072)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:16:59.701557 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.778041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7384f9-b9fe-4b6f-9092-eaba198f9e91 None None] Pushing event updated for resources: {'Port': ['ID=8694bd93-399e-4a1b-bfa9-f345ae0bb256,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:16:59.852319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Made reservation on behalf of 1939716dbdc043268b56130159aff4ba for: {'port': 2} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:59.856454 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.872840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Made reservation on behalf of 59047855c41744dd95105383d31cd553 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:16:59.876583 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:16:59.882298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.014996 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:17:00.016225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router f61a0f8a-856d-44d1-b428-62e6b517c4c8 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:00.084276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::10 (20b14bc9-aab9-4b3b-88d7-f5d73c3e321c/f84cb7fe-4be1-41a6-8681-a1b8155acbdc/eb128083-aba4-4ab0-aee0-4e3050e767ca) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:00.172614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] device_id is not set on port d43130e4-cef9-4d6e-83f6-84f1e1c68eb1 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:00.344146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.364256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:00.366381 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Allocated IP 172.20.0.1 (dac30f63-f492-4007-bccd-3d53a7b4a3ec/8e134c73-a965-43b5-984b-b2c8e4957f37/1e6ebb0d-3109-451d-adae-a0340f40756a) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:00.376674 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b4f2cf-6588-4376-99e4-496746ef8e37 None None] Sync routers for ids ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:00.379040 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9998ece2-f681-4d1a-8c69-8f9b6175798b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/f61a0f8a-856d-44d1-b428-62e6b517c4c8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6162698 Mar 24 02:17:00.379689 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60360) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:00.391288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for port (d43130e4-cef9-4d6e-83f6-84f1e1c68eb1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.392439 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68b4f2cf-6588-4376-99e4-496746ef8e37 None None] Routers {'f61a0f8a-856d-44d1-b428-62e6b517c4c8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:00.393993 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-68b4f2cf-6588-4376-99e4-496746ef8e37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:00.434450 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-68b4f2cf-6588-4376-99e4-496746ef8e37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:00.436675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:00.447087 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68b4f2cf-6588-4376-99e4-496746ef8e37 None None] Routers {'f61a0f8a-856d-44d1-b428-62e6b517c4c8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:00.447975 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-68b4f2cf-6588-4376-99e4-496746ef8e37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:16:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:00.448158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:00.455227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:00.455832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.457777 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e292def-c7cb-4c92-89d0-73d73cd0c258 None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:00.478014 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 0.8291070 Mar 24 02:17:00.483635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60362) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:00.489610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-731151405', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a'}], 'security_groups': ['b4d4a867-4c02-4343-af9b-2e659677c400', 'f4335630-e745-425b-a33c-1bfc99a1c11c']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:00.509562 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-68b4f2cf-6588-4376-99e4-496746ef8e37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:00.510541 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b4f2cf-6588-4376-99e4-496746ef8e37 None None] The sync data for ids ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:00.534381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea70822-7f32-4220-bcc0-0e099e723921 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Subnet': ['ID=2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:00.547821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] device_id is not set on port d0faae99-c4fd-4afa-a606-81ed9b1bbe31 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:00.590302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (40e220bc-f2eb-434e-947c-992328993fce), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.624015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (eb128083-aba4-4ab0-aee0-4e3050e767ca), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.626806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e52a4490-ed87-4e8d-8d14-71b6c416edde None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.737203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.779870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d9d6370-0da3-4bc9-b109-62d86ea19229 None None] Update dhcp port {'port': {'network_id': 'c8466e8e-4c16-4f91-aa0d-8651c7d4116a', 'fixed_ips': [{'subnet_id': '682aa15b-b73a-4fc1-88f6-425543336542', 'ip_address': '172.20.0.18'}, {'subnet_id': '4c962225-fd8e-450d-8d75-fb9db27325aa', 'ip_address': '172.20.0.2'}, {'subnet_id': '2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': 'ce65f7b4-05fd-4b15-85ea-55ec88abec23'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:17:00.803749 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for port (d0faae99-c4fd-4afa-a606-81ed9b1bbe31), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.820785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0d9d6370-0da3-4bc9-b109-62d86ea19229 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.825074 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.845515 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (eb128083-aba4-4ab0-aee0-4e3050e767ca), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.896958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.913749 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (d43130e4-cef9-4d6e-83f6-84f1e1c68eb1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:00.921959 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Network dac30f63-f492-4007-bccd-3d53a7b4a3ec is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:00.933818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:00.940115 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:00.982062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:01.000456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:01.001935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Port': ['ID=d43130e4-cef9-4d6e-83f6-84f1e1c68eb1,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:01.022484 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:01.028625 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:01.029776 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.035664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event updated for resources: {'Port': ['ID=1e6ebb0d-3109-451d-adae-a0340f40756a,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:01.050979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Checking segment: {'id': '6bcf4c0f-553f-407b-8ca4-53868b254a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '872dad4e-7fbd-403e-abf3-561b46f676c3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:01.051679 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Network hostable DHCP agents. Network: 872dad4e-7fbd-403e-abf3-561b46f676c3, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:01.089410 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5eed290-5df8-4a56-8272-b91f30a6c643 None None] Network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:01.104470 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Network 872dad4e-7fbd-403e-abf3-561b46f676c3 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:01.128939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 872dad4e-7fbd-403e-abf3-561b46f676c3) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:01.133757 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:01.134407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (d0faae99-c4fd-4afa-a606-81ed9b1bbe31), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.141198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (7bdf989e-5118-40f2-8477-89f182dcc10b), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.152246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Delete allocated IP 172.20.0.7 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/4c962225-fd8e-450d-8d75-fb9db27325aa) {{(pid=104037) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Mar 24 02:17:01.167826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a07ef92-b73f-4d11-9ed4-b7cd2baf0216 None None] Network 872dad4e-7fbd-403e-abf3-561b46f676c3 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:01.188151 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 2.5637515 Mar 24 02:17:01.192882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60364) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:01.202766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '20b14bc9-aab9-4b3b-88d7-f5d73c3e321c', 'name': 'tempest-PortsIpV6TestJSON-1206959373', 'fixed_ips': [{'subnet_id': 'f84cb7fe-4be1-41a6-8681-a1b8155acbdc', 'ip_address': '2001:db8::f'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:01.209435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff0cf8ba-0262-425b-8f5e-df4bafb648f7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=eb128083-aba4-4ab0-aee0-4e3050e767ca,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:01.214483 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Allocated IP 172.20.0.40 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a/40e220bc-f2eb-434e-947c-992328993fce) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:01.304109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f674d79b-50cb-411b-af5d-c70e8a197bb2 None None] Provisioning complete for port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:01.304109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f674d79b-50cb-411b-af5d-c70e8a197bb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.318044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Port': ['ID=d0faae99-c4fd-4afa-a606-81ed9b1bbe31,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:01.343610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Checking segment: {'id': 'd90407cf-0b66-4c63-b467-f8a660731fb0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '008a18e0-29c4-42c2-ae40-9b61e574a8f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:01.343972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Network hostable DHCP agents. Network: 008a18e0-29c4-42c2-ae40-9b61e574a8f6, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:01.384552 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (f61a0f8a-856d-44d1-b428-62e6b517c4c8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.391183 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.409473 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Network 008a18e0-29c4-42c2-ae40-9b61e574a8f6 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:01.432639 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f674d79b-50cb-411b-af5d-c70e8a197bb2 None None] Current status of the port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:01.433039 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f674d79b-50cb-411b-af5d-c70e8a197bb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.468843 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f674d79b-50cb-411b-af5d-c70e8a197bb2 None None] For port 8694bd93-399e-4a1b-bfa9-f345ae0bb256, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8694bd93-399e-4a1b-bfa9-f345ae0bb256,segment=NetworkSegment(bb85b57f-68dd-4064-91f1-4496122b6072),segment_id=bb85b57f-68dd-4064-91f1-4496122b6072)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:01.474340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f674d79b-50cb-411b-af5d-c70e8a197bb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.490408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 008a18e0-29c4-42c2-ae40-9b61e574a8f6) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:01.494822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:01.501040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:01.506281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:01.506590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.558168 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b4101a83-d635-4812-8fb2-9b7b2ccef83b tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 2.0045595 Mar 24 02:17:01.559171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60366) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:01.561175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:01.596410 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f674d79b-50cb-411b-af5d-c70e8a197bb2 None None] Pushing event updated for resources: {'Port': ['ID=8694bd93-399e-4a1b-bfa9-f345ae0bb256,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:01.599238 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83179cba-92df-4bf6-8283-1b4acdbe6d81 None None] Network 008a18e0-29c4-42c2-ae40-9b61e574a8f6 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:01.678052 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 8694bd93-399e-4a1b-bfa9-f345ae0bb256 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:01.691427 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b2c31022-301a-40fe-b96a-6e91f32f36b7 None None] Provisioning complete for port 1e6ebb0d-3109-451d-adae-a0340f40756a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:01.692043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b2c31022-301a-40fe-b96a-6e91f32f36b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.736686 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.747920 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b2c31022-301a-40fe-b96a-6e91f32f36b7 None None] Port 1e6ebb0d-3109-451d-adae-a0340f40756a cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:01.777683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for port (40e220bc-f2eb-434e-947c-992328993fce), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.809058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8619de79-0f59-4bc9-a401-351303352f9a tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:01.816162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8619de79-0f59-4bc9-a401-351303352f9a tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:01.817928 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8619de79-0f59-4bc9-a401-351303352f9a tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.2576416 Mar 24 02:17:01.818983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (40e220bc-f2eb-434e-947c-992328993fce), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.821800 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port 52b880af-1aed-4065-90a8-21014b0ebaf5 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:01.825262 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60368) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:01.905850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-0d9d6370-0da3-4bc9-b109-62d86ea19229 None None] Allocated IP 172.20.0.34 (c8466e8e-4c16-4f91-aa0d-8651c7d4116a/2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a/ce65f7b4-05fd-4b15-85ea-55ec88abec23) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:01.910968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:01.911378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:01.917511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7f3c8504-ed6c-4983-b546-308e8273ac39 None None] Provisioning complete for port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:01.917859 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7f3c8504-ed6c-4983-b546-308e8273ac39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.016012 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.031207 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.117858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7f3c8504-ed6c-4983-b546-308e8273ac39 None None] Current status of the port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:02.165059 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-0d9d6370-0da3-4bc9-b109-62d86ea19229 None None] For port ce65f7b4-05fd-4b15-85ea-55ec88abec23, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ce65f7b4-05fd-4b15-85ea-55ec88abec23,segment=NetworkSegment(cb1f6bda-0ce9-4c9a-968a-d29295cb534c),segment_id=cb1f6bda-0ce9-4c9a-968a-d29295cb534c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:02.186055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:02.194913 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7f3c8504-ed6c-4983-b546-308e8273ac39 None None] Provisioning complete for port eb128083-aba4-4ab0-aee0-4e3050e767ca triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:02.195290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7f3c8504-ed6c-4983-b546-308e8273ac39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (eb128083-aba4-4ab0-aee0-4e3050e767ca), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.240303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0d9d6370-0da3-4bc9-b109-62d86ea19229 None None] Publish callbacks [] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.245873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0d9d6370-0da3-4bc9-b109-62d86ea19229 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.298221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7f3c8504-ed6c-4983-b546-308e8273ac39 None None] Port eb128083-aba4-4ab0-aee0-4e3050e767ca cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:02.318022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d9d6370-0da3-4bc9-b109-62d86ea19229 None None] Pushing event updated for resources: {'Port': ['ID=ce65f7b4-05fd-4b15-85ea-55ec88abec23,revision_number=7']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:02.405043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.421627 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event updated for resources: {'Port': ['ID=40e220bc-f2eb-434e-947c-992328993fce,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:02.423728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 099eedfc-ff72-4619-9755-f018599ed44c {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:02.424631 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (099eedfc-ff72-4619-9755-f018599ed44c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.425644 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ce499ac2-bcca-4e1e-9ad9-2bec6a0644a0 None None] Provisioning complete for port eb128083-aba4-4ab0-aee0-4e3050e767ca triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:02.427002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ce499ac2-bcca-4e1e-9ad9-2bec6a0644a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (eb128083-aba4-4ab0-aee0-4e3050e767ca), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.449216 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-ecf0bfc8-4b1d-4659-a8d4-972389c94244 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Deleting port d43130e4-cef9-4d6e-83f6-84f1e1c68eb1 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:02.449557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ecf0bfc8-4b1d-4659-a8d4-972389c94244 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d43130e4-cef9-4d6e-83f6-84f1e1c68eb1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.473102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ce499ac2-bcca-4e1e-9ad9-2bec6a0644a0 None None] Port eb128083-aba4-4ab0-aee0-4e3050e767ca cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:02.482391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] In _notify_port_updated(), no bound segment for port 40e220bc-f2eb-434e-947c-992328993fce on network c8466e8e-4c16-4f91-aa0d-8651c7d4116a {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:17:02.488315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:02.489065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.490492 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1e5b369e-536f-495c-b28d-35d5f5ba2292 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "PUT /v2.0/ports/40e220bc-f2eb-434e-947c-992328993fce HTTP/1.1" status: 200 len: 959 time: 2.0059404 Mar 24 02:17:02.494196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60370) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:02.576882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (7bdf989e-5118-40f2-8477-89f182dcc10b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.599941 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event updated for resources: {'Port': ['ID=1e6ebb0d-3109-451d-adae-a0340f40756a,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:02.608001 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ecf0bfc8-4b1d-4659-a8d4-972389c94244 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d43130e4-cef9-4d6e-83f6-84f1e1c68eb1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.622918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::f (20b14bc9-aab9-4b3b-88d7-f5d73c3e321c/f84cb7fe-4be1-41a6-8681-a1b8155acbdc/52b880af-1aed-4065-90a8-21014b0ebaf5) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:02.675608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-733fcac9-33ac-4d5b-985a-5dc03cd55c6f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port 40e220bc-f2eb-434e-947c-992328993fce {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:02.675995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-733fcac9-33ac-4d5b-985a-5dc03cd55c6f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (40e220bc-f2eb-434e-947c-992328993fce), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.678235 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-ecf0bfc8-4b1d-4659-a8d4-972389c94244 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Calling delete_port for d43130e4-cef9-4d6e-83f6-84f1e1c68eb1 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:02.706262 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (099eedfc-ff72-4619-9755-f018599ed44c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.754476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 099eedfc-ff72-4619-9755-f018599ed44c owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:02.839330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-733fcac9-33ac-4d5b-985a-5dc03cd55c6f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (40e220bc-f2eb-434e-947c-992328993fce), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.863728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Network dac30f63-f492-4007-bccd-3d53a7b4a3ec is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:02.864840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-733fcac9-33ac-4d5b-985a-5dc03cd55c6f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for 40e220bc-f2eb-434e-947c-992328993fce owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:02.874732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:02.891117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (52b880af-1aed-4065-90a8-21014b0ebaf5), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:02.953669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ecf0bfc8-4b1d-4659-a8d4-972389c94244 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d43130e4-cef9-4d6e-83f6-84f1e1c68eb1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.008176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (52b880af-1aed-4065-90a8-21014b0ebaf5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.029727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecf0bfc8-4b1d-4659-a8d4-972389c94244 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Port': ['ID=d43130e4-cef9-4d6e-83f6-84f1e1c68eb1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:03.043611 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ecf0bfc8-4b1d-4659-a8d4-972389c94244 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.050803 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ecf0bfc8-4b1d-4659-a8d4-972389c94244 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/ports/d43130e4-cef9-4d6e-83f6-84f1e1c68eb1 HTTP/1.1" status: 204 len: 168 time: 1.2205832 Mar 24 02:17:03.059804 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60372) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:03.089878 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:03.095258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:03.104115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:03.109911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:03.110467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.141530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=52b880af-1aed-4065-90a8-21014b0ebaf5,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:03.150220 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b7c6d25d-8d28-40fc-aa07-1c8aa7bde4ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.9501288 Mar 24 02:17:03.150220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-733fcac9-33ac-4d5b-985a-5dc03cd55c6f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (40e220bc-f2eb-434e-947c-992328993fce), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.150719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60374) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:03.152230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fb45d480-5137-44db-bed2-a73811911da3 None None] Could not find standard attr ID for object 40e220bc-f2eb-434e-947c-992328993fce. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:17:03.167514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fb45d480-5137-44db-bed2-a73811911da3 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:03.167992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fb45d480-5137-44db-bed2-a73811911da3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.213452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-733fcac9-33ac-4d5b-985a-5dc03cd55c6f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=40e220bc-f2eb-434e-947c-992328993fce,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:03.225927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Router 7bdf989e-5118-40f2-8477-89f182dcc10b has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:03.235483 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (099eedfc-ff72-4619-9755-f018599ed44c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.275589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=099eedfc-ff72-4619-9755-f018599ed44c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:03.297088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d49a0dac-d358-4bd7-88fa-7f16bb058952 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:03.302151 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d49a0dac-d358-4bd7-88fa-7f16bb058952 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A1 HTTP/1.1" status: 200 len: 927 time: 0.1470933 Mar 24 02:17:03.304891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fb45d480-5137-44db-bed2-a73811911da3 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:03.307035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60376) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:03.312700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a3b6f09d-63d5-490f-8120-bc29a4999770 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Deleting port d0faae99-c4fd-4afa-a606-81ed9b1bbe31 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:03.313037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a3b6f09d-63d5-490f-8120-bc29a4999770 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d0faae99-c4fd-4afa-a606-81ed9b1bbe31), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.321684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fb45d480-5137-44db-bed2-a73811911da3 None None] Provisioning complete for port fb6aa634-7dc1-40b2-a10c-14a092dbd732 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:03.324361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fb45d480-5137-44db-bed2-a73811911da3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.354687 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-733fcac9-33ac-4d5b-985a-5dc03cd55c6f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.362867 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-733fcac9-33ac-4d5b-985a-5dc03cd55c6f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/40e220bc-f2eb-434e-947c-992328993fce HTTP/1.1" status: 204 len: 168 time: 0.8678734 Mar 24 02:17:03.368896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60378) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:03.381865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fb45d480-5137-44db-bed2-a73811911da3 None None] Port fb6aa634-7dc1-40b2-a10c-14a092dbd732 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:03.444499 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-c8b6e9d2-656a-46a5-aa39-44bab5a6edb9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] GET failed (client error): The resource could not be found. Mar 24 02:17:03.446110 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c8b6e9d2-656a-46a5-aa39-44bab5a6edb9 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports/40e220bc-f2eb-434e-947c-992328993fce HTTP/1.1" status: 404 len: 333 time: 0.0703158 Mar 24 02:17:03.450659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60382) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:03.475555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e5a7b2-4ac7-47eb-b30d-9737d9ffcdbc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:03.481458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e5a7b2-4ac7-47eb-b30d-9737d9ffcdbc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:03.490949 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e5a7b2-4ac7-47eb-b30d-9737d9ffcdbc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:03.493280 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f3e5a7b2-4ac7-47eb-b30d-9737d9ffcdbc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A HTTP/1.1" status: 200 len: 2390 time: 0.1850579 Mar 24 02:17:03.500282 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60384) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:03.519127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7119faa7-2881-457c-809d-99f67c13cb87 None None] Provisioning complete for port 1e6ebb0d-3109-451d-adae-a0340f40756a triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:03.519618 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7119faa7-2881-457c-809d-99f67c13cb87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.695256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-912b4168-8a88-460e-a65d-378b72e59a5d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (f7200025-4892-400f-b60f-f992c8c86483), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.695464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (f61a0f8a-856d-44d1-b428-62e6b517c4c8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.705674 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-697d8810-8c29-406a-bc35-d62b539c57cc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 52b880af-1aed-4065-90a8-21014b0ebaf5 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:03.705901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-697d8810-8c29-406a-bc35-d62b539c57cc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (52b880af-1aed-4065-90a8-21014b0ebaf5), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.706109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a3b6f09d-63d5-490f-8120-bc29a4999770 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d0faae99-c4fd-4afa-a606-81ed9b1bbe31), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.739873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ce65f7b4-05fd-4b15-85ea-55ec88abec23 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:03.784459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-912b4168-8a88-460e-a65d-378b72e59a5d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (f7200025-4892-400f-b60f-f992c8c86483), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.791844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.793659 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7119faa7-2881-457c-809d-99f67c13cb87 None None] Port 1e6ebb0d-3109-451d-adae-a0340f40756a cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:03.816349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a3b6f09d-63d5-490f-8120-bc29a4999770 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Calling delete_port for d0faae99-c4fd-4afa-a606-81ed9b1bbe31 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:03.836336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:03.837070 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.870786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-912b4168-8a88-460e-a65d-378b72e59a5d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f7200025-4892-400f-b60f-f992c8c86483), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.873609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-912b4168-8a88-460e-a65d-378b72e59a5d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.874818 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-912b4168-8a88-460e-a65d-378b72e59a5d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/security-groups/f7200025-4892-400f-b60f-f992c8c86483 HTTP/1.1" status: 204 len: 168 time: 0.4237382 Mar 24 02:17:03.877974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-697d8810-8c29-406a-bc35-d62b539c57cc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (52b880af-1aed-4065-90a8-21014b0ebaf5), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.896001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60386) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:03.896863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-912b4168-8a88-460e-a65d-378b72e59a5d tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7200025-4892-400f-b60f-f992c8c86483,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:03.917479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-697d8810-8c29-406a-bc35-d62b539c57cc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 52b880af-1aed-4065-90a8-21014b0ebaf5 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:03.968872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:03.969991 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 8694bd93-399e-4a1b-bfa9-f345ae0bb256 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:03.974629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-37a3f46a-fe91-45bd-8517-64e4f0d453d4 None None] Provisioning complete for port 52b880af-1aed-4065-90a8-21014b0ebaf5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:03.975008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37a3f46a-fe91-45bd-8517-64e4f0d453d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (52b880af-1aed-4065-90a8-21014b0ebaf5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:03.988542 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:03.994261 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5e807993-02bc-40aa-86db-973038dbfc80 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "PUT /v2.0/routers/7bdf989e-5118-40f2-8477-89f182dcc10b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9246359 Mar 24 02:17:03.999113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60388) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.009480 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Request body: {'port': {'network_id': 'dac30f63-f492-4007-bccd-3d53a7b4a3ec', 'name': 'tempest-FloatingIPAdminTestJSON-1589893716'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:04.021397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-67c5d4a5-2470-46e3-9432-e0a5c412376b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (f4335630-e745-425b-a33c-1bfc99a1c11c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.033887 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c3be52a-c519-4e52-a006-7eb8a753df96 None None] Sync routers for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:04.048036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-67c5d4a5-2470-46e3-9432-e0a5c412376b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (f4335630-e745-425b-a33c-1bfc99a1c11c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.058637 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-37a3f46a-fe91-45bd-8517-64e4f0d453d4 None None] Port 52b880af-1aed-4065-90a8-21014b0ebaf5 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:04.067174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-37a3f46a-fe91-45bd-8517-64e4f0d453d4 None None] Could not find standard attr ID for object 40e220bc-f2eb-434e-947c-992328993fce. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:17:04.074341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c3be52a-c519-4e52-a006-7eb8a753df96 None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:04.075209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0c3be52a-c519-4e52-a006-7eb8a753df96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:04.092884 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router f61a0f8a-856d-44d1-b428-62e6b517c4c8 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:04.102864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a3b6f09d-63d5-490f-8120-bc29a4999770 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d0faae99-c4fd-4afa-a606-81ed9b1bbe31), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.121286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0c3be52a-c519-4e52-a006-7eb8a753df96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:04.134574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:04.135025 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.136602 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c3be52a-c519-4e52-a006-7eb8a753df96 None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:04.137264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0c3be52a-c519-4e52-a006-7eb8a753df96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:04.146351 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3b6f09d-63d5-490f-8120-bc29a4999770 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Port': ['ID=d0faae99-c4fd-4afa-a606-81ed9b1bbe31,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:04.170238 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a3b6f09d-63d5-490f-8120-bc29a4999770 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.170704 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-67c5d4a5-2470-46e3-9432-e0a5c412376b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f4335630-e745-425b-a33c-1bfc99a1c11c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.175728 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a3b6f09d-63d5-490f-8120-bc29a4999770 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/ports/d0faae99-c4fd-4afa-a606-81ed9b1bbe31 HTTP/1.1" status: 204 len: 168 time: 1.1123917 Mar 24 02:17:04.175878 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-67c5d4a5-2470-46e3-9432-e0a5c412376b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.177709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60390) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.177709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60392) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.177943 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-67c5d4a5-2470-46e3-9432-e0a5c412376b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/security-groups/f4335630-e745-425b-a33c-1bfc99a1c11c HTTP/1.1" status: 204 len: 168 time: 0.2785454 Mar 24 02:17:04.189595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-697d8810-8c29-406a-bc35-d62b539c57cc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (52b880af-1aed-4065-90a8-21014b0ebaf5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.192027 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c5d4a5-2470-46e3-9432-e0a5c412376b tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4335630-e745-425b-a33c-1bfc99a1c11c,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:04.193870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0c3be52a-c519-4e52-a006-7eb8a753df96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:04.194569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c3be52a-c519-4e52-a006-7eb8a753df96 None None] The sync data for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:04.222177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697d8810-8c29-406a-bc35-d62b539c57cc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=52b880af-1aed-4065-90a8-21014b0ebaf5,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:04.254477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-697d8810-8c29-406a-bc35-d62b539c57cc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.260612 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-697d8810-8c29-406a-bc35-d62b539c57cc tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/52b880af-1aed-4065-90a8-21014b0ebaf5 HTTP/1.1" status: 204 len: 168 time: 0.7591028 Mar 24 02:17:04.261221 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60394) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.292093 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-8f58b11e-3a8e-4ca5-9301-abcfc7fd53a0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:17:04.294561 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8f58b11e-3a8e-4ca5-9301-abcfc7fd53a0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/52b880af-1aed-4065-90a8-21014b0ebaf5 HTTP/1.1" status: 404 len: 333 time: 0.0313625 Mar 24 02:17:04.296452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60396) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.297358 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bda16848-7ecd-44f3-94f8-2e39e93b6d57 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.1192205 Mar 24 02:17:04.304453 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:04.308051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60398) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.326160 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:04.333786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-658997158'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:04.337298 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8fc2a55a-2330-4776-9863-ef864cc89a5a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/f61a0f8a-856d-44d1-b428-62e6b517c4c8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9489160 Mar 24 02:17:04.337773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60400) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.338740 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e05c824-7138-4d21-a59b-6671c19a2dc6 None None] Sync routers for ids ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:04.358255 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e05c824-7138-4d21-a59b-6671c19a2dc6 None None] Routers {'f61a0f8a-856d-44d1-b428-62e6b517c4c8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:04.358912 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6e05c824-7138-4d21-a59b-6671c19a2dc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:04.378800 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fb25242c-ce44-4b7e-aa05-ecd49ba8600d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=f61a0f8a-856d-44d1-b428-62e6b517c4c8 HTTP/1.1" status: 200 len: 205 time: 0.0364652 Mar 24 02:17:04.381243 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60402) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.396411 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Made reservation on behalf of 3561433150a34016ae3a3844285683ef for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:04.397048 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Made reservation on behalf of 1939716dbdc043268b56130159aff4ba for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:04.399396 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6e05c824-7138-4d21-a59b-6671c19a2dc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:04.399868 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.404153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.409256 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e05c824-7138-4d21-a59b-6671c19a2dc6 None None] Routers {'f61a0f8a-856d-44d1-b428-62e6b517c4c8'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:04.409858 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6e05c824-7138-4d21-a59b-6671c19a2dc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:04.447613 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6e05c824-7138-4d21-a59b-6671c19a2dc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:04.448506 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e05c824-7138-4d21-a59b-6671c19a2dc6 None None] The sync data for ids ['f61a0f8a-856d-44d1-b428-62e6b517c4c8'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:04.466024 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 136} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:04.469577 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fbfd90d9-229a-4417-8a46-4f592d52e35c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (b4d4a867-4c02-4343-af9b-2e659677c400), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.482667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1563ff60-cf69-4f6a-94fd-fe60d162c190), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.483390 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Added segment 1563ff60-cf69-4f6a-94fd-fe60d162c190 of type vlan for network f1576fba-ff22-48d7-b14f-380566cfa438 Mar 24 02:17:04.496836 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] device_id is not set on port a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:04.511511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-95e68be0-62a6-434e-a8f0-cf35162a7900 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (f61a0f8a-856d-44d1-b428-62e6b517c4c8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.519187 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fbfd90d9-229a-4417-8a46-4f592d52e35c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (b4d4a867-4c02-4343-af9b-2e659677c400), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.538853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c1c8b6f9-d9d3-40d8-8802-553d2b4ce44c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port eb128083-aba4-4ab0-aee0-4e3050e767ca {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:04.539266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c1c8b6f9-d9d3-40d8-8802-553d2b4ce44c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (eb128083-aba4-4ab0-aee0-4e3050e767ca), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.545327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (f1576fba-ff22-48d7-b14f-380566cfa438), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.622133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (f1576fba-ff22-48d7-b14f-380566cfa438), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.627671 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:04.628257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.712189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c1c8b6f9-d9d3-40d8-8802-553d2b4ce44c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (eb128083-aba4-4ab0-aee0-4e3050e767ca), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.721551 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.4121852 Mar 24 02:17:04.729901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60406) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.740344 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1613041724'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:04.747241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b79e8df-938a-495b-a7cd-df5a47cd609c tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Network': ['ID=f1576fba-ff22-48d7-b14f-380566cfa438,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:04.749552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c1c8b6f9-d9d3-40d8-8802-553d2b4ce44c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for eb128083-aba4-4ab0-aee0-4e3050e767ca owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:04.760482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network f1576fba-ff22-48d7-b14f-380566cfa438 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:04.782874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fbfd90d9-229a-4417-8a46-4f592d52e35c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b4d4a867-4c02-4343-af9b-2e659677c400), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.785499 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fbfd90d9-229a-4417-8a46-4f592d52e35c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.789777 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fbfd90d9-229a-4417-8a46-4f592d52e35c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/security-groups/b4d4a867-4c02-4343-af9b-2e659677c400 HTTP/1.1" status: 204 len: 168 time: 0.6011674 Mar 24 02:17:04.794120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-95e68be0-62a6-434e-a8f0-cf35162a7900 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (f61a0f8a-856d-44d1-b428-62e6b517c4c8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.795427 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60408) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.805930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Made reservation on behalf of 1939716dbdc043268b56130159aff4ba for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:04.809288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.809473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-95e68be0-62a6-434e-a8f0-cf35162a7900 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (f61a0f8a-856d-44d1-b428-62e6b517c4c8), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.844557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbfd90d9-229a-4417-8a46-4f592d52e35c tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4d4a867-4c02-4343-af9b-2e659677c400,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:04.850475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 138} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:04.874442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0f355cf6-63e6-4df1-bebe-e9f676f3f1c7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.875187 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Added segment 0f355cf6-63e6-4df1-bebe-e9f676f3f1c7 of type vlan for network e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 Mar 24 02:17:04.893807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Allocated IP 172.20.0.4 (dac30f63-f492-4007-bccd-3d53a7b4a3ec/8e134c73-a965-43b5-984b-b2c8e4957f37/a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:04.920749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-4d8aa5b7-44f0-48a7-9ed7-46c6af5a3fbd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet 4c962225-fd8e-450d-8d75-fb9db27325aa {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:04.926967 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-95e68be0-62a6-434e-a8f0-cf35162a7900 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (f61a0f8a-856d-44d1-b428-62e6b517c4c8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.927521 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95e68be0-62a6-434e-a8f0-cf35162a7900 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Fanout notify agent at l3_agent the message router_deleted on router f61a0f8a-856d-44d1-b428-62e6b517c4c8 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:17:04.931273 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d8aa5b7-44f0-48a7-9ed7-46c6af5a3fbd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (4c962225-fd8e-450d-8d75-fb9db27325aa), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.946373 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-95e68be0-62a6-434e-a8f0-cf35162a7900 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:04.950129 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-95e68be0-62a6-434e-a8f0-cf35162a7900 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/f61a0f8a-856d-44d1-b428-62e6b517c4c8 HTTP/1.1" status: 204 len: 168 time: 0.5654075 Mar 24 02:17:04.959341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60410) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:04.972643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (e3dcbaad-6ec6-4696-baa2-73cb3f9213c9), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.009694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d8aa5b7-44f0-48a7-9ed7-46c6af5a3fbd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (4c962225-fd8e-450d-8d75-fb9db27325aa), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.047187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c1c8b6f9-d9d3-40d8-8802-553d2b4ce44c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (eb128083-aba4-4ab0-aee0-4e3050e767ca), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.068332 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-5fb8c9c9-17b1-4c3b-8825-e83baa230e08 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting subnet 03b7d30a-5d44-4916-9c45-ac41eaae3a7f {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:05.070314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (e3dcbaad-6ec6-4696-baa2-73cb3f9213c9), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.075021 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:05.075605 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.102694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5fb8c9c9-17b1-4c3b-8825-e83baa230e08 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (03b7d30a-5d44-4916-9c45-ac41eaae3a7f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.144696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c8b6f9-d9d3-40d8-8802-553d2b4ce44c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=eb128083-aba4-4ab0-aee0-4e3050e767ca,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:05.172271 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for port (a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.174629 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d8aa5b7-44f0-48a7-9ed7-46c6af5a3fbd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (4c962225-fd8e-450d-8d75-fb9db27325aa), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.217341 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.4770873 Mar 24 02:17:05.228607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c1c8b6f9-d9d3-40d8-8802-553d2b4ce44c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.232464 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c1c8b6f9-d9d3-40d8-8802-553d2b4ce44c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/eb128083-aba4-4ab0-aee0-4e3050e767ca HTTP/1.1" status: 204 len: 168 time: 0.9348187 Mar 24 02:17:05.241689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60412) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:05.251159 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.253892 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5fb8c9c9-17b1-4c3b-8825-e83baa230e08 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (03b7d30a-5d44-4916-9c45-ac41eaae3a7f), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.279493 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f9c8ed6-8c80-4236-8cc4-56847f9089cb tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Network': ['ID=e3dcbaad-6ec6-4696-baa2-73cb3f9213c9,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:05.295967 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:05.325000 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d8aa5b7-44f0-48a7-9ed7-46c6af5a3fbd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (4c962225-fd8e-450d-8d75-fb9db27325aa), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.327441 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-53ba70b7-a3b5-4152-9f83-fea2e5862fc0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:17:05.329195 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-53ba70b7-a3b5-4152-9f83-fea2e5862fc0 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/eb128083-aba4-4ab0-aee0-4e3050e767ca HTTP/1.1" status: 404 len: 333 time: 0.0861919 Mar 24 02:17:05.336759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60414) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:05.447910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5fb8c9c9-17b1-4c3b-8825-e83baa230e08 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (03b7d30a-5d44-4916-9c45-ac41eaae3a7f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.520844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5fb8c9c9-17b1-4c3b-8825-e83baa230e08 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (03b7d30a-5d44-4916-9c45-ac41eaae3a7f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.552236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb8c9c9-17b1-4c3b-8825-e83baa230e08 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Subnet': ['ID=03b7d30a-5d44-4916-9c45-ac41eaae3a7f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:05.556164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5fb8c9c9-17b1-4c3b-8825-e83baa230e08 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.559715 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5fb8c9c9-17b1-4c3b-8825-e83baa230e08 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/03b7d30a-5d44-4916-9c45-ac41eaae3a7f HTTP/1.1" status: 204 len: 168 time: 0.5994031 Mar 24 02:17:05.562305 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60416) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:05.569908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcec9290-ae45-49ca-8e01-08923bd0971d None None] Network 5c876cac-460f-4279-a9ce-553b32670a9f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:05.633272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-3ff2abee-5100-41ba-af13-521f1f019325 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting subnet 8d3c3070-7bf8-454a-81a0-f94828e5d1b4 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:05.637320 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ff2abee-5100-41ba-af13-521f1f019325 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (8d3c3070-7bf8-454a-81a0-f94828e5d1b4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.689677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ff2abee-5100-41ba-af13-521f1f019325 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (8d3c3070-7bf8-454a-81a0-f94828e5d1b4), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.773731 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8aa5b7-44f0-48a7-9ed7-46c6af5a3fbd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=4c962225-fd8e-450d-8d75-fb9db27325aa,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:05.775410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event updated for resources: {'Port': ['ID=a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:05.780293 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5afd4332-afd6-42fd-ac27-b011b917c21c None None] DHCP port deletion for 5c876cac-460f-4279-a9ce-553b32670a9f request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:05.790067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Network dac30f63-f492-4007-bccd-3d53a7b4a3ec is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:05.791970 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d8aa5b7-44f0-48a7-9ed7-46c6af5a3fbd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.795365 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4d8aa5b7-44f0-48a7-9ed7-46c6af5a3fbd tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/4c962225-fd8e-450d-8d75-fb9db27325aa HTTP/1.1" status: 204 len: 168 time: 0.9958637 Mar 24 02:17:05.803415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60418) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:05.806050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:05.817540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:05.827479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ff2abee-5100-41ba-af13-521f1f019325 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (8d3c3070-7bf8-454a-81a0-f94828e5d1b4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.839056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17d8b561-9d37-44ae-a1b6-9a56ab60f829 None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:05.867510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:05.869161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.887356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-8bd8c1ee-e023-4cff-95a1-4ff11bb7ea58 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet f84cb7fe-4be1-41a6-8681-a1b8155acbdc {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:05.917870 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-66c1aee2-98a6-40bb-b1fb-926450d40354 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.9162962 Mar 24 02:17:05.919286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ff2abee-5100-41ba-af13-521f1f019325 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (8d3c3070-7bf8-454a-81a0-f94828e5d1b4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.923006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8bd8c1ee-e023-4cff-95a1-4ff11bb7ea58 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (f84cb7fe-4be1-41a6-8681-a1b8155acbdc), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.926032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60420) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:05.944464 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ff2abee-5100-41ba-af13-521f1f019325 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:05.949246 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3ff2abee-5100-41ba-af13-521f1f019325 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/8d3c3070-7bf8-454a-81a0-f94828e5d1b4 HTTP/1.1" status: 204 len: 168 time: 0.3857532 Mar 24 02:17:05.951767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60424) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:05.987488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-37792ed2-e436-4634-a1ed-57db6c4c3e4a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet 2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:05.996286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37792ed2-e436-4634-a1ed-57db6c4c3e4a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.050505 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8bd8c1ee-e023-4cff-95a1-4ff11bb7ea58 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (f84cb7fe-4be1-41a6-8681-a1b8155acbdc), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.075889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (5c876cac-460f-4279-a9ce-553b32670a9f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.085728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37792ed2-e436-4634-a1ed-57db6c4c3e4a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.091255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ff2abee-5100-41ba-af13-521f1f019325 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Subnet': ['ID=8d3c3070-7bf8-454a-81a0-f94828e5d1b4,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:06.134792 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-626c441e-47ef-49b6-82ff-37222f2c9b8d None None] Network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:06.217481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 3e889e2b-f799-4c81-9ef1-b11645cb6543 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:06.219217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.294791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5afd4332-afd6-42fd-ac27-b011b917c21c None None] Deleting port 3e889e2b-f799-4c81-9ef1-b11645cb6543 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:06.295536 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5afd4332-afd6-42fd-ac27-b011b917c21c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.303155 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8bd8c1ee-e023-4cff-95a1-4ff11bb7ea58 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (f84cb7fe-4be1-41a6-8681-a1b8155acbdc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.348604 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37792ed2-e436-4634-a1ed-57db6c4c3e4a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.352264 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port 3e889e2b-f799-4c81-9ef1-b11645cb6543, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3e889e2b-f799-4c81-9ef1-b11645cb6543,segment=NetworkSegment(9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7),segment_id=9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:06.352879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.355318 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'project_id': '3561433150a34016ae3a3844285683ef', 'port_id': 'a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:06.368518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 3e889e2b-f799-4c81-9ef1-b11645cb6543 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:06.431028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for floatingip (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.432633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-edc8bc66-24ae-441c-9a03-8f13d8973b4f None None] Provisioning complete for port a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:06.433212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-edc8bc66-24ae-441c-9a03-8f13d8973b4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.461093 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8bd8c1ee-e023-4cff-95a1-4ff11bb7ea58 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (f84cb7fe-4be1-41a6-8681-a1b8155acbdc), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.516319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfc3b78b-868e-40f4-9f95-06be41e278bc None None] Network 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:06.522867 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8bd8c1ee-e023-4cff-95a1-4ff11bb7ea58 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.528873 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8bd8c1ee-e023-4cff-95a1-4ff11bb7ea58 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/f84cb7fe-4be1-41a6-8681-a1b8155acbdc HTTP/1.1" status: 204 len: 168 time: 0.8087537 Mar 24 02:17:06.537723 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60426) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:06.552925 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bd8c1ee-e023-4cff-95a1-4ff11bb7ea58 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=f84cb7fe-4be1-41a6-8681-a1b8155acbdc,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:06.577595 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37792ed2-e436-4634-a1ed-57db6c4c3e4a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.586877 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.626284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-5afd4332-afd6-42fd-ac27-b011b917c21c None None] For port 3e889e2b-f799-4c81-9ef1-b11645cb6543, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3e889e2b-f799-4c81-9ef1-b11645cb6543,segment=NetworkSegment(9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7),segment_id=9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:06.627109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5afd4332-afd6-42fd-ac27-b011b917c21c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.645247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-37792ed2-e436-4634-a1ed-57db6c4c3e4a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.653938 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No DVR routers for this DVR port 3e889e2b-f799-4c81-9ef1-b11645cb6543 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:06.654430 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-37792ed2-e436-4634-a1ed-57db6c4c3e4a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a HTTP/1.1" status: 204 len: 168 time: 0.8442156 Mar 24 02:17:06.677584 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5afd4332-afd6-42fd-ac27-b011b917c21c None None] Calling delete_port for 3e889e2b-f799-4c81-9ef1-b11645cb6543 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:06.694786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60428) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:06.704257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=3e889e2b-f799-4c81-9ef1-b11645cb6543,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:06.728443 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-57a83c27-6681-4a2d-983e-a38cea70d791 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:06.729173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-57a83c27-6681-4a2d-983e-a38cea70d791 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:06.732461 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-57a83c27-6681-4a2d-983e-a38cea70d791 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/4c962225-fd8e-450d-8d75-fb9db27325aa HTTP/1.1" status: 404 len: 337 time: 0.0345356 Mar 24 02:17:06.733472 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37792ed2-e436-4634-a1ed-57db6c4c3e4a tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=2c16cb82-80e6-40ef-ad8c-4585ef4f2d2a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:06.735284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60430) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:06.805032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (20b14bc9-aab9-4b3b-88d7-f5d73c3e321c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.824485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5afd4332-afd6-42fd-ac27-b011b917c21c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (3e889e2b-f799-4c81-9ef1-b11645cb6543), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.833845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (5c876cac-460f-4279-a9ce-553b32670a9f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.834759 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-edc8bc66-24ae-441c-9a03-8f13d8973b4f None None] Port a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:06.843333 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] DHCP port deletion for 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:06.847145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-021c3c1c-5b92-4553-bc18-5d7b3f40bfa6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting subnet 682aa15b-b73a-4fc1-88f6-425543336542 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:06.868235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c876cac-460f-4279-a9ce-553b32670a9f']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:06.872520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-021c3c1c-5b92-4553-bc18-5d7b3f40bfa6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (682aa15b-b73a-4fc1-88f6-425543336542), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.881072 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:06.881373 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:06.892435 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.910822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.925953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Releasing vlan 114 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:06.926673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (9cb2e4c7-0f7a-483d-a8d2-d0ee39e85fd7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.929196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5afd4332-afd6-42fd-ac27-b011b917c21c None None] No DVR routers for this DVR port 3e889e2b-f799-4c81-9ef1-b11645cb6543 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:06.937285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5afd4332-afd6-42fd-ac27-b011b917c21c None None] Pushing event deleted for resources: {'Port': ['ID=3e889e2b-f799-4c81-9ef1-b11645cb6543,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:06.973750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:06.999972 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-021c3c1c-5b92-4553-bc18-5d7b3f40bfa6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (682aa15b-b73a-4fc1-88f6-425543336542), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:07.022560 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:07.025543 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (5c876cac-460f-4279-a9ce-553b32670a9f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.051790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.055132 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/networks/5c876cac-460f-4279-a9ce-553b32670a9f HTTP/1.1" status: 204 len: 168 time: 1.1022027 Mar 24 02:17:07.056128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3a92215-7dd7-4567-b881-d3a664a38e49 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Network': ['ID=5c876cac-460f-4279-a9ce-553b32670a9f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:07.066490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60432) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:07.125474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:07.126009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.131162 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] Deleting port 0558abf2-2d79-4c5a-b772-ed329fada168 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:07.131956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.242756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf51eb70-3fce-45b4-b187-a3a4adb093a6 None None] DHCP port deletion for 20b14bc9-aab9-4b3b-88d7-f5d73c3e321c request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:07.243942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (0a45dd11-0f24-42f0-8f86-d44d7fcd25a4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.314999 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 0558abf2-2d79-4c5a-b772-ed329fada168 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:07.315812 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.354318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] For port 0558abf2-2d79-4c5a-b772-ed329fada168, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0558abf2-2d79-4c5a-b772-ed329fada168,segment=NetworkSegment(2656a5df-b5cc-4af8-936e-3937dd14f7f7),segment_id=2656a5df-b5cc-4af8-936e-3937dd14f7f7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:07.355306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.375168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] For port 8694bd93-399e-4a1b-bfa9-f345ae0bb256, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8694bd93-399e-4a1b-bfa9-f345ae0bb256,segment=NetworkSegment(bb85b57f-68dd-4064-91f1-4496122b6072),segment_id=bb85b57f-68dd-4064-91f1-4496122b6072)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:07.375521 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.380394 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] Calling delete_port for 0558abf2-2d79-4c5a-b772-ed329fada168 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:07.388646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-021c3c1c-5b92-4553-bc18-5d7b3f40bfa6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (682aa15b-b73a-4fc1-88f6-425543336542), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.394712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port 0558abf2-2d79-4c5a-b772-ed329fada168, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=0558abf2-2d79-4c5a-b772-ed329fada168,segment=NetworkSegment(2656a5df-b5cc-4af8-936e-3937dd14f7f7),segment_id=2656a5df-b5cc-4af8-936e-3937dd14f7f7)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:07.395078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.412348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 0558abf2-2d79-4c5a-b772-ed329fada168 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:07.416390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-bf51eb70-3fce-45b4-b187-a3a4adb093a6 None None] Deleting port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:07.417765 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bf51eb70-3fce-45b4-b187-a3a4adb093a6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.421915 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Allocated IP 172.26.2.245 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/0519c8a9-90a3-4262-a4ed-5c8b490f1046) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:07.435597 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 8694bd93-399e-4a1b-bfa9-f345ae0bb256 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:07.514334 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-bf51eb70-3fce-45b4-b187-a3a4adb093a6 None None] For port 8694bd93-399e-4a1b-bfa9-f345ae0bb256, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8694bd93-399e-4a1b-bfa9-f345ae0bb256,segment=NetworkSegment(bb85b57f-68dd-4064-91f1-4496122b6072),segment_id=bb85b57f-68dd-4064-91f1-4496122b6072)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:07.514955 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bf51eb70-3fce-45b4-b187-a3a4adb093a6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.531100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-bf51eb70-3fce-45b4-b187-a3a4adb093a6 None None] Calling delete_port for 8694bd93-399e-4a1b-bfa9-f345ae0bb256 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:07.538200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.579662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No DVR routers for this DVR port 0558abf2-2d79-4c5a-b772-ed329fada168 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:07.608123 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=0558abf2-2d79-4c5a-b772-ed329fada168,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:07.617403 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-021c3c1c-5b92-4553-bc18-5d7b3f40bfa6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (682aa15b-b73a-4fc1-88f6-425543336542), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.643672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-021c3c1c-5b92-4553-bc18-5d7b3f40bfa6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.646768 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-021c3c1c-5b92-4553-bc18-5d7b3f40bfa6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/682aa15b-b73a-4fc1-88f6-425543336542 HTTP/1.1" status: 204 len: 168 time: 0.9066103 Mar 24 02:17:07.652284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82e28957-8557-4561-a392-49e5a60359f4 None None] Network c8466e8e-4c16-4f91-aa0d-8651c7d4116a requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:07.666854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60434) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:07.690341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (0a45dd11-0f24-42f0-8f86-d44d7fcd25a4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.703884 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-160f8e31-49b9-4cf1-b831-48ad4046bd40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:07.704593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-160f8e31-49b9-4cf1-b831-48ad4046bd40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:07.708413 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-160f8e31-49b9-4cf1-b831-48ad4046bd40 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/9b01bd06-549f-4756-86ba-eebb1d450eb6 HTTP/1.1" status: 404 len: 337 time: 0.0333858 Mar 24 02:17:07.709404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-021c3c1c-5b92-4553-bc18-5d7b3f40bfa6 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Subnet': ['ID=682aa15b-b73a-4fc1-88f6-425543336542,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:07.715819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60436) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:07.724887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0a45dd11-0f24-42f0-8f86-d44d7fcd25a4']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:07.736537 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2656a5df-b5cc-4af8-936e-3937dd14f7f7') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:07.736834 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2656a5df-b5cc-4af8-936e-3937dd14f7f7') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:07.747633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (2656a5df-b5cc-4af8-936e-3937dd14f7f7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.749867 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a30241a0-ade6-42ef-bc20-767b073affdc tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "GET /v2.0/ports?device_id=7d884862-0b03-425b-8c51-b5475b62ebb4 HTTP/1.1" status: 200 len: 205 time: 0.0327959 Mar 24 02:17:07.753394 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 8694bd93-399e-4a1b-bfa9-f345ae0bb256 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:07.754990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60438) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:07.764862 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.767342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (2656a5df-b5cc-4af8-936e-3937dd14f7f7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.775052 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:07.775439 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (2656a5df-b5cc-4af8-936e-3937dd14f7f7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.793080 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 8694bd93-399e-4a1b-bfa9-f345ae0bb256 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:07.793812 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 8694bd93-399e-4a1b-bfa9-f345ae0bb256 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:07.794391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3e889e2b-f799-4c81-9ef1-b11645cb6543 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:07.815960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for port (0519c8a9-90a3-4262-a4ed-5c8b490f1046), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.818809 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bf51eb70-3fce-45b4-b187-a3a4adb093a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (8694bd93-399e-4a1b-bfa9-f345ae0bb256), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.820870 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-8b39dcf8-bf7b-403c-9e6f-0d23b0ff48ad tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] delete failed (client error): The resource could not be found. Mar 24 02:17:07.822297 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8b39dcf8-bf7b-403c-9e6f-0d23b0ff48ad tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/routers/7d884862-0b03-425b-8c51-b5475b62ebb4 HTTP/1.1" status: 404 len: 336 time: 0.0658381 Mar 24 02:17:07.835855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 3e889e2b-f799-4c81-9ef1-b11645cb6543 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:07.836257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3e889e2b-f799-4c81-9ef1-b11645cb6543 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:07.836772 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0558abf2-2d79-4c5a-b772-ed329fada168 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:07.843997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60440) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:07.861760 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:07.865802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (0a45dd11-0f24-42f0-8f86-d44d7fcd25a4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.871771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.876080 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/networks/0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 HTTP/1.1" status: 204 len: 168 time: 0.8085196 Mar 24 02:17:07.881549 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-8d081e71-c22c-4fe0-adf4-180221ea2d29 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:07.882204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8d081e71-c22c-4fe0-adf4-180221ea2d29 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:07.885507 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8d081e71-c22c-4fe0-adf4-180221ea2d29 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/eba982ea-a9c2-4a26-a298-c06e00d7fafc HTTP/1.1" status: 404 len: 337 time: 0.0398781 Mar 24 02:17:07.886722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=8694bd93-399e-4a1b-bfa9-f345ae0bb256,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:07.889784 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60444) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:07.890428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60446) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:07.898196 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'network': {'name': 'tempest-RoutersTest-1991051852'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:07.906381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0886ac0-ee4d-4a76-a4b7-05edbcad7c16 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Network': ['ID=0a45dd11-0f24-42f0-8f86-d44d7fcd25a4,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:07.923206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No DVR routers for this DVR port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:07.923505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f4bbb497-c221-4157-82b5-a8dd23ac28bc None None] Provisioning complete for port ce65f7b4-05fd-4b15-85ea-55ec88abec23 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:07.925040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f4bbb497-c221-4157-82b5-a8dd23ac28bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.928712 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 0558abf2-2d79-4c5a-b772-ed329fada168 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:07.929643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 0558abf2-2d79-4c5a-b772-ed329fada168 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:07.931437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:07.934722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:07.963953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf51eb70-3fce-45b4-b187-a3a4adb093a6 None None] No DVR routers for this DVR port 8694bd93-399e-4a1b-bfa9-f345ae0bb256 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:07.997728 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-d8dd45ac-d900-4631-b925-7a30493b0cd8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:07.998190 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d8dd45ac-d900-4631-b925-7a30493b0cd8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:08.005068 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d8dd45ac-d900-4631-b925-7a30493b0cd8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/8cf5343c-f2c3-4fa0-85d5-2eca0176df46 HTTP/1.1" status: 404 len: 337 time: 0.0866587 Mar 24 02:17:08.005802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60448) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.019583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf51eb70-3fce-45b4-b187-a3a4adb093a6 None None] Pushing event deleted for resources: {'Port': ['ID=8694bd93-399e-4a1b-bfa9-f345ae0bb256,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:08.028560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 103} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:08.037722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (32b606c8-8213-485d-a467-1e35eba02ea8), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.038178 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added segment 32b606c8-8213-485d-a467-1e35eba02ea8 of type vlan for network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b Mar 24 02:17:08.040896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (0558abf2-2d79-4c5a-b772-ed329fada168), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.062926 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-8722b4e8-ead1-40e1-85b8-9f42c5340f1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:08.063759 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8722b4e8-ead1-40e1-85b8-9f42c5340f1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:08.071921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] Pushing event deleted for resources: {'Port': ['ID=0558abf2-2d79-4c5a-b772-ed329fada168,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:08.077707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] Network 0a45dd11-0f24-42f0-8f86-d44d7fcd25a4 is not hosted by any dhcp agent {{(pid=104038) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Mar 24 02:17:08.078156 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b03870c-72a0-400a-b4ad-36af4281739e None None] No DVR routers for this DVR port 0558abf2-2d79-4c5a-b772-ed329fada168 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:08.078733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (ac842fb9-3cb6-4c0f-abdd-14a26c23e49b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.080789 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8722b4e8-ead1-40e1-85b8-9f42c5340f1f tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/bff9ad11-3244-4fdd-aca0-5e91de44c852 HTTP/1.1" status: 404 len: 337 time: 0.0743232 Mar 24 02:17:08.081954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60450) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.133379 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-74793fc1-a0ae-4ba1-a382-f315fd634c56 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:08.133947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-74793fc1-a0ae-4ba1-a382-f315fd634c56 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:08.139424 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-74793fc1-a0ae-4ba1-a382-f315fd634c56 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/2bd8f0a9-61ab-4c8b-a119-c6e98565e95f HTTP/1.1" status: 404 len: 333 time: 0.0475562 Mar 24 02:17:08.140524 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60452) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.166002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (20b14bc9-aab9-4b3b-88d7-f5d73c3e321c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.169278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (ac842fb9-3cb6-4c0f-abdd-14a26c23e49b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.175223 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:08.175874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.196534 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0519c8a9-90a3-4262-a4ed-5c8b490f1046), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.202023 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-628382fd-c907-470b-8d83-a69d57a503cb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:08.203115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-628382fd-c907-470b-8d83-a69d57a503cb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:08.207533 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-628382fd-c907-470b-8d83-a69d57a503cb tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/17a66dfa-e3f0-4d38-aa2f-4c1cb94ed89e HTTP/1.1" status: 404 len: 337 time: 0.0669637 Mar 24 02:17:08.209941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60454) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.227221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a2106eb-cdc8-4d5b-b3bc-6356d578aec3 None None] DHCP port deletion for c8466e8e-4c16-4f91-aa0d-8651c7d4116a request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:08.251693 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-cb7988c2-6515-4d6b-a5a5-023169668b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:08.253679 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cb7988c2-6515-4d6b-a5a5-023169668b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:08.257569 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cb7988c2-6515-4d6b-a5a5-023169668b9e tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/77524766-c63f-44d6-a6df-ae1c18097bb3 HTTP/1.1" status: 404 len: 337 time: 0.0454741 Mar 24 02:17:08.260337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60456) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.267064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f4bbb497-c221-4157-82b5-a8dd23ac28bc None None] Current status of the port ce65f7b4-05fd-4b15-85ea-55ec88abec23 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:08.284123 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-c2c6a5bd-e729-4519-ad4a-8ed49aa11625 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:08.284660 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c2c6a5bd-e729-4519-ad4a-8ed49aa11625 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:08.289863 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c2c6a5bd-e729-4519-ad4a-8ed49aa11625 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/32e46455-c30c-49b7-8ba4-417e4700abc5 HTTP/1.1" status: 404 len: 333 time: 0.0262930 Mar 24 02:17:08.290574 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60458) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.297789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f4bbb497-c221-4157-82b5-a8dd23ac28bc None None] Provisioning complete for port fb6aa634-7dc1-40b2-a10c-14a092dbd732 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:08.298483 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f4bbb497-c221-4157-82b5-a8dd23ac28bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.301420 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['20b14bc9-aab9-4b3b-88d7-f5d73c3e321c']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:08.322938 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.4289622 Mar 24 02:17:08.323153 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-a0b1be64-e54c-4390-b996-d9290001e174 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:08.323418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a0b1be64-e54c-4390-b996-d9290001e174 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:08.328843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bb85b57f-68dd-4064-91f1-4496122b6072') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:08.329028 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a0b1be64-e54c-4390-b996-d9290001e174 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/16dd5a29-c454-424a-849c-aefd975b27bd HTTP/1.1" status: 404 len: 337 time: 0.0350003 Mar 24 02:17:08.329141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bb85b57f-68dd-4064-91f1-4496122b6072') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:08.329236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60460) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.331754 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:08.332382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'subnet': {'network_id': 'ac842fb9-3cb6-4c0f-abdd-14a26c23e49b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:08.332859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60462) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.341584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30bc89fa-45d1-41da-9488-0f72cd150774 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Network': ['ID=ac842fb9-3cb6-4c0f-abdd-14a26c23e49b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:08.360000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8a2106eb-cdc8-4d5b-b3bc-6356d578aec3 None None] Deleting port ce65f7b4-05fd-4b15-85ea-55ec88abec23 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:08.361043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8a2106eb-cdc8-4d5b-b3bc-6356d578aec3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.363068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:08.366002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (bb85b57f-68dd-4064-91f1-4496122b6072), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.388286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:08.390241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Pushing event updated for resources: {'Port': ['ID=0519c8a9-90a3-4262-a4ed-5c8b490f1046,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:08.395900 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-3cee5430-34d1-4566-924e-ba14c4df33a8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] DELETE failed (client error): The resource could not be found. Mar 24 02:17:08.396432 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3cee5430-34d1-4566-924e-ba14c4df33a8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:08.399830 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3cee5430-34d1-4566-924e-ba14c4df33a8 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/subnets/a049e775-8bc9-44df-b042-a5520ee089cd HTTP/1.1" status: 404 len: 337 time: 0.0558341 Mar 24 02:17:08.420535 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60464) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.457307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (bb85b57f-68dd-4064-91f1-4496122b6072), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.463470 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8a2106eb-cdc8-4d5b-b3bc-6356d578aec3 None None] For port ce65f7b4-05fd-4b15-85ea-55ec88abec23, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ce65f7b4-05fd-4b15-85ea-55ec88abec23,segment=NetworkSegment(cb1f6bda-0ce9-4c9a-968a-d29295cb534c),segment_id=cb1f6bda-0ce9-4c9a-968a-d29295cb534c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:08.464529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8a2106eb-cdc8-4d5b-b3bc-6356d578aec3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.470107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:08.471215 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (bb85b57f-68dd-4064-91f1-4496122b6072), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:08.476568 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:08.481540 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:08.484322 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:08.485148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.536062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8a2106eb-cdc8-4d5b-b3bc-6356d578aec3 None None] Calling delete_port for ce65f7b4-05fd-4b15-85ea-55ec88abec23 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:08.544802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60466) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.550279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'subnets': [{'network_id': 'f1576fba-ff22-48d7-b14f-380566cfa438', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--495101617', 'ip_version': 6}, {'network_id': 'e3dcbaad-6ec6-4696-baa2-73cb3f9213c9', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}]} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:08.550986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'subnet': {'network_id': 'f1576fba-ff22-48d7-b14f-380566cfa438', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--495101617', 'ip_version': 6}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:08.551259 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Request body: {'subnet': {'network_id': 'e3dcbaad-6ec6-4696-baa2-73cb3f9213c9', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:08.557989 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f4bbb497-c221-4157-82b5-a8dd23ac28bc None None] Port fb6aa634-7dc1-40b2-a10c-14a092dbd732 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:08.647030 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (20b14bc9-aab9-4b3b-88d7-f5d73c3e321c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.654193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8a2106eb-cdc8-4d5b-b3bc-6356d578aec3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (ce65f7b4-05fd-4b15-85ea-55ec88abec23), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.669862 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.677334 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/networks/20b14bc9-aab9-4b3b-88d7-f5d73c3e321c HTTP/1.1" status: 204 len: 168 time: 2.1322248 Mar 24 02:17:08.677334 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ded65cf-bfc7-4e2d-9441-743be195ff1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Network': ['ID=20b14bc9-aab9-4b3b-88d7-f5d73c3e321c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:08.678261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60468) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:08.687210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1581998795'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:08.693593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2106eb-cdc8-4d5b-b3bc-6356d578aec3 None None] Pushing event deleted for resources: {'Port': ['ID=ce65f7b4-05fd-4b15-85ea-55ec88abec23,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:08.699690 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a2106eb-cdc8-4d5b-b3bc-6356d578aec3 None None] No DVR routers for this DVR port ce65f7b4-05fd-4b15-85ea-55ec88abec23 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:08.713215 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:08.714567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.820706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Made reservation on behalf of 1939716dbdc043268b56130159aff4ba for: {'subnet': 2} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:08.821387 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-010b97d6-695b-45dc-a1d7-3e953cd00682 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Deleting port fb6aa634-7dc1-40b2-a10c-14a092dbd732 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:08.821724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-010b97d6-695b-45dc-a1d7-3e953cd00682 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.825001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.825338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.841258 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 112} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:08.875632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (f2aeac0d-b287-4804-8bc6-c924f575a396), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.895374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (cc25912d-4fad-46c1-b530-4dc46c9c4457), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.895712 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Added segment cc25912d-4fad-46c1-b530-4dc46c9c4457 of type vlan for network 21ab168d-3d66-4372-9c61-322a61da37af Mar 24 02:17:08.940624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-010b97d6-695b-45dc-a1d7-3e953cd00682 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.957946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Subnet': ['ID=f2aeac0d-b287-4804-8bc6-c924f575a396,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:08.972319 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-010b97d6-695b-45dc-a1d7-3e953cd00682 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Calling delete_port for fb6aa634-7dc1-40b2-a10c-14a092dbd732 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:08.983920 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (21ab168d-3d66-4372-9c61-322a61da37af), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:08.994002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Checking segment: {'id': '32b606c8-8213-485d-a467-1e35eba02ea8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ac842fb9-3cb6-4c0f-abdd-14a26c23e49b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:08.994364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network hostable DHCP agents. Network: ac842fb9-3cb6-4c0f-abdd-14a26c23e49b, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:09.043183 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:09.056345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, ac842fb9-3cb6-4c0f-abdd-14a26c23e49b) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:09.061592 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:09.062104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.067331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f522b270-521e-438c-873a-54b157ea527d None None] Network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:09.121545 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7e00f7c2-74bc-4e99-a1bf-0545686b8216 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7932961 Mar 24 02:17:09.122331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60472) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:09.129715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d87c86c9-79bb-49d3-9ef4-81bc3978ceb4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1545318720', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:09.172463 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (21ab168d-3d66-4372-9c61-322a61da37af), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.176305 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:09.176932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.232734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d87c86c9-79bb-49d3-9ef4-81bc3978ceb4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (4055f920-3ed7-429b-9e41-efea495aba65), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.234429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d87c86c9-79bb-49d3-9ef4-81bc3978ceb4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (4055f920-3ed7-429b-9e41-efea495aba65), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.301865 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6208332 Mar 24 02:17:09.305073 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60474) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:09.311503 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '21ab168d-3d66-4372-9c61-322a61da37af', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:09.329632 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-ac842fb9-3cb6-4c0f-abdd-14a26c23e49b', 'network_id': 'ac842fb9-3cb6-4c0f-abdd-14a26c23e49b', 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'fixed_ips': [{'subnet_id': 'f2aeac0d-b287-4804-8bc6-c924f575a396'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:09.332374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.346178 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aede1147-c597-4d2c-a91a-4c80a9ae0feb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Network': ['ID=21ab168d-3d66-4372-9c61-322a61da37af,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:09.369582 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for floatingip (59db86b2-1138-4a50-858b-bbf74c3d4d0e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.380035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d87c86c9-79bb-49d3-9ef4-81bc3978ceb4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (4055f920-3ed7-429b-9e41-efea495aba65), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.384451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-010b97d6-695b-45dc-a1d7-3e953cd00682 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (fb6aa634-7dc1-40b2-a10c-14a092dbd732), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.410042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d87c86c9-79bb-49d3-9ef4-81bc3978ceb4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (4055f920-3ed7-429b-9e41-efea495aba65), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.416629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 21ab168d-3d66-4372-9c61-322a61da37af details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:09.463979 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-010b97d6-695b-45dc-a1d7-3e953cd00682 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Port': ['ID=fb6aa634-7dc1-40b2-a10c-14a092dbd732,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:09.464344 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d87c86c9-79bb-49d3-9ef4-81bc3978ceb4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.468124 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d87c86c9-79bb-49d3-9ef4-81bc3978ceb4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.3401170 Mar 24 02:17:09.470882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60476) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:09.476104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'port': {'network_id': 'ac842fb9-3cb6-4c0f-abdd-14a26c23e49b', 'name': 'tempest-RoutersTest-848677550'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:09.515929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-010b97d6-695b-45dc-a1d7-3e953cd00682 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.522770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:09.523953 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-010b97d6-695b-45dc-a1d7-3e953cd00682 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/ports/fb6aa634-7dc1-40b2-a10c-14a092dbd732 HTTP/1.1" status: 204 len: 168 time: 1.1005645 Mar 24 02:17:09.526341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.530565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60478) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:09.579335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Allocated IP 172.20.0.2 (ac842fb9-3cb6-4c0f-abdd-14a26c23e49b/f2aeac0d-b287-4804-8bc6-c924f575a396/50818269-d373-46ad-8515-577c58d8830f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:09.614155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ce65f7b4-05fd-4b15-85ea-55ec88abec23 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:09.638663 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (6eef1ffa-63be-49f9-b075-709fe499b88b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.669181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: ce65f7b4-05fd-4b15-85ea-55ec88abec23 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:09.669838 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ce65f7b4-05fd-4b15-85ea-55ec88abec23 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:09.777235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (c8466e8e-4c16-4f91-aa0d-8651c7d4116a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.779003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Subnet': ['ID=6eef1ffa-63be-49f9-b075-709fe499b88b,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:09.791823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Publish callbacks [] for port (50818269-d373-46ad-8515-577c58d8830f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.801760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (50818269-d373-46ad-8515-577c58d8830f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.827829 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Checking segment: {'id': '1563ff60-cf69-4f6a-94fd-fe60d162c190', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'f1576fba-ff22-48d7-b14f-380566cfa438'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:09.828209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Network hostable DHCP agents. Network: f1576fba-ff22-48d7-b14f-380566cfa438, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:09.855397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:09.861990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:09.868572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:09.876522 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Pushing event updated for resources: {'Port': ['ID=50818269-d373-46ad-8515-577c58d8830f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:09.952525 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Attempting to bind port 50818269-d373-46ad-8515-577c58d8830f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:09.953177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Attempting to bind port 50818269-d373-46ad-8515-577c58d8830f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '32b606c8-8213-485d-a467-1e35eba02ea8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ac842fb9-3cb6-4c0f-abdd-14a26c23e49b'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:09.953701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Attempting to bind port 50818269-d373-46ad-8515-577c58d8830f on network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:09.961302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:09.962051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Checking segment: {'id': '32b606c8-8213-485d-a467-1e35eba02ea8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ac842fb9-3cb6-4c0f-abdd-14a26c23e49b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:09.962689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.962821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Network f1576fba-ff22-48d7-b14f-380566cfa438 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:09.963335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Bound using segment: {'id': '32b606c8-8213-485d-a467-1e35eba02ea8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ac842fb9-3cb6-4c0f-abdd-14a26c23e49b'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:09.963958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Bound port: 50818269-d373-46ad-8515-577c58d8830f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '32b606c8-8213-485d-a467-1e35eba02ea8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ac842fb9-3cb6-4c0f-abdd-14a26c23e49b'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:09.964760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (50818269-d373-46ad-8515-577c58d8830f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:09.981987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, f1576fba-ff22-48d7-b14f-380566cfa438) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:09.987257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (557c920b-620a-463f-bdc7-22dd912311a1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.003859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (c8466e8e-4c16-4f91-aa0d-8651c7d4116a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.024310 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbb5944b-c43e-43fc-ab4e-cdf30e433055 None None] Network f1576fba-ff22-48d7-b14f-380566cfa438 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:10.036040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (cd78dad5-3c1f-4120-a512-210673826474), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.053599 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:10.060050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.062200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0519c8a9-90a3-4262-a4ed-5c8b490f1046), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.074673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c8466e8e-4c16-4f91-aa0d-8651c7d4116a']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:10.094732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cb1f6bda-0ce9-4c9a-968a-d29295cb534c') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:10.095082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cb1f6bda-0ce9-4c9a-968a-d29295cb534c') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:10.107532 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event updated for resources: {'Subnet': ['ID=557c920b-620a-463f-bdc7-22dd912311a1,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:10.110648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] device_id is not set on port 93bd5c13-366f-4f55-902d-fbdd141fe7e9 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:10.123337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (cb1f6bda-0ce9-4c9a-968a-d29295cb534c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.166560 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] For port 50818269-d373-46ad-8515-577c58d8830f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:10.196314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (cb1f6bda-0ce9-4c9a-968a-d29295cb534c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.199835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] For port 50818269-d373-46ad-8515-577c58d8830f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=50818269-d373-46ad-8515-577c58d8830f,segment=NetworkSegment(32b606c8-8213-485d-a467-1e35eba02ea8),segment_id=32b606c8-8213-485d-a467-1e35eba02ea8)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:10.215195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Releasing vlan 139 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:10.215518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (cb1f6bda-0ce9-4c9a-968a-d29295cb534c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:10.223720 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:10.238586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (50818269-d373-46ad-8515-577c58d8830f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.264937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Checking segment: {'id': 'cc25912d-4fad-46c1-b530-4dc46c9c4457', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21ab168d-3d66-4372-9c61-322a61da37af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:10.265884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network hostable DHCP agents. Network: 21ab168d-3d66-4372-9c61-322a61da37af, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:10.267126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eaffc8a2-f5fe-4557-bcc0-e78d585462e7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-f1576fba-ff22-48d7-b14f-380566cfa438', 'network_id': 'f1576fba-ff22-48d7-b14f-380566cfa438', 'project_id': '1939716dbdc043268b56130159aff4ba', 'fixed_ips': [{'subnet_id': '6eef1ffa-63be-49f9-b075-709fe499b88b'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:10.269362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-eaffc8a2-f5fe-4557-bcc0-e78d585462e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.276912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Checking segment: {'id': '0f355cf6-63e6-4df1-bebe-e9f676f3f1c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'e3dcbaad-6ec6-4696-baa2-73cb3f9213c9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:10.277281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Network hostable DHCP agents. Network: e3dcbaad-6ec6-4696-baa2-73cb3f9213c9, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:10.286745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=cd78dad5-3c1f-4120-a512-210673826474,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:10.317215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (c8466e8e-4c16-4f91-aa0d-8651c7d4116a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.323344 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.329211 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] 10.222.0.20 "DELETE /v2.0/networks/c8466e8e-4c16-4f91-aa0d-8651c7d4116a HTTP/1.1" status: 204 len: 168 time: 0.7938998 Mar 24 02:17:10.346925 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Network e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:10.361464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.20.0.11 (ac842fb9-3cb6-4c0f-abdd-14a26c23e49b/f2aeac0d-b287-4804-8bc6-c924f575a396/93bd5c13-366f-4f55-902d-fbdd141fe7e9) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:10.367135 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 21ab168d-3d66-4372-9c61-322a61da37af is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:10.388754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74fda420-15ef-4771-9dd9-991127819521 tempest-PortsTestJSON-1928652053 tempest-PortsTestJSON-1928652053-project] Pushing event deleted for resources: {'Network': ['ID=c8466e8e-4c16-4f91-aa0d-8651c7d4116a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:10.407373 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, e3dcbaad-6ec6-4696-baa2-73cb3f9213c9) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:10.417621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 21ab168d-3d66-4372-9c61-322a61da37af) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:10.427482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for port (0519c8a9-90a3-4262-a4ed-5c8b490f1046), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.439672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (0519c8a9-90a3-4262-a4ed-5c8b490f1046), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.445532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78f356f1-fe37-4107-9cfe-2e627c2dc338 None None] Network e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:10.451320 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dacef43-79c8-427f-ab7a-dfb28234d402 None None] Network 21ab168d-3d66-4372-9c61-322a61da37af requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:10.457458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:10.459082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:10.460282 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.465425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:10.473339 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.500102 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-59705493-4800-419b-9f2e-cf3720a780fe tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1475 time: 1.9524028 Mar 24 02:17:10.505265 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-189a0359-0bac-41c6-a49c-63ad1db75255 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1989748 Mar 24 02:17:10.505861 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60482) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:10.507884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60484) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:10.512571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-9942f07a-a9a7-4225-b852-42fea328d01c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'router': {'name': 'tempest-PortsIpV6TestJSON-router-1918965847', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:10.552132 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (59db86b2-1138-4a50-858b-bbf74c3d4d0e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.630284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4fa5e44-5c46-4032-9a23-04be99054907 None None] Pushing event updated for resources: {'Port': ['ID=50818269-d373-46ad-8515-577c58d8830f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:10.631019 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1090442f-69af-4a17-b1a6-d666de402169 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:10.633201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1090442f-69af-4a17-b1a6-d666de402169 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:10.640635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1090442f-69af-4a17-b1a6-d666de402169 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:10.652970 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1090442f-69af-4a17-b1a6-d666de402169 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2101 time: 0.1358538 Mar 24 02:17:10.652970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9942f07a-a9a7-4225-b852-42fea328d01c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.652970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9942f07a-a9a7-4225-b852-42fea328d01c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.655649 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60486) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:10.745972 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Pushing event updated for resources: {'Port': ['ID=0519c8a9-90a3-4262-a4ed-5c8b490f1046,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:10.778214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9942f07a-a9a7-4225-b852-42fea328d01c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for router_controller (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.792180 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-9716f8b6-94ae-484a-b2e9-b92cf66295b8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Deleting subnet 6eef1ffa-63be-49f9-b075-709fe499b88b {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:10.797283 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9716f8b6-94ae-484a-b2e9-b92cf66295b8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for subnet (6eef1ffa-63be-49f9-b075-709fe499b88b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.801132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9942f07a-a9a7-4225-b852-42fea328d01c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:10.963105 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Floating IP 59db86b2-1138-4a50-858b-bbf74c3d4d0e associated. External IP: 172.26.2.245, port: a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b. Mar 24 02:17:10.974754 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.041974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-e3dcbaad-6ec6-4696-baa2-73cb3f9213c9', 'network_id': 'e3dcbaad-6ec6-4696-baa2-73cb3f9213c9', 'project_id': '1939716dbdc043268b56130159aff4ba', 'fixed_ips': [{'subnet_id': '557c920b-620a-463f-bdc7-22dd912311a1'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:11.045392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.072918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-21ab168d-3d66-4372-9c61-322a61da37af', 'network_id': '21ab168d-3d66-4372-9c61-322a61da37af', 'project_id': '7b8dee850d65489ba8498576f69edde9', 'fixed_ips': [{'subnet_id': 'cd78dad5-3c1f-4120-a512-210673826474'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:11.074327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.163296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60492) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:11.377460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Allocated IP 2001:db8:0:1::1 (e3dcbaad-6ec6-4696-baa2-73cb3f9213c9/557c920b-620a-463f-bdc7-22dd912311a1/81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:11.388431 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Allocated IP 2001:db8::2 (21ab168d-3d66-4372-9c61-322a61da37af/cd78dad5-3c1f-4120-a512-210673826474/b9fd7e63-5d1c-4b2b-9515-a2b1f503f658) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:11.389328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.390394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9942f07a-a9a7-4225-b852-42fea328d01c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.403521 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9942f07a-a9a7-4225-b852-42fea328d01c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.8941689 Mar 24 02:17:11.404053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60496) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:11.412446 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'network_id': '21ab168d-3d66-4372-9c61-322a61da37af', 'name': 'tempest-PortsIpV6TestJSON-1877002564'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:11.430150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9716f8b6-94ae-484a-b2e9-b92cf66295b8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (6eef1ffa-63be-49f9-b075-709fe499b88b), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.580461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:11.605472 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60498) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:11.607216 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ed577fce-fa19-4618-b971-752c589755db admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=59047855c41744dd95105383d31cd553&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4423819 Mar 24 02:17:11.652215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9716f8b6-94ae-484a-b2e9-b92cf66295b8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (6eef1ffa-63be-49f9-b075-709fe499b88b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.661097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Router 7bdf989e-5118-40f2-8477-89f182dcc10b has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:11.662609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 50818269-d373-46ad-8515-577c58d8830f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:11.665184 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Publish callbacks [] for port (81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.673437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:11.678792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:11.706352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.722325 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Publish callbacks [] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.736073 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=93bd5c13-366f-4f55-902d-fbdd141fe7e9,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:11.768529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.789245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:11.792524 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Network e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:11.794988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.803923 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:11.807077 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:11.811107 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Pushing event updated for resources: {'Port': ['ID=81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:11.841290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port 04201dde-ee39-46cb-8734-9d2c45fbfa06 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:11.857284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33a484f6-1d10-4d32-bd26-dcdbbc66f075 admin admin] Publish callbacks [] for security_group (b88d7f80-95c2-4f3a-adb9-951914dba4ae), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.876015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Network 21ab168d-3d66-4372-9c61-322a61da37af is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:11.895494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:11.898925 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9716f8b6-94ae-484a-b2e9-b92cf66295b8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (6eef1ffa-63be-49f9-b075-709fe499b88b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.899320 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:11.922026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:11.923115 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server [None req-eaffc8a2-f5fe-4557-bcc0-e78d585462e7 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 6eef1ffa-63be-49f9-b075-709fe499b88b: This subnet is being modified by another concurrent operation. Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 278, in create_dhcp_port Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1504, in create_port Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1469, in _create_port_db Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1467, in create_port_db Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 691, in _ipam_get_subnets Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnet.lock_register( Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise exception Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 6eef1ffa-63be-49f9-b075-709fe499b88b: This subnet is being modified by another concurrent operation. Mar 24 02:17:11.941229 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Mar 24 02:17:11.947195 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-441d43f7-c2fd-4a9a-9baa-a895aad457b0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 2.4746549 Mar 24 02:17:11.950608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60500) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:11.975549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 50818269-d373-46ad-8515-577c58d8830f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:11.976290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (50818269-d373-46ad-8515-577c58d8830f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:11.986149 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36cb4d3f-50c9-435b-b18b-5e983b9ea3d4 None None] Network f1576fba-ff22-48d7-b14f-380566cfa438 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:11.993408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9716f8b6-94ae-484a-b2e9-b92cf66295b8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Subnet': ['ID=6eef1ffa-63be-49f9-b075-709fe499b88b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:11.997570 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Pushing event updated for resources: {'Port': ['ID=b9fd7e63-5d1c-4b2b-9515-a2b1f503f658,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:12.009839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33a484f6-1d10-4d32-bd26-dcdbbc66f075 admin admin] Publish callbacks [] for security_group (b88d7f80-95c2-4f3a-adb9-951914dba4ae), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.018874 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9716f8b6-94ae-484a-b2e9-b92cf66295b8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.029323 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9716f8b6-94ae-484a-b2e9-b92cf66295b8 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/subnets/6eef1ffa-63be-49f9-b075-709fe499b88b HTTP/1.1" status: 204 len: 168 time: 1.3726048 Mar 24 02:17:12.039035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60502) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:12.095553 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Attempting to bind port 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:12.095976 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Attempting to bind port 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '0f355cf6-63e6-4df1-bebe-e9f676f3f1c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'e3dcbaad-6ec6-4696-baa2-73cb3f9213c9'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:12.096343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Attempting to bind port 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7 on network e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:12.169734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:12.212345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b1a1517-e346-4a5e-b3f4-8dc09b15917f tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Deleting subnet 557c920b-620a-463f-bdc7-22dd912311a1 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:12.232045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b1a1517-e346-4a5e-b3f4-8dc09b15917f tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for subnet (557c920b-620a-463f-bdc7-22dd912311a1), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.235469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::3d6 (21ab168d-3d66-4372-9c61-322a61da37af/cd78dad5-3c1f-4120-a512-210673826474/04201dde-ee39-46cb-8734-9d2c45fbfa06) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:12.284064 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33a484f6-1d10-4d32-bd26-dcdbbc66f075 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b88d7f80-95c2-4f3a-adb9-951914dba4ae), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.287353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33a484f6-1d10-4d32-bd26-dcdbbc66f075 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.288498 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-33a484f6-1d10-4d32-bd26-dcdbbc66f075 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/b88d7f80-95c2-4f3a-adb9-951914dba4ae HTTP/1.1" status: 204 len: 168 time: 0.6722295 Mar 24 02:17:12.305148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b1a1517-e346-4a5e-b3f4-8dc09b15917f tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (557c920b-620a-463f-bdc7-22dd912311a1), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.340668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a484f6-1d10-4d32-bd26-dcdbbc66f075 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b88d7f80-95c2-4f3a-adb9-951914dba4ae,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:12.346404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41ea38d2-6f4e-4d7e-a0dc-2f974f7cb2e0 None None] Network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:12.353826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b36fc79f-c617-420d-9042-56445497dc33 None None] Sync routers for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:12.391405 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:12.391996 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Checking segment: {'id': '0f355cf6-63e6-4df1-bebe-e9f676f3f1c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'e3dcbaad-6ec6-4696-baa2-73cb3f9213c9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:12.392631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.393676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Bound using segment: {'id': '0f355cf6-63e6-4df1-bebe-e9f676f3f1c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'e3dcbaad-6ec6-4696-baa2-73cb3f9213c9'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:12.394272 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Bound port: 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0f355cf6-63e6-4df1-bebe-e9f676f3f1c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'e3dcbaad-6ec6-4696-baa2-73cb3f9213c9'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:12.394964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.401817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.473342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Attempting to bind port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:12.473722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Attempting to bind port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'cc25912d-4fad-46c1-b530-4dc46c9c4457', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21ab168d-3d66-4372-9c61-322a61da37af'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:12.474084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Attempting to bind port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 on network 21ab168d-3d66-4372-9c61-322a61da37af {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:12.501549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b1a1517-e346-4a5e-b3f4-8dc09b15917f tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (557c920b-620a-463f-bdc7-22dd912311a1), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.520829 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b36fc79f-c617-420d-9042-56445497dc33 None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:12.521583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b36fc79f-c617-420d-9042-56445497dc33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:12.530139 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:12.530884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Checking segment: {'id': 'cc25912d-4fad-46c1-b530-4dc46c9c4457', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21ab168d-3d66-4372-9c61-322a61da37af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:12.531301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.531751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Bound using segment: {'id': 'cc25912d-4fad-46c1-b530-4dc46c9c4457', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21ab168d-3d66-4372-9c61-322a61da37af'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:12.532383 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Bound port: b9fd7e63-5d1c-4b2b-9515-a2b1f503f658, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cc25912d-4fad-46c1-b530-4dc46c9c4457', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21ab168d-3d66-4372-9c61-322a61da37af'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:12.533429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.535246 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1cb1cb25-156e-4f6b-a612-435a13a69966 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 988 time: 6.6072395 Mar 24 02:17:12.539545 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60508) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:12.545509 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.598226 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b24d1607-fcce-449a-a45e-237ec8d2cc82 None None] Provisioning complete for port 50818269-d373-46ad-8515-577c58d8830f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:12.598909 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b24d1607-fcce-449a-a45e-237ec8d2cc82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (50818269-d373-46ad-8515-577c58d8830f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.620596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.649125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b36fc79f-c617-420d-9042-56445497dc33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:12.657869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b1a1517-e346-4a5e-b3f4-8dc09b15917f tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (557c920b-620a-463f-bdc7-22dd912311a1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.667608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.714257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b1a1517-e346-4a5e-b3f4-8dc09b15917f tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Subnet': ['ID=557c920b-620a-463f-bdc7-22dd912311a1,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:12.756493 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-682e9f9a-07eb-4990-b84d-69b0c48a15ec tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] 10.222.0.20 "GET /v2.0/floatingips/59db86b2-1138-4a50-858b-bbf74c3d4d0e HTTP/1.1" status: 200 len: 983 time: 0.2157493 Mar 24 02:17:12.760296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60512) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:12.765096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b36fc79f-c617-420d-9042-56445497dc33 None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:12.767228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b36fc79f-c617-420d-9042-56445497dc33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:12.797010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4b1a1517-e346-4a5e-b3f4-8dc09b15917f tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.802215 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4b1a1517-e346-4a5e-b3f4-8dc09b15917f tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/subnets/557c920b-620a-463f-bdc7-22dd912311a1 HTTP/1.1" status: 204 len: 168 time: 0.7394519 Mar 24 02:17:12.808378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60516) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:12.823881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 21ab168d-3d66-4372-9c61-322a61da37af is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:12.851657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:12.876493 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:12.890697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b36fc79f-c617-420d-9042-56445497dc33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:12.892213 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:12.892573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b36fc79f-c617-420d-9042-56445497dc33 None None] The sync data for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:12.894720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.911757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] For port 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:12.928120 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 50818269-d373-46ad-8515-577c58d8830f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:12.929506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (50818269-d373-46ad-8515-577c58d8830f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:12.941116 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.5336955 Mar 24 02:17:12.944250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d914d89-9d63-4877-9807-52090ccc1da7 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=04201dde-ee39-46cb-8734-9d2c45fbfa06,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:12.952601 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60520) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:12.969934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] For port 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7,segment=NetworkSegment(0f355cf6-63e6-4df1-bebe-e9f676f3f1c7),segment_id=0f355cf6-63e6-4df1-bebe-e9f676f3f1c7)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:12.990173 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] For port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:13.005606 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58a2fb95-2386-4056-b197-75f9ecb3bec9 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:13.012046 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-58a2fb95-2386-4056-b197-75f9ecb3bec9 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2006464 Mar 24 02:17:13.016334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60524) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:13.024854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.126704 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] For port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b9fd7e63-5d1c-4b2b-9515-a2b1f503f658,segment=NetworkSegment(cc25912d-4fad-46c1-b530-4dc46c9c4457),segment_id=cc25912d-4fad-46c1-b530-4dc46c9c4457)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:13.162893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (e3dcbaad-6ec6-4696-baa2-73cb3f9213c9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.178567 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 50818269-d373-46ad-8515-577c58d8830f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=50818269-d373-46ad-8515-577c58d8830f,segment=NetworkSegment(32b606c8-8213-485d-a467-1e35eba02ea8),segment_id=32b606c8-8213-485d-a467-1e35eba02ea8)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:13.180903 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5bbff417-7372-4f5e-b75d-381be9d27e38 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] 10.222.0.20 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 3035 time: 0.4195862 Mar 24 02:17:13.193436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60530) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:13.196529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.278110 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c655041a-b801-4e2c-acb3-99df83317372 None None] Pushing event updated for resources: {'Port': ['ID=81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:13.281429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (50818269-d373-46ad-8515-577c58d8830f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.329648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b24d1607-fcce-449a-a45e-237ec8d2cc82 None None] Current status of the port 50818269-d373-46ad-8515-577c58d8830f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:13.330626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b24d1607-fcce-449a-a45e-237ec8d2cc82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (50818269-d373-46ad-8515-577c58d8830f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.484017 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Deleting port 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:13.484361 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.555392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88bda93-3080-40a2-918a-108fa6ee29f6 None None] Pushing event updated for resources: {'Port': ['ID=b9fd7e63-5d1c-4b2b-9515-a2b1f503f658,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:13.607921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-b24d1607-fcce-449a-a45e-237ec8d2cc82 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:17:13.608416 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-b24d1607-fcce-449a-a45e-237ec8d2cc82 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:17:13.637460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60536) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:13.639515 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=50818269-d373-46ad-8515-577c58d8830f,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:13.645222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.661888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] For port 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7,segment=NetworkSegment(0f355cf6-63e6-4df1-bebe-e9f676f3f1c7),segment_id=0f355cf6-63e6-4df1-bebe-e9f676f3f1c7)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:13.662323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.727137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Calling delete_port for 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:13.837969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.846761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Deleting port 0519c8a9-90a3-4262-a4ed-5c8b490f1046 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:13.847105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0519c8a9-90a3-4262-a4ed-5c8b490f1046), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.906497 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8f4a5f32-f4ac-4620-a95b-7786357ea074 tempest-DvrRoutersNegativeTest-752577632 tempest-DvrRoutersNegativeTest-752577632-project] Request body: {'router': {'name': 'tempest-DvrRoutersNegativeTest-router-1357013356', 'external_gateway_info': {}, 'admin_state_up': False, 'distributed': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:13.914295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.policy [None req-8f4a5f32-f4ac-4620-a95b-7786357ea074 tempest-DvrRoutersNegativeTest-752577632 tempest-DvrRoutersNegativeTest-752577632-project] Enforcing rules: ['create_router', 'create_router:external_gateway_info', 'create_router:distributed'] {{(pid=104036) log_rule_list /opt/stack/neutron/neutron/policy.py:450}} Mar 24 02:17:13.914631 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.policy [None req-8f4a5f32-f4ac-4620-a95b-7786357ea074 tempest-DvrRoutersNegativeTest-752577632 tempest-DvrRoutersNegativeTest-752577632-project] Failed policy check for 'create_router' {{(pid=104036) enforce /opt/stack/neutron/neutron/policy.py:524}} Mar 24 02:17:13.915891 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-8f4a5f32-f4ac-4620-a95b-7786357ea074 tempest-DvrRoutersNegativeTest-752577632 tempest-DvrRoutersNegativeTest-752577632-project] create failed (client error): Access was denied to this resource. Mar 24 02:17:13.916980 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8f4a5f32-f4ac-4620-a95b-7786357ea074 tempest-DvrRoutersNegativeTest-752577632 tempest-DvrRoutersNegativeTest-752577632-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 403 len: 414 time: 0.2785568 Mar 24 02:17:13.923422 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:13.987448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.010401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0519c8a9-90a3-4262-a4ed-5c8b490f1046), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.013233 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for floatingip (0519c8a9-90a3-4262-a4ed-5c8b490f1046), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.065822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Port': ['ID=81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:14.083510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] No DVR routers for this DVR port 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:14.085794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Calling delete_port for 0519c8a9-90a3-4262-a4ed-5c8b490f1046 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:14.180365 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b24d1607-fcce-449a-a45e-237ec8d2cc82 None None] Current status of the port 50818269-d373-46ad-8515-577c58d8830f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:14.253469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (e3dcbaad-6ec6-4696-baa2-73cb3f9213c9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.308611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e3dcbaad-6ec6-4696-baa2-73cb3f9213c9']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:14.317894 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f967a27f-0e2f-4ef8-945e-921a06f9a2ef None None] Provisioning complete for port 50818269-d373-46ad-8515-577c58d8830f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:14.318447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f967a27f-0e2f-4ef8-945e-921a06f9a2ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (50818269-d373-46ad-8515-577c58d8830f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.328251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0f355cf6-63e6-4df1-bebe-e9f676f3f1c7') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:14.328448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0f355cf6-63e6-4df1-bebe-e9f676f3f1c7') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:14.363985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (0f355cf6-63e6-4df1-bebe-e9f676f3f1c7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.388958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0f355cf6-63e6-4df1-bebe-e9f676f3f1c7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.409870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60544) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:14.413800 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:14.414206 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (0f355cf6-63e6-4df1-bebe-e9f676f3f1c7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:14.420737 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:14.441197 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=93bd5c13-366f-4f55-902d-fbdd141fe7e9,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:14.488939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f967a27f-0e2f-4ef8-945e-921a06f9a2ef None None] Current status of the port 50818269-d373-46ad-8515-577c58d8830f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:14.502352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f967a27f-0e2f-4ef8-945e-921a06f9a2ef None None] Provisioning complete for port 93bd5c13-366f-4f55-902d-fbdd141fe7e9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:14.502810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f967a27f-0e2f-4ef8-945e-921a06f9a2ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.525465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (e3dcbaad-6ec6-4696-baa2-73cb3f9213c9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.534025 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.537750 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/networks/e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 HTTP/1.1" status: 204 len: 168 time: 1.5204456 Mar 24 02:17:14.540844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60548) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:14.560036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f967a27f-0e2f-4ef8-945e-921a06f9a2ef None None] Port 93bd5c13-366f-4f55-902d-fbdd141fe7e9 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:14.563176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b92d0e66-5afb-47ec-bdf3-fd50805a2254 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Network': ['ID=e3dcbaad-6ec6-4696-baa2-73cb3f9213c9,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:14.565210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (0519c8a9-90a3-4262-a4ed-5c8b490f1046), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.645031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event deleted for resources: {'Port': ['ID=0519c8a9-90a3-4262-a4ed-5c8b490f1046,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:14.660111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbd39c26-0297-43c4-b7b5-480a865641a7 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.683386 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b7990f41-5aa1-41a9-a097-3f8265f19821 None None] Provisioning complete for port 93bd5c13-366f-4f55-902d-fbdd141fe7e9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:14.683854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b7990f41-5aa1-41a9-a097-3f8265f19821 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.724987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (f1576fba-ff22-48d7-b14f-380566cfa438), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.735636 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b7990f41-5aa1-41a9-a097-3f8265f19821 None None] Port 93bd5c13-366f-4f55-902d-fbdd141fe7e9 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:14.751058 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (4055f920-3ed7-429b-9e41-efea495aba65), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.766795 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for floatingip (59db86b2-1138-4a50-858b-bbf74c3d4d0e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.767131 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Floating IP 59db86b2-1138-4a50-858b-bbf74c3d4d0e disassociated (deleted). External IP: 172.26.2.245, port: a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b. Mar 24 02:17:14.874249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.885791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.931040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.965049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (f1576fba-ff22-48d7-b14f-380566cfa438), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:14.995218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.005284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f1576fba-ff22-48d7-b14f-380566cfa438']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.009336 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=04201dde-ee39-46cb-8734-9d2c45fbfa06,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:15.027954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1563ff60-cf69-4f6a-94fd-fe60d162c190') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.028376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1563ff60-cf69-4f6a-94fd-fe60d162c190') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.034620 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbd39c26-0297-43c4-b7b5-480a865641a7 admin admin] Publish callbacks [] for security_group (da113ffe-4870-42e4-b51e-9e50a1e7f7e2), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.047371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (1563ff60-cf69-4f6a-94fd-fe60d162c190), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.054294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbd39c26-0297-43c4-b7b5-480a865641a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (da113ffe-4870-42e4-b51e-9e50a1e7f7e2), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.086315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (1563ff60-cf69-4f6a-94fd-fe60d162c190), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.093110 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Releasing vlan 136 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:15.093709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (1563ff60-cf69-4f6a-94fd-fe60d162c190), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:15.160535 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:15.214590 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dbd39c26-0297-43c4-b7b5-480a865641a7 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=c1b349baef6e4ef0bf6596cb765115c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8009200 Mar 24 02:17:15.226346 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60550) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:15.241285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54dbdf8c-5cd0-478f-9d6b-2b82c4969e16 None None] Network 21ab168d-3d66-4372-9c61-322a61da37af requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:15.246597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (f1576fba-ff22-48d7-b14f-380566cfa438), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.279816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd39c26-0297-43c4-b7b5-480a865641a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da113ffe-4870-42e4-b51e-9e50a1e7f7e2,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:15.288678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.297779 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/networks/f1576fba-ff22-48d7-b14f-380566cfa438 HTTP/1.1" status: 204 len: 168 time: 0.7560594 Mar 24 02:17:15.313579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60552) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:15.323036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.356062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-df637bfb-4e4a-4e00-b7c2-b8a12176caf8 None None] Provisioning complete for port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:15.356353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-df637bfb-4e4a-4e00-b7c2-b8a12176caf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.377814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-800547c1-8676-48cc-8960-d4a705b0442d tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Network': ['ID=f1576fba-ff22-48d7-b14f-380566cfa438,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:15.431769 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (008a18e0-29c4-42c2-ae40-9b61e574a8f6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.502664 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Router 7bdf989e-5118-40f2-8477-89f182dcc10b has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:15.513606 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1081be0e-9246-4168-8acd-b607f12f6ab7 None None] DHCP port deletion for e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:15.524182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c38216d7-c620-47be-bdd9-21b5ace75efd admin admin] Publish callbacks [] for security_group (da113ffe-4870-42e4-b51e-9e50a1e7f7e2), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.544340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-df637bfb-4e4a-4e00-b7c2-b8a12176caf8 None None] Current status of the port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:15.544812 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-df637bfb-4e4a-4e00-b7c2-b8a12176caf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.556700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (008a18e0-29c4-42c2-ae40-9b61e574a8f6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.615733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c38216d7-c620-47be-bdd9-21b5ace75efd admin admin] Publish callbacks [] for security_group (da113ffe-4870-42e4-b51e-9e50a1e7f7e2), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.635259 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2db8391b-72c5-4c11-a6ce-3914175409ad None None] Network e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:15.644491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.657212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['008a18e0-29c4-42c2-ae40-9b61e574a8f6']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.657358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2db8391b-72c5-4c11-a6ce-3914175409ad None None] Network e3dcbaad-6ec6-4696-baa2-73cb3f9213c9 could not be found, it might have been deleted concurrently. {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:196}} Mar 24 02:17:15.660757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-df637bfb-4e4a-4e00-b7c2-b8a12176caf8 None None] For port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b9fd7e63-5d1c-4b2b-9515-a2b1f503f658,segment=NetworkSegment(cc25912d-4fad-46c1-b530-4dc46c9c4457),segment_id=cc25912d-4fad-46c1-b530-4dc46c9c4457)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:15.671789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-df637bfb-4e4a-4e00-b7c2-b8a12176caf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.685290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.696723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd90407cf-0b66-4c63-b467-f8a660731fb0') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.697089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd90407cf-0b66-4c63-b467-f8a660731fb0') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.712903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (d90407cf-0b66-4c63-b467-f8a660731fb0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.719617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.733144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d90407cf-0b66-4c63-b467-f8a660731fb0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.744833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Releasing vlan 137 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:15.745267 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (d90407cf-0b66-4c63-b467-f8a660731fb0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:15.748424 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:15.783539 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 50818269-d373-46ad-8515-577c58d8830f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:15.793158 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d7acb5c3-2d00-4537-b073-abf70b3be9ff None None] Could not find standard attr ID for object 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:17:15.804100 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:15.811918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.815199 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09d86aab-1d50-4d53-9c1c-c01de67a0eea None None] Sync routers for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:15.827197 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09d86aab-1d50-4d53-9c1c-c01de67a0eea None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:15.828110 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-09d86aab-1d50-4d53-9c1c-c01de67a0eea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.828339 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df637bfb-4e4a-4e00-b7c2-b8a12176caf8 None None] Pushing event updated for resources: {'Port': ['ID=b9fd7e63-5d1c-4b2b-9515-a2b1f503f658,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:15.866889 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 50818269-d373-46ad-8515-577c58d8830f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:15.867577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (50818269-d373-46ad-8515-577c58d8830f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.886037 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7f4c4cb0-4dbd-47d8-bb69-6c37e58472b7 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "DELETE /v2.0/floatingips/59db86b2-1138-4a50-858b-bbf74c3d4d0e HTTP/1.1" status: 204 len: 168 time: 2.6895344 Mar 24 02:17:15.889994 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60556) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:15.891359 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-09d86aab-1d50-4d53-9c1c-c01de67a0eea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.895638 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:15.907337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (008a18e0-29c4-42c2-ae40-9b61e574a8f6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.919109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c38216d7-c620-47be-bdd9-21b5ace75efd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (da113ffe-4870-42e4-b51e-9e50a1e7f7e2), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.919908 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09d86aab-1d50-4d53-9c1c-c01de67a0eea None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:15.920967 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-09d86aab-1d50-4d53-9c1c-c01de67a0eea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.923575 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c38216d7-c620-47be-bdd9-21b5ace75efd admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.925809 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c38216d7-c620-47be-bdd9-21b5ace75efd admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/da113ffe-4870-42e4-b51e-9e50a1e7f7e2 HTTP/1.1" status: 204 len: 168 time: 0.6985278 Mar 24 02:17:15.951444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:15.955954 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/networks/008a18e0-29c4-42c2-ae40-9b61e574a8f6 HTTP/1.1" status: 204 len: 168 time: 0.6413493 Mar 24 02:17:15.956871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8e86f39-bc81-478d-b686-2c3d972cc576 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Network': ['ID=008a18e0-29c4-42c2-ae40-9b61e574a8f6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:15.966069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60560) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:15.969740 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-09d86aab-1d50-4d53-9c1c-c01de67a0eea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:15.971248 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09d86aab-1d50-4d53-9c1c-c01de67a0eea None None] The sync data for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:16.016775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0dc2c1ce-f1f9-4827-b618-cc090f2a9afe None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:17:16.023324 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.073494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2b5a0abd-363d-48d5-9531-6cbfb8f72a89 None None] Provisioning complete for port 04201dde-ee39-46cb-8734-9d2c45fbfa06 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:16.073709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2b5a0abd-363d-48d5-9531-6cbfb8f72a89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.076709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 50818269-d373-46ad-8515-577c58d8830f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:16.077786 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:16.098233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c38216d7-c620-47be-bdd9-21b5ace75efd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da113ffe-4870-42e4-b51e-9e50a1e7f7e2,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:16.101656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (4055f920-3ed7-429b-9e41-efea495aba65), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.110936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=93bd5c13-366f-4f55-902d-fbdd141fe7e9,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:16.127335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (872dad4e-7fbd-403e-abf3-561b46f676c3), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.187015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2b5a0abd-363d-48d5-9531-6cbfb8f72a89 None None] Port 04201dde-ee39-46cb-8734-9d2c45fbfa06 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:16.220099 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2b5a0abd-363d-48d5-9531-6cbfb8f72a89 None None] Provisioning complete for port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:16.220651 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2b5a0abd-363d-48d5-9531-6cbfb8f72a89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.254636 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dc2c1ce-f1f9-4827-b618-cc090f2a9afe None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:17:16.261624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (872dad4e-7fbd-403e-abf3-561b46f676c3), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.262123 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:16.262507 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.268963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.277145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:16.277145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:16.294800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.295657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.298043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['872dad4e-7fbd-403e-abf3-561b46f676c3']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:16.313853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.319874 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6bcf4c0f-553f-407b-8ca4-53868b254a01') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:16.320167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6bcf4c0f-553f-407b-8ca4-53868b254a01') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:16.341981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (6bcf4c0f-553f-407b-8ca4-53868b254a01), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.356739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=04201dde-ee39-46cb-8734-9d2c45fbfa06,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:16.397791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (6bcf4c0f-553f-407b-8ca4-53868b254a01), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.415144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Releasing vlan 140 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:16.415144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (6bcf4c0f-553f-407b-8ca4-53868b254a01), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:16.416282 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:16.530092 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (872dad4e-7fbd-403e-abf3-561b46f676c3), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.532501 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Allocated IP 172.26.2.54 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/12ee5924-15d3-4a2a-85c5-afa963d4ccb2) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:16.543774 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.550412 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] 10.222.0.20 "DELETE /v2.0/networks/872dad4e-7fbd-403e-abf3-561b46f676c3 HTTP/1.1" status: 204 len: 168 time: 0.5805826 Mar 24 02:17:16.550644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 21ab168d-3d66-4372-9c61-322a61da37af is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:16.563622 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6540011b-3c11-4254-9109-dacec36d1213 tempest-BulkNetworkOpsIpV6Test-1062684452 tempest-BulkNetworkOpsIpV6Test-1062684452-project] Pushing event deleted for resources: {'Network': ['ID=872dad4e-7fbd-403e-abf3-561b46f676c3,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:16.571266 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:16.578602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router 4055f920-3ed7-429b-9e41-efea495aba65 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:17:16.662345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:16.687904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for port (12ee5924-15d3-4a2a-85c5-afa963d4ccb2), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.715794 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2b5a0abd-363d-48d5-9531-6cbfb8f72a89 None None] Current status of the port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:16.742770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (12ee5924-15d3-4a2a-85c5-afa963d4ccb2), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:16.830412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Pushing event updated for resources: {'Port': ['ID=12ee5924-15d3-4a2a-85c5-afa963d4ccb2,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:16.843619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:16.845229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:16.848355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:16.966453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for floatingip (4acf62f5-3628-4174-9620-4fc86deacb58), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.013988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60586) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:17.037109 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (12ee5924-15d3-4a2a-85c5-afa963d4ccb2), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.147107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60590) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:17.197200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:17.212399 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ef29e12-ea2f-4dd7-911e-260b5b52872c None None] Sync routers for ids ['4055f920-3ed7-429b-9e41-efea495aba65'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:17.216803 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5bbf5a21-174a-4b25-9af4-51af1e3a49a9 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/4055f920-3ed7-429b-9e41-efea495aba65/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2562518 Mar 24 02:17:17.217530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60594) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:17.231402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ef29e12-ea2f-4dd7-911e-260b5b52872c None None] Routers {'4055f920-3ed7-429b-9e41-efea495aba65'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:17.234045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1ef29e12-ea2f-4dd7-911e-260b5b52872c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['4055f920-3ed7-429b-9e41-efea495aba65'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:17.320283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-599a62d2-eae3-4a85-a3fb-87ed4bd69335 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:17.325090 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-599a62d2-eae3-4a85-a3fb-87ed4bd69335 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports/93bd5c13-366f-4f55-902d-fbdd141fe7e9 HTTP/1.1" status: 200 len: 977 time: 0.1062877 Mar 24 02:17:17.325790 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60598) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:17.326084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1ef29e12-ea2f-4dd7-911e-260b5b52872c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:17.377810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f8fc3582-e126-434d-bf0b-d34e1fa8cbaf None None] Provisioning complete for port 04201dde-ee39-46cb-8734-9d2c45fbfa06 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:17.378199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f8fc3582-e126-434d-bf0b-d34e1fa8cbaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.384635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ef29e12-ea2f-4dd7-911e-260b5b52872c None None] Routers {'4055f920-3ed7-429b-9e41-efea495aba65'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:17.385381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1ef29e12-ea2f-4dd7-911e-260b5b52872c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['4055f920-3ed7-429b-9e41-efea495aba65'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:17.388958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-11cd43e9-0924-47f0-b8af-2ad369b7309e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-912172812', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:17.456760 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11cd43e9-0924-47f0-b8af-2ad369b7309e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (f16cab9e-4385-4fd9-9ce1-9edfe837db44), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.458634 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11cd43e9-0924-47f0-b8af-2ad369b7309e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (f16cab9e-4385-4fd9-9ce1-9edfe837db44), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.459261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1ef29e12-ea2f-4dd7-911e-260b5b52872c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:17.459919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ef29e12-ea2f-4dd7-911e-260b5b52872c None None] The sync data for ids ['4055f920-3ed7-429b-9e41-efea495aba65'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:17.467254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Router 3883e4b6-f9e8-4aa8-a086-9e79f159c9af is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:17:17.476786 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f8fc3582-e126-434d-bf0b-d34e1fa8cbaf None None] Port 04201dde-ee39-46cb-8734-9d2c45fbfa06 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:17.491634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f8fc3582-e126-434d-bf0b-d34e1fa8cbaf None None] Provisioning complete for port 93bd5c13-366f-4f55-902d-fbdd141fe7e9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:17.492107 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f8fc3582-e126-434d-bf0b-d34e1fa8cbaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.547823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f8fc3582-e126-434d-bf0b-d34e1fa8cbaf None None] Port 93bd5c13-366f-4f55-902d-fbdd141fe7e9 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:17.571999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:17.636533 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:17.637266 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.687363 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-204732d5-1b22-407d-86db-210c74001e37 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=1939716dbdc043268b56130159aff4ba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6718516 Mar 24 02:17:17.690600 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60600) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:17.695114 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11cd43e9-0924-47f0-b8af-2ad369b7309e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for router_controller (f16cab9e-4385-4fd9-9ce1-9edfe837db44), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.708629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-889b7624-42af-4205-b109-8d58f1fd5d94 None None] Provisioning complete for port 04201dde-ee39-46cb-8734-9d2c45fbfa06 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:17.708629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-889b7624-42af-4205-b109-8d58f1fd5d94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.723239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11cd43e9-0924-47f0-b8af-2ad369b7309e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (f16cab9e-4385-4fd9-9ce1-9edfe837db44), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.745240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-889b7624-42af-4205-b109-8d58f1fd5d94 None None] Port 04201dde-ee39-46cb-8734-9d2c45fbfa06 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:17.758494 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:17.767172 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-11cd43e9-0924-47f0-b8af-2ad369b7309e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.768147 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-11cd43e9-0924-47f0-b8af-2ad369b7309e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 707 time: 0.6193883 Mar 24 02:17:17.771188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60602) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:17.773778 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce6bd084-5d07-4728-91bc-0a375297ad84 None None] Sync routers for ids ['3883e4b6-f9e8-4aa8-a086-9e79f159c9af'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:17.780397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60604) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:17.784680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-496143040'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:17.784893 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7b6ece3e-5a3b-48e0-b6f7-a9c88d1a617e tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "PUT /v2.0/routers/3883e4b6-f9e8-4aa8-a086-9e79f159c9af/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8215642 Mar 24 02:17:17.791652 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce6bd084-5d07-4728-91bc-0a375297ad84 None None] Routers {'3883e4b6-f9e8-4aa8-a086-9e79f159c9af'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:17.792289 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ce6bd084-5d07-4728-91bc-0a375297ad84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['3883e4b6-f9e8-4aa8-a086-9e79f159c9af'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:17.828330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for port (12ee5924-15d3-4a2a-85c5-afa963d4ccb2), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.830124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f923ca47-0399-4b17-a70f-8f75cd26d2d7 admin admin] Publish callbacks [] for security_group (6bf05dec-246a-4ca3-abb5-f692231fbd88), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.839605 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:17.851135 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ce6bd084-5d07-4728-91bc-0a375297ad84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:17.852635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:17.857432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (12ee5924-15d3-4a2a-85c5-afa963d4ccb2), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.867917 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce6bd084-5d07-4728-91bc-0a375297ad84 None None] Routers {'3883e4b6-f9e8-4aa8-a086-9e79f159c9af'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:17.870752 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ce6bd084-5d07-4728-91bc-0a375297ad84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['3883e4b6-f9e8-4aa8-a086-9e79f159c9af'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:17.881310 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:17.883520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 81a3eaa4-ab47-44e6-8ee1-cf3af5193eb7 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:17.903826 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f923ca47-0399-4b17-a70f-8f75cd26d2d7 admin admin] Publish callbacks [] for security_group (6bf05dec-246a-4ca3-abb5-f692231fbd88), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.923244 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ce6bd084-5d07-4728-91bc-0a375297ad84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:17.924450 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce6bd084-5d07-4728-91bc-0a375297ad84 None None] The sync data for ids ['3883e4b6-f9e8-4aa8-a086-9e79f159c9af'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:17.969678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Made reservation on behalf of 6a5cebb9797c446b84c81f5885d7fc64 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:17.972937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:17.993265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.040428 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Pushing event updated for resources: {'Port': ['ID=12ee5924-15d3-4a2a-85c5-afa963d4ccb2,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:18.050038 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63923aac-58b6-4916-95c9-8bd34e3b042b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:18.051595 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-63923aac-58b6-4916-95c9-8bd34e3b042b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports?device_id=3883e4b6-f9e8-4aa8-a086-9e79f159c9af HTTP/1.1" status: 200 len: 989 time: 0.2600074 Mar 24 02:17:18.057458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60608) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:18.075995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-997c23f9-649a-4f87-a558-7b2002d9ea75 None None] Provisioning complete for port 04201dde-ee39-46cb-8734-9d2c45fbfa06 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:18.076395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-997c23f9-649a-4f87-a558-7b2002d9ea75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.079478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (4055f920-3ed7-429b-9e41-efea495aba65), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.124073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-997c23f9-649a-4f87-a558-7b2002d9ea75 None None] Port 04201dde-ee39-46cb-8734-9d2c45fbfa06 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:18.144992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (4acf62f5-3628-4174-9620-4fc86deacb58), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.151983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f923ca47-0399-4b17-a70f-8f75cd26d2d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (6bf05dec-246a-4ca3-abb5-f692231fbd88), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.154503 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f923ca47-0399-4b17-a70f-8f75cd26d2d7 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.155672 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f923ca47-0399-4b17-a70f-8f75cd26d2d7 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/6bf05dec-246a-4ca3-abb5-f692231fbd88 HTTP/1.1" status: 204 len: 168 time: 0.4644330 Mar 24 02:17:18.191591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f923ca47-0399-4b17-a70f-8f75cd26d2d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6bf05dec-246a-4ca3-abb5-f692231fbd88,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:18.199748 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.203487 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dc60bc2b-257e-4b30-a95d-430d684ec54f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.3096728 Mar 24 02:17:18.204951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60612) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:18.337315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for security_group (e80b0763-fef3-438a-a7df-40040c2c747b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.344508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:18.354856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e80b0763-fef3-438a-a7df-40040c2c747b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.364311 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 93bd5c13-366f-4f55-902d-fbdd141fe7e9 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:18.364858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.417185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 141} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:18.423240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.428790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e80b0763-fef3-438a-a7df-40040c2c747b,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:18.446590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (47cb43a7-feb3-49ab-b9d5-889cd27004d3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.446942 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Added segment 47cb43a7-feb3-49ab-b9d5-889cd27004d3 of type vlan for network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 Mar 24 02:17:18.466074 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.480691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 93bd5c13-366f-4f55-902d-fbdd141fe7e9 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:18.526992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (7cde5c03-1bce-4fe6-bab8-be1b58838f55), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.576567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (7cde5c03-1bce-4fe6-bab8-be1b58838f55), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.582232 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:18.582844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.672925 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.8977113 Mar 24 02:17:18.676704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60628) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:18.683998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Request body: {'subnet': {'network_id': '7cde5c03-1bce-4fe6-bab8-be1b58838f55', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:18.699245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cdcad71-11cc-44f6-9ff9-3539f0d39800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Network': ['ID=7cde5c03-1bce-4fe6-bab8-be1b58838f55,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:18.713920 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:18.732485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.759538 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (93bd5c13-366f-4f55-902d-fbdd141fe7e9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.807194 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=93bd5c13-366f-4f55-902d-fbdd141fe7e9,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:18.864483 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.920071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Made reservation on behalf of 6a5cebb9797c446b84c81f5885d7fc64 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:18.923710 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:18.980268 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Allocated IP 172.26.2.53 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/6fd7a1d7-497b-4e91-b7a0-e59686d60932) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:19.022691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60638) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:19.055404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (4055f920-3ed7-429b-9e41-efea495aba65), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.170428 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks [] for port (6fd7a1d7-497b-4e91-b7a0-e59686d60932), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.184644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9806e809-9bb5-43b3-b1d3-1c788d85dbd0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'router': {'name': 'tempest-RoutersNegativeIpV6Test-router-94615322', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:19.238746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 04201dde-ee39-46cb-8734-9d2c45fbfa06 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:19.238998 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.254931 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (6fd7a1d7-497b-4e91-b7a0-e59686d60932), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.304960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9806e809-9bb5-43b3-b1d3-1c788d85dbd0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (654913c1-1089-45d5-a685-61f2d36bf588), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.305932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9806e809-9bb5-43b3-b1d3-1c788d85dbd0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (654913c1-1089-45d5-a685-61f2d36bf588), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.310713 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router 4055f920-3ed7-429b-9e41-efea495aba65 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:19.333883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:19.345809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:19.352529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:19.397366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Pushing event updated for resources: {'Port': ['ID=6fd7a1d7-497b-4e91-b7a0-e59686d60932,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:19.403608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.421895 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 04201dde-ee39-46cb-8734-9d2c45fbfa06 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:19.433075 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (431fd840-ead5-4cb9-b2cf-4efeba48e88f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.500209 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9806e809-9bb5-43b3-b1d3-1c788d85dbd0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for router_controller (654913c1-1089-45d5-a685-61f2d36bf588), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.508390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:19.512362 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9806e809-9bb5-43b3-b1d3-1c788d85dbd0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (654913c1-1089-45d5-a685-61f2d36bf588), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.520676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d191d4b6-4ba7-403f-8e89-cc5867c160e0 None None] Sync routers for ids ['4055f920-3ed7-429b-9e41-efea495aba65'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:19.524203 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-54bbe56f-9c36-4f48-bd2c-997ac4323ef5 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/4055f920-3ed7-429b-9e41-efea495aba65/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1939077 Mar 24 02:17:19.526403 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60644) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:19.529693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks [] for floatingip (456f8f42-361e-4de8-a11a-314c2fda7612), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.532454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d191d4b6-4ba7-403f-8e89-cc5867c160e0 None None] Routers {'4055f920-3ed7-429b-9e41-efea495aba65'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:19.534002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-d191d4b6-4ba7-403f-8e89-cc5867c160e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['4055f920-3ed7-429b-9e41-efea495aba65'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:19.571912 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-d191d4b6-4ba7-403f-8e89-cc5867c160e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:19.581183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d191d4b6-4ba7-403f-8e89-cc5867c160e0 None None] Routers {'4055f920-3ed7-429b-9e41-efea495aba65'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:19.581861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-d191d4b6-4ba7-403f-8e89-cc5867c160e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['4055f920-3ed7-429b-9e41-efea495aba65'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:19.615069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-d191d4b6-4ba7-403f-8e89-cc5867c160e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:19.615825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d191d4b6-4ba7-403f-8e89-cc5867c160e0 None None] The sync data for ids ['4055f920-3ed7-429b-9e41-efea495aba65'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:19.622293 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (6fd7a1d7-497b-4e91-b7a0-e59686d60932), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.769862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (04201dde-ee39-46cb-8734-9d2c45fbfa06), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.817122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=04201dde-ee39-46cb-8734-9d2c45fbfa06,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:19.855865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Subnet': ['ID=431fd840-ead5-4cb9-b2cf-4efeba48e88f,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:19.865548 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9806e809-9bb5-43b3-b1d3-1c788d85dbd0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.866697 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9806e809-9bb5-43b3-b1d3-1c788d85dbd0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 710 time: 0.8372784 Mar 24 02:17:19.872547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60646) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:19.878608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-1128177683'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:19.891104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Checking segment: {'id': '47cb43a7-feb3-49ab-b9d5-889cd27004d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '7cde5c03-1bce-4fe6-bab8-be1b58838f55'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:19.891357 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network hostable DHCP agents. Network: 7cde5c03-1bce-4fe6-bab8-be1b58838f55, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:19.945051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.967129 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks [] for port (6fd7a1d7-497b-4e91-b7a0-e59686d60932), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:19.975942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (6fd7a1d7-497b-4e91-b7a0-e59686d60932), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.001070 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:20.006121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Made reservation on behalf of 3dbc846d991b4af0ae231d5e469488ba for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:20.009504 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.031179 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-d5b4d690-f6a1-4239-9b16-6e9c948de758 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] remove_router_interface failed (client error): The resource could not be found. Mar 24 02:17:20.035623 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d5b4d690-f6a1-4239-9b16-6e9c948de758 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/4055f920-3ed7-429b-9e41-efea495aba65/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.5023012 Mar 24 02:17:20.038638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60648) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:20.049882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.052613 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 7cde5c03-1bce-4fe6-bab8-be1b58838f55) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:20.064378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97b2ad56-eb62-445e-b4c6-0c2310ad8f7f None None] Network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:20.077602 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6db0b36e-d478-4c7a-b372-5a47961c7636 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=4055f920-3ed7-429b-9e41-efea495aba65 HTTP/1.1" status: 200 len: 205 time: 0.0354469 Mar 24 02:17:20.077602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:20.077602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.079437 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60650) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:20.111115 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-138bb3d3-edbd-4e4f-ac04-907a0ff0d6c4 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4337499 Mar 24 02:17:20.111663 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60652) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:20.118350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Request body: {'network': {'name': 'tempest-router-network01--1917124547'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:20.163504 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Made reservation on behalf of 6a5cebb9797c446b84c81f5885d7fc64 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:20.170782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.200594 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-7cde5c03-1bce-4fe6-bab8-be1b58838f55', 'network_id': '7cde5c03-1bce-4fe6-bab8-be1b58838f55', 'project_id': '6a5cebb9797c446b84c81f5885d7fc64', 'fixed_ips': [{'subnet_id': '431fd840-ead5-4cb9-b2cf-4efeba48e88f'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:20.201803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.219498 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for security_group (8e03c73a-6dd7-49d2-a8f0-97deffea2cf6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.231455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8e03c73a-6dd7-49d2-a8f0-97deffea2cf6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.268539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8e03c73a-6dd7-49d2-a8f0-97deffea2cf6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:20.281302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Pushing event updated for resources: {'Port': ['ID=6fd7a1d7-497b-4e91-b7a0-e59686d60932,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:20.286333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0754fccc-34be-4603-bc7c-6e947824994f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (4055f920-3ed7-429b-9e41-efea495aba65), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.296384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (456f8f42-361e-4de8-a11a-314c2fda7612), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.307549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 133} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:20.320955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (54d87ace-94bc-463b-8b4d-c0a6f71fd89c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.321821 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Added segment 54d87ace-94bc-463b-8b4d-c0a6f71fd89c of type vlan for network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 Mar 24 02:17:20.371948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (7a2f9f0b-26c4-4ab6-b939-a934962cbf90), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.386165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Allocated IP 172.20.0.2 (7cde5c03-1bce-4fe6-bab8-be1b58838f55/431fd840-ead5-4cb9-b2cf-4efeba48e88f/4dd61a54-b881-4383-bfa8-72da7c8e680e) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:20.406712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (7a2f9f0b-26c4-4ab6-b939-a934962cbf90), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.412371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:20.413382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.416412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 114} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:20.496802 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (12ff0fb4-31e7-4801-83d9-b0fe0c5f5482), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.497943 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Added segment 12ff0fb4-31e7-4801-83d9-b0fe0c5f5482 of type vlan for network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 Mar 24 02:17:20.513163 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.3986883 Mar 24 02:17:20.515412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18370092-bbc0-436b-bd51-03a9986a3800 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Network': ['ID=7a2f9f0b-26c4-4ab6-b939-a934962cbf90,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:20.518206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60654) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:20.543625 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Request body: {'network': {'name': 'tempest-router-network02--43848844'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:20.568868 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Made reservation on behalf of 6a5cebb9797c446b84c81f5885d7fc64 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:20.572863 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.602350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (388c1171-5a51-4a13-ad3a-5e02de8f8d78), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.609826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Publish callbacks [] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.617950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 134} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:20.618290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:20.622965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.645343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4818dd34-96c0-484c-b6b9-61dc5ea9b365), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.645959 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Added segment 4818dd34-96c0-484c-b6b9-61dc5ea9b365 of type vlan for network 9a1fcc47-24d9-4303-8c86-1aaa9507bb56 Mar 24 02:17:20.681222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (388c1171-5a51-4a13-ad3a-5e02de8f8d78), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.686764 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:20.687605 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.723871 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:20.731162 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:20.733344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:20.741535 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Pushing event updated for resources: {'Port': ['ID=4dd61a54-b881-4383-bfa8-72da7c8e680e,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:20.742124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60656) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:20.743095 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 0.8693755 Mar 24 02:17:20.745640 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (9a1fcc47-24d9-4303-8c86-1aaa9507bb56), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.754720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'subnet': {'network_id': '388c1171-5a51-4a13-ad3a-5e02de8f8d78', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:20.773726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.774977 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-30ec20a9-3995-47ec-af13-d94e0e97381e tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.5641243 Mar 24 02:17:20.781489 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60658) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:20.803094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Attempting to bind port 4dd61a54-b881-4383-bfa8-72da7c8e680e on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:20.803468 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Attempting to bind port 4dd61a54-b881-4383-bfa8-72da7c8e680e by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '47cb43a7-feb3-49ab-b9d5-889cd27004d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '7cde5c03-1bce-4fe6-bab8-be1b58838f55'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:20.803823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Attempting to bind port 4dd61a54-b881-4383-bfa8-72da7c8e680e on network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:20.809517 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:20.810796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Checking segment: {'id': '47cb43a7-feb3-49ab-b9d5-889cd27004d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '7cde5c03-1bce-4fe6-bab8-be1b58838f55'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:20.810796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.810796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Bound using segment: {'id': '47cb43a7-feb3-49ab-b9d5-889cd27004d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '7cde5c03-1bce-4fe6-bab8-be1b58838f55'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:20.812279 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Bound port: 4dd61a54-b881-4383-bfa8-72da7c8e680e, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '47cb43a7-feb3-49ab-b9d5-889cd27004d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '7cde5c03-1bce-4fe6-bab8-be1b58838f55'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:20.812387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Router 3883e4b6-f9e8-4aa8-a086-9e79f159c9af has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:20.812530 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.858760 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dec9b21b-c818-4058-ad8a-9be7ed79f252 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Network': ['ID=388c1171-5a51-4a13-ad3a-5e02de8f8d78,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:20.873241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (9a1fcc47-24d9-4303-8c86-1aaa9507bb56), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.877819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:20.881399 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:20.882072 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.920004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] For port 4dd61a54-b881-4383-bfa8-72da7c8e680e, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:20.930256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0754fccc-34be-4603-bc7c-6e947824994f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (4055f920-3ed7-429b-9e41-efea495aba65), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.934863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0754fccc-34be-4603-bc7c-6e947824994f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (4055f920-3ed7-429b-9e41-efea495aba65), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.941980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] For port 4dd61a54-b881-4383-bfa8-72da7c8e680e, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4dd61a54-b881-4383-bfa8-72da7c8e680e,segment=NetworkSegment(47cb43a7-feb3-49ab-b9d5-889cd27004d3),segment_id=47cb43a7-feb3-49ab-b9d5-889cd27004d3)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:20.956688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:20.967884 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-918b4af9-8c25-4f2b-97a1-2d084b2425e6 tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] 10.222.0.20 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 3218 time: 0.1851704 Mar 24 02:17:20.968496 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60660) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:20.971797 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Network': ['ID=9a1fcc47-24d9-4303-8c86-1aaa9507bb56,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:20.990811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 9a1fcc47-24d9-4303-8c86-1aaa9507bb56 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:21.073385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0754fccc-34be-4603-bc7c-6e947824994f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (4055f920-3ed7-429b-9e41-efea495aba65), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.074595 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-535d5ab6-3802-401f-9cfb-a1f9e0132d00 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.5536571 Mar 24 02:17:21.074930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0754fccc-34be-4603-bc7c-6e947824994f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Fanout notify agent at l3_agent the message router_deleted on router 4055f920-3ed7-429b-9e41-efea495aba65 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:17:21.081146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60662) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:21.084317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0754fccc-34be-4603-bc7c-6e947824994f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.085709 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0754fccc-34be-4603-bc7c-6e947824994f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/4055f920-3ed7-429b-9e41-efea495aba65 HTTP/1.1" status: 204 len: 168 time: 1.0057867 Mar 24 02:17:21.089825 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Request body: {'subnet': {'network_id': '7a2f9f0b-26c4-4ab6-b939-a934962cbf90', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:21.093722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60664) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:21.100727 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3fe7324f-26b6-4afa-8061-5160e650d91c tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 690 time: 0.1238441 Mar 24 02:17:21.102365 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:21.110889 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c473f0f5-8354-447f-b44a-4d1dd1c26682 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "PUT /v2.0/routers/3883e4b6-f9e8-4aa8-a086-9e79f159c9af/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0521796 Mar 24 02:17:21.112134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60666) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:21.112463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60668) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:21.120374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Made reservation on behalf of 3dbc846d991b4af0ae231d5e469488ba for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:21.120563 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c8a807c-e322-4d77-8f8c-df5b495ec072 None None] Sync routers for ids ['3883e4b6-f9e8-4aa8-a086-9e79f159c9af'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:21.121111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.131224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa907651-5bcf-41dd-92e9-a648e995a62d None None] Pushing event updated for resources: {'Port': ['ID=4dd61a54-b881-4383-bfa8-72da7c8e680e,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:21.136748 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c8a807c-e322-4d77-8f8c-df5b495ec072 None None] Routers {'3883e4b6-f9e8-4aa8-a086-9e79f159c9af'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:21.137983 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3c8a807c-e322-4d77-8f8c-df5b495ec072 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['3883e4b6-f9e8-4aa8-a086-9e79f159c9af'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:21.181933 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3c8a807c-e322-4d77-8f8c-df5b495ec072 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:21.191448 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c8a807c-e322-4d77-8f8c-df5b495ec072 None None] Routers {'3883e4b6-f9e8-4aa8-a086-9e79f159c9af'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:21.192401 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3c8a807c-e322-4d77-8f8c-df5b495ec072 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['3883e4b6-f9e8-4aa8-a086-9e79f159c9af'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:21.231280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-14956cea-b1d7-4794-99cd-82838cdc08d2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting subnet f2aeac0d-b287-4804-8bc6-c924f575a396 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:21.237326 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-fb19fbd4-f259-4d75-a7c6-9c9336ad57da tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:17:21.238763 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3c8a807c-e322-4d77-8f8c-df5b495ec072 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:21.239669 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c8a807c-e322-4d77-8f8c-df5b495ec072 None None] The sync data for ids ['3883e4b6-f9e8-4aa8-a086-9e79f159c9af'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:21.241669 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fb19fbd4-f259-4d75-a7c6-9c9336ad57da tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/04201dde-ee39-46cb-8734-9d2c45fbfa06 HTTP/1.1" status: 404 len: 333 time: 0.1251535 Mar 24 02:17:21.243006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60670) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:21.250802 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14956cea-b1d7-4794-99cd-82838cdc08d2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (f2aeac0d-b287-4804-8bc6-c924f575a396), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.306681 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Made reservation on behalf of 6a5cebb9797c446b84c81f5885d7fc64 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:21.313464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.338240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14956cea-b1d7-4794-99cd-82838cdc08d2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (f2aeac0d-b287-4804-8bc6-c924f575a396), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.436688 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5468641-8167-4e94-be7e-077d7ffdc745 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for router (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.441951 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-cc06f88f-fb79-430f-91ee-d3e5f521555b service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3820522 Mar 24 02:17:21.539228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14956cea-b1d7-4794-99cd-82838cdc08d2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (f2aeac0d-b287-4804-8bc6-c924f575a396), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.566171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4dd61a54-b881-4383-bfa8-72da7c8e680e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:21.621526 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 4dd61a54-b881-4383-bfa8-72da7c8e680e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:21.621926 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.652218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14956cea-b1d7-4794-99cd-82838cdc08d2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (f2aeac0d-b287-4804-8bc6-c924f575a396), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.710067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14956cea-b1d7-4794-99cd-82838cdc08d2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Subnet': ['ID=f2aeac0d-b287-4804-8bc6-c924f575a396,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:21.724315 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14956cea-b1d7-4794-99cd-82838cdc08d2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.726266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5468641-8167-4e94-be7e-077d7ffdc745 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.729077 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5468641-8167-4e94-be7e-077d7ffdc745 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for router_controller (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.729423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b33cbf3-7889-4029-9ed0-9d3d6c617657 None None] Network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:21.731061 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-14956cea-b1d7-4794-99cd-82838cdc08d2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/f2aeac0d-b287-4804-8bc6-c924f575a396 HTTP/1.1" status: 204 len: 168 time: 0.6263003 Mar 24 02:17:21.731738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60672) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:21.739069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Deleting port 6fd7a1d7-497b-4e91-b7a0-e59686d60932 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:21.739412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (6fd7a1d7-497b-4e91-b7a0-e59686d60932), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.742727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-a5c75a7a-3122-4cbf-aa55-89a868621757 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:21.743911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (09ba771b-69d3-44d3-a19c-28d37029db41), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.744254 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-a5c75a7a-3122-4cbf-aa55-89a868621757 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 1129 time: 0.2640240 Mar 24 02:17:21.788295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 4dd61a54-b881-4383-bfa8-72da7c8e680e is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:21.788707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.847175 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 4dd61a54-b881-4383-bfa8-72da7c8e680e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4dd61a54-b881-4383-bfa8-72da7c8e680e,segment=NetworkSegment(47cb43a7-feb3-49ab-b9d5-889cd27004d3),segment_id=47cb43a7-feb3-49ab-b9d5-889cd27004d3)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:21.858215 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.862882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Subnet': ['ID=09ba771b-69d3-44d3-a19c-28d37029db41,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:21.873188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (ac842fb9-3cb6-4c0f-abdd-14a26c23e49b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.882736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5468641-8167-4e94-be7e-077d7ffdc745 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (3883e4b6-f9e8-4aa8-a086-9e79f159c9af), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.883277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5468641-8167-4e94-be7e-077d7ffdc745 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Fanout notify agent at l3_agent the message router_deleted on router 3883e4b6-f9e8-4aa8-a086-9e79f159c9af {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:17:21.899527 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Checking segment: {'id': '54d87ace-94bc-463b-8b4d-c0a6f71fd89c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7a2f9f0b-26c4-4ab6-b939-a934962cbf90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:21.899892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network hostable DHCP agents. Network: 7a2f9f0b-26c4-4ab6-b939-a934962cbf90, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:21.906989 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5468641-8167-4e94-be7e-077d7ffdc745 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:21.912823 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a5468641-8167-4e94-be7e-077d7ffdc745 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/routers/3883e4b6-f9e8-4aa8-a086-9e79f159c9af HTTP/1.1" status: 204 len: 168 time: 0.6652324 Mar 24 02:17:21.925054 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60674) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:21.936129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=4dd61a54-b881-4383-bfa8-72da7c8e680e,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:21.980114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (64dc4bf3-2544-4904-a7e6-ac6433808662), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.017694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:22.022215 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-ac3a149e-4209-4111-8e9a-394bea05e3b1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet cd78dad5-3c1f-4120-a512-210673826474 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:22.030204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] DHCP port deletion for ac842fb9-3cb6-4c0f-abdd-14a26c23e49b request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:22.044303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ac3a149e-4209-4111-8e9a-394bea05e3b1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (cd78dad5-3c1f-4120-a512-210673826474), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.056138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (6fd7a1d7-497b-4e91-b7a0-e59686d60932), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.056456 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks [] for floatingip (6fd7a1d7-497b-4e91-b7a0-e59686d60932), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.067438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 7a2f9f0b-26c4-4ab6-b939-a934962cbf90) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:22.090056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f6da3f9-da94-4f85-bbfe-0f5f92191490 None None] Network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:22.093823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Calling delete_port for 6fd7a1d7-497b-4e91-b7a0-e59686d60932 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:22.117441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Subnet': ['ID=64dc4bf3-2544-4904-a7e6-ac6433808662,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:22.122937 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ac3a149e-4209-4111-8e9a-394bea05e3b1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (cd78dad5-3c1f-4120-a512-210673826474), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.141547 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-c65d5195-19cf-413d-b535-4e4bdf988659 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:22.143609 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-c65d5195-19cf-413d-b535-4e4bdf988659 service neutron] 10.222.0.30 "GET /v2.0/networks?id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d HTTP/1.1" status: 200 len: 897 time: 0.3068397 Mar 24 02:17:22.153287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:22.154159 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.167513 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 50818269-d373-46ad-8515-577c58d8830f {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:22.168009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (50818269-d373-46ad-8515-577c58d8830f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.171420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] Deleting port 50818269-d373-46ad-8515-577c58d8830f {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:22.171908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (50818269-d373-46ad-8515-577c58d8830f), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.178926 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Checking segment: {'id': '12ff0fb4-31e7-4801-83d9-b0fe0c5f5482', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '388c1171-5a51-4a13-ad3a-5e02de8f8d78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:22.179641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network hostable DHCP agents. Network: 388c1171-5a51-4a13-ad3a-5e02de8f8d78, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:22.247244 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-746e4f01-eada-4347-b80b-ae10b87d4ec1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1623998 Mar 24 02:17:22.247454 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60676) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:22.261802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Request body: {'subnet': {'network_id': '9a1fcc47-24d9-4303-8c86-1aaa9507bb56', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:22.295777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port 50818269-d373-46ad-8515-577c58d8830f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=50818269-d373-46ad-8515-577c58d8830f,segment=NetworkSegment(32b606c8-8213-485d-a467-1e35eba02ea8),segment_id=32b606c8-8213-485d-a467-1e35eba02ea8)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:22.296182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (50818269-d373-46ad-8515-577c58d8830f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.318863 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 50818269-d373-46ad-8515-577c58d8830f owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:22.324126 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ac3a149e-4209-4111-8e9a-394bea05e3b1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (cd78dad5-3c1f-4120-a512-210673826474), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.342092 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-137d4ad2-287d-403f-8b45-341cd94e8c1e service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=79123375-136b-4c1b-ba67-948e46e33a7c HTTP/1.1" status: 200 len: 1000 time: 0.1559479 Mar 24 02:17:22.343300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:22.414297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 388c1171-5a51-4a13-ad3a-5e02de8f8d78) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:22.421721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:22.422355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.458399 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3b7f6f3-4adc-46fd-82d4-986e27c1304d None None] Network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:22.461502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-e6823f37-175d-4806-ae98-171cd0d3593c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:22.463081 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-e6823f37-175d-4806-ae98-171cd0d3593c service neutron] 10.222.0.30 "GET /v2.0/subnets?id=852aacbf-87d9-49af-b73c-786b9253307e HTTP/1.1" status: 200 len: 835 time: 0.1111634 Mar 24 02:17:22.479647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ac3a149e-4209-4111-8e9a-394bea05e3b1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (cd78dad5-3c1f-4120-a512-210673826474), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.485533 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] For port 50818269-d373-46ad-8515-577c58d8830f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=50818269-d373-46ad-8515-577c58d8830f,segment=NetworkSegment(32b606c8-8213-485d-a467-1e35eba02ea8),segment_id=32b606c8-8213-485d-a467-1e35eba02ea8)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:22.486699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (50818269-d373-46ad-8515-577c58d8830f), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.501041 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-690d40ae-f4cc-4036-ac27-6a062a42db82 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.7524688 Mar 24 02:17:22.512879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60678) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:22.518894 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-7a2f9f0b-26c4-4ab6-b939-a934962cbf90', 'network_id': '7a2f9f0b-26c4-4ab6-b939-a934962cbf90', 'project_id': '6a5cebb9797c446b84c81f5885d7fc64', 'fixed_ips': [{'subnet_id': '09ba771b-69d3-44d3-a19c-28d37029db41'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:22.519859 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.523639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac3a149e-4209-4111-8e9a-394bea05e3b1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=cd78dad5-3c1f-4120-a512-210673826474,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:22.539536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'network': {'name': 'tempest-router-network01--118570596'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:22.543063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Made reservation on behalf of 6a5cebb9797c446b84c81f5885d7fc64 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:22.546608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.553284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] Calling delete_port for 50818269-d373-46ad-8515-577c58d8830f owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:22.557551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ac3a149e-4209-4111-8e9a-394bea05e3b1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.565292 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ac3a149e-4209-4111-8e9a-394bea05e3b1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/cd78dad5-3c1f-4120-a512-210673826474 HTTP/1.1" status: 204 len: 168 time: 0.6362915 Mar 24 02:17:22.565473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60680) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:22.598597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1e5f09e-52e4-45e8-8262-3f5dabe35f10 None None] Network 21ab168d-3d66-4372-9c61-322a61da37af requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:22.611133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efb1a7bb-7555-4ea3-9c10-e9c9dc539d2c None None] Network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:22.631154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (50818269-d373-46ad-8515-577c58d8830f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.636009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Made reservation on behalf of 3dbc846d991b4af0ae231d5e469488ba for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:22.639428 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.641254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (6fd7a1d7-497b-4e91-b7a0-e59686d60932), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.680660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=50818269-d373-46ad-8515-577c58d8830f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:22.684292 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No DVR routers for this DVR port 50818269-d373-46ad-8515-577c58d8830f on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:22.695218 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Pushing event deleted for resources: {'Port': ['ID=6fd7a1d7-497b-4e91-b7a0-e59686d60932,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:22.716837 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-957ad0fb-2ec7-4793-98a5-ffbbed074b7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:22.718413 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-957ad0fb-2ec7-4793-98a5-ffbbed074b7f service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.2259922 Mar 24 02:17:22.728023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (21ab168d-3d66-4372-9c61-322a61da37af), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.772746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 135} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:22.778955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (ac842fb9-3cb6-4c0f-abdd-14a26c23e49b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.824905 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ac842fb9-3cb6-4c0f-abdd-14a26c23e49b']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:22.840081 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '32b606c8-8213-485d-a467-1e35eba02ea8') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:22.840699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '32b606c8-8213-485d-a467-1e35eba02ea8') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:22.852610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (eaa2d6f4-4a95-41df-9ecc-6e7135524d0c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.852956 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Added segment eaa2d6f4-4a95-41df-9ecc-6e7135524d0c of type vlan for network 834402ee-abbe-4d0a-b309-41f9ccba31d2 Mar 24 02:17:22.856348 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (32b606c8-8213-485d-a467-1e35eba02ea8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.877952 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:22.878458 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.890973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (32b606c8-8213-485d-a467-1e35eba02ea8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.904959 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks [] for floatingip (456f8f42-361e-4de8-a11a-314c2fda7612), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.907776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.912372 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ebf577d1-4c1d-4af4-80fa-180ee9ec6422 tempest-FloatingIPAdminTestJSON-2141763361 tempest-FloatingIPAdminTestJSON-2141763361-project] 10.222.0.20 "DELETE /v2.0/floatingips/456f8f42-361e-4de8-a11a-314c2fda7612 HTTP/1.1" status: 204 len: 168 time: 1.7978470 Mar 24 02:17:22.915397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60682) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:22.930610 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-bbf41015-589a-438e-8831-0c0ed9d16412 None None] Provisioning complete for port 4dd61a54-b881-4383-bfa8-72da7c8e680e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:22.931108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bbf41015-589a-438e-8831-0c0ed9d16412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.934556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Releasing vlan 103 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:22.935347 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (32b606c8-8213-485d-a467-1e35eba02ea8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:22.939130 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:22.944532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-388c1171-5a51-4a13-ad3a-5e02de8f8d78', 'network_id': '388c1171-5a51-4a13-ad3a-5e02de8f8d78', 'project_id': '3dbc846d991b4af0ae231d5e469488ba', 'fixed_ips': [{'subnet_id': '64dc4bf3-2544-4904-a7e6-ac6433808662'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:22.945595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:22.947791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (834402ee-abbe-4d0a-b309-41f9ccba31d2), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.010159 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] For port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b9fd7e63-5d1c-4b2b-9515-a2b1f503f658,segment=NetworkSegment(cc25912d-4fad-46c1-b530-4dc46c9c4457),segment_id=cc25912d-4fad-46c1-b530-4dc46c9c4457)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:23.010706 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.026020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:23.037460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (ac842fb9-3cb6-4c0f-abdd-14a26c23e49b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.045567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.053195 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/networks/ac842fb9-3cb6-4c0f-abdd-14a26c23e49b HTTP/1.1" status: 204 len: 168 time: 1.3187423 Mar 24 02:17:23.059100 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60686) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:23.101385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'network': {'name': 'tempest-RoutersTest-1775708584'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:23.113639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f8bb04-3af7-4b80-b690-43d873be8523 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Network': ['ID=ac842fb9-3cb6-4c0f-abdd-14a26c23e49b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:23.114171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Allocated IP 172.20.0.2 (7a2f9f0b-26c4-4ab6-b939-a934962cbf90/09ba771b-69d3-44d3-a19c-28d37029db41/fe891a64-a3f4-4762-b1ed-ef0b04bfab73) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:23.116278 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (50818269-d373-46ad-8515-577c58d8830f), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.143067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:23.143489 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-20c00adb-e0b3-4edb-9bda-bca969502ec3 service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4074843 Mar 24 02:17:23.147350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.171448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (834402ee-abbe-4d0a-b309-41f9ccba31d2), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.179963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:23.181379 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.186047 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 122} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:23.197813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (880136ce-d208-467b-91a6-7b0795264cd9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.198279 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added segment 880136ce-d208-467b-91a6-7b0795264cd9 of type vlan for network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 Mar 24 02:17:23.206629 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b9fd7e63-5d1c-4b2b-9515-a2b1f503f658), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.209678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] Network ac842fb9-3cb6-4c0f-abdd-14a26c23e49b is not hosted by any dhcp agent {{(pid=104038) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Mar 24 02:17:23.210224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] No DVR routers for this DVR port 50818269-d373-46ad-8515-577c58d8830f on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:23.235452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (b172e891-e367-4684-b354-2c6066a1ffe1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.236544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e0575f-5c63-4c26-a39f-dd9c5a8eb2ed None None] Pushing event deleted for resources: {'Port': ['ID=50818269-d373-46ad-8515-577c58d8830f,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:23.259861 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=b9fd7e63-5d1c-4b2b-9515-a2b1f503f658,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:23.271379 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No DVR routers for this DVR port b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:23.278859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (6e6edefe-93d4-45d7-9f2e-47c72b7d0761), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.342566 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.8271804 Mar 24 02:17:23.343567 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aec185ab-f913-4210-a167-1a44af20ba6b None None] DHCP port deletion for 21ab168d-3d66-4372-9c61-322a61da37af request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:23.359618 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60690) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:23.365098 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'network': {'name': 'tempest-router-network02--316195889'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:23.378393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Subnet': ['ID=b172e891-e367-4684-b354-2c6066a1ffe1,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:23.405233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (6e6edefe-93d4-45d7-9f2e-47c72b7d0761), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.417594 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:23.417594 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.418076 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (21ab168d-3d66-4372-9c61-322a61da37af), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.440531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-bbf41015-589a-438e-8831-0c0ed9d16412 None None] Current status of the port 4dd61a54-b881-4383-bfa8-72da7c8e680e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:23.507254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7f11f3f-3439-40b8-a898-d485ebc43a00 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Network': ['ID=834402ee-abbe-4d0a-b309-41f9ccba31d2,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:23.509073 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['21ab168d-3d66-4372-9c61-322a61da37af']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:23.510204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Allocated IP 2001:db8::2 (388c1171-5a51-4a13-ad3a-5e02de8f8d78/64dc4bf3-2544-4904-a7e6-ac6433808662/830cc8ab-190a-40a7-a475-88a0ef2decc5) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:23.515185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Deleting port 12ee5924-15d3-4a2a-85c5-afa963d4ccb2 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:23.515579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (12ee5924-15d3-4a2a-85c5-afa963d4ccb2), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.516529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Made reservation on behalf of 3dbc846d991b4af0ae231d5e469488ba for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:23.534497 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.557049 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cc25912d-4fad-46c1-b530-4dc46c9c4457') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:23.557400 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cc25912d-4fad-46c1-b530-4dc46c9c4457') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:23.573335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 834402ee-abbe-4d0a-b309-41f9ccba31d2 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:23.574956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Checking segment: {'id': '4818dd34-96c0-484c-b6b9-61dc5ea9b365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '9a1fcc47-24d9-4303-8c86-1aaa9507bb56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:23.575326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network hostable DHCP agents. Network: 9a1fcc47-24d9-4303-8c86-1aaa9507bb56, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:23.594418 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.5313954 Mar 24 02:17:23.597830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60692) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:23.603169 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (cc25912d-4fad-46c1-b530-4dc46c9c4457), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.616927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f314709-949e-4f9f-83b0-5faaecb0c2f2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Network': ['ID=6e6edefe-93d4-45d7-9f2e-47c72b7d0761,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:23.619707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'subnet': {'network_id': '6e6edefe-93d4-45d7-9f2e-47c72b7d0761', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:23.624576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (cc25912d-4fad-46c1-b530-4dc46c9c4457), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.626570 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 125} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:23.645017 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:23.645376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (cc25912d-4fad-46c1-b530-4dc46c9c4457), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:23.648601 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:23.705034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e237a193-a4bf-4a6e-9286-54c6597c20bc), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.705412 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Added segment e237a193-a4bf-4a6e-9286-54c6597c20bc of type vlan for network 58c3ebb3-5acb-4f4a-b028-9c70230944ca Mar 24 02:17:23.718056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4dd61a54-b881-4383-bfa8-72da7c8e680e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:23.720021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:23.738044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network 9a1fcc47-24d9-4303-8c86-1aaa9507bb56 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:23.768289 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c48c46b9-ec4e-47a4-823c-dac00f62a541 req-d9a7ddc9-d3e6-412a-a7b6-ee26355ec639 service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5664897 Mar 24 02:17:23.778436 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 9a1fcc47-24d9-4303-8c86-1aaa9507bb56) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:23.783737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:23.784619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.788805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (12ee5924-15d3-4a2a-85c5-afa963d4ccb2), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.789137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for floatingip (12ee5924-15d3-4a2a-85c5-afa963d4ccb2), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.792659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (58c3ebb3-5acb-4f4a-b028-9c70230944ca), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.793285 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:23.797856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.826832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (21ab168d-3d66-4372-9c61-322a61da37af), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.831486 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.837660 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/networks/21ab168d-3d66-4372-9c61-322a61da37af HTTP/1.1" status: 204 len: 168 time: 1.2693927 Mar 24 02:17:23.841853 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (58c3ebb3-5acb-4f4a-b028-9c70230944ca), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.842017 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72e18bbe-f0b5-4154-bb13-67d1f85f7b34 None None] Network 9a1fcc47-24d9-4303-8c86-1aaa9507bb56 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:23.848146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:23.849359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.852887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60694) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:23.874847 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Publish callbacks [] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.882072 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afde8866-d707-4f2e-92c8-a523f0c1ca0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Network': ['ID=21ab168d-3d66-4372-9c61-322a61da37af,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:23.939759 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.5760176 Mar 24 02:17:23.940032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:23.978511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60696) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:23.984224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'subnet': {'network_id': '834402ee-abbe-4d0a-b309-41f9ccba31d2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:24.037908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3b021c81-ed5e-4462-a6ac-95d24527823c None None] Provisioning complete for port 4dd61a54-b881-4383-bfa8-72da7c8e680e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:24.038298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3b021c81-ed5e-4462-a6ac-95d24527823c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.042852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad39b802-9a25-49e9-b3c0-b941db4a0b43 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:24.047826 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ad39b802-9a25-49e9-b3c0-b941db4a0b43 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/aee2f7ee-569a-4b32-9981-c7cefe350ef1 HTTP/1.1" status: 200 len: 844 time: 0.1892197 Mar 24 02:17:24.056013 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60698) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:24.076907 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96ef28ff-2f73-42d0-8fbe-290df926a85e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Network': ['ID=58c3ebb3-5acb-4f4a-b028-9c70230944ca,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:24.206131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:24.222925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 58c3ebb3-5acb-4f4a-b028-9c70230944ca details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:24.246734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Calling delete_port for 12ee5924-15d3-4a2a-85c5-afa963d4ccb2 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:24.264941 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:24.267938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:24.271404 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5e033468-52a7-4a91-acfa-f752c2e9c6d3 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0228753 Mar 24 02:17:24.272054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60700) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:24.351343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Pushing event updated for resources: {'Port': ['ID=fe891a64-a3f4-4762-b1ed-ef0b04bfab73,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:24.373778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 4dd61a54-b881-4383-bfa8-72da7c8e680e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:24.374166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.384200 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c875ad65-35d8-46bb-901c-73dd625d7d6d tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/aee2f7ee-569a-4b32-9981-c7cefe350ef1?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.3236005 Mar 24 02:17:24.388473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60702) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:24.393562 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:24.456066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Made reservation on behalf of 3dbc846d991b4af0ae231d5e469488ba for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:24.460803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.474167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Publish callbacks [] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.505835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.539894 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Attempting to bind port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:24.540852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Attempting to bind port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '54d87ace-94bc-463b-8b4d-c0a6f71fd89c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7a2f9f0b-26c4-4ab6-b939-a934962cbf90'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:24.541220 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Attempting to bind port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 on network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:24.561620 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:24.561998 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Checking segment: {'id': '54d87ace-94bc-463b-8b4d-c0a6f71fd89c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7a2f9f0b-26c4-4ab6-b939-a934962cbf90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:24.563006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.563436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Bound using segment: {'id': '54d87ace-94bc-463b-8b4d-c0a6f71fd89c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7a2f9f0b-26c4-4ab6-b939-a934962cbf90'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:24.563937 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Bound port: fe891a64-a3f4-4762-b1ed-ef0b04bfab73, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '54d87ace-94bc-463b-8b4d-c0a6f71fd89c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7a2f9f0b-26c4-4ab6-b939-a934962cbf90'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:24.565160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.605642 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:24.621561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:24.623896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:24.626314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-9a1fcc47-24d9-4303-8c86-1aaa9507bb56', 'network_id': '9a1fcc47-24d9-4303-8c86-1aaa9507bb56', 'project_id': '6a5cebb9797c446b84c81f5885d7fc64', 'fixed_ips': [{'subnet_id': 'b172e891-e367-4684-b354-2c6066a1ffe1'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:24.628281 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.641242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:24.645078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.663084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Pushing event updated for resources: {'Port': ['ID=830cc8ab-190a-40a7-a475-88a0ef2decc5,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:24.726087 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3b021c81-ed5e-4462-a6ac-95d24527823c None None] Current status of the port 4dd61a54-b881-4383-bfa8-72da7c8e680e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:24.818377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (f3841d7d-4008-4e44-9c89-698d071245fa), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.825279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.844111 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (0761200f-0d8a-46d8-ac1c-807c96143fe9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.854291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 4dd61a54-b881-4383-bfa8-72da7c8e680e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:24.854571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (12ee5924-15d3-4a2a-85c5-afa963d4ccb2), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.881237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] For port fe891a64-a3f4-4762-b1ed-ef0b04bfab73, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:24.898332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Attempting to bind port 830cc8ab-190a-40a7-a475-88a0ef2decc5 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:24.898332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Attempting to bind port 830cc8ab-190a-40a7-a475-88a0ef2decc5 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '12ff0fb4-31e7-4801-83d9-b0fe0c5f5482', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '388c1171-5a51-4a13-ad3a-5e02de8f8d78'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:24.898722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Attempting to bind port 830cc8ab-190a-40a7-a475-88a0ef2decc5 on network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:24.903714 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] For port fe891a64-a3f4-4762-b1ed-ef0b04bfab73, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fe891a64-a3f4-4762-b1ed-ef0b04bfab73,segment=NetworkSegment(54d87ace-94bc-463b-8b4d-c0a6f71fd89c),segment_id=54d87ace-94bc-463b-8b4d-c0a6f71fd89c)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:24.905410 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Pushing event deleted for resources: {'Port': ['ID=12ee5924-15d3-4a2a-85c5-afa963d4ccb2,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:24.915033 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Subnet': ['ID=0761200f-0d8a-46d8-ac1c-807c96143fe9,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:24.918087 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:24.918334 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Checking segment: {'id': '12ff0fb4-31e7-4801-83d9-b0fe0c5f5482', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '388c1171-5a51-4a13-ad3a-5e02de8f8d78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:24.918583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.919181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Bound using segment: {'id': '12ff0fb4-31e7-4801-83d9-b0fe0c5f5482', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '388c1171-5a51-4a13-ad3a-5e02de8f8d78'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:24.919954 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Bound port: 830cc8ab-190a-40a7-a475-88a0ef2decc5, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '12ff0fb4-31e7-4801-83d9-b0fe0c5f5482', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '388c1171-5a51-4a13-ad3a-5e02de8f8d78'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:24.920343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.949887 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:24.970697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Checking segment: {'id': 'eaa2d6f4-4a95-41df-9ecc-6e7135524d0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '834402ee-abbe-4d0a-b309-41f9ccba31d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:24.971118 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network hostable DHCP agents. Network: 834402ee-abbe-4d0a-b309-41f9ccba31d2, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:24.994462 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (afd24e27-ea10-4df7-bb48-bdbdad6fea6e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.014684 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:25.017478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:25.036059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Subnet': ['ID=f3841d7d-4008-4e44-9c89-698d071245fa,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:25.038770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:25.039495 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.046460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network 834402ee-abbe-4d0a-b309-41f9ccba31d2 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:25.046717 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 50818269-d373-46ad-8515-577c58d8830f no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:25.048057 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe91b57b-e318-4b6f-806d-6cf86c1ff86b None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:25.079028 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6897449 Mar 24 02:17:25.082741 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60704) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:25.088256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 834402ee-abbe-4d0a-b309-41f9ccba31d2) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:25.096297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7a385c38-fa59-420c-a65e-48bf5eab9f6f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'security_group': {'name': 'tempest-secgroup-1788755046'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:25.103132 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:25.103735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.112098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Checking segment: {'id': '880136ce-d208-467b-91a6-7b0795264cd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '6e6edefe-93d4-45d7-9f2e-47c72b7d0761'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:25.112796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network hostable DHCP agents. Network: 6e6edefe-93d4-45d7-9f2e-47c72b7d0761, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:25.119416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-216f158e-ad93-4029-8fd0-73bb5feb06fb tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=afd24e27-ea10-4df7-bb48-bdbdad6fea6e,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:25.136077 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4821fa7c-bbb7-4130-a677-e37012a448c2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1566236 Mar 24 02:17:25.140729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60706) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:25.147136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'subnet': {'network_id': '58c3ebb3-5acb-4f4a-b028-9c70230944ca', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:25.151252 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 50818269-d373-46ad-8515-577c58d8830f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:25.151742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7a385c38-fa59-420c-a65e-48bf5eab9f6f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.152133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 50818269-d373-46ad-8515-577c58d8830f not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:25.152837 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:25.157692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Allocated IP 172.20.0.2 (9a1fcc47-24d9-4303-8c86-1aaa9507bb56/b172e891-e367-4684-b354-2c6066a1ffe1/3393b423-b7b7-475b-9467-175cb41d7b9c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:25.178820 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks [] for floatingip (4acf62f5-3628-4174-9620-4fc86deacb58), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.181448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.186116 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2e81d7ea-6f78-4600-be63-ac8f9c675b9f tempest-FloatingIPAdminTestJSON-1517336987 tempest-FloatingIPAdminTestJSON-1517336987-project-admin] 10.222.0.20 "DELETE /v2.0/floatingips/4acf62f5-3628-4174-9620-4fc86deacb58 HTTP/1.1" status: 204 len: 168 time: 2.2589982 Mar 24 02:17:25.188001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60708) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:25.210415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46a7ebfb-a9d1-4eaf-a7a2-351c50cae37a None None] Network 834402ee-abbe-4d0a-b309-41f9ccba31d2 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:25.264823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:25.287955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Made reservation on behalf of 3dbc846d991b4af0ae231d5e469488ba for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:25.288328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 6e6edefe-93d4-45d7-9f2e-47c72b7d0761) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:25.301436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.306956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:25.307489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b9fd7e63-5d1c-4b2b-9515-a2b1f503f658 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:25.311585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-301827f9-f0a5-4c1d-8aad-78a30b131c81 None None] Pushing event updated for resources: {'Port': ['ID=fe891a64-a3f4-4762-b1ed-ef0b04bfab73,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:25.321945 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20f8f2d1-898d-4095-acd7-9a89d6beff99 None None] Network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:25.328816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:25.329433 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.410806 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7a385c38-fa59-420c-a65e-48bf5eab9f6f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (b38ade3f-d491-4b39-afc2-1f7da48ce033), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.418061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7a385c38-fa59-420c-a65e-48bf5eab9f6f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b38ade3f-d491-4b39-afc2-1f7da48ce033), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.448673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] For port 830cc8ab-190a-40a7-a475-88a0ef2decc5, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:25.450136 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4186c131-d5d1-47d2-84ac-fac55b3c0b46 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8465507 Mar 24 02:17:25.453583 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60710) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:25.467433 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0fe2dfb3-2bb8-422a-a3a2-d574ca348b8c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-983468377', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:25.503323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7a385c38-fa59-420c-a65e-48bf5eab9f6f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.507192 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7a385c38-fa59-420c-a65e-48bf5eab9f6f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.4177177 Mar 24 02:17:25.507549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Allocated IP 172.20.0.1 (7a2f9f0b-26c4-4ab6-b939-a934962cbf90/09ba771b-69d3-44d3-a19c-28d37029db41/3e6e8117-b905-46ae-8fab-8ee3c8733cd0) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:25.509918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60712) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:25.513075 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a385c38-fa59-420c-a65e-48bf5eab9f6f tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b38ade3f-d491-4b39-afc2-1f7da48ce033,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:25.514682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7441f4d5-afc5-4daa-ab15-31b55dee4351 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'security_group': {'name': 'tempest-secgroup-1010420514'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:25.528338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-86ebb0b2-5748-41b5-aade-8dc300c4a33c tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Deleting port a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:25.528584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-86ebb0b2-5748-41b5-aade-8dc300c4a33c tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.531217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0fe2dfb3-2bb8-422a-a3a2-d574ca348b8c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (e327e313-0127-4476-b533-24ce9c089768), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.532438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0fe2dfb3-2bb8-422a-a3a2-d574ca348b8c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (e327e313-0127-4476-b533-24ce9c089768), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.558335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] For port 830cc8ab-190a-40a7-a475-88a0ef2decc5, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=830cc8ab-190a-40a7-a475-88a0ef2decc5,segment=NetworkSegment(12ff0fb4-31e7-4801-83d9-b0fe0c5f5482),segment_id=12ff0fb4-31e7-4801-83d9-b0fe0c5f5482)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:25.593002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0fe2dfb3-2bb8-422a-a3a2-d574ca348b8c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (e327e313-0127-4476-b533-24ce9c089768), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.601327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0fe2dfb3-2bb8-422a-a3a2-d574ca348b8c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (e327e313-0127-4476-b533-24ce9c089768), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.642658 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.663834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0fe2dfb3-2bb8-422a-a3a2-d574ca348b8c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.667586 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0fe2dfb3-2bb8-422a-a3a2-d574ca348b8c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.2059724 Mar 24 02:17:25.668321 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60714) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:25.736451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fe891a64-a3f4-4762-b1ed-ef0b04bfab73 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:25.753116 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7441f4d5-afc5-4daa-ab15-31b55dee4351 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.813870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-86ebb0b2-5748-41b5-aade-8dc300c4a33c tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.817554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-834402ee-abbe-4d0a-b309-41f9ccba31d2', 'network_id': '834402ee-abbe-4d0a-b309-41f9ccba31d2', 'project_id': '3dbc846d991b4af0ae231d5e469488ba', 'fixed_ips': [{'subnet_id': '0761200f-0d8a-46d8-ac1c-807c96143fe9'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:25.818074 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.853984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-86ebb0b2-5748-41b5-aade-8dc300c4a33c tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Calling delete_port for a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:25.870751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.874505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-6e6edefe-93d4-45d7-9f2e-47c72b7d0761', 'network_id': '6e6edefe-93d4-45d7-9f2e-47c72b7d0761', 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'fixed_ips': [{'subnet_id': 'f3841d7d-4008-4e44-9c89-698d071245fa'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:25.875221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.888821 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f810e045-ed14-4b79-a80f-104a99c8833b None None] Pushing event updated for resources: {'Port': ['ID=830cc8ab-190a-40a7-a475-88a0ef2decc5,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:25.916827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (81becc6f-1f1b-41c3-95c9-208eb1fecf3f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.973320 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7441f4d5-afc5-4daa-ab15-31b55dee4351 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (cd4f5544-e94d-42f7-8b1e-9750c65abae8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:25.983467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7441f4d5-afc5-4daa-ab15-31b55dee4351 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (cd4f5544-e94d-42f7-8b1e-9750c65abae8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.028741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Publish callbacks [] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.050721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7441f4d5-afc5-4daa-ab15-31b55dee4351 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.052323 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7441f4d5-afc5-4daa-ab15-31b55dee4351 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5414157 Mar 24 02:17:26.056366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7441f4d5-afc5-4daa-ab15-31b55dee4351 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cd4f5544-e94d-42f7-8b1e-9750c65abae8,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:26.058751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60716) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:26.071261 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1307431125', 'security_groups': ['cd4f5544-e94d-42f7-8b1e-9750c65abae8'], 'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'afd24e27-ea10-4df7-bb48-bdbdad6fea6e'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:26.085119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Subnet': ['ID=81becc6f-1f1b-41c3-95c9-208eb1fecf3f,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:26.096683 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Checking segment: {'id': 'e237a193-a4bf-4a6e-9286-54c6597c20bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '58c3ebb3-5acb-4f4a-b028-9c70230944ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:26.097188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network hostable DHCP agents. Network: 58c3ebb3-5acb-4f4a-b028-9c70230944ca, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:26.110552 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:26.110811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.111502 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.113442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.127503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'project_id': '7b8dee850d65489ba8498576f69edde9', 'fixed_ips': [{'subnet_id': 'afd24e27-ea10-4df7-bb48-bdbdad6fea6e'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:26.128284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.168274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.208860 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network 58c3ebb3-5acb-4f4a-b028-9c70230944ca is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:26.274491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:26.399105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Port': ['ID=3e6e8117-b905-46ae-8fab-8ee3c8733cd0,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:26.417272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:26.422815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-86ebb0b2-5748-41b5-aade-8dc300c4a33c tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.428394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:26.455439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 58c3ebb3-5acb-4f4a-b028-9c70230944ca) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:26.461038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:26.461663 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.487804 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f067a27-a517-41ca-a1f7-011914e54aa6 None None] Network 58c3ebb3-5acb-4f4a-b028-9c70230944ca requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:26.513098 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-190f0a6b-1a4a-4d46-8fb7-2bf6522ede17 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.3707333 Mar 24 02:17:26.516476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60718) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:26.527209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ebb0b2-5748-41b5-aade-8dc300c4a33c tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event deleted for resources: {'Port': ['ID=a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:26.568507 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Network 9a1fcc47-24d9-4303-8c86-1aaa9507bb56 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:26.631806 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.20.0.1 (6e6edefe-93d4-45d7-9f2e-47c72b7d0761/f3841d7d-4008-4e44-9c89-698d071245fa/38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:26.643382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:26.682292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:26.693950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Pushing event updated for resources: {'Port': ['ID=3393b423-b7b7-475b-9467-175cb41d7b9c,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:26.698720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:26.710144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-86ebb0b2-5748-41b5-aade-8dc300c4a33c tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.714144 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-86ebb0b2-5748-41b5-aade-8dc300c4a33c tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "DELETE /v2.0/ports/a02ed8c7-eeba-4e7b-9c63-e2f086bb8c4b HTTP/1.1" status: 204 len: 168 time: 1.5218589 Mar 24 02:17:26.717242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60720) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:26.785078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (f16cab9e-4385-4fd9-9ce1-9edfe837db44), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.835190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-58c3ebb3-5acb-4f4a-b028-9c70230944ca', 'network_id': '58c3ebb3-5acb-4f4a-b028-9c70230944ca', 'project_id': '3dbc846d991b4af0ae231d5e469488ba', 'fixed_ips': [{'subnet_id': '81becc6f-1f1b-41c3-95c9-208eb1fecf3f'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:26.835969 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:26.839582 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Allocated IP 2001:db8::2 (834402ee-abbe-4d0a-b309-41f9ccba31d2/0761200f-0d8a-46d8-ac1c-807c96143fe9/a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:26.874960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e774b6e-b651-42a9-a576-255b0a83dcb2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:26.876725 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5e774b6e-b651-42a9-a576-255b0a83dcb2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "GET /v2.0/ports?device_id=7bdf989e-5118-40f2-8477-89f182dcc10b HTTP/1.1" status: 200 len: 913 time: 0.1569595 Mar 24 02:17:26.908293 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60722) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:26.911029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ec3bafa-201e-4763-8b99-ed5e476ae840 None None] Network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:27.015603 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.049031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.070201 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Attempting to bind port 3393b423-b7b7-475b-9467-175cb41d7b9c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:27.070663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Attempting to bind port 3393b423-b7b7-475b-9467-175cb41d7b9c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '4818dd34-96c0-484c-b6b9-61dc5ea9b365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '9a1fcc47-24d9-4303-8c86-1aaa9507bb56'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:27.071280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Attempting to bind port 3393b423-b7b7-475b-9467-175cb41d7b9c on network 9a1fcc47-24d9-4303-8c86-1aaa9507bb56 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:27.073595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:27.073982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.078554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.157136 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:27.157510 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Checking segment: {'id': '4818dd34-96c0-484c-b6b9-61dc5ea9b365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '9a1fcc47-24d9-4303-8c86-1aaa9507bb56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:27.157961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.158357 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Bound using segment: {'id': '4818dd34-96c0-484c-b6b9-61dc5ea9b365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '9a1fcc47-24d9-4303-8c86-1aaa9507bb56'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:27.158865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Bound port: 3393b423-b7b7-475b-9467-175cb41d7b9c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4818dd34-96c0-484c-b6b9-61dc5ea9b365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '9a1fcc47-24d9-4303-8c86-1aaa9507bb56'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:27.159243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.206954 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.209323 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Allocated IP 2001:db8::2 (8ec9fea4-b38d-4612-9d1d-87145ce2366f/afd24e27-ea10-4df7-bb48-bdbdad6fea6e/a556ca5d-ed98-488b-8079-7f9b8d39c082) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:27.211185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port 2cc4637a-bddc-4978-8426-bf61a2e9eb50 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:27.222696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.229705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-84b55f5f-73b1-48c9-a4a6-20604de67922 None None] Provisioning complete for port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:27.230088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-84b55f5f-73b1-48c9-a4a6-20604de67922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.276605 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60726) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:27.361412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:27.375549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:27.380872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port fe891a64-a3f4-4762-b1ed-ef0b04bfab73, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fe891a64-a3f4-4762-b1ed-ef0b04bfab73,segment=NetworkSegment(54d87ace-94bc-463b-8b4d-c0a6f71fd89c),segment_id=54d87ace-94bc-463b-8b4d-c0a6f71fd89c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:27.383198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:27.388081 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:27.450961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.490482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-25db41e3-4869-440b-8f23-b351354c59e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.566252 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Allocated IP 172.20.0.2 (6e6edefe-93d4-45d7-9f2e-47c72b7d0761/f3841d7d-4008-4e44-9c89-698d071245fa/bd7bc251-e555-4a04-8eb4-7874269fbe1e) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:27.637734 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Allocated IP 2001:db8::2 (58c3ebb3-5acb-4f4a-b028-9c70230944ca/81becc6f-1f1b-41c3-95c9-208eb1fecf3f/1533e374-3fea-47d0-a13c-1c95eef43132) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:27.666548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ea724bf-4d1a-4d5b-a8c3-e3e6853a16ac None None] Network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:27.719994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 830cc8ab-190a-40a7-a475-88a0ef2decc5 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:27.724103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] For port 3393b423-b7b7-475b-9467-175cb41d7b9c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:27.804015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (e327e313-0127-4476-b533-24ce9c089768), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.811165 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a90ca54-5a4a-4ecd-92cb-ac36d7466a26 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:27.811650 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a90ca54-5a4a-4ecd-92cb-ac36d7466a26 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:27.812125 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a90ca54-5a4a-4ecd-92cb-ac36d7466a26 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:27.829167 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0a90ca54-5a4a-4ecd-92cb-ac36d7466a26 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?project_id=6c0b7eea99a4423dac22912b1fa60ca2&network_id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d HTTP/1.1" status: 200 len: 3102 time: 0.5507753 Mar 24 02:17:27.841065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Publish callbacks [] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.868725 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] For port 3393b423-b7b7-475b-9467-175cb41d7b9c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3393b423-b7b7-475b-9467-175cb41d7b9c,segment=NetworkSegment(4818dd34-96c0-484c-b6b9-61dc5ea9b365),segment_id=4818dd34-96c0-484c-b6b9-61dc5ea9b365)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:27.874065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=fe891a64-a3f4-4762-b1ed-ef0b04bfab73,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:27.956807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Allocated IP 2001:db8::1 (834402ee-abbe-4d0a-b309-41f9ccba31d2/0761200f-0d8a-46d8-ac1c-807c96143fe9/3057ad7a-4991-4aa2-9bde-f699720a8bec) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:27.969617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:27.972548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.094130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for port (3057ad7a-4991-4aa2-9bde-f699720a8bec), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.134370 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-84b55f5f-73b1-48c9-a4a6-20604de67922 None None] Current status of the port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:28.197198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.197575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Network 834402ee-abbe-4d0a-b309-41f9ccba31d2 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:28.218755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (3057ad7a-4991-4aa2-9bde-f699720a8bec), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.246237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:28.295091 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:28.303100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de231a04-f5c9-4300-8134-eec5c19fb412 None None] Pushing event updated for resources: {'Port': ['ID=3393b423-b7b7-475b-9467-175cb41d7b9c,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:28.317899 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Publish callbacks [] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.358199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network 834402ee-abbe-4d0a-b309-41f9ccba31d2 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:28.365027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Port': ['ID=3057ad7a-4991-4aa2-9bde-f699720a8bec,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:28.368832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:28.373354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:28.373919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (654913c1-1089-45d5-a685-61f2d36bf588), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.403288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.419208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.531842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3057ad7a-4991-4aa2-9bde-f699720a8bec), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.576844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::221 (8ec9fea4-b38d-4612-9d1d-87145ce2366f/afd24e27-ea10-4df7-bb48-bdbdad6fea6e/2cc4637a-bddc-4978-8426-bf61a2e9eb50) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:28.630168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.699776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 830cc8ab-190a-40a7-a475-88a0ef2decc5 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:28.700569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.747356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (f16cab9e-4385-4fd9-9ce1-9edfe837db44), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.755884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Port': ['ID=3e6e8117-b905-46ae-8fab-8ee3c8733cd0,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:28.758756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Provisioning complete for port 830cc8ab-190a-40a7-a475-88a0ef2decc5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:28.759319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.777269 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (7bdf989e-5118-40f2-8477-89f182dcc10b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.831361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Pushing event updated for resources: {'Port': ['ID=a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:28.839672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Publish callbacks [] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.845749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:28.896995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Attempting to bind port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:28.897390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Attempting to bind port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'eaa2d6f4-4a95-41df-9ecc-6e7135524d0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '834402ee-abbe-4d0a-b309-41f9ccba31d2'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:28.898182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Attempting to bind port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 on network 834402ee-abbe-4d0a-b309-41f9ccba31d2 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:28.900074 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:28.907532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Publish callbacks [] for port (1533e374-3fea-47d0-a13c-1c95eef43132), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.913202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.923048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:28.967753 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.970793 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Pushing event updated for resources: {'Port': ['ID=a556ca5d-ed98-488b-8079-7f9b8d39c082,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:28.976654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:28.977569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Checking segment: {'id': 'eaa2d6f4-4a95-41df-9ecc-6e7135524d0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '834402ee-abbe-4d0a-b309-41f9ccba31d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:28.978239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.978859 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Bound using segment: {'id': 'eaa2d6f4-4a95-41df-9ecc-6e7135524d0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '834402ee-abbe-4d0a-b309-41f9ccba31d2'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:28.979903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Bound port: a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eaa2d6f4-4a95-41df-9ecc-6e7135524d0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '834402ee-abbe-4d0a-b309-41f9ccba31d2'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:28.980512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.981208 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:28.989978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.039042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:29.046654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:29.057414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.078201 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:29.079197 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for port (3057ad7a-4991-4aa2-9bde-f699720a8bec), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.089775 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:29.098807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (3057ad7a-4991-4aa2-9bde-f699720a8bec), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.099610 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (654913c1-1089-45d5-a685-61f2d36bf588), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.109667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Network 58c3ebb3-5acb-4f4a-b028-9c70230944ca is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:29.112341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:29.118687 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:29.135315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.138785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (e327e313-0127-4476-b533-24ce9c089768), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.226476 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:29.244590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Port': ['ID=3057ad7a-4991-4aa2-9bde-f699720a8bec,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:29.296916 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:29.300862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=2cc4637a-bddc-4978-8426-bf61a2e9eb50,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:29.303915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 830cc8ab-190a-40a7-a475-88a0ef2decc5 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:29.305427 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.346040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Current status of the port 830cc8ab-190a-40a7-a475-88a0ef2decc5 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:29.346428 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.349222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Pushing event updated for resources: {'Port': ['ID=bd7bc251-e555-4a04-8eb4-7874269fbe1e,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:29.359196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:29.368682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:29.431264 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:29.436726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:29.437248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.454727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network 834402ee-abbe-4d0a-b309-41f9ccba31d2 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:29.457141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:29.458323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:29.464401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:29.478073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Pushing event updated for resources: {'Port': ['ID=1533e374-3fea-47d0-a13c-1c95eef43132,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:29.526060 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c2d9e347-381b-44d5-8c90-1242186879c5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 3.4628692 Mar 24 02:17:29.536199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60740) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:29.538178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60742) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:29.545101 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-99c08b6e-a682-457b-b80a-180830f6fc6b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:29.591076 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Attempting to bind port 1533e374-3fea-47d0-a13c-1c95eef43132 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:29.591449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Attempting to bind port 1533e374-3fea-47d0-a13c-1c95eef43132 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'e237a193-a4bf-4a6e-9286-54c6597c20bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '58c3ebb3-5acb-4f4a-b028-9c70230944ca'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:29.591814 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Attempting to bind port 1533e374-3fea-47d0-a13c-1c95eef43132 on network 58c3ebb3-5acb-4f4a-b028-9c70230944ca {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:29.608866 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:29.609565 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Checking segment: {'id': 'e237a193-a4bf-4a6e-9286-54c6597c20bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '58c3ebb3-5acb-4f4a-b028-9c70230944ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:29.609981 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.610375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Bound using segment: {'id': 'e237a193-a4bf-4a6e-9286-54c6597c20bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '58c3ebb3-5acb-4f4a-b028-9c70230944ca'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:29.611535 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Bound port: 1533e374-3fea-47d0-a13c-1c95eef43132, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e237a193-a4bf-4a6e-9286-54c6597c20bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '58c3ebb3-5acb-4f4a-b028-9c70230944ca'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:29.611919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.645138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Attempting to bind port bd7bc251-e555-4a04-8eb4-7874269fbe1e on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:29.646412 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Attempting to bind port bd7bc251-e555-4a04-8eb4-7874269fbe1e by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '880136ce-d208-467b-91a6-7b0795264cd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '6e6edefe-93d4-45d7-9f2e-47c72b7d0761'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:29.647812 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Attempting to bind port bd7bc251-e555-4a04-8eb4-7874269fbe1e on network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:29.651501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Attempting to bind port a556ca5d-ed98-488b-8079-7f9b8d39c082 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:29.652045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Attempting to bind port a556ca5d-ed98-488b-8079-7f9b8d39c082 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '90bce2cd-2d9e-4697-bef8-e219d1c040c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:29.653559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Attempting to bind port a556ca5d-ed98-488b-8079-7f9b8d39c082 on network 8ec9fea4-b38d-4612-9d1d-87145ce2366f {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:29.668046 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b329519-4c86-4b8a-9a9b-3475a313389c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:29.668722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 830cc8ab-190a-40a7-a475-88a0ef2decc5, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=830cc8ab-190a-40a7-a475-88a0ef2decc5,segment=NetworkSegment(12ff0fb4-31e7-4801-83d9-b0fe0c5f5482),segment_id=12ff0fb4-31e7-4801-83d9-b0fe0c5f5482)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:29.669790 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5b329519-4c86-4b8a-9a9b-3475a313389c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 814 time: 0.0663142 Mar 24 02:17:29.708267 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Router 654913c1-1089-45d5-a685-61f2d36bf588 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:17:29.716254 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ded4db08-7eed-4691-935f-04ebae94eda5 None None] Network 9a1fcc47-24d9-4303-8c86-1aaa9507bb56 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:29.718166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Deleting port 1e6ebb0d-3109-451d-adae-a0340f40756a {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:29.718536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.771463 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:17:29.771946 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:17:29.772783 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:29.773146 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Checking segment: {'id': '90bce2cd-2d9e-4697-bef8-e219d1c040c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:29.773872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.773995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Bound using segment: {'id': '90bce2cd-2d9e-4697-bef8-e219d1c040c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:29.774568 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Bound port: a556ca5d-ed98-488b-8079-7f9b8d39c082, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '90bce2cd-2d9e-4697-bef8-e219d1c040c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:29.774963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.777013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Router f16cab9e-4385-4fd9-9ce1-9edfe837db44 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:17:29.789301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:29.789668 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Checking segment: {'id': '880136ce-d208-467b-91a6-7b0795264cd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '6e6edefe-93d4-45d7-9f2e-47c72b7d0761'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:29.790218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.790814 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Bound using segment: {'id': '880136ce-d208-467b-91a6-7b0795264cd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '6e6edefe-93d4-45d7-9f2e-47c72b7d0761'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:29.791287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Bound port: bd7bc251-e555-4a04-8eb4-7874269fbe1e, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '880136ce-d208-467b-91a6-7b0795264cd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '6e6edefe-93d4-45d7-9f2e-47c72b7d0761'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:29.792662 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.794893 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.828269 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:29.849176 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8dba3ef3-9a8e-484f-b3d8-105561d40ce9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "PUT /v2.0/routers/654913c1-1089-45d5-a685-61f2d36bf588/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3307619 Mar 24 02:17:29.850627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e327e313-0127-4476-b533-24ce9c089768 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:17:29.852496 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60748) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:29.911754 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] For port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:29.928838 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] For port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8,segment=NetworkSegment(eaa2d6f4-4a95-41df-9ecc-6e7135524d0c),segment_id=eaa2d6f4-4a95-41df-9ecc-6e7135524d0c)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:29.940039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.942626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99c08b6e-a682-457b-b80a-180830f6fc6b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:29.946043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99c08b6e-a682-457b-b80a-180830f6fc6b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:29.966231 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da0ea5e9-be41-4751-8ef9-72e2b171a646 None None] Sync routers for ids ['654913c1-1089-45d5-a685-61f2d36bf588'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:30.014914 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:30.019137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Calling delete_port for 1e6ebb0d-3109-451d-adae-a0340f40756a owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:30.030874 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5aa2c2a5-05c2-48b8-a5f8-2634b7d98778 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "PUT /v2.0/routers/f16cab9e-4385-4fd9-9ce1-9edfe837db44/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7532218 Mar 24 02:17:30.031506 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60750) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:30.042996 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2804fe0-6636-417e-a0d1-dd41e0991e79 None None] Sync routers for ids ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:30.060558 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3393b423-b7b7-475b-9467-175cb41d7b9c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:30.065208 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2804fe0-6636-417e-a0d1-dd41e0991e79 None None] Routers {'f16cab9e-4385-4fd9-9ce1-9edfe837db44'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:30.066583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.067466 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f2804fe0-6636-417e-a0d1-dd41e0991e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:30.134047 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f2804fe0-6636-417e-a0d1-dd41e0991e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:30.175049 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2804fe0-6636-417e-a0d1-dd41e0991e79 None None] Routers {'f16cab9e-4385-4fd9-9ce1-9edfe837db44'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:30.175821 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f2804fe0-6636-417e-a0d1-dd41e0991e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:30.186854 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60752) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:30.192460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da0ea5e9-be41-4751-8ef9-72e2b171a646 None None] Routers {'654913c1-1089-45d5-a685-61f2d36bf588'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:30.193112 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-da0ea5e9-be41-4751-8ef9-72e2b171a646 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['654913c1-1089-45d5-a685-61f2d36bf588'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:30.193440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'network': {'name': 'tempest-network-smoke--700147673', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'port_security_enabled': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:30.201114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] For port 1533e374-3fea-47d0-a13c-1c95eef43132, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:30.212317 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] For port 1533e374-3fea-47d0-a13c-1c95eef43132, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=1533e374-3fea-47d0-a13c-1c95eef43132,segment=NetworkSegment(e237a193-a4bf-4a6e-9286-54c6597c20bc),segment_id=e237a193-a4bf-4a6e-9286-54c6597c20bc)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:30.274551 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.ipam_backend_mixin [None req-99c08b6e-a682-457b-b80a-180830f6fc6b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet afd24e27-ea10-4df7-bb48-bdbdad6fea6e (CIDR: 2001:db8::/64) Mar 24 02:17:30.287209 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f2804fe0-6636-417e-a0d1-dd41e0991e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:30.288347 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2804fe0-6636-417e-a0d1-dd41e0991e79 None None] The sync data for ids ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:30.324506 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:30.328464 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.332463 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-99c08b6e-a682-457b-b80a-180830f6fc6b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:17:30.332463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-99c08b6e-a682-457b-b80a-180830f6fc6b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:30.332721 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-da0ea5e9-be41-4751-8ef9-72e2b171a646 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:30.336243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=830cc8ab-190a-40a7-a475-88a0ef2decc5,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:30.342295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.357727 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] For port bd7bc251-e555-4a04-8eb4-7874269fbe1e, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:30.387019 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] For port a556ca5d-ed98-488b-8079-7f9b8d39c082, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:30.429211 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] For port bd7bc251-e555-4a04-8eb4-7874269fbe1e, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=bd7bc251-e555-4a04-8eb4-7874269fbe1e,segment=NetworkSegment(880136ce-d208-467b-91a6-7b0795264cd9),segment_id=880136ce-d208-467b-91a6-7b0795264cd9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:30.454763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] For port a556ca5d-ed98-488b-8079-7f9b8d39c082, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a556ca5d-ed98-488b-8079-7f9b8d39c082,segment=NetworkSegment(90bce2cd-2d9e-4697-bef8-e219d1c040c9),segment_id=90bce2cd-2d9e-4697-bef8-e219d1c040c9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:30.457007 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da0ea5e9-be41-4751-8ef9-72e2b171a646 None None] Routers {'654913c1-1089-45d5-a685-61f2d36bf588'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:30.457973 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-da0ea5e9-be41-4751-8ef9-72e2b171a646 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['654913c1-1089-45d5-a685-61f2d36bf588'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:30.465194 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-99c08b6e-a682-457b-b80a-180830f6fc6b tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.9220779 Mar 24 02:17:30.472963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60754) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:30.482272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:30.485677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 110} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:30.505116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-da0ea5e9-be41-4751-8ef9-72e2b171a646 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:30.505933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da0ea5e9-be41-4751-8ef9-72e2b171a646 None None] The sync data for ids ['654913c1-1089-45d5-a685-61f2d36bf588'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:30.507400 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:30.511822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (14f47a5d-c68c-4d67-a6e3-4402aa07610f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.512040 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Added segment 14f47a5d-c68c-4d67-a6e3-4402aa07610f of type vlan for network 0a3a0bb4-4db4-4907-a006-67d97a634086 Mar 24 02:17:30.515446 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bd54c3e0-5292-481b-88bb-5f579bc55251 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e327e313-0127-4476-b533-24ce9c089768/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8455634 Mar 24 02:17:30.519216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Current status of the port 830cc8ab-190a-40a7-a475-88a0ef2decc5 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:30.521865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.531517 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60756) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:30.556123 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.575767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48f1c50-d367-4ac4-b109-1004262a9aa8 None None] Sync routers for ids ['e327e313-0127-4476-b533-24ce9c089768'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:30.577571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (0a3a0bb4-4db4-4907-a006-67d97a634086), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.583518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3393b423-b7b7-475b-9467-175cb41d7b9c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:30.583895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.651682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e5995a4-2286-4f1c-9ffe-b77ac777edf2 None None] Pushing event updated for resources: {'Port': ['ID=a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:30.694657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-97f84944-4d2f-4eea-8ac0-990096d4d68d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.759206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1465406c-7471-4aa5-98d9-3ab9bdbbcdce tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:30.761604 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1465406c-7471-4aa5-98d9-3ab9bdbbcdce tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports/38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c HTTP/1.1" status: 200 len: 910 time: 0.2284675 Mar 24 02:17:30.764249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60758) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:30.775611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48f1c50-d367-4ac4-b109-1004262a9aa8 None None] Routers {'e327e313-0127-4476-b533-24ce9c089768'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:30.776268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a48f1c50-d367-4ac4-b109-1004262a9aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e327e313-0127-4476-b533-24ce9c089768'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:30.778380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Provisioning complete for port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:30.781712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (0a3a0bb4-4db4-4907-a006-67d97a634086), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.782243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.802257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:30.802944 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:30.880197 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.6919904 Mar 24 02:17:30.882927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60760) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:31.198348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:31.203816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:31.288298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a48f1c50-d367-4ac4-b109-1004262a9aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:31.341645 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-f5349f27-c66c-45b2-bb5b-15217b4ee5df tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:17:31.342809 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f5349f27-c66c-45b2-bb5b-15217b4ee5df tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "PUT /v2.0/routers/654913c1-1089-45d5-a685-61f2d36bf588/add_router_interface HTTP/1.1" status: 400 len: 438 time: 1.4892218 Mar 24 02:17:31.357022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60762) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:31.362164 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e240144-bf49-4018-a6ef-e82ea46c13cb None None] Pushing event updated for resources: {'Port': ['ID=1533e374-3fea-47d0-a13c-1c95eef43132,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:31.394794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b79a3f13-0966-4f01-9a9d-f20288ecf00c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:31.398922 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b79a3f13-0966-4f01-9a9d-f20288ecf00c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=6c0b7eea99a4423dac22912b1fa60ca2&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 830 time: 0.4995749 Mar 24 02:17:31.430609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60764) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:31.468544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48f1c50-d367-4ac4-b109-1004262a9aa8 None None] Routers {'e327e313-0127-4476-b533-24ce9c089768'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:31.469199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a48f1c50-d367-4ac4-b109-1004262a9aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e327e313-0127-4476-b533-24ce9c089768'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:31.490012 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:31.542633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (1e6ebb0d-3109-451d-adae-a0340f40756a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:31.560609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a48f1c50-d367-4ac4-b109-1004262a9aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:31.561315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48f1c50-d367-4ac4-b109-1004262a9aa8 None None] The sync data for ids ['e327e313-0127-4476-b533-24ce9c089768'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:31.567378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc2e522-783b-4526-9fd2-d6c2ad2f4284 None None] Pushing event updated for resources: {'Port': ['ID=bd7bc251-e555-4a04-8eb4-7874269fbe1e,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:31.605532 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60768) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:31.674945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f08eed3b-3f11-4114-99e9-5b3e683b59db tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Network': ['ID=0a3a0bb4-4db4-4907-a006-67d97a634086,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:31.686441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event deleted for resources: {'Port': ['ID=1e6ebb0d-3109-451d-adae-a0340f40756a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:31.690428 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3393b423-b7b7-475b-9467-175cb41d7b9c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:31.691432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:31.709533 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-433e632a-da83-4c39-9b19-fc0ab919bddd None None] Pushing event updated for resources: {'Port': ['ID=a556ca5d-ed98-488b-8079-7f9b8d39c082,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:31.722462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 0a3a0bb4-4db4-4907-a006-67d97a634086 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:31.753916 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11457061-5cbc-476f-8a9c-4499c8f9e31f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:31.759567 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-11457061-5cbc-476f-8a9c-4499c8f9e31f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.3252730 Mar 24 02:17:31.765580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60770) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:31.856578 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Current status of the port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:31.881250 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Provisioning complete for port 3e6e8117-b905-46ae-8fab-8ee3c8733cd0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:31.881641 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:31.900113 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5c68938b-0084-4518-a8c3-5879ce6dd8a5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1307809 Mar 24 02:17:31.909790 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60772) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:31.926937 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 3393b423-b7b7-475b-9467-175cb41d7b9c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3393b423-b7b7-475b-9467-175cb41d7b9c,segment=NetworkSegment(4818dd34-96c0-484c-b6b9-61dc5ea9b365),segment_id=4818dd34-96c0-484c-b6b9-61dc5ea9b365)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:31.928379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c2d14b68-480c-4c44-9e37-e0a7f5adbcce None None] Port 3e6e8117-b905-46ae-8fab-8ee3c8733cd0 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:31.937375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:31.938407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fe891a64-a3f4-4762-b1ed-ef0b04bfab73 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:31.957557 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1d2a1d67-19de-4ca8-83f7-263f9bd932a6 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=6c0b7eea99a4423dac22912b1fa60ca2&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0453062 Mar 24 02:17:31.966742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60774) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:32.067703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=3393b423-b7b7-475b-9467-175cb41d7b9c,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:32.077237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:32.077635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:32.108703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a6e6e002-162f-469e-93b1-0567fa822a48 None None] Provisioning complete for port 3393b423-b7b7-475b-9467-175cb41d7b9c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:32.109145 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a6e6e002-162f-469e-93b1-0567fa822a48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:32.132966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a00ba3f-03ac-498a-9e7c-68d4cae0822c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:32.137928 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5a00ba3f-03ac-498a-9e7c-68d4cae0822c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1665261 Mar 24 02:17:32.138145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60776) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:32.200347 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-23a08e5c-c5f9-4ada-a3f7-295a4e956d62 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0496497 Mar 24 02:17:32.200592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad6264be-0915-4916-ba8e-43730b5b8ff8 None None] Network 834402ee-abbe-4d0a-b309-41f9ccba31d2 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:32.201865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60778) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:32.207390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2076536619', 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:32.297375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a6e6e002-162f-469e-93b1-0567fa822a48 None None] Current status of the port 3393b423-b7b7-475b-9467-175cb41d7b9c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:32.302205 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (e327e313-0127-4476-b533-24ce9c089768), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:32.317746 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-71f4078f-202f-4dee-bfa1-64fe81094d07 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:17:32.321672 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-71f4078f-202f-4dee-bfa1-64fe81094d07 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "PUT /v2.0/routers/f16cab9e-4385-4fd9-9ce1-9edfe837db44/add_router_interface HTTP/1.1" status: 400 len: 438 time: 2.2817769 Mar 24 02:17:32.324700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60780) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:32.366375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a6e6e002-162f-469e-93b1-0567fa822a48 None None] Provisioning complete for port 830cc8ab-190a-40a7-a475-88a0ef2decc5 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:32.367073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a6e6e002-162f-469e-93b1-0567fa822a48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:32.394965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:32.503840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:32.605146 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a6e6e002-162f-469e-93b1-0567fa822a48 None None] Current status of the port 830cc8ab-190a-40a7-a475-88a0ef2decc5 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:32.639519 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a6e6e002-162f-469e-93b1-0567fa822a48 None None] Provisioning complete for port 3e6e8117-b905-46ae-8fab-8ee3c8733cd0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:32.639901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a6e6e002-162f-469e-93b1-0567fa822a48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:32.712152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a6e6e002-162f-469e-93b1-0567fa822a48 None None] Port 3e6e8117-b905-46ae-8fab-8ee3c8733cd0 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:32.841856 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7ddd4b4f-c5d4-4c8b-a818-6a6fb7e55ea9 None None] Provisioning complete for port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:32.842239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7ddd4b4f-c5d4-4c8b-a818-6a6fb7e55ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:32.890174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (7bdf989e-5118-40f2-8477-89f182dcc10b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:32.957108 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:32.961272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.010332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device bd7bc251-e555-4a04-8eb4-7874269fbe1e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:33.167921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7ddd4b4f-c5d4-4c8b-a818-6a6fb7e55ea9 None None] Current status of the port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:33.168315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7ddd4b4f-c5d4-4c8b-a818-6a6fb7e55ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.173227 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27b9e2ad-266b-471f-91cd-ad2a734d60a2 None None] Network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:33.200306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (654913c1-1089-45d5-a685-61f2d36bf588), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.308810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7ddd4b4f-c5d4-4c8b-a818-6a6fb7e55ea9 None None] For port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8,segment=NetworkSegment(eaa2d6f4-4a95-41df-9ecc-6e7135524d0c),segment_id=eaa2d6f4-4a95-41df-9ecc-6e7135524d0c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:33.338705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port bd7bc251-e555-4a04-8eb4-7874269fbe1e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:33.339494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.348622 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7ddd4b4f-c5d4-4c8b-a818-6a6fb7e55ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.441398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Deleting port 98bd286a-e648-4aac-a38e-985c626523ae {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:33.441751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (98bd286a-e648-4aac-a38e-985c626523ae), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.558681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Provisioning complete for port bd7bc251-e555-4a04-8eb4-7874269fbe1e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:33.558681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.576340 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (824de909-ed6d-42eb-91e2-7f0e51862ab0), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.586086 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ddd4b4f-c5d4-4c8b-a818-6a6fb7e55ea9 None None] Pushing event updated for resources: {'Port': ['ID=a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:33.650116 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (47e13ca4-a1b5-4f9e-95ce-b93533455f10), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.665101 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=824de909-ed6d-42eb-91e2-7f0e51862ab0,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:33.672989 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port bd7bc251-e555-4a04-8eb4-7874269fbe1e is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:33.673516 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.684076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:33.686866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (f16cab9e-4385-4fd9-9ce1-9edfe837db44), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.754382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:33.759285 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:33.759972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.768371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-939d277f-c773-4e3e-ae08-e47321fedef7 None None] Network 58c3ebb3-5acb-4f4a-b028-9c70230944ca requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:33.807111 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:33.807717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.867333 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.897592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port bd7bc251-e555-4a04-8eb4-7874269fbe1e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=bd7bc251-e555-4a04-8eb4-7874269fbe1e,segment=NetworkSegment(880136ce-d208-467b-91a6-7b0795264cd9),segment_id=880136ce-d208-467b-91a6-7b0795264cd9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:33.909151 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a67cd332-df24-4f37-bc08-3adbce340c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 3.4334533 Mar 24 02:17:33.923923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60782) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:33.939856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1329119197', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '824de909-ed6d-42eb-91e2-7f0e51862ab0'}], 'security_groups': ['b38ade3f-d491-4b39-afc2-1f7da48ce033']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:33.945526 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Current status of the port bd7bc251-e555-4a04-8eb4-7874269fbe1e is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:33.946451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.983282 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.985298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:33.986190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:34.003251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (98bd286a-e648-4aac-a38e-985c626523ae), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.003542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for floatingip (98bd286a-e648-4aac-a38e-985c626523ae), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.015008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:34.078556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Calling delete_port for 98bd286a-e648-4aac-a38e-985c626523ae owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:34.094411 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Subnet': ['ID=47e13ca4-a1b5-4f9e-95ce-b93533455f10,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:34.109226 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:17:34.110259 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:17:34.147008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cef73b49-7ccc-4612-9f16-e4de14075218 None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:34.159392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Checking segment: {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:34.159765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network hostable DHCP agents. Network: 0a3a0bb4-4db4-4907-a006-67d97a634086, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:34.237973 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=bd7bc251-e555-4a04-8eb4-7874269fbe1e,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:34.262510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 0a3a0bb4-4db4-4907-a006-67d97a634086 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:34.273347 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:34.273671 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.297939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 0a3a0bb4-4db4-4907-a006-67d97a634086) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:34.305864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:34.306480 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.325041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb6404af-715e-48ee-9479-d4123b8be48a None None] Network 0a3a0bb4-4db4-4907-a006-67d97a634086 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:34.334092 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Deleting port 3057ad7a-4991-4aa2-9bde-f699720a8bec {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:34.334434 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3057ad7a-4991-4aa2-9bde-f699720a8bec), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.414075 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f405316d-9191-47c8-aa22-40fa334e0254 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 2.2083039 Mar 24 02:17:34.482075 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.559121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:34.576438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3057ad7a-4991-4aa2-9bde-f699720a8bec), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.672572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Calling delete_port for 3057ad7a-4991-4aa2-9bde-f699720a8bec owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:34.691864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Current status of the port bd7bc251-e555-4a04-8eb4-7874269fbe1e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:34.732257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-0a3a0bb4-4db4-4907-a006-67d97a634086', 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ips': [{'subnet_id': '47e13ca4-a1b5-4f9e-95ce-b93533455f10'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:34.733205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.736597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Router 7bdf989e-5118-40f2-8477-89f182dcc10b has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:34.844827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60786) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:34.874906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Provisioning complete for port 3057ad7a-4991-4aa2-9bde-f699720a8bec triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:34.875469 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3057ad7a-4991-4aa2-9bde-f699720a8bec), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.910964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e373f6bd-381f-4f0c-ab18-f9a825139039 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-576976483', 'description': 'tempest-secgroup-smoke-576976483 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:34.926332 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (98bd286a-e648-4aac-a38e-985c626523ae), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.950742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (e327e313-0127-4476-b533-24ce9c089768), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:34.959614 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fca67919-a7d8-4793-81e8-7661d8617187 None None] Update dhcp port {'port': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'fixed_ips': [{'subnet_id': 'afd24e27-ea10-4df7-bb48-bdbdad6fea6e', 'ip_address': '2001:db8::2'}, {'subnet_id': '824de909-ed6d-42eb-91e2-7f0e51862ab0'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': 'a556ca5d-ed98-488b-8079-7f9b8d39c082'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:17:34.967519 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e373f6bd-381f-4f0c-ab18-f9a825139039 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.028243 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event deleted for resources: {'Port': ['ID=98bd286a-e648-4aac-a38e-985c626523ae,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:35.037651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.045682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Port 3057ad7a-4991-4aa2-9bde-f699720a8bec cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:35.070038 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fca67919-a7d8-4793-81e8-7661d8617187 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.093474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:35.094270 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3393b423-b7b7-475b-9467-175cb41d7b9c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:35.165917 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Provisioning complete for port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:35.165917 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.207026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Allocated IP 172.20.0.18 (0a3a0bb4-4db4-4907-a006-67d97a634086/47e13ca4-a1b5-4f9e-95ce-b93533455f10/78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:35.246648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e327e313-0127-4476-b533-24ce9c089768 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:35.294337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3393b423-b7b7-475b-9467-175cb41d7b9c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:35.294744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.335369 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (3057ad7a-4991-4aa2-9bde-f699720a8bec), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.379363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Port': ['ID=3057ad7a-4991-4aa2-9bde-f699720a8bec,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:35.419929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:35.431940 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c26e60-becb-42a4-b5fa-97f9fd696adb None None] Sync routers for ids ['e327e313-0127-4476-b533-24ce9c089768'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:35.438783 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a32c2b89-5693-4f98-a57b-3feb995fcb30 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e327e313-0127-4476-b533-24ce9c089768/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6689038 Mar 24 02:17:35.440199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60788) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:35.448742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:35.451223 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6c26e60-becb-42a4-b5fa-97f9fd696adb None None] Routers {'e327e313-0127-4476-b533-24ce9c089768'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:35.451837 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-c6c26e60-becb-42a4-b5fa-97f9fd696adb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e327e313-0127-4476-b533-24ce9c089768'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:35.488013 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99c2d653-0573-4697-9651-e29c6f5c79d9 None None] Sync routers for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:35.528484 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-c6c26e60-becb-42a4-b5fa-97f9fd696adb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:35.537600 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6c26e60-becb-42a4-b5fa-97f9fd696adb None None] Routers {'e327e313-0127-4476-b533-24ce9c089768'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:35.538215 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-c6c26e60-becb-42a4-b5fa-97f9fd696adb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e327e313-0127-4476-b533-24ce9c089768'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:35.548683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Delete allocated IP 2001:db8::221 (8ec9fea4-b38d-4612-9d1d-87145ce2366f/afd24e27-ea10-4df7-bb48-bdbdad6fea6e) {{(pid=104037) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Mar 24 02:17:35.559713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8:0:1::197 (8ec9fea4-b38d-4612-9d1d-87145ce2366f/824de909-ed6d-42eb-91e2-7f0e51862ab0/2cc4637a-bddc-4978-8426-bf61a2e9eb50) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:35.560815 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dfbb75f3-68d1-4df4-b614-8d29d6b14bfe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=e327e313-0127-4476-b533-24ce9c089768 HTTP/1.1" status: 200 len: 205 time: 0.0784128 Mar 24 02:17:35.566769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e373f6bd-381f-4f0c-ab18-f9a825139039 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.568370 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60790) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:35.599177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0bd4491b-0bb4-423c-be6d-01ff5179fec4 None None] Current status of the port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:35.623332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99c2d653-0573-4697-9651-e29c6f5c79d9 None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:35.624151 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99c2d653-0573-4697-9651-e29c6f5c79d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:35.633006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e373f6bd-381f-4f0c-ab18-f9a825139039 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.701536 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99c2d653-0573-4697-9651-e29c6f5c79d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:35.726996 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3393b423-b7b7-475b-9467-175cb41d7b9c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:35.728319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 1533e374-3fea-47d0-a13c-1c95eef43132 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:35.733920 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Could not find standard attr ID for object 3057ad7a-4991-4aa2-9bde-f699720a8bec. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:17:35.758294 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99c2d653-0573-4697-9651-e29c6f5c79d9 None None] Routers {'7bdf989e-5118-40f2-8477-89f182dcc10b'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:35.758885 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-c6c26e60-becb-42a4-b5fa-97f9fd696adb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:35.759229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99c2d653-0573-4697-9651-e29c6f5c79d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['7bdf989e-5118-40f2-8477-89f182dcc10b'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:35.759963 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c26e60-becb-42a4-b5fa-97f9fd696adb None None] The sync data for ids ['e327e313-0127-4476-b533-24ce9c089768'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:35.789680 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f38d7879-c07f-4437-ab04-db79239754bb tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "PUT /v2.0/routers/7bdf989e-5118-40f2-8477-89f182dcc10b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.8782632 Mar 24 02:17:35.792488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for floatingip (93b3d5f4-3404-4069-ba69-76c7b29011a1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.792828 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Floating IP 93b3d5f4-3404-4069-ba69-76c7b29011a1 disassociated (deleted). External IP: 172.26.2.214, port: 4716cbf2-4cfd-4eec-91c2-c814fff2a832. Mar 24 02:17:35.794346 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Publish callbacks [] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.794736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60792) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:35.796768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.802356 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-99c2d653-0573-4697-9651-e29c6f5c79d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:35.803327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99c2d653-0573-4697-9651-e29c6f5c79d9 None None] The sync data for ids ['7bdf989e-5118-40f2-8477-89f182dcc10b'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:35.823907 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.891158 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Provisioning complete for port bd7bc251-e555-4a04-8eb4-7874269fbe1e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:35.891811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.929832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Network 0a3a0bb4-4db4-4907-a006-67d97a634086 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:35.934446 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.947661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:35.952892 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:35.959590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Pushing event updated for resources: {'Port': ['ID=78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:35.968597 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (654913c1-1089-45d5-a685-61f2d36bf588), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.974626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a52efab3-65c0-4cf9-930c-d86f73588de3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (e327e313-0127-4476-b533-24ce9c089768), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:35.988003 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-fca67919-a7d8-4793-81e8-7661d8617187 None None] Allocated IP 2001:db8:0:1::2 (8ec9fea4-b38d-4612-9d1d-87145ce2366f/824de909-ed6d-42eb-91e2-7f0e51862ab0/a556ca5d-ed98-488b-8079-7f9b8d39c082) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:36.013596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e373f6bd-381f-4f0c-ab18-f9a825139039 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:36.017406 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e373f6bd-381f-4f0c-ab18-f9a825139039 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.019230 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e373f6bd-381f-4f0c-ab18-f9a825139039 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 1.1585410 Mar 24 02:17:36.026821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60794) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:36.028795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 1533e374-3fea-47d0-a13c-1c95eef43132 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:36.029023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.042723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-8570e948-0c61-40d3-8882-9cd90490d4a8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:36.115252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=2cc4637a-bddc-4978-8426-bf61a2e9eb50,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:36.127516 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] In _notify_port_updated(), no bound segment for port 2cc4637a-bddc-4978-8426-bf61a2e9eb50 on network 8ec9fea4-b38d-4612-9d1d-87145ce2366f {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:17:36.133174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:36.133996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.135044 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6fdc7df0-7e80-4da3-8393-92047a1b4428 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "PUT /v2.0/ports/2cc4637a-bddc-4978-8426-bf61a2e9eb50 HTTP/1.1" status: 200 len: 931 time: 2.2094939 Mar 24 02:17:36.143760 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60796) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:36.162941 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Attempting to bind port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:36.163682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Attempting to bind port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:36.164210 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Attempting to bind port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e on network 0a3a0bb4-4db4-4907-a006-67d97a634086 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:36.196526 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Deleting port 3e6e8117-b905-46ae-8fab-8ee3c8733cd0 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:36.196884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.200544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:36.200929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Checking segment: {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:36.201338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.202374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Bound using segment: {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:36.202374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Bound port: 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:36.202610 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.218262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8570e948-0c61-40d3-8882-9cd90490d4a8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7eab2487-ceed-4f60-87e2-c361713a6ff3), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.252177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for router (7bdf989e-5118-40f2-8477-89f182dcc10b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.258842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a52efab3-65c0-4cf9-930c-d86f73588de3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (e327e313-0127-4476-b533-24ce9c089768), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.278631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Current status of the port bd7bc251-e555-4a04-8eb4-7874269fbe1e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:36.284088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-fca67919-a7d8-4793-81e8-7661d8617187 None None] For port a556ca5d-ed98-488b-8079-7f9b8d39c082, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a556ca5d-ed98-488b-8079-7f9b8d39c082,segment=NetworkSegment(90bce2cd-2d9e-4697-bef8-e219d1c040c9),segment_id=90bce2cd-2d9e-4697-bef8-e219d1c040c9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:36.284841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a52efab3-65c0-4cf9-930c-d86f73588de3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (e327e313-0127-4476-b533-24ce9c089768), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.334200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Router 654913c1-1089-45d5-a685-61f2d36bf588 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:36.344179 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a52efab3-65c0-4cf9-930c-d86f73588de3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (e327e313-0127-4476-b533-24ce9c089768), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.344724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a52efab3-65c0-4cf9-930c-d86f73588de3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Fanout notify agent at l3_agent the message router_deleted on router e327e313-0127-4476-b533-24ce9c089768 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:17:36.352910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Provisioning complete for port 2cc4637a-bddc-4978-8426-bf61a2e9eb50 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:36.353078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a52efab3-65c0-4cf9-930c-d86f73588de3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.353315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.356984 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a52efab3-65c0-4cf9-930c-d86f73588de3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/e327e313-0127-4476-b533-24ce9c089768 HTTP/1.1" status: 204 len: 168 time: 0.7870629 Mar 24 02:17:36.357708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60798) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:36.407504 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] For port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:36.411679 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fca67919-a7d8-4793-81e8-7661d8617187 None None] Publish callbacks [] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.417230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 1533e374-3fea-47d0-a13c-1c95eef43132 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:36.417684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.432612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] For port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:36.434552 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fca67919-a7d8-4793-81e8-7661d8617187 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.469756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:36.477854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.482142 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-955201e4-2fb6-4973-a2ea-e846fabd9ae7 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "PUT /v2.0/routers/654913c1-1089-45d5-a685-61f2d36bf588/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1239352 Mar 24 02:17:36.482661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Port 2cc4637a-bddc-4978-8426-bf61a2e9eb50 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:36.482799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60800) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:36.495734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-7520154e-eb26-4def-bef8-3660273c296b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting subnet f3841d7d-4008-4e44-9c89-698d071245fa {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:36.496505 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a2552aa-5bdc-4bb0-b8c6-022c10eeddd9 None None] Sync routers for ids ['654913c1-1089-45d5-a685-61f2d36bf588'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:36.529579 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a2552aa-5bdc-4bb0-b8c6-022c10eeddd9 None None] Routers {'654913c1-1089-45d5-a685-61f2d36bf588'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:36.530442 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7520154e-eb26-4def-bef8-3660273c296b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (f3841d7d-4008-4e44-9c89-698d071245fa), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.533503 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-6cb264cf-0684-42c7-bf6c-86f7b99fb9aa tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] delete failed (client error): The resource could not be found. Mar 24 02:17:36.534625 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-1a2552aa-5bdc-4bb0-b8c6-022c10eeddd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['654913c1-1089-45d5-a685-61f2d36bf588'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:36.539685 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6cb264cf-0684-42c7-bf6c-86f7b99fb9aa tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/routers/tempest-non_exist_router-2027240546 HTTP/1.1" status: 404 len: 335 time: 0.0538917 Mar 24 02:17:36.540492 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60802) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:36.565054 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8c040b21-80cc-4dfc-99fa-9a16238d85e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'router': {'external_gateway_info': {'network_id': '654913c1-1089-45d5-a685-61f2d36bf588'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:36.586766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 1533e374-3fea-47d0-a13c-1c95eef43132, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=1533e374-3fea-47d0-a13c-1c95eef43132,segment=NetworkSegment(e237a193-a4bf-4a6e-9286-54c6597c20bc),segment_id=e237a193-a4bf-4a6e-9286-54c6597c20bc)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:36.592477 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Provisioning complete for port aee2f7ee-569a-4b32-9981-c7cefe350ef1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:36.593059 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.595779 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fca67919-a7d8-4793-81e8-7661d8617187 None None] Pushing event updated for resources: {'Port': ['ID=a556ca5d-ed98-488b-8079-7f9b8d39c082,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:36.641368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.642261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 830cc8ab-190a-40a7-a475-88a0ef2decc5 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:36.658680 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7520154e-eb26-4def-bef8-3660273c296b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (f3841d7d-4008-4e44-9c89-698d071245fa), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.705267 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Port aee2f7ee-569a-4b32-9981-c7cefe350ef1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:36.709893 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-1a2552aa-5bdc-4bb0-b8c6-022c10eeddd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:36.719844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635a79d4-ea3d-49e2-b665-03f9a5dea48e None None] Pushing event updated for resources: {'Port': ['ID=78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:36.745263 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a2552aa-5bdc-4bb0-b8c6-022c10eeddd9 None None] Routers {'654913c1-1089-45d5-a685-61f2d36bf588'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:36.749939 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-1a2552aa-5bdc-4bb0-b8c6-022c10eeddd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['654913c1-1089-45d5-a685-61f2d36bf588'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:36.793618 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:36.794082 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.836891 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-1a2552aa-5bdc-4bb0-b8c6-022c10eeddd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:36.837925 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a2552aa-5bdc-4bb0-b8c6-022c10eeddd9 None None] The sync data for ids ['654913c1-1089-45d5-a685-61f2d36bf588'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:36.913489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8570e948-0c61-40d3-8882-9cd90490d4a8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7eab2487-ceed-4f60-87e2-c361713a6ff3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.917168 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.929434 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c040b21-80cc-4dfc-99fa-9a16238d85e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for router_gateway (654913c1-1089-45d5-a685-61f2d36bf588), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.946889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8570e948-0c61-40d3-8882-9cd90490d4a8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (7eab2487-ceed-4f60-87e2-c361713a6ff3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:36.982102 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:17:36.995308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Calling delete_port for 3e6e8117-b905-46ae-8fab-8ee3c8733cd0 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:37.000778 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-8c040b21-80cc-4dfc-99fa-9a16238d85e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] update failed (client error): The resource could not be found. Mar 24 02:17:37.002402 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8c040b21-80cc-4dfc-99fa-9a16238d85e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "PUT /v2.0/routers/654913c1-1089-45d5-a685-61f2d36bf588 HTTP/1.1" status: 404 len: 339 time: 0.4418373 Mar 24 02:17:37.014359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7520154e-eb26-4def-bef8-3660273c296b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (f3841d7d-4008-4e44-9c89-698d071245fa), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.017781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60804) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:37.042814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8570e948-0c61-40d3-8882-9cd90490d4a8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7eab2487-ceed-4f60-87e2-c361713a6ff3,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:37.044105 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-631043499'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:37.056993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=1533e374-3fea-47d0-a13c-1c95eef43132,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:37.060721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8570e948-0c61-40d3-8882-9cd90490d4a8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.061973 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8570e948-0c61-40d3-8882-9cd90490d4a8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.0290930 Mar 24 02:17:37.067051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60806) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:37.079586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 830cc8ab-190a-40a7-a475-88a0ef2decc5 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:37.080612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.086300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3f3f22c2-9e29-4248-b4e4-7e4a015c6abc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:37.097569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for router_gateway (7bdf989e-5118-40f2-8477-89f182dcc10b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.116421 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-eec7602d-b622-4914-a4ec-716b8d117579 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port 2cc4637a-bddc-4978-8426-bf61a2e9eb50 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:37.123314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eec7602d-b622-4914-a4ec-716b8d117579 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.137357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Router c4a3de90-537a-4022-b079-9feeedff6892 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:37.148036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Made reservation on behalf of 3dbc846d991b4af0ae231d5e469488ba for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:37.151605 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.191616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3f3f22c2-9e29-4248-b4e4-7e4a015c6abc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (3cccdbff-a7e2-4308-9085-948091c7a77f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.196915 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7520154e-eb26-4def-bef8-3660273c296b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (f3841d7d-4008-4e44-9c89-698d071245fa), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.281173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7520154e-eb26-4def-bef8-3660273c296b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Subnet': ['ID=f3841d7d-4008-4e44-9c89-698d071245fa,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:37.283058 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:37.283808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.296367 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 147} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:37.306830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7520154e-eb26-4def-bef8-3660273c296b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.313615 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7520154e-eb26-4def-bef8-3660273c296b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/f3841d7d-4008-4e44-9c89-698d071245fa HTTP/1.1" status: 204 len: 168 time: 0.9540830 Mar 24 02:17:37.320733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60808) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:37.326064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e96242fe-2de1-4424-a4ab-bc58fb16c8ac None None] Network 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:37.357220 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b26d6640-afc6-4ec4-9700-0407ae9ecfa0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.357932 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Added segment b26d6640-afc6-4ec4-9700-0407ae9ecfa0 of type vlan for network 14ac1797-9f65-495f-b6f7-83aedcd8aef1 Mar 24 02:17:37.392526 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 830cc8ab-190a-40a7-a475-88a0ef2decc5 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:37.393867 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a556ca5d-ed98-488b-8079-7f9b8d39c082 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:37.421948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eec7602d-b622-4914-a4ec-716b8d117579 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.453612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-eec7602d-b622-4914-a4ec-716b8d117579 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for 2cc4637a-bddc-4978-8426-bf61a2e9eb50 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:37.456439 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] For port a556ca5d-ed98-488b-8079-7f9b8d39c082, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a556ca5d-ed98-488b-8079-7f9b8d39c082,segment=NetworkSegment(90bce2cd-2d9e-4697-bef8-e219d1c040c9),segment_id=90bce2cd-2d9e-4697-bef8-e219d1c040c9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:37.466904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.473736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Deleting port ff1a1949-f877-4444-80e6-2f7014ba47e6 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:37.474247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ff1a1949-f877-4444-80e6-2f7014ba47e6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.478255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (14ac1797-9f65-495f-b6f7-83aedcd8aef1), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.489839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (6e6edefe-93d4-45d7-9f2e-47c72b7d0761), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.504671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3f3f22c2-9e29-4248-b4e4-7e4a015c6abc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (3cccdbff-a7e2-4308-9085-948091c7a77f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.519662 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3f3f22c2-9e29-4248-b4e4-7e4a015c6abc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (3cccdbff-a7e2-4308-9085-948091c7a77f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.553841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3f22c2-9e29-4248-b4e4-7e4a015c6abc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3cccdbff-a7e2-4308-9085-948091c7a77f,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:37.555933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Provisioning complete for port 1533e374-3fea-47d0-a13c-1c95eef43132 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:37.556372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.592311 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3f3f22c2-9e29-4248-b4e4-7e4a015c6abc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.593503 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3f3f22c2-9e29-4248-b4e4-7e4a015c6abc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5183442 Mar 24 02:17:37.594226 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (14ac1797-9f65-495f-b6f7-83aedcd8aef1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.599555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:37.600155 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.608586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60810) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:37.640531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Pushing event updated for resources: {'Port': ['ID=a556ca5d-ed98-488b-8079-7f9b8d39c082,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:37.642746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c9ed35b1-2b0a-45f3-af85-ff06800ee7a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:37.650004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:37.650379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.677701 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:37.701563 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] Sync routers for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:37.703552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.756235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:37.756925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:37.768898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Current status of the port 1533e374-3fea-47d0-a13c-1c95eef43132 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:37.771258 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.7522099 Mar 24 02:17:37.776025 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60812) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:37.783403 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'subnet': {'network_id': '14ac1797-9f65-495f-b6f7-83aedcd8aef1', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:37.798704 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ff1a1949-f877-4444-80e6-2f7014ba47e6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.806042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f1136040-7ad9-4d3c-9ed4-596bbceee278 None None] Could not find standard attr ID for object 38543bba-4a81-4cfc-bbc5-f6d69a4ebd1c. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:17:37.816682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Calling delete_port for ff1a1949-f877-4444-80e6-2f7014ba47e6 owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:37.866742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb617f20-86d7-4a77-9792-5db2f073f0c4 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Network': ['ID=14ac1797-9f65-495f-b6f7-83aedcd8aef1,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:37.890222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 14ac1797-9f65-495f-b6f7-83aedcd8aef1 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:37.893892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9ed35b1-2b0a-45f3-af85-ff06800ee7a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (dcdecff8-2ed7-4938-b8f2-6ef96e6c2f5e), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.906279 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] DHCP port deletion for 6e6edefe-93d4-45d7-9f2e-47c72b7d0761 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:37.933331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port bd7bc251-e555-4a04-8eb4-7874269fbe1e {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:37.933903 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:37.999495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3e6e8117-b905-46ae-8fab-8ee3c8733cd0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.005954 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-43cdbedd-ebb7-4197-9adc-fdbf28f1667c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "DELETE /v2.0/floatingips/93b3d5f4-3404-4069-ba69-76c7b29011a1 HTTP/1.1" status: 204 len: 168 time: 6.3835571 Mar 24 02:17:38.006781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port bd7bc251-e555-4a04-8eb4-7874269fbe1e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=bd7bc251-e555-4a04-8eb4-7874269fbe1e,segment=NetworkSegment(880136ce-d208-467b-91a6-7b0795264cd9),segment_id=880136ce-d208-467b-91a6-7b0795264cd9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:38.007329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.022281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for bd7bc251-e555-4a04-8eb4-7874269fbe1e owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:38.050919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:17:38.053486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1" -d '{"events": [{"name": "network-changed", "server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:17:38.115301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:38.123028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0bd7c349-e6a9-47a6-84ae-c0c12c10f3b8 None None] Provisioning complete for port 2cc4637a-bddc-4978-8426-bf61a2e9eb50 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:38.123404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0bd7c349-e6a9-47a6-84ae-c0c12c10f3b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.164153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Made reservation on behalf of 3dbc846d991b4af0ae231d5e469488ba for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:38.167056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event deleted for resources: {'Port': ['ID=3e6e8117-b905-46ae-8fab-8ee3c8733cd0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:38.173773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.177254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.290612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0bd7c349-e6a9-47a6-84ae-c0c12c10f3b8 None None] Port 2cc4637a-bddc-4978-8426-bf61a2e9eb50 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:38.335974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0bd7c349-e6a9-47a6-84ae-c0c12c10f3b8 None None] Provisioning complete for port aee2f7ee-569a-4b32-9981-c7cefe350ef1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:38.336380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0bd7c349-e6a9-47a6-84ae-c0c12c10f3b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.341881 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=bd7bc251-e555-4a04-8eb4-7874269fbe1e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:38.353407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:17:38.380746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No DVR routers for this DVR port bd7bc251-e555-4a04-8eb4-7874269fbe1e on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:38.445914 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eec7602d-b622-4914-a4ec-716b8d117579 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (2cc4637a-bddc-4978-8426-bf61a2e9eb50), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.554621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec7602d-b622-4914-a4ec-716b8d117579 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=2cc4637a-bddc-4978-8426-bf61a2e9eb50,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:38.571389 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] Deleting port bd7bc251-e555-4a04-8eb4-7874269fbe1e {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:38.571832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.598174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:17:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55f4d82f-c913-42e4-ae70-871f5f5dbab2 x-openstack-request-id: req-55f4d82f-c913-42e4-ae70-871f5f5dbab2 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:17:38.599809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:17:38.600569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-55f4d82f-c913-42e4-ae70-871f5f5dbab2 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:17:38.601588 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-55f4d82f-c913-42e4-ae70-871f5f5dbab2'] response: {'name': 'network-changed', 'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'status': 'completed', 'code': 200} Mar 24 02:17:38.616383 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eec7602d-b622-4914-a4ec-716b8d117579 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.623375 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eec7602d-b622-4914-a4ec-716b8d117579 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/2cc4637a-bddc-4978-8426-bf61a2e9eb50 HTTP/1.1" status: 204 len: 168 time: 2.4778616 Mar 24 02:17:38.629232 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60824) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:38.646728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ff1a1949-f877-4444-80e6-2f7014ba47e6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.672691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9ed35b1-2b0a-45f3-af85-ff06800ee7a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (dcdecff8-2ed7-4938-b8f2-6ef96e6c2f5e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.692705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9ed35b1-2b0a-45f3-af85-ff06800ee7a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (dcdecff8-2ed7-4938-b8f2-6ef96e6c2f5e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.697053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (6e6edefe-93d4-45d7-9f2e-47c72b7d0761), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.707576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:38.710182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0508199d-f2db-45af-9bb2-88360d025d4b None None] Network 0a3a0bb4-4db4-4907-a006-67d97a634086 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:38.739046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0bd7c349-e6a9-47a6-84ae-c0c12c10f3b8 None None] Port aee2f7ee-569a-4b32-9981-c7cefe350ef1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:38.753495 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ed35b1-2b0a-45f3-af85-ff06800ee7a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dcdecff8-2ed7-4938-b8f2-6ef96e6c2f5e,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:38.757914 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6e6edefe-93d4-45d7-9f2e-47c72b7d0761']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:38.787502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '880136ce-d208-467b-91a6-7b0795264cd9') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:38.789041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '880136ce-d208-467b-91a6-7b0795264cd9') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:38.804596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (880136ce-d208-467b-91a6-7b0795264cd9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.813600 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9ed35b1-2b0a-45f3-af85-ff06800ee7a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.815733 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c9ed35b1-2b0a-45f3-af85-ff06800ee7a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.1884451 Mar 24 02:17:38.819646 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-7be4737f-979a-48a3-8369-09ac5c9007df tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:17:38.820424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60826) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:38.821362 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7be4737f-979a-48a3-8369-09ac5c9007df tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/2cc4637a-bddc-4978-8426-bf61a2e9eb50 HTTP/1.1" status: 404 len: 333 time: 0.1889851 Mar 24 02:17:38.831844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b09490c2-08ea-4159-8673-357a936505c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:38.833393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60828) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:38.846294 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (880136ce-d208-467b-91a6-7b0795264cd9), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.870005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] For port bd7bc251-e555-4a04-8eb4-7874269fbe1e, host dv-neutron-834874-3-hyperv, got binding levels [] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:38.870413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.876299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0bd7c349-e6a9-47a6-84ae-c0c12c10f3b8 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:38.876678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0bd7c349-e6a9-47a6-84ae-c0c12c10f3b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.885285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Releasing vlan 122 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:38.886637 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (880136ce-d208-467b-91a6-7b0795264cd9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:38.889896 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:38.920646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event deleted for resources: {'Port': ['ID=ff1a1949-f877-4444-80e6-2f7014ba47e6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:38.932737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] Calling delete_port for bd7bc251-e555-4a04-8eb4-7874269fbe1e owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:38.952450 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.ipam_backend_mixin [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] Port bd7bc251-e555-4a04-8eb4-7874269fbe1e was not found and therefore no delete operation was performed {{(pid=104038) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:571}} Mar 24 02:17:38.964812 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (bd7bc251-e555-4a04-8eb4-7874269fbe1e), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:38.969827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b09490c2-08ea-4159-8673-357a936505c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (056d52e7-785e-4bb0-b6a4-f5c8f8f4bb85), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.024427 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (6e6edefe-93d4-45d7-9f2e-47c72b7d0761), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.033979 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] No DVR routers for this DVR port bd7bc251-e555-4a04-8eb4-7874269fbe1e on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:39.039780 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97f11a81-2910-4464-b1eb-b3683d4e24c7 None None] Pushing event deleted for resources: {'Port': ['ID=bd7bc251-e555-4a04-8eb4-7874269fbe1e,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:39.042453 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.049907 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/networks/6e6edefe-93d4-45d7-9f2e-47c72b7d0761 HTTP/1.1" status: 204 len: 168 time: 1.7272050 Mar 24 02:17:39.063167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (f16cab9e-4385-4fd9-9ce1-9edfe837db44), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.065264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60830) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:39.071722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-88823095', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:39.082028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (e1b9c951-d7a2-4df4-8544-dda219bf68fa), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.083579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:39.083959 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.089910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74798d09-bf0b-4c5f-8cc8-53091e3becd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Network': ['ID=6e6edefe-93d4-45d7-9f2e-47c72b7d0761,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:39.146875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-8e498526-0e24-4c14-9ff6-c186a33bebce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:39.148767 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-8e498526-0e24-4c14-9ff6-c186a33bebce service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=615b57fe01bd445f87fb9f1a86851430&device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 1129 time: 0.5176473 Mar 24 02:17:39.170780 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b09490c2-08ea-4159-8673-357a936505c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (056d52e7-785e-4bb0-b6a4-f5c8f8f4bb85), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.174481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (8f5947fe-add3-477c-9328-aaba7d270bfd), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.175780 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (8f5947fe-add3-477c-9328-aaba7d270bfd), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.187476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b09490c2-08ea-4159-8673-357a936505c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (056d52e7-785e-4bb0-b6a4-f5c8f8f4bb85), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.194051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0bd7c349-e6a9-47a6-84ae-c0c12c10f3b8 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:39.199134 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a241a0ee-a158-4025-8b7b-6e9767042270', 'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'mac_address': 'fa:16:3e:d3:c7:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_interface', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:14:02Z', 'updated_at': '2022-03-24T02:14:09Z', 'revision_number': 5, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'subnets': [{'id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:39.199527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (7bdf989e-5118-40f2-8477-89f182dcc10b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.205497 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Subnet': ['ID=e1b9c951-d7a2-4df4-8544-dda219bf68fa,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:39.231521 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] Checking router: c4a3de90-537a-4022-b079-9feeedff6892 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:17:39.234549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b09490c2-08ea-4159-8673-357a936505c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=056d52e7-785e-4bb0-b6a4-f5c8f8f4bb85,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:39.246784 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:39.247424 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:39.254540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Checking segment: {'id': 'b26d6640-afc6-4ec4-9700-0407ae9ecfa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '14ac1797-9f65-495f-b6f7-83aedcd8aef1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:39.255186 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network hostable DHCP agents. Network: 14ac1797-9f65-495f-b6f7-83aedcd8aef1, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:39.273326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb6fbe-323d-44d9-a4e8-7de80265d4f0 req-e2aa173c-1128-4aa0-a789-55838b58789c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:39.282982 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fffb6fbe-323d-44d9-a4e8-7de80265d4f0 req-e2aa173c-1128-4aa0-a789-55838b58789c tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.7680891 Mar 24 02:17:39.286593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b09490c2-08ea-4159-8673-357a936505c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.291325 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b09490c2-08ea-4159-8673-357a936505c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4659650 Mar 24 02:17:39.291933 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60832) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:39.298311 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9b933958-4fc5-4cf4-8125-18354f777b41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:39.306751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (8f5947fe-add3-477c-9328-aaba7d270bfd), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.466909 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fffb6fbe-323d-44d9-a4e8-7de80265d4f0 req-42f69dd5-dc94-4bda-8d7f-fad7d4c3ceb7 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1828804 Mar 24 02:17:39.480516 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8aa1bd46-1f54-4ee3-a12d-2a342525c358 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (cd4f5544-e94d-42f7-8b1e-9750c65abae8), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.488253 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (7bdf989e-5118-40f2-8477-89f182dcc10b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.500160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for router_controller (7bdf989e-5118-40f2-8477-89f182dcc10b), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.559058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8aa1bd46-1f54-4ee3-a12d-2a342525c358 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (cd4f5544-e94d-42f7-8b1e-9750c65abae8), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.565391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-e9f967fc-ebdd-4fa3-bc53-be88d211ec35 None None] Provisioning complete for port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:39.565774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e9f967fc-ebdd-4fa3-bc53-be88d211ec35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.571595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:39.572931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a556ca5d-ed98-488b-8079-7f9b8d39c082 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:39.663336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:17:39.696374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network 14ac1797-9f65-495f-b6f7-83aedcd8aef1 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:39.708313 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-9b933958-4fc5-4cf4-8125-18354f777b41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:17:39.715388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 14ac1797-9f65-495f-b6f7-83aedcd8aef1) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:39.720155 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:39.720756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.725476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b933958-4fc5-4cf4-8125-18354f777b41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7c1f02dd-d0ee-412c-8260-9cfbf991402a), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.742870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00eca0c2-4077-474d-b71d-1629175e030d None None] Network 14ac1797-9f65-495f-b6f7-83aedcd8aef1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:39.822240 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a4b77ae6-1787-4c19-ab46-e08e41a362e9 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 2.0429494 Mar 24 02:17:39.824298 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_gateway (8f5947fe-add3-477c-9328-aaba7d270bfd), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.832299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60834) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:39.834827 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:39.835273 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.837250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-f213d5d5-f2ac-495f-a5ee-1a003db135e0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'router': {'external_gateway_info': {'network_id': '14ac1797-9f65-495f-b6f7-83aedcd8aef1'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:39.925501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e9f967fc-ebdd-4fa3-bc53-be88d211ec35 None None] Current status of the port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:39.926216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e9f967fc-ebdd-4fa3-bc53-be88d211ec35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.935747 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (7bdf989e-5118-40f2-8477-89f182dcc10b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.936299 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Fanout notify agent at l3_agent the message router_deleted on router 7bdf989e-5118-40f2-8477-89f182dcc10b {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:17:39.943191 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-01ed80a3-bf12-4317-bb0b-8da9b273ffbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:39.945271 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-01ed80a3-bf12-4317-bb0b-8da9b273ffbc service neutron] 10.222.0.30 "GET /v2.0/networks?id=1ff12164-ce98-442e-81ee-e22f78c3a0ff HTTP/1.1" status: 200 len: 898 time: 0.7590113 Mar 24 02:17:39.961252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:39.964916 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a5669c47-17ef-4b41-9179-f1166f7747c2 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "DELETE /v2.0/routers/7bdf989e-5118-40f2-8477-89f182dcc10b HTTP/1.1" status: 204 len: 168 time: 4.1615944 Mar 24 02:17:39.965868 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Router f16cab9e-4385-4fd9-9ce1-9edfe837db44 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:39.976412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60836) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:40.030152 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-5c5880e6-37c5-4686-9872-854bab9165ee service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832 HTTP/1.1" status: 200 len: 217 time: 0.0635567 Mar 24 02:17:40.039343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e9f967fc-ebdd-4fa3-bc53-be88d211ec35 None None] For port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:40.039795 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8aa1bd46-1f54-4ee3-a12d-2a342525c358 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (cd4f5544-e94d-42f7-8b1e-9750c65abae8), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.042552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8aa1bd46-1f54-4ee3-a12d-2a342525c358 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.043907 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8aa1bd46-1f54-4ee3-a12d-2a342525c358 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/security-groups/cd4f5544-e94d-42f7-8b1e-9750c65abae8 HTTP/1.1" status: 204 len: 168 time: 1.1380520 Mar 24 02:17:40.058734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60838) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:40.059235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e9f967fc-ebdd-4fa3-bc53-be88d211ec35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.071032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-e9f967fc-ebdd-4fa3-bc53-be88d211ec35 None None] Could not find standard attr ID for object 2cc4637a-bddc-4978-8426-bf61a2e9eb50. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:17:40.091949 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-14ac1797-9f65-495f-b6f7-83aedcd8aef1', 'network_id': '14ac1797-9f65-495f-b6f7-83aedcd8aef1', 'project_id': '3dbc846d991b4af0ae231d5e469488ba', 'fixed_ips': [{'subnet_id': 'e1b9c951-d7a2-4df4-8544-dda219bf68fa'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:40.093036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.107707 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b933958-4fc5-4cf4-8125-18354f777b41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7c1f02dd-d0ee-412c-8260-9cfbf991402a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.119699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b933958-4fc5-4cf4-8125-18354f777b41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (7c1f02dd-d0ee-412c-8260-9cfbf991402a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.140141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa1bd46-1f54-4ee3-a12d-2a342525c358 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd4f5544-e94d-42f7-8b1e-9750c65abae8,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:40.166049 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-de037d01-74fc-4f6c-a79c-ff92971b6cbf tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Deleting subnet 8e134c73-a965-43b5-984b-b2c8e4957f37 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:40.171738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b933958-4fc5-4cf4-8125-18354f777b41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7c1f02dd-d0ee-412c-8260-9cfbf991402a,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:40.208847 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de037d01-74fc-4f6c-a79c-ff92971b6cbf tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for subnet (8e134c73-a965-43b5-984b-b2c8e4957f37), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.214511 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-48663c87-e69b-4cea-98b6-ed7152df7758 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:40.216007 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-48663c87-e69b-4cea-98b6-ed7152df7758 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.30 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.2778268 Mar 24 02:17:40.221188 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:40.222345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:40.229408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9f967fc-ebdd-4fa3-bc53-be88d211ec35 None None] Pushing event updated for resources: {'Port': ['ID=78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:40.234322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-68a5236f-58d7-432a-a043-85cbe04db492 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:40.235827 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-68a5236f-58d7-432a-a043-85cbe04db492 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=44e52247-2dfd-4416-b8c9-7ab69363e1f2 HTTP/1.1" status: 200 len: 834 time: 0.1971030 Mar 24 02:17:40.239153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:40.256993 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a0bfbfa-da57-4e5d-962d-945b4d7f8316 None None] Sync routers for ids ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:40.268964 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bf7889dc-82d8-43cd-be09-c9bf00a76c97 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "PUT /v2.0/routers/f16cab9e-4385-4fd9-9ce1-9edfe837db44/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.9387715 Mar 24 02:17:40.271127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60840) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:40.277719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9b933958-4fc5-4cf4-8125-18354f777b41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.281960 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9b933958-4fc5-4cf4-8125-18354f777b41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.9871099 Mar 24 02:17:40.283238 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60842) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:40.285618 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a0bfbfa-da57-4e5d-962d-945b4d7f8316 None None] Routers {'f16cab9e-4385-4fd9-9ce1-9edfe837db44'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:40.287659 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8a0bfbfa-da57-4e5d-962d-945b4d7f8316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:40.292464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b9ac61b6-15be-439e-ab9d-540340bf74f5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:40.317575 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f213d5d5-f2ac-495f-a5ee-1a003db135e0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for router_gateway (654913c1-1089-45d5-a685-61f2d36bf588), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.323314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-630b614d-8775-4280-a1a3-0e0b340287a4 None None] Provisioning complete for port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:40.323792 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-630b614d-8775-4280-a1a3-0e0b340287a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.342149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de037d01-74fc-4f6c-a79c-ff92971b6cbf tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (8e134c73-a965-43b5-984b-b2c8e4957f37), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.372986 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-02cc631f-3ce8-4dac-bcb5-99614e6df39d tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] delete failed (client error): The resource could not be found. Mar 24 02:17:40.378327 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-b9ac61b6-15be-439e-ab9d-540340bf74f5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:17:40.379056 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-02cc631f-3ce8-4dac-bcb5-99614e6df39d tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "DELETE /v2.0/routers/tempest-non_exist_router-241020611 HTTP/1.1" status: 404 len: 334 time: 0.0936809 Mar 24 02:17:40.380010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60844) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:40.383957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b9ac61b6-15be-439e-ab9d-540340bf74f5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (f3701c87-5b2f-4cc7-a358-046f4ca83ced), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.388011 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8a0bfbfa-da57-4e5d-962d-945b4d7f8316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:40.397016 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b381e8c6-a605-4bf0-b31b-f819b3b81d3e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Request body: {'router': {'external_gateway_info': {'network_id': 'f16cab9e-4385-4fd9-9ce1-9edfe837db44'}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:40.413051 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a0bfbfa-da57-4e5d-962d-945b4d7f8316 None None] Routers {'f16cab9e-4385-4fd9-9ce1-9edfe837db44'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:40.413682 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8a0bfbfa-da57-4e5d-962d-945b4d7f8316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:40.422135 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-da90da79-87d8-43fe-840e-1f2e9170c99a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (b38ade3f-d491-4b39-afc2-1f7da48ce033), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.435568 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a241a0ee-a158-4025-8b7b-6e9767042270', 'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'mac_address': 'fa:16:3e:d3:c7:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_interface', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:14:02Z', 'updated_at': '2022-03-24T02:14:09Z', 'revision_number': 5, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'subnets': [{'id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:40.475266 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-556176f4-8cc3-4563-80dc-9d9ea2a9bf01 None None] The sync data for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv is: [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:14:04Z', 'revision_number': 4, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a241a0ee-a158-4025-8b7b-6e9767042270', 'name': '', 'network_id': '1ff12164-ce98-442e-81ee-e22f78c3a0ff', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'mac_address': 'fa:16:3e:d3:c7:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_interface', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:14:02Z', 'updated_at': '2022-03-24T02:14:09Z', 'revision_number': 5, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'subnets': [{'id': '44e52247-2dfd-4416-b8c9-7ab69363e1f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:40.481326 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:40.486550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.489757 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8a0bfbfa-da57-4e5d-962d-945b4d7f8316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:40.491274 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a0bfbfa-da57-4e5d-962d-945b4d7f8316 None None] The sync data for ids ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:40.512678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Allocated IP 2001:db8:1::2 (14ac1797-9f65-495f-b6f7-83aedcd8aef1/e1b9c951-d7a2-4df4-8544-dda219bf68fa/708a1479-0ee0-4234-a291-4d08e9e69c9c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:40.539046 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-da90da79-87d8-43fe-840e-1f2e9170c99a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (b38ade3f-d491-4b39-afc2-1f7da48ce033), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.578075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-ea9676f4-cc96-4fe9-aaac-68b7b8ac903f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:40.580359 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-ea9676f4-cc96-4fe9-aaac-68b7b8ac903f service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1ff12164-ce98-442e-81ee-e22f78c3a0ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.3207698 Mar 24 02:17:40.668327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_gateway (8f5947fe-add3-477c-9328-aaba7d270bfd), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.720389 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b9ac61b6-15be-439e-ab9d-540340bf74f5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (f3701c87-5b2f-4cc7-a358-046f4ca83ced), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.722756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de037d01-74fc-4f6c-a79c-ff92971b6cbf tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (8e134c73-a965-43b5-984b-b2c8e4957f37), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.748125 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.755652 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b9ac61b6-15be-439e-ab9d-540340bf74f5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (f3701c87-5b2f-4cc7-a358-046f4ca83ced), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.789182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-630b614d-8775-4280-a1a3-0e0b340287a4 None None] Current status of the port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:40.801850 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Deleting port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:40.802403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.812639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ac61b6-15be-439e-ab9d-540340bf74f5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f3701c87-5b2f-4cc7-a358-046f4ca83ced,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:40.855411 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b9ac61b6-15be-439e-ab9d-540340bf74f5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.864738 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b9ac61b6-15be-439e-ab9d-540340bf74f5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.5738463 Mar 24 02:17:40.888146 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:40.889257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 1533e374-3fea-47d0-a13c-1c95eef43132 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:40.928928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43b8fdc7-8c7f-4292-90b9-2bcc6cdcd1b3 None None] New status for floating IP 93b3d5f4-3404-4069-ba69-76c7b29011a1: DOWN {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:17:40.942616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-da90da79-87d8-43fe-840e-1f2e9170c99a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b38ade3f-d491-4b39-afc2-1f7da48ce033), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.945471 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-da90da79-87d8-43fe-840e-1f2e9170c99a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:40.949126 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-da90da79-87d8-43fe-840e-1f2e9170c99a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/security-groups/b38ade3f-d491-4b39-afc2-1f7da48ce033 HTTP/1.1" status: 204 len: 168 time: 0.8628304 Mar 24 02:17:40.967082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60852) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:40.970163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.26.2.212 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/4b402ffa-02a1-4f99-bd85-8fa8f6518238) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:40.984461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b381e8c6-a605-4bf0-b31b-f819b3b81d3e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for router_gateway (f16cab9e-4385-4fd9-9ce1-9edfe837db44), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.020587 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Publish callbacks [] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.026103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da90da79-87d8-43fe-840e-1f2e9170c99a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b38ade3f-d491-4b39-afc2-1f7da48ce033,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:41.050698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.088768 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-b381e8c6-a605-4bf0-b31b-f819b3b81d3e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] update failed (client error): The resource could not be found. Mar 24 02:17:41.096067 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b381e8c6-a605-4bf0-b31b-f819b3b81d3e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "PUT /v2.0/routers/f16cab9e-4385-4fd9-9ce1-9edfe837db44 HTTP/1.1" status: 404 len: 339 time: 0.7058508 Mar 24 02:17:41.097567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60868) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:41.104134 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 1533e374-3fea-47d0-a13c-1c95eef43132 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:41.104529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.109623 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-f213d5d5-f2ac-495f-a5ee-1a003db135e0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:17:41.111632 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f213d5d5-f2ac-495f-a5ee-1a003db135e0 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "PUT /v2.0/routers/654913c1-1089-45d5-a685-61f2d36bf588 HTTP/1.1" status: 400 len: 364 time: 1.2774746 Mar 24 02:17:41.114543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Network 14ac1797-9f65-495f-b6f7-83aedcd8aef1 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:41.114969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de037d01-74fc-4f6c-a79c-ff92971b6cbf tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (8e134c73-a965-43b5-984b-b2c8e4957f37), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.117885 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60870) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:41.148335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Pushing event updated for resources: {'Port': ['ID=708a1479-0ee0-4234-a291-4d08e9e69c9c,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:41.152798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:41.156800 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:41.182121 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e37a431-ba66-4b8f-97e4-b9fdfa61cff0 req-8e7154ea-df86-4eed-a2ae-8025c7b1e04a tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:41.184276 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1e37a431-ba66-4b8f-97e4-b9fdfa61cff0 req-8e7154ea-df86-4eed-a2ae-8025c7b1e04a tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 945 time: 0.5617249 Mar 24 02:17:41.186295 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-9c36af13-0307-4acd-924f-474695810044 service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5335672 Mar 24 02:17:41.228320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de037d01-74fc-4f6c-a79c-ff92971b6cbf tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event deleted for resources: {'Subnet': ['ID=8e134c73-a965-43b5-984b-b2c8e4957f37,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:41.235203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-c9d08b52-62a8-4054-a08e-e0dd80fe9f1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet afd24e27-ea10-4df7-bb48-bdbdad6fea6e {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:41.237773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de037d01-74fc-4f6c-a79c-ff92971b6cbf tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.241010 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-de037d01-74fc-4f6c-a79c-ff92971b6cbf tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "DELETE /v2.0/subnets/8e134c73-a965-43b5-984b-b2c8e4957f37 HTTP/1.1" status: 204 len: 168 time: 1.2605762 Mar 24 02:17:41.246950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60872) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:41.258027 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9d08b52-62a8-4054-a08e-e0dd80fe9f1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (afd24e27-ea10-4df7-bb48-bdbdad6fea6e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.264887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] For port 4716cbf2-4cfd-4eec-91c2-c814fff2a832, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=4716cbf2-4cfd-4eec-91c2-c814fff2a832,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:41.265806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.268285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc255d7d-5ad5-41f2-bb93-322a7ec0802d None None] Network dac30f63-f492-4007-bccd-3d53a7b4a3ec requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:41.275300 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Attempting to bind port 708a1479-0ee0-4234-a291-4d08e9e69c9c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:41.275678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Attempting to bind port 708a1479-0ee0-4234-a291-4d08e9e69c9c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'b26d6640-afc6-4ec4-9700-0407ae9ecfa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '14ac1797-9f65-495f-b6f7-83aedcd8aef1'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:41.276052 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Attempting to bind port 708a1479-0ee0-4234-a291-4d08e9e69c9c on network 14ac1797-9f65-495f-b6f7-83aedcd8aef1 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:41.330537 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:41.330983 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Checking segment: {'id': 'b26d6640-afc6-4ec4-9700-0407ae9ecfa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '14ac1797-9f65-495f-b6f7-83aedcd8aef1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:41.331378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.331776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Bound using segment: {'id': 'b26d6640-afc6-4ec4-9700-0407ae9ecfa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '14ac1797-9f65-495f-b6f7-83aedcd8aef1'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:41.332263 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Bound port: 708a1479-0ee0-4234-a291-4d08e9e69c9c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b26d6640-afc6-4ec4-9700-0407ae9ecfa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '14ac1797-9f65-495f-b6f7-83aedcd8aef1'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:41.332647 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.336655 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 1533e374-3fea-47d0-a13c-1c95eef43132 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:41.362554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Calling delete_port for 4716cbf2-4cfd-4eec-91c2-c814fff2a832 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:41.365353 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (4b402ffa-02a1-4f99-bd85-8fa8f6518238), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.471947 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (dac30f63-f492-4007-bccd-3d53a7b4a3ec), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.562669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device bd7bc251-e555-4a04-8eb4-7874269fbe1e no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:41.594365 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: bd7bc251-e555-4a04-8eb4-7874269fbe1e {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:41.594758 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device bd7bc251-e555-4a04-8eb4-7874269fbe1e not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:41.624955 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] For port 708a1479-0ee0-4234-a291-4d08e9e69c9c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:41.629722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] For port 708a1479-0ee0-4234-a291-4d08e9e69c9c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=708a1479-0ee0-4234-a291-4d08e9e69c9c,segment=NetworkSegment(b26d6640-afc6-4ec4-9700-0407ae9ecfa0),segment_id=b26d6640-afc6-4ec4-9700-0407ae9ecfa0)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:41.640666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.715956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-255a3290-392f-40a9-bb60-d5d7cf8169ba None None] Pushing event updated for resources: {'Port': ['ID=708a1479-0ee0-4234-a291-4d08e9e69c9c,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:41.754962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf06332b-7f17-4da7-a489-5a25b66a31c8 None None] DHCP port deletion for dac30f63-f492-4007-bccd-3d53a7b4a3ec request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:41.804464 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9d08b52-62a8-4054-a08e-e0dd80fe9f1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (afd24e27-ea10-4df7-bb48-bdbdad6fea6e), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.810735 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:41.855467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-cf06332b-7f17-4da7-a489-5a25b66a31c8 None None] Deleting port a124448b-6e8e-4e33-b837-ee975de76cf5 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:41.856216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf06332b-7f17-4da7-a489-5a25b66a31c8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.868149 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-d1c6cbb5-0970-4f40-94ae-aa2f82658e9e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-576976483&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.7448485 Mar 24 02:17:41.901962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (4b402ffa-02a1-4f99-bd85-8fa8f6518238), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:41.977552 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-cf06332b-7f17-4da7-a489-5a25b66a31c8 None None] For port a124448b-6e8e-4e33-b837-ee975de76cf5, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a124448b-6e8e-4e33-b837-ee975de76cf5,segment=NetworkSegment(592adf92-627d-4865-92b2-f4769d1654a7),segment_id=592adf92-627d-4865-92b2-f4769d1654a7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:41.978059 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf06332b-7f17-4da7-a489-5a25b66a31c8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.001038 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-cf06332b-7f17-4da7-a489-5a25b66a31c8 None None] Calling delete_port for a124448b-6e8e-4e33-b837-ee975de76cf5 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:42.007801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:42.024282 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1e37a431-ba66-4b8f-97e4-b9fdfa61cff0 req-35370488-9c7e-4ef8-ab54-7109e10eafd0 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/security-groups?id=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7935793 Mar 24 02:17:42.033582 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:42.033582 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.046883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.050873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:42.062413 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:42.065328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=4b402ffa-02a1-4f99-bd85-8fa8f6518238,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:42.142700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Deleting port a124448b-6e8e-4e33-b837-ee975de76cf5 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:42.143045 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.195142 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:42.195666 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-943c2e34-1ac5-43e3-ac1a-9edd9005aef1 req-5d7e9ecf-6232-4366-ab37-5092451f906c service neutron] 10.222.0.30 "GET /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9707043 Mar 24 02:17:42.215709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf06332b-7f17-4da7-a489-5a25b66a31c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.246068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf06332b-7f17-4da7-a489-5a25b66a31c8 None None] Pushing event deleted for resources: {'Port': ['ID=a124448b-6e8e-4e33-b837-ee975de76cf5,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:42.248283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf06332b-7f17-4da7-a489-5a25b66a31c8 None None] No DVR routers for this DVR port a124448b-6e8e-4e33-b837-ee975de76cf5 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:42.345623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8968675a-82a1-4a5f-8784-b811836bac87 req-1f10cd4d-8b74-4dbf-82dc-d02a0b651649 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:42.347054 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-1f10cd4d-8b74-4dbf-82dc-d02a0b651649 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/networks?id=0a3a0bb4-4db4-4907-a006-67d97a634086 HTTP/1.1" status: 200 len: 796 time: 0.4781199 Mar 24 02:17:42.403020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9d08b52-62a8-4054-a08e-e0dd80fe9f1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (afd24e27-ea10-4df7-bb48-bdbdad6fea6e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.422220 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 4716cbf2-4cfd-4eec-91c2-c814fff2a832 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:42.430344 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-b5742ced-c75c-47e1-bbb2-fe9db636ee6d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/quotas/6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 375 time: 0.0720809 Mar 24 02:17:42.449599 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] For port a124448b-6e8e-4e33-b837-ee975de76cf5, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a124448b-6e8e-4e33-b837-ee975de76cf5,segment=NetworkSegment(592adf92-627d-4865-92b2-f4769d1654a7),segment_id=592adf92-627d-4865-92b2-f4769d1654a7)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:42.451017 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.493731 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Calling delete_port for a124448b-6e8e-4e33-b837-ee975de76cf5 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:42.512049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 is: ACTIVE; New status is: DOWN {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:42.512807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.535612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.542625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (4716cbf2-4cfd-4eec-91c2-c814fff2a832), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.600352 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event deleted for resources: {'Port': ['ID=4716cbf2-4cfd-4eec-91c2-c814fff2a832,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:42.712566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9d08b52-62a8-4054-a08e-e0dd80fe9f1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (afd24e27-ea10-4df7-bb48-bdbdad6fea6e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.714727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] No DVR routers for this DVR port 4716cbf2-4cfd-4eec-91c2-c814fff2a832 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:42.717138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.720862 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b0a10d97-d6c6-4be4-98a7-9d4d4c6e31d5 req-3d7b32af-aab5-411e-89a2-07fb80ffc936 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.30 "DELETE /v2.0/ports/4716cbf2-4cfd-4eec-91c2-c814fff2a832 HTTP/1.1" status: 204 len: 173 time: 2.4986520 Mar 24 02:17:42.727451 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'name': 'network-vif-deleted', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:17:42.729783 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07be868b-d8ed-4bd1-881c-0599e5feee31" -d '{"events": [{"server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "name": "network-vif-deleted", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:17:42.781732 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-b8d594f4-f4ce-469d-8688-de7615feb6c1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&fields=id HTTP/1.1" status: 200 len: 394 time: 0.3367684 Mar 24 02:17:42.788057 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a124448b-6e8e-4e33-b837-ee975de76cf5), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.788306 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d08b52-62a8-4054-a08e-e0dd80fe9f1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=afd24e27-ea10-4df7-bb48-bdbdad6fea6e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:42.803949 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9d08b52-62a8-4054-a08e-e0dd80fe9f1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:42.814942 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c9d08b52-62a8-4054-a08e-e0dd80fe9f1c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/afd24e27-ea10-4df7-bb48-bdbdad6fea6e HTTP/1.1" status: 204 len: 168 time: 1.8461158 Mar 24 02:17:42.817161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66c10f1f-7016-4247-9465-11b826e9af6b None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:42.818548 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60876) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:42.821913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] No DVR routers for this DVR port a124448b-6e8e-4e33-b837-ee975de76cf5 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:42.824276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:42.850433 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:17:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e7e4c87-aa26-4780-8c03-09eb08d78d5c x-openstack-request-id: req-2e7e4c87-aa26-4780-8c03-09eb08d78d5c {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:17:42.850695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2288eb51-db8a-403d-aae5-b3afb1a1d477", "name": "network-vif-deleted", "tag": "4716cbf2-4cfd-4eec-91c2-c814fff2a832", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:17:42.850947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-2e7e4c87-aa26-4780-8c03-09eb08d78d5c {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:17:42.851347 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-2e7e4c87-aa26-4780-8c03-09eb08d78d5c'] response: {'server_uuid': '2288eb51-db8a-403d-aae5-b3afb1a1d477', 'name': 'network-vif-deleted', 'tag': '4716cbf2-4cfd-4eec-91c2-c814fff2a832', 'status': 'completed', 'code': 200} Mar 24 02:17:42.895773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Allocated IP 2001:db8::1 (388c1171-5a51-4a13-ad3a-5e02de8f8d78/64dc4bf3-2544-4904-a7e6-ac6433808662/143de4fa-33eb-4099-8d8a-9fc761177eba) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:43.014842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event deleted for resources: {'Port': ['ID=a124448b-6e8e-4e33-b837-ee975de76cf5,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:43.173597 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (dac30f63-f492-4007-bccd-3d53a7b4a3ec), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.177344 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_gateway (8f5947fe-add3-477c-9328-aaba7d270bfd), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.187295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:43.196330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.220782 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfbced69-c70d-4415-b19d-2af312e67a4d None None] Network 14ac1797-9f65-495f-b6f7-83aedcd8aef1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:43.295047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8ac52962-6f8b-48ad-af39-19d72294eb7c None None] Provisioning complete for port 708a1479-0ee0-4234-a291-4d08e9e69c9c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:43.295419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ac52962-6f8b-48ad-af39-19d72294eb7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.330736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dac30f63-f492-4007-bccd-3d53a7b4a3ec']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:43.389461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '592adf92-627d-4865-92b2-f4769d1654a7') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:43.390593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '592adf92-627d-4865-92b2-f4769d1654a7') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:43.438162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (592adf92-627d-4865-92b2-f4769d1654a7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.439485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8ac52962-6f8b-48ad-af39-19d72294eb7c None None] Current status of the port 708a1479-0ee0-4234-a291-4d08e9e69c9c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:43.440667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ac52962-6f8b-48ad-af39-19d72294eb7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.472818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.486587 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (592adf92-627d-4865-92b2-f4769d1654a7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.510061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8ac52962-6f8b-48ad-af39-19d72294eb7c None None] For port 708a1479-0ee0-4234-a291-4d08e9e69c9c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=708a1479-0ee0-4234-a291-4d08e9e69c9c,segment=NetworkSegment(b26d6640-afc6-4ec4-9700-0407ae9ecfa0),segment_id=b26d6640-afc6-4ec4-9700-0407ae9ecfa0)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:43.510778 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:43.511240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (592adf92-627d-4865-92b2-f4769d1654a7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:43.514872 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:43.520229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ac52962-6f8b-48ad-af39-19d72294eb7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.556058 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-411310c4-12da-4bd9-9bb1-dd3772de20b9 req-6c76a185-17c3-4d5f-8848-75fd7a99daf0 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "GET /v2.0/ports?device_id=2288eb51-db8a-403d-aae5-b3afb1a1d477 HTTP/1.1" status: 200 len: 210 time: 0.1801667 Mar 24 02:17:43.596175 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2ad55ad1-44d1-4fb5-8165-c73e0b564422 service neutron] 10.222.0.20 "GET /v2.0/networks/0a3a0bb4-4db4-4907-a006-67d97a634086?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7799544 Mar 24 02:17:43.598763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Allocated IP 172.20.0.1 (7cde5c03-1bce-4fe6-bab8-be1b58838f55/431fd840-ead5-4cb9-b2cf-4efeba48e88f/d9fb4ae9-5855-4bac-9967-ed51b20414e0) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:43.620356 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac52962-6f8b-48ad-af39-19d72294eb7c None None] Pushing event updated for resources: {'Port': ['ID=708a1479-0ee0-4234-a291-4d08e9e69c9c,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:43.647246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (dac30f63-f492-4007-bccd-3d53a7b4a3ec), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.700722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.707424 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "DELETE /v2.0/networks/dac30f63-f492-4007-bccd-3d53a7b4a3ec HTTP/1.1" status: 204 len: 168 time: 2.4544342 Mar 24 02:17:43.711623 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60884) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:43.803229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.807532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 708a1479-0ee0-4234-a291-4d08e9e69c9c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:43.842054 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b2bc2f-8687-4089-b54b-ba6ec0d703da tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event deleted for resources: {'Network': ['ID=dac30f63-f492-4007-bccd-3d53a7b4a3ec,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:43.864129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-901ac4a1-4bc6-4dd8-a9a6-b33334fd4921 None None] Provisioning complete for port 708a1479-0ee0-4234-a291-4d08e9e69c9c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:43.864809 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-901ac4a1-4bc6-4dd8-a9a6-b33334fd4921 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.918761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (8f5947fe-add3-477c-9328-aaba7d270bfd), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.933905 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 708a1479-0ee0-4234-a291-4d08e9e69c9c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:43.934919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:43.949918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:43.955952 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:43.958567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:43.959456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (654913c1-1089-45d5-a685-61f2d36bf588), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.029249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Port': ['ID=143de4fa-33eb-4099-8d8a-9fc761177eba,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:44.029828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-901ac4a1-4bc6-4dd8-a9a6-b33334fd4921 None None] Current status of the port 708a1479-0ee0-4234-a291-4d08e9e69c9c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:44.113857 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 708a1479-0ee0-4234-a291-4d08e9e69c9c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:44.208995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a124448b-6e8e-4e33-b837-ee975de76cf5 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:44.223163 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-360b0834-7add-4898-9e91-dcb4411bc315 service neutron] 10.222.0.20 "GET /v2.0/networks/0a3a0bb4-4db4-4907-a006-67d97a634086?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6260924 Mar 24 02:17:44.232769 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (944064c8-2071-42aa-b2a3-4fdbf39aa8ed), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.250150 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: a124448b-6e8e-4e33-b837-ee975de76cf5 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:44.252548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a124448b-6e8e-4e33-b837-ee975de76cf5 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:44.280011 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-774be805-b0b9-49f9-bc6b-53578b9dd538 None None] Provisioning complete for port aee2f7ee-569a-4b32-9981-c7cefe350ef1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:44.280729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-774be805-b0b9-49f9-bc6b-53578b9dd538 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.305928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=944064c8-2071-42aa-b2a3-4fdbf39aa8ed,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:44.310835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.318318 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:44.321660 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:44.326038 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:44.326209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.347352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01cca3c7-93d7-42ab-a8e9-ad207c00bad4 None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:44.357069 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-082701d9-abef-4d85-9b15-8fd1b067f161 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.5373526 Mar 24 02:17:44.360624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60886) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:44.365894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-867ba047-209a-48fe-a43b-c6c49387fafe tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'security_group': {'name': 'tempest-secgroup-75806718'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:44.394284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.401919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-867ba047-209a-48fe-a43b-c6c49387fafe tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.444303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-774be805-b0b9-49f9-bc6b-53578b9dd538 None None] Port aee2f7ee-569a-4b32-9981-c7cefe350ef1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:44.498531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-774be805-b0b9-49f9-bc6b-53578b9dd538 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:44.498910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-774be805-b0b9-49f9-bc6b-53578b9dd538 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.519719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Deleting port 777a3610-d046-4096-80c3-b7a8e6faf3a7 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:44.520090 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (777a3610-d046-4096-80c3-b7a8e6faf3a7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.539295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:44.540116 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Port': ['ID=d9fb4ae9-5855-4bac-9967-ed51b20414e0,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:44.551649 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-57ebc79e-6d36-49aa-a21c-aae4e0b54df7 req-e6547fb4-df5f-456e-b3a1-b7d9f45f48b6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 210 time: 0.0594971 Mar 24 02:17:44.555215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:44.559194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:44.617520 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (f16cab9e-4385-4fd9-9ce1-9edfe837db44), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.652272 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-774be805-b0b9-49f9-bc6b-53578b9dd538 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:44.658551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60896) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:44.759183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea7a409a-1f4f-408d-bb58-258108d2bae6 None None] Update dhcp port {'port': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'fixed_ips': [{'subnet_id': '824de909-ed6d-42eb-91e2-7f0e51862ab0', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': '944064c8-2071-42aa-b2a3-4fdbf39aa8ed'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': 'a556ca5d-ed98-488b-8079-7f9b8d39c082'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:17:44.804304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.813154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-867ba047-209a-48fe-a43b-c6c49387fafe tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (1cc62c9b-7561-4b03-b819-d7e9a54d2b3e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.813388 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-82487b48-2f3b-4e00-af9d-57cd86a6f720 None None] Provisioning complete for port 143de4fa-33eb-4099-8d8a-9fc761177eba triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:44.813952 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-82487b48-2f3b-4e00-af9d-57cd86a6f720 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.821556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-867ba047-209a-48fe-a43b-c6c49387fafe tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1cc62c9b-7561-4b03-b819-d7e9a54d2b3e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.855335 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.894455 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-82487b48-2f3b-4e00-af9d-57cd86a6f720 None None] Port 143de4fa-33eb-4099-8d8a-9fc761177eba cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:44.897060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ea7a409a-1f4f-408d-bb58-258108d2bae6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.901274 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-867ba047-209a-48fe-a43b-c6c49387fafe tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.905324 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-867ba047-209a-48fe-a43b-c6c49387fafe tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.5407965 Mar 24 02:17:44.907911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60902) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:44.916822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7e7b6b0f-2e7d-4326-a86f-1826d81a0bb9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'security_group': {'name': 'tempest-secgroup-914047499'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:44.930718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-867ba047-209a-48fe-a43b-c6c49387fafe tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1cc62c9b-7561-4b03-b819-d7e9a54d2b3e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:44.977243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.979097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (777a3610-d046-4096-80c3-b7a8e6faf3a7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.980062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for floatingip (777a3610-d046-4096-80c3-b7a8e6faf3a7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:44.986464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router 8f5947fe-add3-477c-9328-aaba7d270bfd is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:17:45.038337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6b0f-2e7d-4326-a86f-1826d81a0bb9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.071624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Calling delete_port for 777a3610-d046-4096-80c3-b7a8e6faf3a7 owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:45.166549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0e4e2f62-8a24-4e88-bc27-a7d6ad5f927c None None] Provisioning complete for port d9fb4ae9-5855-4bac-9967-ed51b20414e0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:45.166940 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0e4e2f62-8a24-4e88-bc27-a7d6ad5f927c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.202353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-ea7a409a-1f4f-408d-bb58-258108d2bae6 None None] Allocated IP 2001:db8::2 (8ec9fea4-b38d-4612-9d1d-87145ce2366f/944064c8-2071-42aa-b2a3-4fdbf39aa8ed/a556ca5d-ed98-488b-8079-7f9b8d39c082) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:45.221971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6b0f-2e7d-4326-a86f-1826d81a0bb9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (3eafdaf8-64e4-42b4-a2ca-1b610621f713), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.232217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6b0f-2e7d-4326-a86f-1826d81a0bb9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (3eafdaf8-64e4-42b4-a2ca-1b610621f713), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.233805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0e4e2f62-8a24-4e88-bc27-a7d6ad5f927c None None] Port d9fb4ae9-5855-4bac-9967-ed51b20414e0 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:45.267747 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7b6b0f-2e7d-4326-a86f-1826d81a0bb9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3eafdaf8-64e4-42b4-a2ca-1b610621f713,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:45.295308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6b0f-2e7d-4326-a86f-1826d81a0bb9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.301113 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7e7b6b0f-2e7d-4326-a86f-1826d81a0bb9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.3851566 Mar 24 02:17:45.302342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60906) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:45.307013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-99db36b5-b533-491b-a7b1-48af116c2edd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'security_group': {'name': 'tempest-secgroup-1774630681'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:45.326037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.333580 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.352834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ea7a409a-1f4f-408d-bb58-258108d2bae6 None None] For port a556ca5d-ed98-488b-8079-7f9b8d39c082, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a556ca5d-ed98-488b-8079-7f9b8d39c082,segment=NetworkSegment(90bce2cd-2d9e-4697-bef8-e219d1c040c9),segment_id=90bce2cd-2d9e-4697-bef8-e219d1c040c9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:45.393321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ea7a409a-1f4f-408d-bb58-258108d2bae6 None None] Publish callbacks [] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.399685 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ea7a409a-1f4f-408d-bb58-258108d2bae6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.402685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99db36b5-b533-491b-a7b1-48af116c2edd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.435776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event updated for resources: {'Port': ['ID=d9fb4ae9-5855-4bac-9967-ed51b20414e0,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:45.438472 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (f16cab9e-4385-4fd9-9ce1-9edfe837db44), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.533742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7a409a-1f4f-408d-bb58-258108d2bae6 None None] Pushing event updated for resources: {'Port': ['ID=a556ca5d-ed98-488b-8079-7f9b8d39c082,revision_number=6']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:45.577481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:45.587032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:45.601069 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f202a783-3d98-49ad-aa6a-863b4b091861 None None] Sync routers for ids ['8f5947fe-add3-477c-9328-aaba7d270bfd'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:45.604848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:45.616988 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f202a783-3d98-49ad-aa6a-863b4b091861 None None] Routers {'8f5947fe-add3-477c-9328-aaba7d270bfd'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:45.618122 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f202a783-3d98-49ad-aa6a-863b4b091861 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['8f5947fe-add3-477c-9328-aaba7d270bfd'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:45.636359 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99db36b5-b533-491b-a7b1-48af116c2edd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (326ef952-70f7-4dbe-9687-948ffd5cb56f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.704827 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f202a783-3d98-49ad-aa6a-863b4b091861 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:45.731865 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f202a783-3d98-49ad-aa6a-863b4b091861 None None] Routers {'8f5947fe-add3-477c-9328-aaba7d270bfd'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:45.732489 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f202a783-3d98-49ad-aa6a-863b4b091861 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['8f5947fe-add3-477c-9328-aaba7d270bfd'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:45.736442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99db36b5-b533-491b-a7b1-48af116c2edd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (326ef952-70f7-4dbe-9687-948ffd5cb56f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.767522 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.772815 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0f8833ce-db87-489b-9ca7-40bcd0997700 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 878 time: 6.7059970 Mar 24 02:17:45.775456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60910) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:45.781946 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f202a783-3d98-49ad-aa6a-863b4b091861 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:45.783401 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f202a783-3d98-49ad-aa6a-863b4b091861 None None] The sync data for ids ['8f5947fe-add3-477c-9328-aaba7d270bfd'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:45.807410 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a556ca5d-ed98-488b-8079-7f9b8d39c082 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:45.846764 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3d270702-1d90-4135-a3fc-1addfab14c9b req-45a6d7df-d217-4170-8ca3-fd9e83d99aa9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 210 time: 0.1502113 Mar 24 02:17:45.924590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:45.924974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:45.944879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Router f16cab9e-4385-4fd9-9ce1-9edfe837db44 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:45.994735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (777a3610-d046-4096-80c3-b7a8e6faf3a7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.013364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.059094 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.060388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (654913c1-1089-45d5-a685-61f2d36bf588), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.062443 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Pushing event deleted for resources: {'Port': ['ID=777a3610-d046-4096-80c3-b7a8e6faf3a7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:46.069675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99db36b5-b533-491b-a7b1-48af116c2edd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'SecurityGroup': ['ID=326ef952-70f7-4dbe-9687-948ffd5cb56f,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:46.074040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-99db36b5-b533-491b-a7b1-48af116c2edd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.075525 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-99db36b5-b533-491b-a7b1-48af116c2edd tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.7720511 Mar 24 02:17:46.084212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60912) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:46.091931 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1076612284', 'security_groups': ['326ef952-70f7-4dbe-9687-948ffd5cb56f'], 'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '944064c8-2071-42aa-b2a3-4fdbf39aa8ed'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:46.119193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (c4a3de90-537a-4022-b079-9feeedff6892), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.130235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:46.178183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-22fc467e-573d-45d8-b8d4-4cb8f2a311c2 None None] Provisioning complete for port d9fb4ae9-5855-4bac-9967-ed51b20414e0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:46.178592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-22fc467e-573d-45d8-b8d4-4cb8f2a311c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.215398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-22fc467e-573d-45d8-b8d4-4cb8f2a311c2 None None] Port d9fb4ae9-5855-4bac-9967-ed51b20414e0 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:46.290872 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event updated for resources: {'Port': ['ID=143de4fa-33eb-4099-8d8a-9fc761177eba,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:46.306772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8968675a-82a1-4a5f-8784-b811836bac87 req-0587baed-5334-4515-ba46-5f4c4cd3aaac tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:46.308240 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-0587baed-5334-4515-ba46-5f4c4cd3aaac tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=0a3a0bb4-4db4-4907-a006-67d97a634086 HTTP/1.1" status: 200 len: 796 time: 0.3575404 Mar 24 02:17:46.326750 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7b73ebae-8637-46ac-981b-17633a6ea557 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/routers/8f5947fe-add3-477c-9328-aaba7d270bfd HTTP/1.1" status: 200 len: 879 time: 0.5469496 Mar 24 02:17:46.333513 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60918) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:46.384836 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks [] for floatingip (38d63644-7364-4f09-b991-87552d318343), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.387773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.390876 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-15a7d9ef-dc12-4fba-92c7-79f16e9d3662 tempest-FloatingIPAdminTestJSON-1818078078 tempest-FloatingIPAdminTestJSON-1818078078-project] 10.222.0.20 "DELETE /v2.0/floatingips/38d63644-7364-4f09-b991-87552d318343 HTTP/1.1" status: 204 len: 168 time: 2.6763778 Mar 24 02:17:46.447977 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c9b7cc33-1273-45e0-8264-93e654c38069 None None] Provisioning complete for port aee2f7ee-569a-4b32-9981-c7cefe350ef1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:46.449009 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c9b7cc33-1273-45e0-8264-93e654c38069 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.465828 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:46.466067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:46.470750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:46.489712 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ad57f7ea-3220-4c30-ba20-5d62908673eb tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "PUT /v2.0/routers/f16cab9e-4385-4fd9-9ce1-9edfe837db44/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3817513 Mar 24 02:17:46.497326 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2916372d-3fd8-451d-9d7f-9c6d336cb788 None None] Sync routers for ids ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:46.503345 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60922) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:46.557699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2916372d-3fd8-451d-9d7f-9c6d336cb788 None None] Routers {'f16cab9e-4385-4fd9-9ce1-9edfe837db44'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:46.559355 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2916372d-3fd8-451d-9d7f-9c6d336cb788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:46.567936 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:46.574016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c9b7cc33-1273-45e0-8264-93e654c38069 None None] Port aee2f7ee-569a-4b32-9981-c7cefe350ef1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:46.629833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2916372d-3fd8-451d-9d7f-9c6d336cb788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:46.654511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c9b7cc33-1273-45e0-8264-93e654c38069 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:46.655266 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c9b7cc33-1273-45e0-8264-93e654c38069 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.684434 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2916372d-3fd8-451d-9d7f-9c6d336cb788 None None] Routers {'f16cab9e-4385-4fd9-9ce1-9edfe837db44'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:46.685238 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2916372d-3fd8-451d-9d7f-9c6d336cb788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:46.733314 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2916372d-3fd8-451d-9d7f-9c6d336cb788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:46.734147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2916372d-3fd8-451d-9d7f-9c6d336cb788 None None] The sync data for ids ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:46.826101 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c9b7cc33-1273-45e0-8264-93e654c38069 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:46.857836 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60926) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:46.941568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Router 654913c1-1089-45d5-a685-61f2d36bf588 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:46.951068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-dd44475e-e102-4e21-8f38-9cc8bf3047ec None None] Provisioning complete for port 143de4fa-33eb-4099-8d8a-9fc761177eba triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:46.951575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd44475e-e102-4e21-8f38-9cc8bf3047ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:46.993057 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-dd44475e-e102-4e21-8f38-9cc8bf3047ec None None] Port 143de4fa-33eb-4099-8d8a-9fc761177eba cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:47.028790 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-56fa0618-3763-4694-b0b8-f94cc3ed9787 req-e6ce3b88-579d-4977-8aa3-c9b04eabab22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 210 time: 0.0760107 Mar 24 02:17:47.046963 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-5111b981-ffed-4b9b-9dda-5e6742b93a4a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 472 time: 0.7222135 Mar 24 02:17:47.058023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'device_id': '8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5', 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086', 'admin_state_up': True, 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'security_groups': ['6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:47.096241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-028adb70-35a4-44ba-9354-4b28c381eac1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for router (f16cab9e-4385-4fd9-9ce1-9edfe837db44), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.141343 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-eb4be56c-af8c-4100-8a7b-907fe091c4fb admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=3561433150a34016ae3a3844285683ef&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2824714 Mar 24 02:17:47.146038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60932) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:47.154415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:47.159895 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e5b4d98f-7b2c-4ed9-93de-b0585aeaf5b3 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "PUT /v2.0/routers/654913c1-1089-45d5-a685-61f2d36bf588/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0300953 Mar 24 02:17:47.168173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60934) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:47.169831 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f21676a6-05fc-4e4b-8581-a3bd3f2102bc None None] Sync routers for ids ['654913c1-1089-45d5-a685-61f2d36bf588'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:47.181167 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f21676a6-05fc-4e4b-8581-a3bd3f2102bc None None] Routers {'654913c1-1089-45d5-a685-61f2d36bf588'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:47.181713 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Deleting port a241a0ee-a158-4025-8b7b-6e9767042270 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:47.182014 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f21676a6-05fc-4e4b-8581-a3bd3f2102bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['654913c1-1089-45d5-a685-61f2d36bf588'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:47.182154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.220479 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f21676a6-05fc-4e4b-8581-a3bd3f2102bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:47.230346 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f21676a6-05fc-4e4b-8581-a3bd3f2102bc None None] Routers {'654913c1-1089-45d5-a685-61f2d36bf588'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:47.231292 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f21676a6-05fc-4e4b-8581-a3bd3f2102bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['654913c1-1089-45d5-a685-61f2d36bf588'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:47.260984 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cc45af88-6ce6-445a-bbcd-ba528522e193 admin admin] Publish callbacks [] for security_group (8f68d962-62e9-4956-bff3-fc60eadeea81), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.265238 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f21676a6-05fc-4e4b-8581-a3bd3f2102bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:47.266148 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f21676a6-05fc-4e4b-8581-a3bd3f2102bc None None] The sync data for ids ['654913c1-1089-45d5-a685-61f2d36bf588'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:47.291531 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.309052 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cc45af88-6ce6-445a-bbcd-ba528522e193 admin admin] Publish callbacks [] for security_group (8f68d962-62e9-4956-bff3-fc60eadeea81), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.322752 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] For port a241a0ee-a158-4025-8b7b-6e9767042270, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a241a0ee-a158-4025-8b7b-6e9767042270,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:47.323116 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.347162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Calling delete_port for a241a0ee-a158-4025-8b7b-6e9767042270 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:47.372418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] device_id is not set on port ee36bd51-4117-478e-8b43-8b3b0ec9f517 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:47.385996 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-028adb70-35a4-44ba-9354-4b28c381eac1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] delete failed (client error): There was a conflict when trying to complete your request. Mar 24 02:17:47.389727 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-028adb70-35a4-44ba-9354-4b28c381eac1 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "DELETE /v2.0/routers/f16cab9e-4385-4fd9-9ce1-9edfe837db44 HTTP/1.1" status: 409 len: 376 time: 0.8827784 Mar 24 02:17:47.395451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60936) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:47.434456 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6096e0c9-3693-4076-b65b-4310513d6c4f tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for router (654913c1-1089-45d5-a685-61f2d36bf588), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.487322 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cc45af88-6ce6-445a-bbcd-ba528522e193 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8f68d962-62e9-4956-bff3-fc60eadeea81), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.489901 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cc45af88-6ce6-445a-bbcd-ba528522e193 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.493634 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cc45af88-6ce6-445a-bbcd-ba528522e193 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/8f68d962-62e9-4956-bff3-fc60eadeea81 HTTP/1.1" status: 204 len: 168 time: 0.3430879 Mar 24 02:17:47.511328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc45af88-6ce6-445a-bbcd-ba528522e193 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f68d962-62e9-4956-bff3-fc60eadeea81,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:47.591507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:47.594860 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.652927 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8dbc30e5-19f7-4222-b4ff-2f5707ea35c6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 882 time: 1.3161144 Mar 24 02:17:47.652927 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-6096e0c9-3693-4076-b65b-4310513d6c4f tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] delete failed (client error): There was a conflict when trying to complete your request. Mar 24 02:17:47.652927 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6096e0c9-3693-4076-b65b-4310513d6c4f tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/routers/654913c1-1089-45d5-a685-61f2d36bf588 HTTP/1.1" status: 409 len: 376 time: 0.4508173 Mar 24 02:17:47.655752 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60942) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:47.658617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60944) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:47.671100 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-bbb8fd4b-335e-42e8-ad81-1d2905bbda3d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'name': 'updatedtempest-RoutersTest-router-88823095'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:47.814371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60946) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:47.849950 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8::3b4 (8ec9fea4-b38d-4612-9d1d-87145ce2366f/944064c8-2071-42aa-b2a3-4fdbf39aa8ed/ee36bd51-4117-478e-8b43-8b3b0ec9f517) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:47.882156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-486b88d3-7816-44c5-a8bc-2b3cd00c396a admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.935116 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a241a0ee-a158-4025-8b7b-6e9767042270), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:47.998285 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.21 (0a3a0bb4-4db4-4907-a006-67d97a634086/47e13ca4-a1b5-4f9e-95ce-b93533455f10/1ee59cd7-c2ab-4bdd-aae1-75d878279ee1) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:48.055300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event deleted for resources: {'Port': ['ID=a241a0ee-a158-4025-8b7b-6e9767042270,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:48.267044 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c9e1efc5-5438-451d-b9bf-e4ed4ef838c9 req-d57387d7-e558-43d0-8178-633973512ed2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 210 time: 0.1068480 Mar 24 02:17:48.325489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.381333 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-486b88d3-7816-44c5-a8bc-2b3cd00c396a admin admin] Publish callbacks [] for security_group (102d8624-6c90-4258-9fca-c0d93dc5be47), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.394401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-486b88d3-7816-44c5-a8bc-2b3cd00c396a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (102d8624-6c90-4258-9fca-c0d93dc5be47), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.403279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.423935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.468680 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-486b88d3-7816-44c5-a8bc-2b3cd00c396a admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=f59ae170164e452c94c24b5ff06eecc0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6360819 Mar 24 02:17:48.474441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60950) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:48.480128 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-486b88d3-7816-44c5-a8bc-2b3cd00c396a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=102d8624-6c90-4258-9fca-c0d93dc5be47,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:48.513843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bbb8fd4b-335e-42e8-ad81-1d2905bbda3d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (8f5947fe-add3-477c-9328-aaba7d270bfd), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.524829 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (c4a3de90-537a-4022-b079-9feeedff6892), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.550080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (f16cab9e-4385-4fd9-9ce1-9edfe837db44), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.555685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bbb8fd4b-335e-42e8-ad81-1d2905bbda3d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (8f5947fe-add3-477c-9328-aaba7d270bfd), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.781333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:48.794041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:48.801015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:48.806326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:48.807114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.815350 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=ee36bd51-4117-478e-8b43-8b3b0ec9f517,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:48.836044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.848891 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cc2def61-f57f-4cdf-a8b3-cb6ec86a65f6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.7605438 Mar 24 02:17:48.852001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60952) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:48.859894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-506a7292-0f8e-495d-9893-8cc1406a00a3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:48.908200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (654913c1-1089-45d5-a685-61f2d36bf588), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:48.975327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 0a3a0bb4-4db4-4907-a006-67d97a634086 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:49.024598 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:49.030146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:49.034382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:49.053845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da8b3b7b-83c0-4db2-b21e-e7c03cc477d9 admin admin] Publish callbacks [] for security_group (102d8624-6c90-4258-9fca-c0d93dc5be47), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.113430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:49.114083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.137805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4c8a8d51-3615-4b57-aee5-a0cef38a1278 None None] Provisioning complete for port ee36bd51-4117-478e-8b43-8b3b0ec9f517 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:49.140171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4c8a8d51-3615-4b57-aee5-a0cef38a1278 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.175344 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da8b3b7b-83c0-4db2-b21e-e7c03cc477d9 admin admin] Publish callbacks [] for security_group (102d8624-6c90-4258-9fca-c0d93dc5be47), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.179744 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-2329e330-510f-49ed-a51a-984965ead450 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1253810 Mar 24 02:17:49.196842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4c8a8d51-3615-4b57-aee5-a0cef38a1278 None None] Port ee36bd51-4117-478e-8b43-8b3b0ec9f517 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:49.211218 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Request body: {'port': {'device_id': '8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:49.243121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bbb8fd4b-335e-42e8-ad81-1d2905bbda3d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router 8f5947fe-add3-477c-9328-aaba7d270bfd has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:49.244367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-506a7292-0f8e-495d-9893-8cc1406a00a3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:49.247964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-506a7292-0f8e-495d-9893-8cc1406a00a3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.341822 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a11066ac-12f0-410c-b50b-e7462833869d None None] Provisioning complete for port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:49.342285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a11066ac-12f0-410c-b50b-e7462833869d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.353303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.391323 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a11066ac-12f0-410c-b50b-e7462833869d None None] Port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:49.416585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da8b3b7b-83c0-4db2-b21e-e7c03cc477d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (102d8624-6c90-4258-9fca-c0d93dc5be47), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.419161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-da8b3b7b-83c0-4db2-b21e-e7c03cc477d9 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.420319 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-da8b3b7b-83c0-4db2-b21e-e7c03cc477d9 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/102d8624-6c90-4258-9fca-c0d93dc5be47 HTTP/1.1" status: 204 len: 168 time: 0.9420393 Mar 24 02:17:49.464723 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da8b3b7b-83c0-4db2-b21e-e7c03cc477d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=102d8624-6c90-4258-9fca-c0d93dc5be47,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:49.476363 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.ipam_backend_mixin [None req-506a7292-0f8e-495d-9893-8cc1406a00a3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 944064c8-2071-42aa-b2a3-4fdbf39aa8ed (CIDR: 2001:db8::/64) Mar 24 02:17:49.492253 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-506a7292-0f8e-495d-9893-8cc1406a00a3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:17:49.492253 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-506a7292-0f8e-495d-9893-8cc1406a00a3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:49.507353 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Router c4a3de90-537a-4022-b079-9feeedff6892 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:49.553292 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbb8fd4b-335e-42e8-ad81-1d2905bbda3d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:49.560417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bbb8fd4b-335e-42e8-ad81-1d2905bbda3d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.565128 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bbb8fd4b-335e-42e8-ad81-1d2905bbda3d tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/8f5947fe-add3-477c-9328-aaba7d270bfd HTTP/1.1" status: 200 len: 886 time: 1.8985853 Mar 24 02:17:49.565417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ca88482-40cb-4086-85f1-9e75560169f2 None None] Sync routers for ids ['8f5947fe-add3-477c-9328-aaba7d270bfd'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:49.570363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60958) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:49.580828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ca88482-40cb-4086-85f1-9e75560169f2 None None] Routers {'8f5947fe-add3-477c-9328-aaba7d270bfd'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:49.582150 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6ca88482-40cb-4086-85f1-9e75560169f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['8f5947fe-add3-477c-9328-aaba7d270bfd'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:49.628194 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6ca88482-40cb-4086-85f1-9e75560169f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:49.645996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-894115a2-2d72-4cd5-bb70-119e0751d7af req-e043d87b-7fb6-4da1-a8c8-c4ec090085b4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:49.648117 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-894115a2-2d72-4cd5-bb70-119e0751d7af req-e043d87b-7fb6-4da1-a8c8-c4ec090085b4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 932 time: 0.2776823 Mar 24 02:17:49.650572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ca88482-40cb-4086-85f1-9e75560169f2 None None] Routers {'8f5947fe-add3-477c-9328-aaba7d270bfd'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:49.651752 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-506a7292-0f8e-495d-9893-8cc1406a00a3 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.7959471 Mar 24 02:17:49.653004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6ca88482-40cb-4086-85f1-9e75560169f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['8f5947fe-add3-477c-9328-aaba7d270bfd'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:49.660195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60960) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:49.673374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b2b6aaa1-3ee0-4fed-b443-41cac001d4ec tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:49.718410 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6ca88482-40cb-4086-85f1-9e75560169f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:49.719770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ca88482-40cb-4086-85f1-9e75560169f2 None None] The sync data for ids ['8f5947fe-add3-477c-9328-aaba7d270bfd'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:49.766007 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Deleting port d9fb4ae9-5855-4bac-9967-ed51b20414e0 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:49.766558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.848069 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:49.857334 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-55833f86-ff4c-4d5c-aa93-5cdeff552229 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "PUT /v2.0/routers/c4a3de90-537a-4022-b079-9feeedff6892/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1833687 Mar 24 02:17:49.861665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60964) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:49.865274 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] Sync routers for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:49.881953 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:49.882976 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:49.897720 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-894115a2-2d72-4cd5-bb70-119e0751d7af req-45a09396-cbc3-4a88-bf6c-754912f063ea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2125201 Mar 24 02:17:49.920050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60966) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:49.922368 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Deleting port 143de4fa-33eb-4099-8d8a-9fc761177eba {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:49.922743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.938026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f19fc98-2e53-4047-8c72-594e14e4b7aa tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Deleting subnet 44e52247-2dfd-4416-b8c9-7ab69363e1f2 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:49.949819 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-39cffb24-c02a-4458-ab81-2d19f2591e7a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/routers/8f5947fe-add3-477c-9328-aaba7d270bfd HTTP/1.1" status: 200 len: 886 time: 0.3761754 Mar 24 02:17:49.953423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60968) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:49.953581 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f19fc98-2e53-4047-8c72-594e14e4b7aa tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for subnet (44e52247-2dfd-4416-b8c9-7ab69363e1f2), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:49.991094 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.005154 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:17:50.005557 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40d732ef-4e1a-4c92-8a25-8fc0b6fc6d39 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.011259 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Calling delete_port for d9fb4ae9-5855-4bac-9967-ed51b20414e0 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:50.014381 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f19fc98-2e53-4047-8c72-594e14e4b7aa tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (44e52247-2dfd-4416-b8c9-7ab69363e1f2), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.048576 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7ad6b30f-2a12-4e1c-a829-189c2446a27f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=8f5947fe-add3-477c-9328-aaba7d270bfd HTTP/1.1" status: 200 len: 205 time: 0.0865319 Mar 24 02:17:50.049568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60970) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:50.078567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2b6aaa1-3ee0-4fed-b443-41cac001d4ec tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:50.082417 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2b6aaa1-3ee0-4fed-b443-41cac001d4ec tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.202829 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:17:47Z', 'revision_number': 5, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:50.221157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.229024 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] Checking router: c4a3de90-537a-4022-b079-9feeedff6892 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:17:50.237782 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:17:50.237963 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] Routers {'c4a3de90-537a-4022-b079-9feeedff6892'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:50.238449 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['c4a3de90-537a-4022-b079-9feeedff6892'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:50.264500 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Publish callbacks [] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.273170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Calling delete_port for 143de4fa-33eb-4099-8d8a-9fc761177eba owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:50.285274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f19fc98-2e53-4047-8c72-594e14e4b7aa tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (44e52247-2dfd-4416-b8c9-7ab69363e1f2), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.310928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Transition to ACTIVE for port object 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:17:50.319904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (8f5947fe-add3-477c-9328-aaba7d270bfd), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.325236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.349373 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] Set router c4a3de90-537a-4022-b079-9feeedff6892 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:17:50.373153 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.ipam_backend_mixin [None req-b2b6aaa1-3ee0-4fed-b443-41cac001d4ec tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Validation for CIDR: 2001:db8:0:1::/64 failed - overlaps with subnet 824de909-ed6d-42eb-91e2-7f0e51862ab0 (CIDR: 2001:db8:0:1::/64) Mar 24 02:17:50.406545 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-b2b6aaa1-3ee0-4fed-b443-41cac001d4ec tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:17:50.407049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b2b6aaa1-3ee0-4fed-b443-41cac001d4ec tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:17:50.451873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40d732ef-4e1a-4c92-8a25-8fc0b6fc6d39 admin admin] Publish callbacks [] for security_group (a777a4e7-8d85-475d-807a-933c917eae76), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.466302 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b2b6aaa1-3ee0-4fed-b443-41cac001d4ec tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 428 time: 0.8050086 Mar 24 02:17:50.476541 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-40d732ef-4e1a-4c92-8a25-8fc0b6fc6d39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a777a4e7-8d85-475d-807a-933c917eae76), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.480166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60972) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:50.484080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Pushing event updated for resources: {'Port': ['ID=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:50.491583 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'subnet': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'cidr': '2001:db8:0:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:2::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:50.541067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f19fc98-2e53-4047-8c72-594e14e4b7aa tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (44e52247-2dfd-4416-b8c9-7ab69363e1f2), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.564585 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:17:47Z', 'revision_number': 5, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:50.609079 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6aaa7ad3-4bcc-4264-b040-51ba8019bfa9 None None] The sync data for ids ['c4a3de90-537a-4022-b079-9feeedff6892'] in dv-neutron-834874-3-hyperv is: [{'id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1988193927', 'tenant_id': '615b57fe01bd445f87fb9f1a86851430', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112'}], 'enable_snat': True}, 'gw_port_id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:13:52Z', 'updated_at': '2022-03-24T02:17:47Z', 'revision_number': 5, 'project_id': '615b57fe01bd445f87fb9f1a86851430', 'gw_port': {'id': '276b4a0e-938f-4560-8acb-b1e286da1948', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:17:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4a3de90-537a-4022-b079-9feeedff6892', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:13:54Z', 'updated_at': '2022-03-24T02:14:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:50.669036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40d732ef-4e1a-4c92-8a25-8fc0b6fc6d39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a777a4e7-8d85-475d-807a-933c917eae76,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:50.680757 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-40d732ef-4e1a-4c92-8a25-8fc0b6fc6d39 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=1e300a88993f4835a9544e33c954b846&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7544560 Mar 24 02:17:50.691286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 60974) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:50.900390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f19fc98-2e53-4047-8c72-594e14e4b7aa tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.906825 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1f19fc98-2e53-4047-8c72-594e14e4b7aa tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "DELETE /v2.0/subnets/44e52247-2dfd-4416-b8c9-7ab69363e1f2 HTTP/1.1" status: 204 len: 168 time: 1.0394607 Mar 24 02:17:50.910726 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a69eca23-5d22-416b-9d93-9ccae0e7fd37 None None] Network 1ff12164-ce98-442e-81ee-e22f78c3a0ff requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:50.911541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f19fc98-2e53-4047-8c72-594e14e4b7aa tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event deleted for resources: {'Subnet': ['ID=44e52247-2dfd-4416-b8c9-7ab69363e1f2,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:50.919895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_gateway (8f5947fe-add3-477c-9328-aaba7d270bfd), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:50.924005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60976) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:50.972909 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d9fb4ae9-5855-4bac-9967-ed51b20414e0), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.054095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event deleted for resources: {'Port': ['ID=d9fb4ae9-5855-4bac-9967-ed51b20414e0,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:51.139418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Attempting to bind port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:51.139754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Attempting to bind port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:51.140092 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Attempting to bind port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 on network 0a3a0bb4-4db4-4907-a006-67d97a634086 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:51.186615 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for router (c4a3de90-537a-4022-b079-9feeedff6892), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.193170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b6051ad-3505-49a5-ac15-8fac0d047c50 None None] DHCP port deletion for 1ff12164-ce98-442e-81ee-e22f78c3a0ff request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:51.204265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 on network 0a3a0bb4-4db4-4907-a006-67d97a634086 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:51.204889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Attempting to bind port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 on network 0a3a0bb4-4db4-4907-a006-67d97a634086 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:51.238786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6530c2d-be6c-495b-8c3f-8a067a2f8255 admin admin] Publish callbacks [] for security_group (a777a4e7-8d85-475d-807a-933c917eae76), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.254062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:51.254395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Checking segment: {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:51.254954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Bound using segment: {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:51.255394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Bound port: 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:51.255764 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.268732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Made reservation on behalf of 7b8dee850d65489ba8498576f69edde9 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:51.270699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8b6051ad-3505-49a5-ac15-8fac0d047c50 None None] Deleting port c463af66-3216-4df8-b1fe-f12f14f0aa63 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:51.271089 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8b6051ad-3505-49a5-ac15-8fac0d047c50 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.272869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.282885 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (f16cab9e-4385-4fd9-9ce1-9edfe837db44), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.323638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 4b402ffa-02a1-4f99-bd85-8fa8f6518238 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:51.323979 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4b402ffa-02a1-4f99-bd85-8fa8f6518238), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.350535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (143de4fa-33eb-4099-8d8a-9fc761177eba), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.367505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8b6051ad-3505-49a5-ac15-8fac0d047c50 None None] For port c463af66-3216-4df8-b1fe-f12f14f0aa63, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=c463af66-3216-4df8-b1fe-f12f14f0aa63,segment=NetworkSegment(b448347f-bded-4382-8e80-6253172a6577),segment_id=b448347f-bded-4382-8e80-6253172a6577)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:51.369006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8b6051ad-3505-49a5-ac15-8fac0d047c50 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.374863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6530c2d-be6c-495b-8c3f-8a067a2f8255 admin admin] Publish callbacks [] for security_group (a777a4e7-8d85-475d-807a-933c917eae76), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.390852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8b6051ad-3505-49a5-ac15-8fac0d047c50 None None] Calling delete_port for c463af66-3216-4df8-b1fe-f12f14f0aa63 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:51.459025 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Port': ['ID=143de4fa-33eb-4099-8d8a-9fc761177eba,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:51.493055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4b402ffa-02a1-4f99-bd85-8fa8f6518238), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.504358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8b6051ad-3505-49a5-ac15-8fac0d047c50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (c463af66-3216-4df8-b1fe-f12f14f0aa63), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.507822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb25e456-5a0d-4ecf-b01e-99ff5e0e658e req-4eae14fe-14d1-4005-8713-ce2f6f554b69 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:51.509722 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fb25e456-5a0d-4ecf-b01e-99ff5e0e658e req-4eae14fe-14d1-4005-8713-ce2f6f554b69 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 944 time: 0.4302742 Mar 24 02:17:51.513363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 4b402ffa-02a1-4f99-bd85-8fa8f6518238 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:51.536839 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b6051ad-3505-49a5-ac15-8fac0d047c50 None None] Pushing event deleted for resources: {'Port': ['ID=c463af66-3216-4df8-b1fe-f12f14f0aa63,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:51.552834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b6051ad-3505-49a5-ac15-8fac0d047c50 None None] No DVR routers for this DVR port c463af66-3216-4df8-b1fe-f12f14f0aa63 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:51.711319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (654913c1-1089-45d5-a685-61f2d36bf588), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.719082 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fb25e456-5a0d-4ecf-b01e-99ff5e0e658e req-e2b62a4a-025d-4b95-bdbe-f3ce3a8ad26a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1983752 Mar 24 02:17:51.727816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] For port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:51.733165 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] For port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:51.751207 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a241a0ee-a158-4025-8b7b-6e9767042270 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:51.764415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for router_gateway (c4a3de90-537a-4022-b079-9feeedff6892), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.775201 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: a241a0ee-a158-4025-8b7b-6e9767042270 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:51.775570 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a241a0ee-a158-4025-8b7b-6e9767042270 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:51.775975 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c463af66-3216-4df8-b1fe-f12f14f0aa63 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:51.784984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6530c2d-be6c-495b-8c3f-8a067a2f8255 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a777a4e7-8d85-475d-807a-933c917eae76), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.788358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d6530c2d-be6c-495b-8c3f-8a067a2f8255 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.792152 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d6530c2d-be6c-495b-8c3f-8a067a2f8255 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/a777a4e7-8d85-475d-807a-933c917eae76 HTTP/1.1" status: 204 len: 168 time: 1.0920885 Mar 24 02:17:51.796459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: c463af66-3216-4df8-b1fe-f12f14f0aa63 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:51.796813 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device c463af66-3216-4df8-b1fe-f12f14f0aa63 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:51.824863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.836727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6530c2d-be6c-495b-8c3f-8a067a2f8255 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a777a4e7-8d85-475d-807a-933c917eae76,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:51.838090 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Router f16cab9e-4385-4fd9-9ce1-9edfe837db44 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:51.851203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:51.851916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:51.853461 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] 10.222.0.30 "PUT /v2.0/ports/1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 HTTP/1.1" status: 200 len: 1094 time: 2.6515777 Mar 24 02:17:51.873171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5', 'tag': '1ee59cd7-c2ab-4bdd-aae1-75d878279ee1'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:17:51.875689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8" -d '{"events": [{"name": "network-changed", "server_uuid": "8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5", "tag": "1ee59cd7-c2ab-4bdd-aae1-75d878279ee1"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:17:52.021120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:17:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f236cd3f-2db4-48c5-9601-d701f15ffe4b x-openstack-request-id: req-f236cd3f-2db4-48c5-9601-d701f15ffe4b {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:17:52.021268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:52.021421 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5", "tag": "1ee59cd7-c2ab-4bdd-aae1-75d878279ee1", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:17:52.021692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-f236cd3f-2db4-48c5-9601-d701f15ffe4b {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:17:52.022356 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-f236cd3f-2db4-48c5-9601-d701f15ffe4b'] response: {'name': 'network-changed', 'server_uuid': '8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5', 'tag': '1ee59cd7-c2ab-4bdd-aae1-75d878279ee1', 'status': 'completed', 'code': 200} Mar 24 02:17:52.033232 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a638dc2f-7096-486e-a2d6-6b6c4bce2936 None None] Sync routers for ids ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:52.040007 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-60d114f1-a71e-415a-9cb7-919eb4ed2220 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "PUT /v2.0/routers/f16cab9e-4385-4fd9-9ce1-9edfe837db44/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6418581 Mar 24 02:17:52.045861 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60986) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:52.048895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a638dc2f-7096-486e-a2d6-6b6c4bce2936 None None] Routers {'f16cab9e-4385-4fd9-9ce1-9edfe837db44'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:52.049623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a638dc2f-7096-486e-a2d6-6b6c4bce2936 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:52.066741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c710bd-e0f9-46d0-b429-3d87e683ef24 service neutron] Pushing event updated for resources: {'Port': ['ID=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:52.109502 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a638dc2f-7096-486e-a2d6-6b6c4bce2936 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:52.131330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a638dc2f-7096-486e-a2d6-6b6c4bce2936 None None] Routers {'f16cab9e-4385-4fd9-9ce1-9edfe837db44'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:52.131785 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-0cb62ba5-182e-4c67-ac4d-7b5910bec401 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] show failed (client error): The resource could not be found. Mar 24 02:17:52.132368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a638dc2f-7096-486e-a2d6-6b6c4bce2936 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:52.137014 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0cb62ba5-182e-4c67-ac4d-7b5910bec401 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "GET /v2.0/routers/tempest-non_exist_router-1772772091 HTTP/1.1" status: 404 len: 335 time: 0.0816362 Mar 24 02:17:52.137291 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Router 654913c1-1089-45d5-a685-61f2d36bf588 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:17:52.137615 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60988) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:52.146964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8968675a-82a1-4a5f-8784-b811836bac87 req-f7986d5d-d8d6-4183-a096-67e56a04dc04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:52.148256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Deleting port 276b4a0e-938f-4560-8acb-b1e286da1948 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:52.148715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.149366 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-f7986d5d-d8d6-4183-a096-67e56a04dc04 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 1128 time: 0.2185357 Mar 24 02:17:52.172050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2f7c483c-8863-4967-8324-cd0e8df1004c tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Request body: {'router': {'name': 'new_name'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:52.268724 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-2f7c483c-8863-4967-8324-cd0e8df1004c tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] update failed (client error): The resource could not be found. Mar 24 02:17:52.274594 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2f7c483c-8863-4967-8324-cd0e8df1004c tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "PUT /v2.0/routers/tempest-non_exist_router-1958826530 HTTP/1.1" status: 404 len: 335 time: 0.1151202 Mar 24 02:17:52.275386 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60994) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:52.283531 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:17:52.288193 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-4533a20d-cc40-4cd7-b360-075550866e52 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.21&port_id=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 HTTP/1.1" status: 200 len: 217 time: 0.1293693 Mar 24 02:17:52.296377 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55375dea-f91a-4d6b-99c0-bdcb6d9540bf None None] Sync routers for ids ['654913c1-1089-45d5-a685-61f2d36bf588'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:17:52.303805 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-12780b70-ccd8-4c10-a66c-77ca0e26fea1 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "PUT /v2.0/routers/654913c1-1089-45d5-a685-61f2d36bf588/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6439776 Mar 24 02:17:52.318290 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55375dea-f91a-4d6b-99c0-bdcb6d9540bf None None] Routers {'654913c1-1089-45d5-a685-61f2d36bf588'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:52.319167 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-55375dea-f91a-4d6b-99c0-bdcb6d9540bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['654913c1-1089-45d5-a685-61f2d36bf588'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:52.322288 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 60996) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:52.341685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (4b402ffa-02a1-4f99-bd85-8fa8f6518238), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.388356 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-55375dea-f91a-4d6b-99c0-bdcb6d9540bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:52.392792 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (b40ea1e4-8e4c-493d-bab3-f8f91b5462a6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.409501 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55375dea-f91a-4d6b-99c0-bdcb6d9540bf None None] Routers {'654913c1-1089-45d5-a685-61f2d36bf588'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:17:52.410307 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-55375dea-f91a-4d6b-99c0-bdcb6d9540bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:17:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['654913c1-1089-45d5-a685-61f2d36bf588'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:52.415445 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a638dc2f-7096-486e-a2d6-6b6c4bce2936 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:52.416344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a638dc2f-7096-486e-a2d6-6b6c4bce2936 None None] The sync data for ids ['f16cab9e-4385-4fd9-9ce1-9edfe837db44'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:52.419863 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-f2c2dd19-3855-4790-a80d-92cab6ee89b2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] show failed (client error): The resource could not be found. Mar 24 02:17:52.426786 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f2c2dd19-3855-4790-a80d-92cab6ee89b2 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "GET /v2.0/routers/tempest-non_exist_router-87260538 HTTP/1.1" status: 404 len: 333 time: 0.0952280 Mar 24 02:17:52.427825 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=4b402ffa-02a1-4f99-bd85-8fa8f6518238,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:52.432656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32770) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:52.439663 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-20d82eeb-7394-4d7e-9d62-9ea16d1cc793 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Request body: {'router': {'name': 'new_name'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:52.464988 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-55375dea-f91a-4d6b-99c0-bdcb6d9540bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:52.465923 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55375dea-f91a-4d6b-99c0-bdcb6d9540bf None None] The sync data for ids ['654913c1-1089-45d5-a685-61f2d36bf588'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:17:52.485911 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-20d82eeb-7394-4d7e-9d62-9ea16d1cc793 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] update failed (client error): The resource could not be found. Mar 24 02:17:52.487009 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-20d82eeb-7394-4d7e-9d62-9ea16d1cc793 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "PUT /v2.0/routers/tempest-non_exist_router-28920002 HTTP/1.1" status: 404 len: 333 time: 0.0514731 Mar 24 02:17:52.494602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32772) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:52.505008 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:52.512550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8968675a-82a1-4a5f-8784-b811836bac87 req-96cb31cf-0076-479e-8e24-6dd900bd6bbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:52.514016 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-96cb31cf-0076-479e-8e24-6dd900bd6bbf service neutron] 10.222.0.30 "GET /v2.0/subnets?id=47e13ca4-a1b5-4f9e-95ce-b93533455f10 HTTP/1.1" status: 200 len: 838 time: 0.2036812 Mar 24 02:17:52.516207 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-cd3cddc4-0075-4c6e-98db-b3fcc42a6114 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Deleting subnet b172e891-e367-4684-b354-2c6066a1ffe1 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:52.538586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cd3cddc4-0075-4c6e-98db-b3fcc42a6114 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for subnet (b172e891-e367-4684-b354-2c6066a1ffe1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.539048 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:52.551964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9b9616c-6348-4e49-9108-61b88267c0cc None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:52.577394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:52.577984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.591852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] For port 276b4a0e-938f-4560-8acb-b1e286da1948, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=276b4a0e-938f-4560-8acb-b1e286da1948,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:52.592204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.594770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Subnet': ['ID=b40ea1e4-8e4c-493d-bab3-f8f91b5462a6,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:52.612287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cd3cddc4-0075-4c6e-98db-b3fcc42a6114 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (b172e891-e367-4684-b354-2c6066a1ffe1), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.619364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Calling delete_port for 276b4a0e-938f-4560-8acb-b1e286da1948 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:52.631389 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bc320daa-78f2-4ccc-8642-0c094ac72f81 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 2.1412659 Mar 24 02:17:52.639014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32776) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:52.644416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (8f5947fe-add3-477c-9328-aaba7d270bfd), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.659650 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-258990001', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'b40ea1e4-8e4c-493d-bab3-f8f91b5462a6'}], 'security_groups': ['1cc62c9b-7561-4b03-b819-d7e9a54d2b3e', '3eafdaf8-64e4-42b4-a2ca-1b610621f713']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:52.697222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-9c370d93-72ba-4132-8e61-0235ca2283fd tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Deleting subnet e1b9c951-d7a2-4df4-8544-dda219bf68fa {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:52.707164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8968675a-82a1-4a5f-8784-b811836bac87 req-a218f06e-6404-4288-b53e-c5b4b0990758 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:52.708671 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-a218f06e-6404-4288-b53e-c5b4b0990758 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=0a3a0bb4-4db4-4907-a006-67d97a634086&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1215 time: 0.1711447 Mar 24 02:17:52.709366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c370d93-72ba-4132-8e61-0235ca2283fd tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (e1b9c951-d7a2-4df4-8544-dda219bf68fa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.782707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50361e9a-cd17-422d-9e42-6746f11a88c4 None None] Update dhcp port {'port': {'network_id': '8ec9fea4-b38d-4612-9d1d-87145ce2366f', 'fixed_ips': [{'subnet_id': '824de909-ed6d-42eb-91e2-7f0e51862ab0', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': '944064c8-2071-42aa-b2a3-4fdbf39aa8ed', 'ip_address': '2001:db8::2'}, {'subnet_id': 'b40ea1e4-8e4c-493d-bab3-f8f91b5462a6'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': 'a556ca5d-ed98-488b-8079-7f9b8d39c082'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:17:52.842934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (8f5947fe-add3-477c-9328-aaba7d270bfd), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.844805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-50361e9a-cd17-422d-9e42-6746f11a88c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.848429 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (8f5947fe-add3-477c-9328-aaba7d270bfd), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:52.932821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c370d93-72ba-4132-8e61-0235ca2283fd tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (e1b9c951-d7a2-4df4-8544-dda219bf68fa), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.055660 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-c1fcfb3c-694d-43ee-a964-97d3245b8464 service neutron] 10.222.0.30 "GET /v2.0/networks/0a3a0bb4-4db4-4907-a006-67d97a634086?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3074548 Mar 24 02:17:53.068316 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-50361e9a-cd17-422d-9e42-6746f11a88c4 None None] Allocated IP 2001:db8:0:2::2 (8ec9fea4-b38d-4612-9d1d-87145ce2366f/b40ea1e4-8e4c-493d-bab3-f8f91b5462a6/a556ca5d-ed98-488b-8079-7f9b8d39c082) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:53.077443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d3c50c5-61e3-4821-b204-55c5a60ab4d8 req-e54dc116-35fa-4205-9f79-4859b7e15194 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:53.079025 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4d3c50c5-61e3-4821-b204-55c5a60ab4d8 req-e54dc116-35fa-4205-9f79-4859b7e15194 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 944 time: 0.2519965 Mar 24 02:17:53.212586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-50361e9a-cd17-422d-9e42-6746f11a88c4 None None] For port a556ca5d-ed98-488b-8079-7f9b8d39c082, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a556ca5d-ed98-488b-8079-7f9b8d39c082,segment=NetworkSegment(90bce2cd-2d9e-4697-bef8-e219d1c040c9),segment_id=90bce2cd-2d9e-4697-bef8-e219d1c040c9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:53.221925 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8968675a-82a1-4a5f-8784-b811836bac87 req-721aecde-79a1-485c-9ddf-8184f9aae4c6 service neutron] 10.222.0.30 "GET /v2.0/networks/0a3a0bb4-4db4-4907-a006-67d97a634086?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1540229 Mar 24 02:17:53.223032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (8f5947fe-add3-477c-9328-aaba7d270bfd), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.223557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Fanout notify agent at l3_agent the message router_deleted on router 8f5947fe-add3-477c-9328-aaba7d270bfd {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:17:53.233266 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.234274 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cb14832b-c31c-4228-9d68-da60421e7e17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/8f5947fe-add3-477c-9328-aaba7d270bfd HTTP/1.1" status: 204 len: 168 time: 3.1837413 Mar 24 02:17:53.238691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32792) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:53.243522 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'network': {'name': 'tempest-RoutersTest-392236969'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:53.266826 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.281922 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cd3cddc4-0075-4c6e-98db-b3fcc42a6114 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (b172e891-e367-4684-b354-2c6066a1ffe1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.283247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c370d93-72ba-4132-8e61-0235ca2283fd tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (e1b9c951-d7a2-4df4-8544-dda219bf68fa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.292046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-50361e9a-cd17-422d-9e42-6746f11a88c4 None None] Publish callbacks [] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.300673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-50361e9a-cd17-422d-9e42-6746f11a88c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.356334 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:53.366628 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.383696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50361e9a-cd17-422d-9e42-6746f11a88c4 None None] Pushing event updated for resources: {'Port': ['ID=a556ca5d-ed98-488b-8079-7f9b8d39c082,revision_number=7']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:53.422422 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4d3c50c5-61e3-4821-b204-55c5a60ab4d8 req-4af5a77d-edbe-4da5-8566-289b039f23ef tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1957481 Mar 24 02:17:53.463431 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cd3cddc4-0075-4c6e-98db-b3fcc42a6114 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (b172e891-e367-4684-b354-2c6066a1ffe1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.500649 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-0fa217ef-072f-4925-93d9-196f60eafee5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:53.502219 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-0fa217ef-072f-4925-93d9-196f60eafee5 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 1128 time: 0.1904678 Mar 24 02:17:53.505992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c370d93-72ba-4132-8e61-0235ca2283fd tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (e1b9c951-d7a2-4df4-8544-dda219bf68fa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.513630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3cddc4-0075-4c6e-98db-b3fcc42a6114 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event deleted for resources: {'Subnet': ['ID=b172e891-e367-4684-b354-2c6066a1ffe1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:53.515751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 120} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:53.527272 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cd3cddc4-0075-4c6e-98db-b3fcc42a6114 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.531802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce97f5ba-2a4f-4a5e-bf4b-665315b1b520 None None] Network 9a1fcc47-24d9-4303-8c86-1aaa9507bb56 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:53.541591 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cd3cddc4-0075-4c6e-98db-b3fcc42a6114 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "DELETE /v2.0/subnets/b172e891-e367-4684-b354-2c6066a1ffe1 HTTP/1.1" status: 204 len: 168 time: 1.2582321 Mar 24 02:17:53.545361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32800) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:53.562252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (29ff5209-ca7a-4e4b-b3e0-ef87894e6465), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.562822 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added segment 29ff5209-ca7a-4e4b-b3e0-ef87894e6465 of type vlan for network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 Mar 24 02:17:53.593344 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (276b4a0e-938f-4560-8acb-b1e286da1948), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.654487 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01608f06-b349-4875-9aa9-6bf7ab5131ce None None] Network 14ac1797-9f65-495f-b6f7-83aedcd8aef1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:53.708530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (8e4318a8-0a0c-46ae-a03a-45d69e971ed8), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.751872 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event deleted for resources: {'Port': ['ID=276b4a0e-938f-4560-8acb-b1e286da1948,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:53.799527 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a556ca5d-ed98-488b-8079-7f9b8d39c082 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:53.803742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-011b5200-1d51-44b7-890f-6aec1f873b6e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Deleting subnet 09ba771b-69d3-44d3-a19c-28d37029db41 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:53.812738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-011b5200-1d51-44b7-890f-6aec1f873b6e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for subnet (09ba771b-69d3-44d3-a19c-28d37029db41), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.866230 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32804) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:53.872918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:53.873466 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.922686 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (8e4318a8-0a0c-46ae-a03a-45d69e971ed8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.933121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:53.934328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:53.947305 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-379eaf31-2db4-48b4-8194-31e0c7a15e4f None None] DHCP port deletion for 9a1fcc47-24d9-4303-8c86-1aaa9507bb56 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:53.953261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddcae337-983c-4e96-822b-5aa652395e63 None None] DHCP port deletion for 14ac1797-9f65-495f-b6f7-83aedcd8aef1 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:54.037645 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Network': ['ID=8e4318a8-0a0c-46ae-a03a-45d69e971ed8,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:54.054772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-011b5200-1d51-44b7-890f-6aec1f873b6e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (09ba771b-69d3-44d3-a19c-28d37029db41), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.082302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (c4a3de90-537a-4022-b079-9feeedff6892), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.088157 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:54.131606 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c370d93-72ba-4132-8e61-0235ca2283fd tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Subnet': ['ID=e1b9c951-d7a2-4df4-8544-dda219bf68fa,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:54.146260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9c370d93-72ba-4132-8e61-0235ca2283fd tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.150044 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9c370d93-72ba-4132-8e61-0235ca2283fd tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/subnets/e1b9c951-d7a2-4df4-8544-dda219bf68fa HTTP/1.1" status: 204 len: 168 time: 1.6495645 Mar 24 02:17:54.184472 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:54.193622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (c4a3de90-537a-4022-b079-9feeedff6892), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.196114 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for router_controller (c4a3de90-537a-4022-b079-9feeedff6892), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.215481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-5325dfdf-ea12-4d00-abfb-4969a192282d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:54.220231 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-5325dfdf-ea12-4d00-abfb-4969a192282d service neutron] 10.222.0.30 "GET /v2.0/networks?id=0a3a0bb4-4db4-4907-a006-67d97a634086 HTTP/1.1" status: 200 len: 897 time: 0.7114885 Mar 24 02:17:54.224672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32808) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:54.229466 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ddcae337-983c-4e96-822b-5aa652395e63 None None] Deleting port 708a1479-0ee0-4234-a291-4d08e9e69c9c {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:54.230392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ddcae337-983c-4e96-822b-5aa652395e63 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.244412 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-379eaf31-2db4-48b4-8194-31e0c7a15e4f None None] Deleting port 3393b423-b7b7-475b-9467-175cb41d7b9c {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:54.244852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-379eaf31-2db4-48b4-8194-31e0c7a15e4f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.249199 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-96bc39cf-7dc7-498b-9040-bb037db01374 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.0094590 Mar 24 02:17:54.258441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-test-network-1667454065'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:54.262610 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32810) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:54.274930 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'subnet': {'network_id': '8e4318a8-0a0c-46ae-a03a-45d69e971ed8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:54.308450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (c4a3de90-537a-4022-b079-9feeedff6892), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.308998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Fanout notify agent at l3_agent the message router_deleted on router c4a3de90-537a-4022-b079-9feeedff6892 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:17:54.349323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.350590 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3e8136f0-8d6c-402e-be2a-b7efd585f818 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "DELETE /v2.0/routers/c4a3de90-537a-4022-b079-9feeedff6892 HTTP/1.1" status: 204 len: 168 time: 3.4253533 Mar 24 02:17:54.351372 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-5e3fba78-61ab-4a32-88a3-56eab91a212e service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.21&port_id=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 HTTP/1.1" status: 200 len: 217 time: 0.1145189 Mar 24 02:17:54.356222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32812) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:54.370684 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Made reservation on behalf of 6ee3fe330bf54d91be862188aace04d6 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:54.375143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.379646 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ddcae337-983c-4e96-822b-5aa652395e63 None None] For port 708a1479-0ee0-4234-a291-4d08e9e69c9c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=708a1479-0ee0-4234-a291-4d08e9e69c9c,segment=NetworkSegment(b26d6640-afc6-4ec4-9700-0407ae9ecfa0),segment_id=b26d6640-afc6-4ec4-9700-0407ae9ecfa0)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:54.380046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ddcae337-983c-4e96-822b-5aa652395e63 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.397303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-379eaf31-2db4-48b4-8194-31e0c7a15e4f None None] For port 3393b423-b7b7-475b-9467-175cb41d7b9c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3393b423-b7b7-475b-9467-175cb41d7b9c,segment=NetworkSegment(4818dd34-96c0-484c-b6b9-61dc5ea9b365),segment_id=4818dd34-96c0-484c-b6b9-61dc5ea9b365)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:54.397593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-379eaf31-2db4-48b4-8194-31e0c7a15e4f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.409485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ddcae337-983c-4e96-822b-5aa652395e63 None None] Calling delete_port for 708a1479-0ee0-4234-a291-4d08e9e69c9c owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:54.419712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.424106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-379eaf31-2db4-48b4-8194-31e0c7a15e4f None None] Calling delete_port for 3393b423-b7b7-475b-9467-175cb41d7b9c owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:54.515502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-011b5200-1d51-44b7-890f-6aec1f873b6e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (09ba771b-69d3-44d3-a19c-28d37029db41), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.581175 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ddcae337-983c-4e96-822b-5aa652395e63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (708a1479-0ee0-4234-a291-4d08e9e69c9c), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.612166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-379eaf31-2db4-48b4-8194-31e0c7a15e4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (3393b423-b7b7-475b-9467-175cb41d7b9c), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.613163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:54.616866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.625177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (14ac1797-9f65-495f-b6f7-83aedcd8aef1), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.649749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddcae337-983c-4e96-822b-5aa652395e63 None None] No DVR routers for this DVR port 708a1479-0ee0-4234-a291-4d08e9e69c9c on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:54.664617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcae337-983c-4e96-822b-5aa652395e63 None None] Pushing event deleted for resources: {'Port': ['ID=708a1479-0ee0-4234-a291-4d08e9e69c9c,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:54.671068 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-27561362-5a9c-4631-becf-ae3818457c6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:54.672537 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-27561362-5a9c-4631-becf-ae3818457c6e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=47e13ca4-a1b5-4f9e-95ce-b93533455f10 HTTP/1.1" status: 200 len: 838 time: 0.3076503 Mar 24 02:17:54.697372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-379eaf31-2db4-48b4-8194-31e0c7a15e4f None None] Pushing event deleted for resources: {'Port': ['ID=3393b423-b7b7-475b-9467-175cb41d7b9c,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:54.708835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks [] for security_group (69f00836-6a91-467e-baf7-88e4c46a5b9e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.710586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-379eaf31-2db4-48b4-8194-31e0c7a15e4f None None] No DVR routers for this DVR port 3393b423-b7b7-475b-9467-175cb41d7b9c on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:54.714223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-27faac8f-db59-49a8-8097-ddba76c78472 None None] Provisioning complete for port aee2f7ee-569a-4b32-9981-c7cefe350ef1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:54.714703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-27faac8f-db59-49a8-8097-ddba76c78472 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.723559 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-011b5200-1d51-44b7-890f-6aec1f873b6e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (09ba771b-69d3-44d3-a19c-28d37029db41), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.729918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (69f00836-6a91-467e-baf7-88e4c46a5b9e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.752875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (1ff12164-ce98-442e-81ee-e22f78c3a0ff), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.753798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-27faac8f-db59-49a8-8097-ddba76c78472 None None] Port aee2f7ee-569a-4b32-9981-c7cefe350ef1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:54.765635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-27faac8f-db59-49a8-8097-ddba76c78472 None None] Provisioning complete for port ee36bd51-4117-478e-8b43-8b3b0ec9f517 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:54.766129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-27faac8f-db59-49a8-8097-ddba76c78472 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.783404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-011b5200-1d51-44b7-890f-6aec1f873b6e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event deleted for resources: {'Subnet': ['ID=09ba771b-69d3-44d3-a19c-28d37029db41,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:54.787921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-011b5200-1d51-44b7-890f-6aec1f873b6e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.791404 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-011b5200-1d51-44b7-890f-6aec1f873b6e tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "DELETE /v2.0/subnets/09ba771b-69d3-44d3-a19c-28d37029db41 HTTP/1.1" status: 204 len: 168 time: 1.2408428 Mar 24 02:17:54.799534 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32816) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:54.801301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1395077f-e35b-42d7-9a12-9062349ff382 None None] Network 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:54.809071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 130} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:17:54.819652 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Pushing event updated for resources: {'SecurityGroup': ['ID=69f00836-6a91-467e-baf7-88e4c46a5b9e,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:54.828984 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (cfbb7394-f014-4306-945c-f87e60c522b6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.829491 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Added segment cfbb7394-f014-4306-945c-f87e60c522b6 of type vlan for network 68479eb8-4769-40a2-a486-b1f8a55226e1 Mar 24 02:17:54.883343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-27faac8f-db59-49a8-8097-ddba76c78472 None None] Port ee36bd51-4117-478e-8b43-8b3b0ec9f517 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:54.903392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (68479eb8-4769-40a2-a486-b1f8a55226e1), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.917405 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-27faac8f-db59-49a8-8097-ddba76c78472 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:54.917782 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-27faac8f-db59-49a8-8097-ddba76c78472 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.981064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (68479eb8-4769-40a2-a486-b1f8a55226e1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:54.987107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:54.987739 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.041140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff27280-76ec-4be7-95dd-36a9844bf883 req-bb0bce15-0af1-449e-afc6-f7114616573d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:55.042775 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cff27280-76ec-4be7-95dd-36a9844bf883 req-bb0bce15-0af1-449e-afc6-f7114616573d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 944 time: 0.4437425 Mar 24 02:17:55.053675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (14ac1797-9f65-495f-b6f7-83aedcd8aef1), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.071099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-5e55d8a0-6797-45a8-9af1-b74b73c9c83d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:55.073434 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-5e55d8a0-6797-45a8-9af1-b74b73c9c83d service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=0a3a0bb4-4db4-4907-a006-67d97a634086&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1215 time: 0.3445044 Mar 24 02:17:55.077204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-27faac8f-db59-49a8-8097-ddba76c78472 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:55.083894 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 803 time: 1.2140944 Mar 24 02:17:55.093898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (9f9fea3e-31d0-443c-a06b-ff1b47b07b4c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.100833 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0e549d9-65fb-41bb-9806-c314969f5769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Pushing event updated for resources: {'Network': ['ID=68479eb8-4769-40a2-a486-b1f8a55226e1,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:55.105208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] DHCP port deletion for 7a2f9f0b-26c4-4ab6-b939-a934962cbf90 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:55.121300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (9a1fcc47-24d9-4303-8c86-1aaa9507bb56), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.139931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 68479eb8-4769-40a2-a486-b1f8a55226e1 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:17:55.157921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Subnet': ['ID=9f9fea3e-31d0-443c-a06b-ff1b47b07b4c,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:55.175706 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Checking segment: {'id': '29ff5209-ca7a-4e4b-b3e0-ef87894e6465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '8e4318a8-0a0c-46ae-a03a-45d69e971ed8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:55.176071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network hostable DHCP agents. Network: 8e4318a8-0a0c-46ae-a03a-45d69e971ed8, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:55.183986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Delete allocated IP 2001:db8::3b4 (8ec9fea4-b38d-4612-9d1d-87145ce2366f/944064c8-2071-42aa-b2a3-4fdbf39aa8ed) {{(pid=104037) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Mar 24 02:17:55.208777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:55.215076 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['14ac1797-9f65-495f-b6f7-83aedcd8aef1']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:55.223393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 8e4318a8-0a0c-46ae-a03a-45d69e971ed8) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:55.235336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae4f48c7-c990-43a1-a706-d89623ec66ec None None] Network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:55.239191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:55.240365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.263151 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6ddaa0c0-843f-48f0-9c7b-243d5940a1c7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9964240 Mar 24 02:17:55.265228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32822) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:55.268495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Allocated IP 2001:db8:0:2::ae (8ec9fea4-b38d-4612-9d1d-87145ce2366f/b40ea1e4-8e4c-493d-bab3-f8f91b5462a6/ee36bd51-4117-478e-8b43-8b3b0ec9f517) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:55.273451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ca1b8810-d7be-4106-8e21-834fc11072c8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-142698265', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:55.280048 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b26d6640-afc6-4ec4-9700-0407ae9ecfa0') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:55.280340 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b26d6640-afc6-4ec4-9700-0407ae9ecfa0') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:55.312807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (1ff12164-ce98-442e-81ee-e22f78c3a0ff), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.319479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (b26d6640-afc6-4ec4-9700-0407ae9ecfa0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.327023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ca1b8810-d7be-4106-8e21-834fc11072c8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (17fb882c-6eff-4650-ba6f-c10c720662b6), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.327023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ca1b8810-d7be-4106-8e21-834fc11072c8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (17fb882c-6eff-4650-ba6f-c10c720662b6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.327526 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Deleting port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:55.328454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.335729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32824) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:55.342403 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Request body: {'port': {'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1', 'binding:host_id': 'hv-neutron-8348', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-672507923'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:17:55.401608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Made reservation on behalf of c067301dc45b4f2aba081cc64b7888c1 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:17:55.405714 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.413242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b26d6640-afc6-4ec4-9700-0407ae9ecfa0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.416035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ca1b8810-d7be-4106-8e21-834fc11072c8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (17fb882c-6eff-4650-ba6f-c10c720662b6), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.416469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1ff12164-ce98-442e-81ee-e22f78c3a0ff']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:55.417506 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.418675 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] For port fe891a64-a3f4-4762-b1ed-ef0b04bfab73, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fe891a64-a3f4-4762-b1ed-ef0b04bfab73,segment=NetworkSegment(54d87ace-94bc-463b-8b4d-c0a6f71fd89c),segment_id=54d87ace-94bc-463b-8b4d-c0a6f71fd89c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:55.419147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.428841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ca1b8810-d7be-4106-8e21-834fc11072c8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (17fb882c-6eff-4650-ba6f-c10c720662b6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.434369 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cff27280-76ec-4be7-95dd-36a9844bf883 req-12d64559-8652-4ecf-a00a-c4a8bd9f1d77 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3738968 Mar 24 02:17:55.445658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b448347f-bded-4382-8e80-6253172a6577') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:55.445995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b448347f-bded-4382-8e80-6253172a6577') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:55.448006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:55.449124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Calling delete_port for fe891a64-a3f4-4762-b1ed-ef0b04bfab73 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:55.458340 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (b26d6640-afc6-4ec4-9700-0407ae9ecfa0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:55.467539 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:55.476354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ca1b8810-d7be-4106-8e21-834fc11072c8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.477716 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ca1b8810-d7be-4106-8e21-834fc11072c8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.2108669 Mar 24 02:17:55.480294 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32826) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:55.497492 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-8e4318a8-0a0c-46ae-a03a-45d69e971ed8', 'network_id': '8e4318a8-0a0c-46ae-a03a-45d69e971ed8', 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'fixed_ips': [{'subnet_id': '9f9fea3e-31d0-443c-a06b-ff1b47b07b4c'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:17:55.498354 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.570684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (b448347f-bded-4382-8e80-6253172a6577), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.600786 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-5fbf505b-204b-4599-849e-d6b8b429dfde service neutron] 10.222.0.30 "GET /v2.0/networks/0a3a0bb4-4db4-4907-a006-67d97a634086?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4890366 Mar 24 02:17:55.640127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b448347f-bded-4382-8e80-6253172a6577), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.643546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (9a1fcc47-24d9-4303-8c86-1aaa9507bb56), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.682032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks [] for security_group (63ec2533-df14-4cb3-983a-183175e73942), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.698427 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Releasing vlan 131 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:55.698945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (b448347f-bded-4382-8e80-6253172a6577), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.721839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (63ec2533-df14-4cb3-983a-183175e73942), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:55.728284 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:55.757387 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] device_id is not set on port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:55.761950 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (14ac1797-9f65-495f-b6f7-83aedcd8aef1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.797509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.801681 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/networks/14ac1797-9f65-495f-b6f7-83aedcd8aef1 HTTP/1.1" status: 204 len: 168 time: 1.5762751 Mar 24 02:17:55.808300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a1fcc47-24d9-4303-8c86-1aaa9507bb56']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:55.808677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (fe891a64-a3f4-4762-b1ed-ef0b04bfab73), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.815287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32828) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:55.815524 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3393b423-b7b7-475b-9467-175cb41d7b9c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:55.852245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4818dd34-96c0-484c-b6b9-61dc5ea9b365') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:55.852495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4818dd34-96c0-484c-b6b9-61dc5ea9b365') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:55.869946 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Pushing event deleted for resources: {'Port': ['ID=fe891a64-a3f4-4762-b1ed-ef0b04bfab73,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:55.878018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 3393b423-b7b7-475b-9467-175cb41d7b9c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:55.878493 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3393b423-b7b7-475b-9467-175cb41d7b9c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:55.879111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 276b4a0e-938f-4560-8acb-b1e286da1948 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:55.886950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] No DVR routers for this DVR port fe891a64-a3f4-4762-b1ed-ef0b04bfab73 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:55.891330 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63ec2533-df14-4cb3-983a-183175e73942,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:55.901437 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c085e3-8007-4d67-9c4b-18e514252078 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Network': ['ID=14ac1797-9f65-495f-b6f7-83aedcd8aef1,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:55.915697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.916073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.916387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.916727 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.917062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.917393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.918203 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.918203 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.918390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.918965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.919094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.919355 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.920165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.920165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.920382 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e755bf30-b883-4b1c-9c61-d3610301e122 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.923004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.923536 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.923761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.923997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.924333 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.924663 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.924991 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.925312 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.925822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.926397 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.926535 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 276b4a0e-938f-4560-8acb-b1e286da1948 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:55.926851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 276b4a0e-938f-4560-8acb-b1e286da1948 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:55.927269 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fe891a64-a3f4-4762-b1ed-ef0b04bfab73 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:55.927617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.928264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.928855 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.929392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.929739 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Allocated IP 172.20.0.2 (8e4318a8-0a0c-46ae-a03a-45d69e971ed8/9f9fea3e-31d0-443c-a06b-ff1b47b07b4c/2e96e7b6-cf4b-46f6-b960-ada79914ac66) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:55.930191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:55.940267 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (4818dd34-96c0-484c-b6b9-61dc5ea9b365), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:55.953434 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: fe891a64-a3f4-4762-b1ed-ef0b04bfab73 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:55.953787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fe891a64-a3f4-4762-b1ed-ef0b04bfab73 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:55.954770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 708a1479-0ee0-4234-a291-4d08e9e69c9c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:17:55.982858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 708a1479-0ee0-4234-a291-4d08e9e69c9c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:17:55.983217 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 708a1479-0ee0-4234-a291-4d08e9e69c9c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:17:55.990875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (1ff12164-ce98-442e-81ee-e22f78c3a0ff), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.002809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.012196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.019044 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "DELETE /v2.0/networks/1ff12164-ce98-442e-81ee-e22f78c3a0ff HTTP/1.1" status: 204 len: 168 time: 1.6596649 Mar 24 02:17:56.041416 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (4818dd34-96c0-484c-b6b9-61dc5ea9b365), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.045592 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32830) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:56.049578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Deleting subnet 81becc6f-1f1b-41c3-95c9-208eb1fecf3f {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:56.074746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (81becc6f-1f1b-41c3-95c9-208eb1fecf3f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.078821 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bd14d9cb-3bac-447f-87cf-a8e92d379cd8 req-bacd686f-eec0-491b-9f1c-c5564c928397 service neutron] 10.222.0.30 "GET /v2.0/networks/0a3a0bb4-4db4-4907-a006-67d97a634086?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4634004 Mar 24 02:17:56.103910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Releasing vlan 134 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:56.104236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (4818dd34-96c0-484c-b6b9-61dc5ea9b365), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.107366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ba9fe5-b17e-4153-ae4d-c98431a54fda tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event deleted for resources: {'Network': ['ID=1ff12164-ce98-442e-81ee-e22f78c3a0ff,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:56.109128 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:56.172693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Publish callbacks [] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.178863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.225183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:56.227687 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:56.227954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.235808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:56.244340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Pushing event updated for resources: {'Port': ['ID=2e96e7b6-cf4b-46f6-b960-ada79914ac66,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:56.245876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] device_id is not set on port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:17:56.254946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.261461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks [] for port (0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.263686 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (81becc6f-1f1b-41c3-95c9-208eb1fecf3f), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.295452 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.301331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (9a1fcc47-24d9-4303-8c86-1aaa9507bb56), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.309907 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Attempting to bind port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:56.310461 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Attempting to bind port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '29ff5209-ca7a-4e4b-b3e0-ef87894e6465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '8e4318a8-0a0c-46ae-a03a-45d69e971ed8'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:56.310940 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Attempting to bind port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 on network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:56.317234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:17:56.317734 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Checking segment: {'id': '29ff5209-ca7a-4e4b-b3e0-ef87894e6465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '8e4318a8-0a0c-46ae-a03a-45d69e971ed8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:56.318264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.318773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Bound using segment: {'id': '29ff5209-ca7a-4e4b-b3e0-ef87894e6465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '8e4318a8-0a0c-46ae-a03a-45d69e971ed8'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:17:56.319330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Bound port: 2e96e7b6-cf4b-46f6-b960-ada79914ac66, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '29ff5209-ca7a-4e4b-b3e0-ef87894e6465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '8e4318a8-0a0c-46ae-a03a-45d69e971ed8'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:17:56.319804 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.344572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.348132 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "DELETE /v2.0/networks/9a1fcc47-24d9-4303-8c86-1aaa9507bb56 HTTP/1.1" status: 204 len: 168 time: 1.5424657 Mar 24 02:17:56.355569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32832) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:56.382399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0033497b-77d0-4938-aa84-e3e5c50a8f52 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event deleted for resources: {'Network': ['ID=9a1fcc47-24d9-4303-8c86-1aaa9507bb56,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:56.395239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'Port': ['ID=0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:56.409037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] For port 2e96e7b6-cf4b-46f6-b960-ada79914ac66, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:56.413027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] For port 2e96e7b6-cf4b-46f6-b960-ada79914ac66, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2e96e7b6-cf4b-46f6-b960-ada79914ac66,segment=NetworkSegment(29ff5209-ca7a-4e4b-b3e0-ef87894e6465),segment_id=29ff5209-ca7a-4e4b-b3e0-ef87894e6465)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:17:56.425883 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.426544 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] In _notify_port_updated(), no bound segment for port ee36bd51-4117-478e-8b43-8b3b0ec9f517 on network 8ec9fea4-b38d-4612-9d1d-87145ce2366f {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:17:56.431614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:56.432416 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.433924 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "PUT /v2.0/ports/ee36bd51-4117-478e-8b43-8b3b0ec9f517 HTTP/1.1" status: 200 len: 968 time: 3.7852433 Mar 24 02:17:56.440733 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group (b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.442647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32834) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:56.450113 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed4247f-4dc3-401e-830d-19634c583159 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event updated for resources: {'Port': ['ID=ee36bd51-4117-478e-8b43-8b3b0ec9f517,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:56.468134 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:17:56.532221 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Checking segment: {'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:17:56.533378 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Network hostable DHCP agents. Network: 68479eb8-4769-40a2-a486-b1f8a55226e1, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:17:56.534565 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a59d50-49ac-4e6f-8fb6-b6b4dafb9cf6 None None] Pushing event updated for resources: {'Port': ['ID=2e96e7b6-cf4b-46f6-b960-ada79914ac66,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:56.584942 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.20.0.1 (8e4318a8-0a0c-46ae-a03a-45d69e971ed8/9f9fea3e-31d0-443c-a06b-ff1b47b07b4c/b4861b01-4f78-41bc-a1e1-8876aa529776) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:17:56.613835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (81becc6f-1f1b-41c3-95c9-208eb1fecf3f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.665539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group (b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.667661 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (7a2f9f0b-26c4-4ab6-b939-a934962cbf90), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.681063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:56.707713 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '1ee59cd7-c2ab-4bdd-aae1-75d878279ee1', 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086', 'port_id': '1ee59cd7-c2ab-4bdd-aae1-75d878279ee1', 'mac_address': 'fa:16:3e:ec:66:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 110, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '47e13ca4-a1b5-4f9e-95ce-b93533455f10', 'ip_address': '172.20.0.21'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:17:56.756149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Network 68479eb8-4769-40a2-a486-b1f8a55226e1 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:17:56.797609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83836cc1-aca9-4877-b44f-a7b9d72f2e80 req-c6146d79-3111-4c76-a520-8d6de2aa4ebe tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:56.800065 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-83836cc1-aca9-4877-b44f-a7b9d72f2e80 req-c6146d79-3111-4c76-a520-8d6de2aa4ebe tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 944 time: 0.2608681 Mar 24 02:17:56.817685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 68479eb8-4769-40a2-a486-b1f8a55226e1) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:56.818383 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:56.819391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.821570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (81becc6f-1f1b-41c3-95c9-208eb1fecf3f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.841631 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:56.847964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d75d172b-07fb-4df6-b71c-168741fd131c None None] Network 68479eb8-4769-40a2-a486-b1f8a55226e1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:56.852140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.857527 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/subnets/81becc6f-1f1b-41c3-95c9-208eb1fecf3f HTTP/1.1" status: 204 len: 168 time: 1.0274684 Mar 24 02:17:56.861507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.864225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.868588 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] 10.222.0.20 "DELETE /v2.0/security-groups/b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8 HTTP/1.1" status: 204 len: 168 time: 0.8164740 Mar 24 02:17:56.915615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32838) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:56.918941 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ac5023f-82db-4936-b02c-4c8b586ea4ca None None] Network 58c3ebb3-5acb-4f4a-b028-9c70230944ca requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:56.932149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Subnet': ['ID=81becc6f-1f1b-41c3-95c9-208eb1fecf3f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:56.953224 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b24b27f0-d4aa-47a9-8c81-b36a2d6d7cc8,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:56.972008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:17:56.972135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:56.994953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.995348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.995655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.995946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.996283 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.997356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.997356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.997356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.997774 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.997997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.998325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.998731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.999055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.999378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:56.999701 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f77d30fa-c7ed-48fd-89d1-e2b533c7bf04 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.010284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.010887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.011029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.011468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.011709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.012059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.012394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.012716 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.013042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.013369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.013693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.014017 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.014341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.014686 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.015011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ec50581-adf4-4251-8b98-23f3c4e96180 tempest-TestNetworkAdvancedServerOps-988596020 tempest-TestNetworkAdvancedServerOps-988596020-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:17:57.056161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-b03addbc-4f04-4258-9d4b-ed8ba5ed29a8 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Deleting subnet 0761200f-0d8a-46d8-ac1c-807c96143fe9 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:57.063550 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-83836cc1-aca9-4877-b44f-a7b9d72f2e80 req-843f0306-3bb5-4ffa-9696-95721c51d8a7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2190146 Mar 24 02:17:57.064455 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b03addbc-4f04-4258-9d4b-ed8ba5ed29a8 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (0761200f-0d8a-46d8-ac1c-807c96143fe9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.086421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-64ad9ac5-fd4b-4ed0-9dcd-5b6b5be81bb6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port ee36bd51-4117-478e-8b43-8b3b0ec9f517 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:57.086998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-64ad9ac5-fd4b-4ed0-9dcd-5b6b5be81bb6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.090727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:57.091237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:57.092225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:57.097242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (7a2f9f0b-26c4-4ab6-b939-a934962cbf90), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.115892 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b03addbc-4f04-4258-9d4b-ed8ba5ed29a8 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (0761200f-0d8a-46d8-ac1c-807c96143fe9), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.136679 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:57.193342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.208884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d6221a77-70d9-41e1-9572-bb5c5dfb3fd2 None None] Provisioning complete for port ee36bd51-4117-478e-8b43-8b3b0ec9f517 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:57.208884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d6221a77-70d9-41e1-9572-bb5c5dfb3fd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.260062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b03addbc-4f04-4258-9d4b-ed8ba5ed29a8 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (0761200f-0d8a-46d8-ac1c-807c96143fe9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.307296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d6221a77-70d9-41e1-9572-bb5c5dfb3fd2 None None] Port ee36bd51-4117-478e-8b43-8b3b0ec9f517 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:57.312847 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:57.323554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32846) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:57.353398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b03addbc-4f04-4258-9d4b-ed8ba5ed29a8 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (0761200f-0d8a-46d8-ac1c-807c96143fe9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.381789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f18762e5-3099-4f46-ac93-8defbb65cf95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.396960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b03addbc-4f04-4258-9d4b-ed8ba5ed29a8 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.399685 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b03addbc-4f04-4258-9d4b-ed8ba5ed29a8 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/subnets/0761200f-0d8a-46d8-ac1c-807c96143fe9 HTTP/1.1" status: 204 len: 168 time: 0.4801159 Mar 24 02:17:57.400987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b03addbc-4f04-4258-9d4b-ed8ba5ed29a8 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Subnet': ['ID=0761200f-0d8a-46d8-ac1c-807c96143fe9,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:57.404196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32850) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:57.405655 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a929b83-ae64-40a0-bcd3-9d49133ced66 None None] Network 834402ee-abbe-4d0a-b309-41f9ccba31d2 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:57.464155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0be8cc6-706a-4293-ab24-5302af045f74 None None] DHCP port deletion for 58c3ebb3-5acb-4f4a-b028-9c70230944ca request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:57.585336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a0be8cc6-706a-4293-ab24-5302af045f74 None None] Deleting port 1533e374-3fea-47d0-a13c-1c95eef43132 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:57.585706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a0be8cc6-706a-4293-ab24-5302af045f74 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.585816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:57.586113 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:57.602762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7a2f9f0b-26c4-4ab6-b939-a934962cbf90']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:57.609138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['1ee59cd7-c2ab-4bdd-aae1-75d878279ee1'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:17:57.616476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '54d87ace-94bc-463b-8b4d-c0a6f71fd89c') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:57.616919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '54d87ace-94bc-463b-8b4d-c0a6f71fd89c') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:57.629097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (54d87ace-94bc-463b-8b4d-c0a6f71fd89c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.632573 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 2 to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 Mar 24 02:17:57.702288 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17704759-fea7-419e-8a1d-0e2abee058d3 None None] DHCP port deletion for 834402ee-abbe-4d0a-b309-41f9ccba31d2 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:57.720921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:57.723474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:57.723878 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:57.731426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (54d87ace-94bc-463b-8b4d-c0a6f71fd89c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.760982 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:57.761637 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (54d87ace-94bc-463b-8b4d-c0a6f71fd89c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:57.769079 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:57.796408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a0be8cc6-706a-4293-ab24-5302af045f74 None None] For port 1533e374-3fea-47d0-a13c-1c95eef43132, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=1533e374-3fea-47d0-a13c-1c95eef43132,segment=NetworkSegment(e237a193-a4bf-4a6e-9286-54c6597c20bc),segment_id=e237a193-a4bf-4a6e-9286-54c6597c20bc)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:57.796807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a0be8cc6-706a-4293-ab24-5302af045f74 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.809266 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.836586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a0be8cc6-706a-4293-ab24-5302af045f74 None None] Calling delete_port for 1533e374-3fea-47d0-a13c-1c95eef43132 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:57.854900 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:57.855233 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:57.867531 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 3 to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 Mar 24 02:17:57.868781 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2e96e7b6-cf4b-46f6-b960-ada79914ac66 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:17:57.888916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (58c3ebb3-5acb-4f4a-b028-9c70230944ca), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:57.908504 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-59437310-6aa2-4a47-a7b3-8ab24c7a3240 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=615b57fe01bd445f87fb9f1a86851430&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5829418 Mar 24 02:17:57.910992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32852) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:57.912088 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:57.912424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:57.912755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:57.920415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:57.939681 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:57.949442 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:17:57.955407 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:57.955740 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:57.963117 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 4 to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 Mar 24 02:17:58.003812 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-64ad9ac5-fd4b-4ed0-9dcd-5b6b5be81bb6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.006978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:58.007431 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:58.007754 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:58.009185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-17704759-fea7-419e-8a1d-0e2abee058d3 None None] Deleting port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:58.009562 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-17704759-fea7-419e-8a1d-0e2abee058d3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.019597 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=b4861b01-4f78-41bc-a1e1-8876aa529776,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:58.022772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (7a2f9f0b-26c4-4ab6-b939-a934962cbf90), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.035647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-64ad9ac5-fd4b-4ed0-9dcd-5b6b5be81bb6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for ee36bd51-4117-478e-8b43-8b3b0ec9f517 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:58.037522 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30957b64-b8c3-4a7f-92c3-d6c8bc9f4a8e admin admin] Publish callbacks [] for security_group (919370df-d899-4ffe-8d0a-4c4db42fadcb), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.056014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Deleting port 1533e374-3fea-47d0-a13c-1c95eef43132 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:58.056359 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.059072 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.061453 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a48d1d9-c245-4a60-a674-7cdaed768d94 None None] Network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:58.065123 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "DELETE /v2.0/networks/7a2f9f0b-26c4-4ab6-b939-a934962cbf90 HTTP/1.1" status: 204 len: 168 time: 1.7060604 Mar 24 02:17:58.066051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32854) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:58.066998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626bd56e-d3b3-42a1-9608-f4a9a7072d0b tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event deleted for resources: {'Network': ['ID=7a2f9f0b-26c4-4ab6-b939-a934962cbf90,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:58.068737 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:58.069056 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:58.073145 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 5 to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 Mar 24 02:17:58.092856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (17fb882c-6eff-4650-ba6f-c10c720662b6), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.123641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30957b64-b8c3-4a7f-92c3-d6c8bc9f4a8e admin admin] Publish callbacks [] for security_group (919370df-d899-4ffe-8d0a-4c4db42fadcb), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.176283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:58.176505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:58.176744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:58.176874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.177072 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:58.185556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:58.185556 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:58.188481 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 6 to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 Mar 24 02:17:58.224837 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a0be8cc6-706a-4293-ab24-5302af045f74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.226707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-afd92eb5-e907-4bca-91a0-2691a3cb48ba None None] Provisioning complete for port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:58.227067 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-afd92eb5-e907-4bca-91a0-2691a3cb48ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.240831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-17704759-fea7-419e-8a1d-0e2abee058d3 None None] For port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8,segment=NetworkSegment(eaa2d6f4-4a95-41df-9ecc-6e7135524d0c),segment_id=eaa2d6f4-4a95-41df-9ecc-6e7135524d0c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:58.241083 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:58.241181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-17704759-fea7-419e-8a1d-0e2abee058d3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.242585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:58.243885 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:58.247154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] For port 1533e374-3fea-47d0-a13c-1c95eef43132, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=1533e374-3fea-47d0-a13c-1c95eef43132,segment=NetworkSegment(e237a193-a4bf-4a6e-9286-54c6597c20bc),segment_id=e237a193-a4bf-4a6e-9286-54c6597c20bc)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:58.247526 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.254503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:58.254951 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:58.258447 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 7 to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 Mar 24 02:17:58.274586 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-045582e7-4a80-49cd-b78e-a7b621b24535 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Deleting subnet 431fd840-ead5-4cb9-b2cf-4efeba48e88f {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:17:58.282142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-045582e7-4a80-49cd-b78e-a7b621b24535 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for subnet (431fd840-ead5-4cb9-b2cf-4efeba48e88f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.302128 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:58.302630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:58.303062 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:58.309330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Calling delete_port for 1533e374-3fea-47d0-a13c-1c95eef43132 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:58.341754 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:58.342172 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:58.344110 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 8 to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 Mar 24 02:17:58.384972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-045582e7-4a80-49cd-b78e-a7b621b24535 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (431fd840-ead5-4cb9-b2cf-4efeba48e88f), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.388683 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.398070 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:58.398481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:58.398912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:58.417167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:58.417563 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:58.418366 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 9 to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 Mar 24 02:17:58.418580 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30957b64-b8c3-4a7f-92c3-d6c8bc9f4a8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (919370df-d899-4ffe-8d0a-4c4db42fadcb), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.421152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-30957b64-b8c3-4a7f-92c3-d6c8bc9f4a8e admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.422295 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-30957b64-b8c3-4a7f-92c3-d6c8bc9f4a8e admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/919370df-d899-4ffe-8d0a-4c4db42fadcb HTTP/1.1" status: 204 len: 168 time: 0.5094965 Mar 24 02:17:58.468186 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:58.469131 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:58.469517 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:58.476136 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-64ad9ac5-fd4b-4ed0-9dcd-5b6b5be81bb6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (ee36bd51-4117-478e-8b43-8b3b0ec9f517), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.479645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0be8cc6-706a-4293-ab24-5302af045f74 None None] Pushing event deleted for resources: {'Port': ['ID=1533e374-3fea-47d0-a13c-1c95eef43132,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:58.487574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0be8cc6-706a-4293-ab24-5302af045f74 None None] No DVR routers for this DVR port 1533e374-3fea-47d0-a13c-1c95eef43132 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:58.489223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-17704759-fea7-419e-8a1d-0e2abee058d3 None None] Calling delete_port for a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:58.542670 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-045582e7-4a80-49cd-b78e-a7b621b24535 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (431fd840-ead5-4cb9-b2cf-4efeba48e88f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.599527 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:58.599901 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:58.610962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-64ad9ac5-fd4b-4ed0-9dcd-5b6b5be81bb6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.619800 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-64ad9ac5-fd4b-4ed0-9dcd-5b6b5be81bb6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/ee36bd51-4117-478e-8b43-8b3b0ec9f517 HTTP/1.1" status: 204 len: 168 time: 2.1702938 Mar 24 02:17:58.619973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32860) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:58.647228 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 10 to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 Mar 24 02:17:58.661864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ad9ac5-fd4b-4ed0-9dcd-5b6b5be81bb6 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=ee36bd51-4117-478e-8b43-8b3b0ec9f517,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:58.670635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (1533e374-3fea-47d0-a13c-1c95eef43132), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.683875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-045582e7-4a80-49cd-b78e-a7b621b24535 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (431fd840-ead5-4cb9-b2cf-4efeba48e88f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.707112 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-b4993f87-c849-49b6-ae5f-0855140c8949 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] GET failed (client error): The resource could not be found. Mar 24 02:17:58.711366 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b4993f87-c849-49b6-ae5f-0855140c8949 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports/ee36bd51-4117-478e-8b43-8b3b0ec9f517 HTTP/1.1" status: 404 len: 333 time: 0.0611746 Mar 24 02:17:58.716031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:17:58.716371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:17:58.716706 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:17:58.726454 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32864) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:58.745573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:17:58.745935 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:17:58.746278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.760914 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30957b64-b8c3-4a7f-92c3-d6c8bc9f4a8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=919370df-d899-4ffe-8d0a-4c4db42fadcb,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:58.769573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c20668-e989-4a38-8ad4-128a76d6c166 req-436bc083-d55a-4a5e-8a9b-705cb7dd06e9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:58.771156 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4c20668-e989-4a38-8ad4-128a76d6c166 req-436bc083-d55a-4a5e-8a9b-705cb7dd06e9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 945 time: 0.5611475 Mar 24 02:17:58.772573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-045582e7-4a80-49cd-b78e-a7b621b24535 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.776047 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-045582e7-4a80-49cd-b78e-a7b621b24535 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "DELETE /v2.0/subnets/431fd840-ead5-4cb9-b2cf-4efeba48e88f HTTP/1.1" status: 204 len: 168 time: 0.7001026 Mar 24 02:17:58.777173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] No DVR routers for this DVR port 1533e374-3fea-47d0-a13c-1c95eef43132 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:58.778974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Port': ['ID=1533e374-3fea-47d0-a13c-1c95eef43132,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:58.780696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-045582e7-4a80-49cd-b78e-a7b621b24535 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event deleted for resources: {'Subnet': ['ID=431fd840-ead5-4cb9-b2cf-4efeba48e88f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:58.782997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32866) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:58.819852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df85da54-1624-4738-861d-72d2712d7e67 None None] Network 7cde5c03-1bce-4fe6-bab8-be1b58838f55 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:17:58.884867 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (58c3ebb3-5acb-4f4a-b028-9c70230944ca), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.943816 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:58.944700 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.957873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-afd92eb5-e907-4bca-91a0-2691a3cb48ba None None] Current status of the port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:58.958299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-afd92eb5-e907-4bca-91a0-2691a3cb48ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.969216 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c31e5568-943e-4d19-8527-5c7c5ff2f097 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (326ef952-70f7-4dbe-9687-948ffd5cb56f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:58.977389 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] For port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311, host hv-neutron-8348, cleared binding levels {{(pid=104036) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:17:58.977765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempted to set empty binding levels {{(pid=104036) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Mar 24 02:17:58.998140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.014914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-17704759-fea7-419e-8a1d-0e2abee058d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.048898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32868) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:59.055788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c31e5568-943e-4d19-8527-5c7c5ff2f097 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (326ef952-70f7-4dbe-9687-948ffd5cb56f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.058639 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['58c3ebb3-5acb-4f4a-b028-9c70230944ca']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:59.066758 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4c20668-e989-4a38-8ad4-128a76d6c166 req-14f607bc-eab8-46cd-9a35-94a5d94fbdd2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0638220 Mar 24 02:17:59.079900 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (7cde5c03-1bce-4fe6-bab8-be1b58838f55), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.082736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-26ac4fd4-639f-4c8d-908b-c9c4e88a647c admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.083915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e237a193-a4bf-4a6e-9286-54c6597c20bc') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:59.084324 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e237a193-a4bf-4a6e-9286-54c6597c20bc') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:59.104307 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (e237a193-a4bf-4a6e-9286-54c6597c20bc), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.105457 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:17:59.106056 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.148928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e237a193-a4bf-4a6e-9286-54c6597c20bc), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.151779 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-afd92eb5-e907-4bca-91a0-2691a3cb48ba None None] For port 2e96e7b6-cf4b-46f6-b960-ada79914ac66, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2e96e7b6-cf4b-46f6-b960-ada79914ac66,segment=NetworkSegment(29ff5209-ca7a-4e4b-b3e0-ef87894e6465),segment_id=29ff5209-ca7a-4e4b-b3e0-ef87894e6465)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:59.159969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Releasing vlan 125 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:17:59.160438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (e237a193-a4bf-4a6e-9286-54c6597c20bc), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:17:59.163628 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:17:59.174384 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17704759-fea7-419e-8a1d-0e2abee058d3 None None] Pushing event deleted for resources: {'Port': ['ID=a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.182565 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-afd92eb5-e907-4bca-91a0-2691a3cb48ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.194773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17704759-fea7-419e-8a1d-0e2abee058d3 None None] No DVR routers for this DVR port a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:59.206490 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'Port': ['ID=0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.227453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32870) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:59.228061 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0140e0c0-39c4-465f-912c-b60e773ac2e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 985 time: 3.8845310 Mar 24 02:17:59.256660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.294424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c31e5568-943e-4d19-8527-5c7c5ff2f097 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (326ef952-70f7-4dbe-9687-948ffd5cb56f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.296990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c31e5568-943e-4d19-8527-5c7c5ff2f097 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.301308 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c31e5568-943e-4d19-8527-5c7c5ff2f097 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/security-groups/326ef952-70f7-4dbe-9687-948ffd5cb56f HTTP/1.1" status: 204 len: 168 time: 0.5721321 Mar 24 02:17:59.304762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.304921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32872) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:59.323460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:17:59.324627 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:17:59.341062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (58c3ebb3-5acb-4f4a-b028-9c70230944ca), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.345037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c31e5568-943e-4d19-8527-5c7c5ff2f097 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=326ef952-70f7-4dbe-9687-948ffd5cb56f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.363704 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afd92eb5-e907-4bca-91a0-2691a3cb48ba None None] Pushing event updated for resources: {'Port': ['ID=2e96e7b6-cf4b-46f6-b960-ada79914ac66,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.373933 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.384150 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/networks/58c3ebb3-5acb-4f4a-b028-9c70230944ca HTTP/1.1" status: 204 len: 168 time: 1.9785504 Mar 24 02:17:59.393200 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32874) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:59.398051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-26ac4fd4-639f-4c8d-908b-c9c4e88a647c admin admin] Publish callbacks [] for security_group (a48158ef-db95-485a-84f0-33a173fa9dca), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.412415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3df7bf7b-a70e-40e7-bcfa-80dec93729e2 None None] Provisioning complete for port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:59.412706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3df7bf7b-a70e-40e7-bcfa-80dec93729e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.415860 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Deleting port 4dd61a54-b881-4383-bfa8-72da7c8e680e {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:59.416563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.424951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-26ac4fd4-639f-4c8d-908b-c9c4e88a647c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a48158ef-db95-485a-84f0-33a173fa9dca), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.459697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-501e7f51-bcf7-45bc-906a-73f3024d3c69 None None] DHCP port deletion for 7cde5c03-1bce-4fe6-bab8-be1b58838f55 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:17:59.517403 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (17fb882c-6eff-4650-ba6f-c10c720662b6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.527616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] For port 4dd61a54-b881-4383-bfa8-72da7c8e680e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4dd61a54-b881-4383-bfa8-72da7c8e680e,segment=NetworkSegment(47cb43a7-feb3-49ab-b9d5-889cd27004d3),segment_id=47cb43a7-feb3-49ab-b9d5-889cd27004d3)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:59.528072 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.539865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=b4861b01-4f78-41bc-a1e1-8876aa529776,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.556943 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-380d356b-0135-454b-a4d9-f4dfba0f7f9d tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Network': ['ID=58c3ebb3-5acb-4f4a-b028-9c70230944ca,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.567214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Calling delete_port for 4dd61a54-b881-4383-bfa8-72da7c8e680e owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:59.568904 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-26ac4fd4-639f-4c8d-908b-c9c4e88a647c admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=80f95dd6f28e4509aedad437fa848fde&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5153403 Mar 24 02:17:59.569620 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26ac4fd4-639f-4c8d-908b-c9c4e88a647c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a48158ef-db95-485a-84f0-33a173fa9dca,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.571939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32876) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:59.575011 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-501e7f51-bcf7-45bc-906a-73f3024d3c69 None None] Deleting port 4dd61a54-b881-4383-bfa8-72da7c8e680e {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:59.575595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-501e7f51-bcf7-45bc-906a-73f3024d3c69 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.577537 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3df7bf7b-a70e-40e7-bcfa-80dec93729e2 None None] Current status of the port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:59.622545 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (834402ee-abbe-4d0a-b309-41f9ccba31d2), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.641429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3df7bf7b-a70e-40e7-bcfa-80dec93729e2 None None] Provisioning complete for port b4861b01-4f78-41bc-a1e1-8876aa529776 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:59.642336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3df7bf7b-a70e-40e7-bcfa-80dec93729e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.646729 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69ffdaaa-441d-4831-8bfa-2b57bf3a698a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (3eafdaf8-64e4-42b4-a2ca-1b610621f713), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.673518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-501e7f51-bcf7-45bc-906a-73f3024d3c69 None None] For port 4dd61a54-b881-4383-bfa8-72da7c8e680e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=4dd61a54-b881-4383-bfa8-72da7c8e680e,segment=NetworkSegment(47cb43a7-feb3-49ab-b9d5-889cd27004d3),segment_id=47cb43a7-feb3-49ab-b9d5-889cd27004d3)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:59.674222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-501e7f51-bcf7-45bc-906a-73f3024d3c69 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.693211 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-501e7f51-bcf7-45bc-906a-73f3024d3c69 None None] Calling delete_port for 4dd61a54-b881-4383-bfa8-72da7c8e680e owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:59.698232 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3df7bf7b-a70e-40e7-bcfa-80dec93729e2 None None] Port b4861b01-4f78-41bc-a1e1-8876aa529776 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:59.716055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69ffdaaa-441d-4831-8bfa-2b57bf3a698a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (3eafdaf8-64e4-42b4-a2ca-1b610621f713), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.730380 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-0a765ebb-f617-4fb0-a0c4-f1996a81d593 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Deleting port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:17:59.730746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0a765ebb-f617-4fb0-a0c4-f1996a81d593 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.749471 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:17:59.751447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (834402ee-abbe-4d0a-b309-41f9ccba31d2), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.754365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:17:59.784894 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-501e7f51-bcf7-45bc-906a-73f3024d3c69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.789472 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1e3eefc-1daf-4599-a1fc-d00f41074e26 admin admin] Publish callbacks [] for security_group (a48158ef-db95-485a-84f0-33a173fa9dca), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.816669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['834402ee-abbe-4d0a-b309-41f9ccba31d2']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:59.824939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501e7f51-bcf7-45bc-906a-73f3024d3c69 None None] Pushing event deleted for resources: {'Port': ['ID=4dd61a54-b881-4383-bfa8-72da7c8e680e,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.864067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-0a765ebb-f617-4fb0-a0c4-f1996a81d593 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] For port 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311, host hv-neutron-8348, got binding levels [] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:17:59.864317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eaa2d6f4-4a95-41df-9ecc-6e7135524d0c') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:59.864903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0a765ebb-f617-4fb0-a0c4-f1996a81d593 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.865302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eaa2d6f4-4a95-41df-9ecc-6e7135524d0c') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:17:59.869398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1e3eefc-1daf-4599-a1fc-d00f41074e26 admin admin] Publish callbacks [] for security_group (a48158ef-db95-485a-84f0-33a173fa9dca), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.872834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-501e7f51-bcf7-45bc-906a-73f3024d3c69 None None] No DVR routers for this DVR port 4dd61a54-b881-4383-bfa8-72da7c8e680e on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:17:59.876672 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-07dee16d-9276-47b0-983f-5727563e770a None None] Provisioning complete for port b4861b01-4f78-41bc-a1e1-8876aa529776 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:17:59.877231 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-07dee16d-9276-47b0-983f-5727563e770a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.885260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (eaa2d6f4-4a95-41df-9ecc-6e7135524d0c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.891147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (4dd61a54-b881-4383-bfa8-72da7c8e680e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.893449 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69ffdaaa-441d-4831-8bfa-2b57bf3a698a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (3eafdaf8-64e4-42b4-a2ca-1b610621f713), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.896033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-69ffdaaa-441d-4831-8bfa-2b57bf3a698a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.897183 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-69ffdaaa-441d-4831-8bfa-2b57bf3a698a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/security-groups/3eafdaf8-64e4-42b4-a2ca-1b610621f713 HTTP/1.1" status: 204 len: 168 time: 0.5930493 Mar 24 02:17:59.901173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32878) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:17:59.901326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-0a765ebb-f617-4fb0-a0c4-f1996a81d593 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Calling delete_port for 0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:17:59.931442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:17:59.934407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-07dee16d-9276-47b0-983f-5727563e770a None None] Port b4861b01-4f78-41bc-a1e1-8876aa529776 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:17:59.966002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (eaa2d6f4-4a95-41df-9ecc-6e7135524d0c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:17:59.969754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69ffdaaa-441d-4831-8bfa-2b57bf3a698a tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3eafdaf8-64e4-42b4-a2ca-1b610621f713,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.972107 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event deleted for resources: {'Port': ['ID=4dd61a54-b881-4383-bfa8-72da7c8e680e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:17:59.984572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] No DVR routers for this DVR port 4dd61a54-b881-4383-bfa8-72da7c8e680e on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:00.001633 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Releasing vlan 135 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:00.002152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (eaa2d6f4-4a95-41df-9ecc-6e7135524d0c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:00.006288 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:00.026363 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:00.058607 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:00.059957 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a1fd5f3e-5320-40b3-a2f3-13bd3d578cb8 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:00.059957 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 1533e374-3fea-47d0-a13c-1c95eef43132 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:00.098267 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 1533e374-3fea-47d0-a13c-1c95eef43132 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:00.098722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 1533e374-3fea-47d0-a13c-1c95eef43132 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:00.129975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cebebd7-778a-4573-ac52-4dc0a43d1c5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (1cc62c9b-7561-4b03-b819-d7e9a54d2b3e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.133741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (7cde5c03-1bce-4fe6-bab8-be1b58838f55), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.148263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1e3eefc-1daf-4599-a1fc-d00f41074e26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a48158ef-db95-485a-84f0-33a173fa9dca), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.150969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e1e3eefc-1daf-4599-a1fc-d00f41074e26 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.152110 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e1e3eefc-1daf-4599-a1fc-d00f41074e26 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/a48158ef-db95-485a-84f0-33a173fa9dca HTTP/1.1" status: 204 len: 168 time: 0.5760837 Mar 24 02:18:00.164958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-e39cf53c-248e-4a00-9022-3c44a7da6ba2 None None] Provisioning complete for port b4861b01-4f78-41bc-a1e1-8876aa529776 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:00.166577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e39cf53c-248e-4a00-9022-3c44a7da6ba2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.192161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cebebd7-778a-4573-ac52-4dc0a43d1c5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (1cc62c9b-7561-4b03-b819-d7e9a54d2b3e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.211217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (834402ee-abbe-4d0a-b309-41f9ccba31d2), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.224224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e39cf53c-248e-4a00-9022-3c44a7da6ba2 None None] Port b4861b01-4f78-41bc-a1e1-8876aa529776 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:00.227950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router 17fb882c-6eff-4650-ba6f-c10c720662b6 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:18:00.233851 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.239775 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/networks/834402ee-abbe-4d0a-b309-41f9ccba31d2 HTTP/1.1" status: 204 len: 168 time: 0.8341999 Mar 24 02:18:00.252412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32884) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:00.259498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7cde5c03-1bce-4fe6-bab8-be1b58838f55']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:00.262484 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e3eefc-1daf-4599-a1fc-d00f41074e26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a48158ef-db95-485a-84f0-33a173fa9dca,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:00.267181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2e96e7b6-cf4b-46f6-b960-ada79914ac66 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:00.283013 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f6c05c-0323-42a8-8128-319914a2a8db tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Network': ['ID=834402ee-abbe-4d0a-b309-41f9ccba31d2,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:00.295266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0a765ebb-f617-4fb0-a0c4-f1996a81d593 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.300814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '47cb43a7-feb3-49ab-b9d5-889cd27004d3') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:00.301113 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '47cb43a7-feb3-49ab-b9d5-889cd27004d3') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:00.329646 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:00.330660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.365329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a765ebb-f617-4fb0-a0c4-f1996a81d593 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event deleted for resources: {'Port': ['ID=0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:00.368588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (47cb43a7-feb3-49ab-b9d5-889cd27004d3), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.400462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a494a42-5d5c-43a9-8be5-312fbe5fd294 req-e9f61153-0030-4e1a-a38b-1f65a3e42114 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:00.401414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cebebd7-778a-4573-ac52-4dc0a43d1c5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (1cc62c9b-7561-4b03-b819-d7e9a54d2b3e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.402724 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1a494a42-5d5c-43a9-8be5-312fbe5fd294 req-e9f61153-0030-4e1a-a38b-1f65a3e42114 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 945 time: 0.2207658 Mar 24 02:18:00.404154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2cebebd7-778a-4573-ac52-4dc0a43d1c5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.405298 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2cebebd7-778a-4573-ac52-4dc0a43d1c5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/security-groups/1cc62c9b-7561-4b03-b819-d7e9a54d2b3e HTTP/1.1" status: 204 len: 168 time: 0.5008519 Mar 24 02:18:00.408476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32886) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:00.413919 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-6146a7d2-2e16-4b42-b8d5-c67140b2fe47 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Deleting subnet 64dc4bf3-2544-4904-a7e6-ac6433808662 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:00.420878 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6146a7d2-2e16-4b42-b8d5-c67140b2fe47 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (64dc4bf3-2544-4904-a7e6-ac6433808662), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.451353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:00.459138 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cebebd7-778a-4573-ac52-4dc0a43d1c5c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cc62c9b-7561-4b03-b819-d7e9a54d2b3e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:00.469309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:00.475085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-c64733f6-2b82-4fae-82f8-70a3a980020c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet 944064c8-2071-42aa-b2a3-4fdbf39aa8ed {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:00.479134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0a765ebb-f617-4fb0-a0c4-f1996a81d593 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.482809 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0a765ebb-f617-4fb0-a0c4-f1996a81d593 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "DELETE /v2.0/ports/0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 HTTP/1.1" status: 204 len: 168 time: 1.2433410 Mar 24 02:18:00.484847 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (47cb43a7-feb3-49ab-b9d5-889cd27004d3), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.487931 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c64733f6-2b82-4fae-82f8-70a3a980020c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (944064c8-2071-42aa-b2a3-4fdbf39aa8ed), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.488319 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32890) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:00.531997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:00.543747 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ff9e13b8-5bd2-4412-b8fb-c8ac8eee4123 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/17fb882c-6eff-4650-ba6f-c10c720662b6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0622687 Mar 24 02:18:00.548390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32892) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:00.557022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4dd61a54-b881-4383-bfa8-72da7c8e680e no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:00.561774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e3f1d61-ff6c-47e7-b3f0-1ddb7163f5a3 None None] Sync routers for ids ['17fb882c-6eff-4650-ba6f-c10c720662b6'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:00.564444 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1a494a42-5d5c-43a9-8be5-312fbe5fd294 req-58620c21-f456-49fb-b7f9-03b00dbac55f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0960615 Mar 24 02:18:00.573333 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:00.573858 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (47cb43a7-feb3-49ab-b9d5-889cd27004d3), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:00.577156 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:00.586403 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-eaae37ae-a6c1-47fb-bcd2-b93a24b73b23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.633152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6146a7d2-2e16-4b42-b8d5-c67140b2fe47 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (64dc4bf3-2544-4904-a7e6-ac6433808662), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.636607 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-e30ccee1-bac1-4500-a3f9-b307bffb9535 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] GET failed (client error): The resource could not be found. Mar 24 02:18:00.640873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 4dd61a54-b881-4383-bfa8-72da7c8e680e {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:00.641160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 4dd61a54-b881-4383-bfa8-72da7c8e680e not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:00.644565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32898) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:00.647160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c64733f6-2b82-4fae-82f8-70a3a980020c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (944064c8-2071-42aa-b2a3-4fdbf39aa8ed), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.648346 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e3f1d61-ff6c-47e7-b3f0-1ddb7163f5a3 None None] Routers {'17fb882c-6eff-4650-ba6f-c10c720662b6'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:00.649669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9e3f1d61-ff6c-47e7-b3f0-1ddb7163f5a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['17fb882c-6eff-4650-ba6f-c10c720662b6'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:00.652349 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e30ccee1-bac1-4500-a3f9-b307bffb9535 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "GET /v2.0/ports/0893f84d-a8d1-4bdb-bd4c-c0c8b15d5311 HTTP/1.1" status: 404 len: 333 time: 0.1557205 Mar 24 02:18:00.675997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Request body: {'port': {'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-12222962'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:00.685154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-deb9dc91-d922-4765-84b2-6fb24a80b6d3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:00.690772 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-deb9dc91-d922-4765-84b2-6fb24a80b6d3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports/b4861b01-4f78-41bc-a1e1-8876aa529776 HTTP/1.1" status: 200 len: 910 time: 0.1402094 Mar 24 02:18:00.693594 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32900) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:00.698660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9e3f1d61-ff6c-47e7-b3f0-1ddb7163f5a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:00.701448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Made reservation on behalf of c067301dc45b4f2aba081cc64b7888c1 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:00.704114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.706998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5c4b1eaa-5f93-4557-a3c9-c7114dc275e8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '9f9fea3e-31d0-443c-a06b-ff1b47b07b4c'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:00.713373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e3f1d61-ff6c-47e7-b3f0-1ddb7163f5a3 None None] Routers {'17fb882c-6eff-4650-ba6f-c10c720662b6'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:00.714011 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9e3f1d61-ff6c-47e7-b3f0-1ddb7163f5a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['17fb882c-6eff-4650-ba6f-c10c720662b6'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:00.722039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (7cde5c03-1bce-4fe6-bab8-be1b58838f55), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.747853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.749848 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9e3f1d61-ff6c-47e7-b3f0-1ddb7163f5a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:00.750673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e3f1d61-ff6c-47e7-b3f0-1ddb7163f5a3 None None] The sync data for ids ['17fb882c-6eff-4650-ba6f-c10c720662b6'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:00.755175 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "DELETE /v2.0/networks/7cde5c03-1bce-4fe6-bab8-be1b58838f55 HTTP/1.1" status: 204 len: 168 time: 1.9434235 Mar 24 02:18:00.755305 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:18:00.755391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff533adc-5ff6-4508-b01e-47820f78b105 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Pushing event deleted for resources: {'Network': ['ID=7cde5c03-1bce-4fe6-bab8-be1b58838f55,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:00.756424 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32904) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:00.758629 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:00.759172 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.762630 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] device_id is not set on port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:18:00.823187 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-96b3159f-f97c-4973-b4f3-b0486cf82f76 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "GET /v2.0/ports?device_id=f16cab9e-4385-4fd9-9ce1-9edfe837db44 HTTP/1.1" status: 200 len: 205 time: 0.0620055 Mar 24 02:18:00.825652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32908) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:00.866900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:00.867332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.871021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.893986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ee59cd7-c2ab-4bdd-aae1-75d878279ee1'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:18:00.896441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd4a4125-e7b3-49a2-9b6d-dcc6e7c4408e" -d '{"events": [{"server_uuid": "8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5", "name": "network-vif-plugged", "status": "completed", "tag": "1ee59cd7-c2ab-4bdd-aae1-75d878279ee1"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:18:00.908261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6146a7d2-2e16-4b42-b8d5-c67140b2fe47 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (64dc4bf3-2544-4904-a7e6-ac6433808662), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.915673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:00.922903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:00.997793 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:01.050601 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c4b1eaa-5f93-4557-a3c9-c7114dc275e8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.061418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6146a7d2-2e16-4b42-b8d5-c67140b2fe47 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (64dc4bf3-2544-4904-a7e6-ac6433808662), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.110218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18d53d28-a344-4582-8b9b-ccedbd11ba9d None None] Network 388c1171-5a51-4a13-ad3a-5e02de8f8d78 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:01.110791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6146a7d2-2e16-4b42-b8d5-c67140b2fe47 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.113590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-934802ac-599a-4c15-86f6-314c7d501f38 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for router (f16cab9e-4385-4fd9-9ce1-9edfe837db44), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.118042 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6146a7d2-2e16-4b42-b8d5-c67140b2fe47 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/subnets/64dc4bf3-2544-4904-a7e6-ac6433808662 HTTP/1.1" status: 204 len: 168 time: 0.8603456 Mar 24 02:18:01.121045 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6146a7d2-2e16-4b42-b8d5-c67140b2fe47 tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Subnet': ['ID=64dc4bf3-2544-4904-a7e6-ac6433808662,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:01.126438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks [] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.166502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32920) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:01.225294 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:18:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1937838c-a828-48d7-95a7-453156a1b382 x-openstack-request-id: req-1937838c-a828-48d7-95a7-453156a1b382 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:18:01.225995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5", "name": "network-vif-plugged", "status": "completed", "tag": "1ee59cd7-c2ab-4bdd-aae1-75d878279ee1", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:18:01.226442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-1937838c-a828-48d7-95a7-453156a1b382 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:18:01.227072 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1937838c-a828-48d7-95a7-453156a1b382'] response: {'server_uuid': '8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ee59cd7-c2ab-4bdd-aae1-75d878279ee1', 'code': 200} Mar 24 02:18:01.279043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c64733f6-2b82-4fae-82f8-70a3a980020c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (944064c8-2071-42aa-b2a3-4fdbf39aa8ed), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.332372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32924) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:01.384402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04f53f48-bdf8-47f0-b482-f9c94fde3cae None None] DHCP port deletion for 388c1171-5a51-4a13-ad3a-5e02de8f8d78 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:18:01.469966 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-04f53f48-bdf8-47f0-b482-f9c94fde3cae None None] Deleting port 830cc8ab-190a-40a7-a475-88a0ef2decc5 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:01.472566 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-04f53f48-bdf8-47f0-b482-f9c94fde3cae None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.548374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-04f53f48-bdf8-47f0-b482-f9c94fde3cae None None] For port 830cc8ab-190a-40a7-a475-88a0ef2decc5, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=830cc8ab-190a-40a7-a475-88a0ef2decc5,segment=NetworkSegment(12ff0fb4-31e7-4801-83d9-b0fe0c5f5482),segment_id=12ff0fb4-31e7-4801-83d9-b0fe0c5f5482)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:01.548950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-04f53f48-bdf8-47f0-b482-f9c94fde3cae None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.565177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-04f53f48-bdf8-47f0-b482-f9c94fde3cae None None] Calling delete_port for 830cc8ab-190a-40a7-a475-88a0ef2decc5 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:01.590929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c4b1eaa-5f93-4557-a3c9-c7114dc275e8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.602509 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c4b1eaa-5f93-4557-a3c9-c7114dc275e8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.656196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-04f53f48-bdf8-47f0-b482-f9c94fde3cae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (830cc8ab-190a-40a7-a475-88a0ef2decc5), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.690735 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04f53f48-bdf8-47f0-b482-f9c94fde3cae None None] Pushing event deleted for resources: {'Port': ['ID=830cc8ab-190a-40a7-a475-88a0ef2decc5,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:01.694341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04f53f48-bdf8-47f0-b482-f9c94fde3cae None None] No DVR routers for this DVR port 830cc8ab-190a-40a7-a475-88a0ef2decc5 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:01.705641 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c4b1eaa-5f93-4557-a3c9-c7114dc275e8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:01.706303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5c4b1eaa-5f93-4557-a3c9-c7114dc275e8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.707736 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5c4b1eaa-5f93-4557-a3c9-c7114dc275e8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/ports/b4861b01-4f78-41bc-a1e1-8876aa529776 HTTP/1.1" status: 200 len: 910 time: 1.0133755 Mar 24 02:18:01.709002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b1eaa-5f93-4557-a3c9-c7114dc275e8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=b4861b01-4f78-41bc-a1e1-8876aa529776,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:01.712424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32930) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:01.811848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1548578822-network', 'tenant_id': '4419a48020f546a6abf15b6c1b4cdbdb'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:01.844054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (388c1171-5a51-4a13-ad3a-5e02de8f8d78), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.872684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-934802ac-599a-4c15-86f6-314c7d501f38 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (f16cab9e-4385-4fd9-9ce1-9edfe837db44), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.881290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-934802ac-599a-4c15-86f6-314c7d501f38 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for router_controller (f16cab9e-4385-4fd9-9ce1-9edfe837db44), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.902469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.976240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Made reservation on behalf of 4419a48020f546a6abf15b6c1b4cdbdb for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:01.978716 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:01.990635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c64733f6-2b82-4fae-82f8-70a3a980020c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (944064c8-2071-42aa-b2a3-4fdbf39aa8ed), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.038148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-934802ac-599a-4c15-86f6-314c7d501f38 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (f16cab9e-4385-4fd9-9ce1-9edfe837db44), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.038731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-934802ac-599a-4c15-86f6-314c7d501f38 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Fanout notify agent at l3_agent the message router_deleted on router f16cab9e-4385-4fd9-9ce1-9edfe837db44 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:18:02.042371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.054695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-934802ac-599a-4c15-86f6-314c7d501f38 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.055827 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-934802ac-599a-4c15-86f6-314c7d501f38 tempest-RoutersNegativeTest-1273205175 tempest-RoutersNegativeTest-1273205175-project] 10.222.0.20 "DELETE /v2.0/routers/f16cab9e-4385-4fd9-9ce1-9edfe837db44 HTTP/1.1" status: 204 len: 168 time: 1.0777321 Mar 24 02:18:02.088241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Network 68479eb8-4769-40a2-a486-b1f8a55226e1 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:02.102738 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c64733f6-2b82-4fae-82f8-70a3a980020c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=944064c8-2071-42aa-b2a3-4fdbf39aa8ed,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:02.110160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'Port': ['ID=755b57cd-ff7c-497b-b5ac-7f56139dc2b1,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:02.118744 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c0a72c-0283-413f-92c9-c072737f4875 req-7bf5a774-8b46-4d4b-8713-5003f5496c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:02.120418 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a7c0a72c-0283-413f-92c9-c072737f4875 req-7bf5a774-8b46-4d4b-8713-5003f5496c48 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 1130 time: 0.7640762 Mar 24 02:18:02.128170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0ab45ed-1adb-4f17-af3b-9e66533d4aa7 None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:02.134550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c64733f6-2b82-4fae-82f8-70a3a980020c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.141229 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c64733f6-2b82-4fae-82f8-70a3a980020c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/944064c8-2071-42aa-b2a3-4fdbf39aa8ed HTTP/1.1" status: 204 len: 168 time: 1.7237415 Mar 24 02:18:02.141229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:02.145899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32934) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:02.191480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:02.192696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:02.193603 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.239377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e007ec-63bb-4a45-8e18-e3bd6743491c req-9cee32f5-3d89-4a48-a82e-25cc208a4df4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:02.240927 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-08e007ec-63bb-4a45-8e18-e3bd6743491c req-9cee32f5-3d89-4a48-a82e-25cc208a4df4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 946 time: 0.4637904 Mar 24 02:18:02.246375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 830cc8ab-190a-40a7-a475-88a0ef2decc5 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:02.272176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 830cc8ab-190a-40a7-a475-88a0ef2decc5 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:02.272777 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 830cc8ab-190a-40a7-a475-88a0ef2decc5 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:02.298746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (388c1171-5a51-4a13-ad3a-5e02de8f8d78), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.347490 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d49c3dfc-4105-460d-8abf-df81b5014bed tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 962 time: 1.6971731 Mar 24 02:18:02.354038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32938) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:02.359612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8348'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:02.365938 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32940) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:02.381826 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a7c0a72c-0283-413f-92c9-c072737f4875 req-6ab30aff-ecde-4a68-a6c5-0f3b69581b23 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2342446 Mar 24 02:18:02.383612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['388c1171-5a51-4a13-ad3a-5e02de8f8d78']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:02.409893 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.425947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-2ce1b61f-b45c-467a-a332-828231669f0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet b40ea1e4-8e4c-493d-bab3-f8f91b5462a6 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:02.431036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '12ff0fb4-31e7-4801-83d9-b0fe0c5f5482') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:02.431331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '12ff0fb4-31e7-4801-83d9-b0fe0c5f5482') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:02.443500 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2ce1b61f-b45c-467a-a332-828231669f0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (b40ea1e4-8e4c-493d-bab3-f8f91b5462a6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.449014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.482218 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (12ff0fb4-31e7-4801-83d9-b0fe0c5f5482), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.520779 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-08e007ec-63bb-4a45-8e18-e3bd6743491c req-e4ed39bb-59fa-467c-9ce3-e6763990b99d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2453544 Mar 24 02:18:02.534140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (12ff0fb4-31e7-4801-83d9-b0fe0c5f5482), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.544234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2ce1b61f-b45c-467a-a332-828231669f0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (b40ea1e4-8e4c-493d-bab3-f8f91b5462a6), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.551445 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Releasing vlan 114 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:02.551862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (12ff0fb4-31e7-4801-83d9-b0fe0c5f5482), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:02.573526 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:02.602974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (17fb882c-6eff-4650-ba6f-c10c720662b6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.658952 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Publish callbacks [] for security_group (b5a73a5a-e374-42bc-a7d1-6c0708d9a337), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.665539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b5a73a5a-e374-42bc-a7d1-6c0708d9a337), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.690224 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (388c1171-5a51-4a13-ad3a-5e02de8f8d78), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.694624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.698242 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/networks/388c1171-5a51-4a13-ad3a-5e02de8f8d78 HTTP/1.1" status: 204 len: 168 time: 1.5285141 Mar 24 02:18:02.702263 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32944) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:02.732247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 109} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:18:02.752536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75961150-fe91-4693-894e-b7b6ceff96ce tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Pushing event deleted for resources: {'Network': ['ID=388c1171-5a51-4a13-ad3a-5e02de8f8d78,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:02.761431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5a73a5a-e374-42bc-a7d1-6c0708d9a337,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:02.761671 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-034f0ce7-bcac-498f-854e-bfa110adc89c tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "GET /v2.0/ports?device_id=654913c1-1089-45d5-a685-61f2d36bf588 HTTP/1.1" status: 200 len: 205 time: 0.0555789 Mar 24 02:18:02.766103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32946) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:02.769394 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-87690cf4-2e45-4a20-9f57-a0c61cb3836d admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=6a5cebb9797c446b84c81f5885d7fc64&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4013734 Mar 24 02:18:02.778281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32948) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:02.851335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0ecb8365-8c6b-4988-93b0-262a15edd551), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.851931 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Added segment 0ecb8365-8c6b-4988-93b0-262a15edd551 of type vlan for network da1aec0d-a786-4656-9380-f71f1c64ba05 Mar 24 02:18:02.877379 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ab9d97d-7a5f-45b6-b9e5-7f093c13ea6e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for router (654913c1-1089-45d5-a685-61f2d36bf588), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.880609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2ce1b61f-b45c-467a-a332-828231669f0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (b40ea1e4-8e4c-493d-bab3-f8f91b5462a6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.906882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] device_id is not set on port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:18:02.916986 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks [] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.922208 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d217d969-ad18-4ebb-9f37-8ecb2714eda5 admin admin] Publish callbacks [] for security_group (e80b0763-fef3-438a-a7df-40040c2c747b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.927557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:02.988785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d217d969-ad18-4ebb-9f37-8ecb2714eda5 admin admin] Publish callbacks [] for security_group (e80b0763-fef3-438a-a7df-40040c2c747b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.006089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (da1aec0d-a786-4656-9380-f71f1c64ba05), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.029230 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'Port': ['ID=755b57cd-ff7c-497b-b5ac-7f56139dc2b1,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:03.063897 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:03.064223 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:03.064555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:03.072622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:03.072945 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:03.074642 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 2 to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 Mar 24 02:18:03.085126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0639a7e3-d935-45f9-a3d8-21303c8f5393 None None] Provisioning complete for port aee2f7ee-569a-4b32-9981-c7cefe350ef1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:03.085503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0639a7e3-d935-45f9-a3d8-21303c8f5393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.119850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:03.119850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:03.119850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:03.119850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d217d969-ad18-4ebb-9f37-8ecb2714eda5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e80b0763-fef3-438a-a7df-40040c2c747b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.120294 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d217d969-ad18-4ebb-9f37-8ecb2714eda5 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.121240 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d217d969-ad18-4ebb-9f37-8ecb2714eda5 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/e80b0763-fef3-438a-a7df-40040c2c747b HTTP/1.1" status: 204 len: 168 time: 0.3420370 Mar 24 02:18:03.129159 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:03.129486 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:03.133477 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 3 to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 Mar 24 02:18:03.138610 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0639a7e3-d935-45f9-a3d8-21303c8f5393 None None] Port aee2f7ee-569a-4b32-9981-c7cefe350ef1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:03.144575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (da1aec0d-a786-4656-9380-f71f1c64ba05), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.145623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:03.146370 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.152570 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0639a7e3-d935-45f9-a3d8-21303c8f5393 None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:03.153253 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0639a7e3-d935-45f9-a3d8-21303c8f5393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.163127 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d217d969-ad18-4ebb-9f37-8ecb2714eda5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e80b0763-fef3-438a-a7df-40040c2c747b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:03.172409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ab9d97d-7a5f-45b6-b9e5-7f093c13ea6e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (654913c1-1089-45d5-a685-61f2d36bf588), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.173725 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:03.173852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:03.174296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:03.186243 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:03.186600 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:03.187183 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 4 to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 Mar 24 02:18:03.196616 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.8530216 Mar 24 02:18:03.196616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2ce1b61f-b45c-467a-a332-828231669f0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (b40ea1e4-8e4c-493d-bab3-f8f91b5462a6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.200423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32952) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:03.205970 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Request body: {'subnet': {'network_id': 'da1aec0d-a786-4656-9380-f71f1c64ba05', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1548578822-subnet', 'tenant_id': '4419a48020f546a6abf15b6c1b4cdbdb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:03.226671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:03.227015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:03.227344 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:03.234481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ab9d97d-7a5f-45b6-b9e5-7f093c13ea6e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for router_controller (654913c1-1089-45d5-a685-61f2d36bf588), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.242891 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port b4861b01-4f78-41bc-a1e1-8876aa529776 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:03.243212 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.285872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0639a7e3-d935-45f9-a3d8-21303c8f5393 None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:03.291301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ce1b61f-b45c-467a-a332-828231669f0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=b40ea1e4-8e4c-493d-bab3-f8f91b5462a6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:03.295047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f5e6bfe-5e8a-49ed-a77d-ee9a96437789 None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:03.325898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:03.326223 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:03.331183 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 5 to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 Mar 24 02:18:03.334732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2ce1b61f-b45c-467a-a332-828231669f0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.337189 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Made reservation on behalf of 4419a48020f546a6abf15b6c1b4cdbdb for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:03.339039 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2ce1b61f-b45c-467a-a332-828231669f0c tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/b40ea1e4-8e4c-493d-bab3-f8f91b5462a6 HTTP/1.1" status: 204 len: 168 time: 1.1569831 Mar 24 02:18:03.339529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.347511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32954) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:03.349054 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.352171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8ea1b0c-3011-4933-a58b-08ef65f6fd09 admin admin] Pushing event updated for resources: {'Network': ['ID=da1aec0d-a786-4656-9380-f71f1c64ba05,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:03.365576 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ab9d97d-7a5f-45b6-b9e5-7f093c13ea6e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (654913c1-1089-45d5-a685-61f2d36bf588), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.366200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1ab9d97d-7a5f-45b6-b9e5-7f093c13ea6e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Fanout notify agent at l3_agent the message router_deleted on router 654913c1-1089-45d5-a685-61f2d36bf588 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:18:03.377490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ab9d97d-7a5f-45b6-b9e5-7f093c13ea6e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.387536 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1ab9d97d-7a5f-45b6-b9e5-7f093c13ea6e tempest-RoutersNegativeIpV6Test-1305319122 tempest-RoutersNegativeIpV6Test-1305319122-project] 10.222.0.20 "DELETE /v2.0/routers/654913c1-1089-45d5-a685-61f2d36bf588 HTTP/1.1" status: 204 len: 168 time: 0.6103272 Mar 24 02:18:03.410256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network da1aec0d-a786-4656-9380-f71f1c64ba05 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:18:03.458012 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for b4861b01-4f78-41bc-a1e1-8876aa529776 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:03.463563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:03.463893 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:03.464225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:03.472015 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-bb5d0a2f-676b-4583-b488-2f1e37fb5d57 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:03.472466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bb5d0a2f-676b-4583-b488-2f1e37fb5d57 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:03.475558 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bb5d0a2f-676b-4583-b488-2f1e37fb5d57 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/944064c8-2071-42aa-b2a3-4fdbf39aa8ed HTTP/1.1" status: 404 len: 337 time: 0.1237888 Mar 24 02:18:03.478705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32962) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:03.485353 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:03.485723 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:03.491058 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 6 to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 Mar 24 02:18:03.588409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-85272763-3ab1-4fb2-bb0f-0a31e4ec8c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting subnet 824de909-ed6d-42eb-91e2-7f0e51862ab0 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:03.597444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85272763-3ab1-4fb2-bb0f-0a31e4ec8c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (824de909-ed6d-42eb-91e2-7f0e51862ab0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.702225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85272763-3ab1-4fb2-bb0f-0a31e4ec8c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (824de909-ed6d-42eb-91e2-7f0e51862ab0), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.708208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.804997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849f416e-35c0-49e8-bca9-c116db2876d6 req-fa042526-f6cd-4947-af0a-324a80dd4a90 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:03.806582 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-849f416e-35c0-49e8-bca9-c116db2876d6 req-fa042526-f6cd-4947-af0a-324a80dd4a90 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 946 time: 0.1605418 Mar 24 02:18:03.828031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:03.828547 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:03.828803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:03.837130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (1a07dda3-b4d8-484a-9399-92d0432cd074), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.870812 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:03.870812 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:03.875571 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 7 to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 Mar 24 02:18:03.900930 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:03.901287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:03.901692 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:03.901811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32974) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:03.905394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85272763-3ab1-4fb2-bb0f-0a31e4ec8c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (824de909-ed6d-42eb-91e2-7f0e51862ab0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:03.924108 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:03.924467 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:03.927576 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 8 to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 Mar 24 02:18:03.942974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Pushing event updated for resources: {'Subnet': ['ID=1a07dda3-b4d8-484a-9399-92d0432cd074,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:03.959455 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-849f416e-35c0-49e8-bca9-c116db2876d6 req-55eb2cab-8a65-48e8-8514-509b2aecaad1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1409798 Mar 24 02:18:03.964227 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:03.964567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:03.964903 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:04.003386 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85272763-3ab1-4fb2-bb0f-0a31e4ec8c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (824de909-ed6d-42eb-91e2-7f0e51862ab0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.021774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:04.022113 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:04.029739 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 9 to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 Mar 24 02:18:04.036683 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Checking segment: {'id': '0ecb8365-8c6b-4988-93b0-262a15edd551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'da1aec0d-a786-4656-9380-f71f1c64ba05'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:04.037050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Network hostable DHCP agents. Network: da1aec0d-a786-4656-9380-f71f1c64ba05, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:18:04.063830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85272763-3ab1-4fb2-bb0f-0a31e4ec8c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Subnet': ['ID=824de909-ed6d-42eb-91e2-7f0e51862ab0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:04.076769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:04.077279 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:04.078114 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:04.083123 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85272763-3ab1-4fb2-bb0f-0a31e4ec8c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.087941 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-85272763-3ab1-4fb2-bb0f-0a31e4ec8c31 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/824de909-ed6d-42eb-91e2-7f0e51862ab0 HTTP/1.1" status: 204 len: 168 time: 0.6081166 Mar 24 02:18:04.088107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:04.088505 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:04.089090 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b4861b01-4f78-41bc-a1e1-8876aa529776), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.090670 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32984) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.102224 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 10 to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 Mar 24 02:18:04.136520 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-c67066fb-4ad9-4f59-89e9-d56678c113be tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:04.136981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c67066fb-4ad9-4f59-89e9-d56678c113be tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:04.137680 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Network da1aec0d-a786-4656-9380-f71f1c64ba05 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:18:04.144625 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c67066fb-4ad9-4f59-89e9-d56678c113be tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/afd24e27-ea10-4df7-bb48-bdbdad6fea6e HTTP/1.1" status: 404 len: 337 time: 0.0524945 Mar 24 02:18:04.146438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32986) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.156227 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=b4861b01-4f78-41bc-a1e1-8876aa529776,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:04.168751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:04.169328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:04.169784 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:04.201173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32990) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.201752 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b2fea334-59ac-43d0-a857-a687ec22e2c8 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "GET /v2.0/ports?device_id=3883e4b6-f9e8-4aa8-a086-9e79f159c9af HTTP/1.1" status: 200 len: 205 time: 0.0535526 Mar 24 02:18:04.209040 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, da1aec0d-a786-4656-9380-f71f1c64ba05) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:04.224831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe1b2491-0636-443d-9fa6-b2e110518313 None None] Network da1aec0d-a786-4656-9380-f71f1c64ba05 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:04.225609 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:04.226032 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:04.226779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.250956 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:04.253869 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fb4357c3-e99f-491c-8b6e-db2edb9a05e4 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=3dbc846d991b4af0ae231d5e469488ba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3488350 Mar 24 02:18:04.254033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32992) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.254635 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.335868 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebe454bc-dff9-44a5-9ac8-5147b9c150a4 admin admin] Publish callbacks [] for security_group (8e03c73a-6dd7-49d2-a8f0-97deffea2cf6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.369204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e41b12c6-5662-460e-881e-7d37d2e28ad6 None None] Network da1aec0d-a786-4656-9380-f71f1c64ba05 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:04.379236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebe454bc-dff9-44a5-9ac8-5147b9c150a4 admin admin] Publish callbacks [] for security_group (8e03c73a-6dd7-49d2-a8f0-97deffea2cf6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.397094 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-494fa919-4ae2-4883-a558-79ad69dc5fc1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] delete failed (client error): The resource could not be found. Mar 24 02:18:04.401000 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-494fa919-4ae2-4883-a558-79ad69dc5fc1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/routers/3883e4b6-f9e8-4aa8-a086-9e79f159c9af HTTP/1.1" status: 404 len: 336 time: 0.1981874 Mar 24 02:18:04.401583 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 32994) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.435280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 32996) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.462478 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-f63a741a-fd7b-4161-a6a5-5503864ff809 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:04.462478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f63a741a-fd7b-4161-a6a5-5503864ff809 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:04.471765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33000) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.473185 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f63a741a-fd7b-4161-a6a5-5503864ff809 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/cd78dad5-3c1f-4120-a512-210673826474 HTTP/1.1" status: 404 len: 337 time: 0.0492592 Mar 24 02:18:04.485359 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bb8a47f1-0245-4812-9b9b-21d10bf81aee admin admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2804081 Mar 24 02:18:04.558151 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-1dc53d79-1292-419c-bfe1-7e63c32559ed tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:04.558645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1dc53d79-1292-419c-bfe1-7e63c32559ed tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:04.571071 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1dc53d79-1292-419c-bfe1-7e63c32559ed tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/f84cb7fe-4be1-41a6-8681-a1b8155acbdc HTTP/1.1" status: 404 len: 337 time: 0.0977366 Mar 24 02:18:04.578556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33004) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.591043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebe454bc-dff9-44a5-9ac8-5147b9c150a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8e03c73a-6dd7-49d2-a8f0-97deffea2cf6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.594013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebe454bc-dff9-44a5-9ac8-5147b9c150a4 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.595376 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ebe454bc-dff9-44a5-9ac8-5147b9c150a4 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/8e03c73a-6dd7-49d2-a8f0-97deffea2cf6 HTTP/1.1" status: 204 len: 168 time: 0.3399940 Mar 24 02:18:04.621635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe454bc-dff9-44a5-9ac8-5147b9c150a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e03c73a-6dd7-49d2-a8f0-97deffea2cf6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:04.622001 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69b6aaef-f0c2-47fb-b5e3-9697843f5221 None None] Network 8ec9fea4-b38d-4612-9d1d-87145ce2366f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:04.624363 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-c42408f6-c694-4ad5-a726-1c1c103eca17 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:04.625011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c42408f6-c694-4ad5-a726-1c1c103eca17 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:04.627520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (17fb882c-6eff-4650-ba6f-c10c720662b6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.630465 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c42408f6-c694-4ad5-a726-1c1c103eca17 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/dc00a534-aed7-41fa-ad57-69f513f5a472 HTTP/1.1" status: 404 len: 337 time: 0.0503137 Mar 24 02:18:04.633281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33008) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.643639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] For port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1, host hv-neutron-8348, cleared binding levels {{(pid=104036) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:04.644472 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempted to set empty binding levels {{(pid=104036) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Mar 24 02:18:04.690359 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-0072379b-2be6-41c9-817f-76968433f248 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:04.692619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0072379b-2be6-41c9-817f-76968433f248 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:04.696682 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0072379b-2be6-41c9-817f-76968433f248 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/ac55636d-05b0-427e-819a-3f1e8335d3af HTTP/1.1" status: 404 len: 333 time: 0.0618582 Mar 24 02:18:04.701211 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-337c2ab5-9b13-40d8-9388-417f00b2703d None None] Provisioning complete for port aee2f7ee-569a-4b32-9981-c7cefe350ef1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:04.701585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-337c2ab5-9b13-40d8-9388-417f00b2703d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.704114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ed268dac-2fd4-4aa2-b0c7-cb38d0e781b7 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'default'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:04.705263 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-ed268dac-2fd4-4aa2-b0c7-cb38d0e781b7 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Mar 24 02:18:04.705763 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-ed268dac-2fd4-4aa2-b0c7-cb38d0e781b7 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): There was a conflict when trying to complete your request. Mar 24 02:18:04.719491 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ed268dac-2fd4-4aa2-b0c7-cb38d0e781b7 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.2802260 Mar 24 02:18:04.719491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33010) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.719779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33014) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.732571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.749124 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] In _notify_port_updated(), no bound segment for port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:18:04.750404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:04.751537 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.753010 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "PUT /v2.0/ports/755b57cd-ff7c-497b-b5ac-7f56139dc2b1 HTTP/1.1" status: 200 len: 979 time: 2.3978796 Mar 24 02:18:04.762617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-337c2ab5-9b13-40d8-9388-417f00b2703d None None] Port aee2f7ee-569a-4b32-9981-c7cefe350ef1 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:04.771940 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33016) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.779458 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-337c2ab5-9b13-40d8-9388-417f00b2703d None None] Provisioning complete for port a556ca5d-ed98-488b-8079-7f9b8d39c082 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:04.779778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-337c2ab5-9b13-40d8-9388-417f00b2703d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.780668 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-49827434-2a49-42bf-a2f6-4628d1bcd9ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:04.783865 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-49827434-2a49-42bf-a2f6-4628d1bcd9ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:04.793438 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-49827434-2a49-42bf-a2f6-4628d1bcd9ae tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/5f7cd9dd-83ad-4dce-b46c-1b7e5ecc90aa HTTP/1.1" status: 404 len: 337 time: 0.0746059 Mar 24 02:18:04.799325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--1466056856'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:04.818541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33018) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.845733 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.857564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.926848 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-e7af7f1f-68ac-4de7-80bd-f7f38ac802d2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:04.927419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e7af7f1f-68ac-4de7-80bd-f7f38ac802d2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:04.930799 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e7af7f1f-68ac-4de7-80bd-f7f38ac802d2 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/832612c5-f8b1-4313-969a-7a9490b97979 HTTP/1.1" status: 404 len: 337 time: 0.1112866 Mar 24 02:18:04.964786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908ee14f-b693-47eb-951e-62ae2ce3b9bc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'Port': ['ID=755b57cd-ff7c-497b-b5ac-7f56139dc2b1,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:04.970437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33020) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:04.976790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (b16d6671-01ab-4b03-be36-5c7cd0c7c655), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:04.987148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b16d6671-01ab-4b03-be36-5c7cd0c7c655), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.011331 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-1441af9d-4c6c-4430-8304-421bf8b45ed1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:05.011331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1441af9d-4c6c-4430-8304-421bf8b45ed1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:05.011331 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1441af9d-4c6c-4430-8304-421bf8b45ed1 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/b678d21a-db3f-40e1-ac7d-3b435406dbb7 HTTP/1.1" status: 404 len: 333 time: 0.0324461 Mar 24 02:18:05.011331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33026) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.056386 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-781dbfe9-214d-4c28-9317-8939fd4b70e5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:05.056854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-781dbfe9-214d-4c28-9317-8939fd4b70e5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:05.060087 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-781dbfe9-214d-4c28-9317-8939fd4b70e5 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/cddfa930-bd7b-4fb5-8f6c-3296e0135ef7 HTTP/1.1" status: 404 len: 337 time: 0.0481825 Mar 24 02:18:05.062295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router 17fb882c-6eff-4650-ba6f-c10c720662b6 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:05.064078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33028) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.113659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b16d6671-01ab-4b03-be36-5c7cd0c7c655,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:05.119680 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.119680 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.120144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.120590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.121137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.121624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.122138 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.122630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.123102 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.123567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.124034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.124503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.124966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.125613 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.126156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.129339 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-57f2a077-2a0d-46bc-9655-c1f113b12b99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "GET /v2.0/ports HTTP/1.1" status: 200 len: 14007 time: 0.3547378 Mar 24 02:18:05.132871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33030) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.144672 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b6d7817-d921-4d60-8f28-621bc0c072c9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:05.145101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1b6d7817-d921-4d60-8f28-621bc0c072c9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:05.148645 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1b6d7817-d921-4d60-8f28-621bc0c072c9 tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/subnets/04aa60b1-669f-48fd-bf85-14b2a8d09559 HTTP/1.1" status: 404 len: 337 time: 0.0830898 Mar 24 02:18:05.152441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33032) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.178401 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-337c2ab5-9b13-40d8-9388-417f00b2703d None None] Current status of the port a556ca5d-ed98-488b-8079-7f9b8d39c082 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:05.200938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e97b37f-4aa6-429c-b79b-bf48e8e8b989 None None] DHCP port deletion for 8ec9fea4-b38d-4612-9d1d-87145ce2366f request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:18:05.278200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052a8cc7-3d50-4c8d-b9e7-6476ba012ebd req-b0c85932-9581-4e2c-9f62-f003bc2d48fb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.280283 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-052a8cc7-3d50-4c8d-b9e7-6476ba012ebd req-b0c85932-9581-4e2c-9f62-f003bc2d48fb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 946 time: 0.1569531 Mar 24 02:18:05.309755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3e97b37f-4aa6-429c-b79b-bf48e8e8b989 None None] Deleting port a556ca5d-ed98-488b-8079-7f9b8d39c082 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:05.310248 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e97b37f-4aa6-429c-b79b-bf48e8e8b989 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.330572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:05.343675 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79d0a6a0-e61d-4ea4-985c-90434183b5cf None None] Sync routers for ids ['17fb882c-6eff-4650-ba6f-c10c720662b6'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:05.361808 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79d0a6a0-e61d-4ea4-985c-90434183b5cf None None] Routers {'17fb882c-6eff-4650-ba6f-c10c720662b6'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:05.363368 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-79d0a6a0-e61d-4ea4-985c-90434183b5cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['17fb882c-6eff-4650-ba6f-c10c720662b6'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:05.392166 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-052a8cc7-3d50-4c8d-b9e7-6476ba012ebd req-871bd00d-6689-4ba9-8566-3c482b78cd5b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1023242 Mar 24 02:18:05.398038 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (e9deb428-6192-4213-9844-4cb352560df1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.423958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e9deb428-6192-4213-9844-4cb352560df1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.425467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3e97b37f-4aa6-429c-b79b-bf48e8e8b989 None None] For port a556ca5d-ed98-488b-8079-7f9b8d39c082, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a556ca5d-ed98-488b-8079-7f9b8d39c082,segment=NetworkSegment(90bce2cd-2d9e-4697-bef8-e219d1c040c9),segment_id=90bce2cd-2d9e-4697-bef8-e219d1c040c9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:05.426079 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e97b37f-4aa6-429c-b79b-bf48e8e8b989 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.447580 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-79d0a6a0-e61d-4ea4-985c-90434183b5cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:05.456193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3e97b37f-4aa6-429c-b79b-bf48e8e8b989 None None] Calling delete_port for a556ca5d-ed98-488b-8079-7f9b8d39c082 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:05.467347 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79d0a6a0-e61d-4ea4-985c-90434183b5cf None None] Routers {'17fb882c-6eff-4650-ba6f-c10c720662b6'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:05.470881 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-79d0a6a0-e61d-4ea4-985c-90434183b5cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['17fb882c-6eff-4650-ba6f-c10c720662b6'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:05.511322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.513007 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.7335262 Mar 24 02:18:05.532020 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-79d0a6a0-e61d-4ea4-985c-90434183b5cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:05.533220 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79d0a6a0-e61d-4ea4-985c-90434183b5cf None None] The sync data for ids ['17fb882c-6eff-4650-ba6f-c10c720662b6'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:05.537045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc3bb90-b544-44bb-bdb4-a416cdc79ccf tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e9deb428-6192-4213-9844-4cb352560df1,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:05.547569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33038) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.560147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-38893896-3caf-4a00-b62f-683ed26f1885 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': 'e9deb428-6192-4213-9844-4cb352560df1', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:05.582561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3e97b37f-4aa6-429c-b79b-bf48e8e8b989 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (a556ca5d-ed98-488b-8079-7f9b8d39c082), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.601054 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e97b37f-4aa6-429c-b79b-bf48e8e8b989 None None] No DVR routers for this DVR port a556ca5d-ed98-488b-8079-7f9b8d39c082 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:05.613384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d83c2b-31c2-4c1a-8912-ae302ebf938d req-06748aba-3995-429d-b07a-514bb92c8e60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:05.621605 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-57d83c2b-31c2-4c1a-8912-ae302ebf938d req-06748aba-3995-429d-b07a-514bb92c8e60 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 946 time: 0.1274920 Mar 24 02:18:05.627639 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e97b37f-4aa6-429c-b79b-bf48e8e8b989 None None] Pushing event deleted for resources: {'Port': ['ID=a556ca5d-ed98-488b-8079-7f9b8d39c082,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:05.649605 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-38893896-3caf-4a00-b62f-683ed26f1885 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group_rule (17069dfb-e1fd-4c69-8ee9-03be08644919), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.655033 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f5320b28-66c3-4bcf-9e95-80a620dd6fc7 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/17fb882c-6eff-4650-ba6f-c10c720662b6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9415705 Mar 24 02:18:05.658945 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33044) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.695422 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a3170a86-ec65-430e-88e6-4fc837d0b92b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=17fb882c-6eff-4650-ba6f-c10c720662b6 HTTP/1.1" status: 200 len: 205 time: 0.0310431 Mar 24 02:18:05.698408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33046) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.709302 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-57d83c2b-31c2-4c1a-8912-ae302ebf938d req-d164f125-86c3-480b-a505-2713e9698e32 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0854993 Mar 24 02:18:05.723139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-38893896-3caf-4a00-b62f-683ed26f1885 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group_rule (17069dfb-e1fd-4c69-8ee9-03be08644919), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.729676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-38893896-3caf-4a00-b62f-683ed26f1885 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (17069dfb-e1fd-4c69-8ee9-03be08644919), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.746568 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38893896-3caf-4a00-b62f-683ed26f1885 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=17069dfb-e1fd-4c69-8ee9-03be08644919,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:05.764114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-38893896-3caf-4a00-b62f-683ed26f1885 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.768909 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-38893896-3caf-4a00-b62f-683ed26f1885 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2109370 Mar 24 02:18:05.769119 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33050) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.773633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-490bba56-23a0-45c4-ac76-6b070af56359 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': 'e9deb428-6192-4213-9844-4cb352560df1', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:05.805494 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0e79548e-ffa9-41a0-b2c0-37343b8f4cd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (17fb882c-6eff-4650-ba6f-c10c720662b6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.808275 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-490bba56-23a0-45c4-ac76-6b070af56359 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group_rule (1185d71a-19e7-416e-87d3-5a24b0b10193), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.811316 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1feb517c-a99c-4d54-9a99-2dadd3703bd7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Deleting port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:05.811316 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1feb517c-a99c-4d54-9a99-2dadd3703bd7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.828693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33054) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.834646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-653705172-network', 'tenant_id': 'd1ea2c09df3341759fd289649513d9e3'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:05.865919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Made reservation on behalf of d1ea2c09df3341759fd289649513d9e3 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:05.867410 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.880833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.889713 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-490bba56-23a0-45c4-ac76-6b070af56359 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): There was a conflict when trying to complete your request. Mar 24 02:18:05.890710 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-490bba56-23a0-45c4-ac76-6b070af56359 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.1206174 Mar 24 02:18:05.894043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33058) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:05.935669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-d4a09578-487c-46bb-ac49-45a7f7d03eab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Deleting port aee2f7ee-569a-4b32-9981-c7cefe350ef1 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:05.936268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4a09578-487c-46bb-ac49-45a7f7d03eab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:05.976107 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cce263c9-308f-47fb-8acd-7360265e6888 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (e9deb428-6192-4213-9844-4cb352560df1), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.010573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cce263c9-308f-47fb-8acd-7360265e6888 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (e9deb428-6192-4213-9844-4cb352560df1), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.018080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-1feb517c-a99c-4d54-9a99-2dadd3703bd7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] For port 755b57cd-ff7c-497b-b5ac-7f56139dc2b1, host hv-neutron-8348, got binding levels [] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:06.018442 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1feb517c-a99c-4d54-9a99-2dadd3703bd7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.040230 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Publish callbacks [] for security_group (dbef6ee0-824b-40ae-a0f3-d0dc5087f9d7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.052156 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (dbef6ee0-824b-40ae-a0f3-d0dc5087f9d7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.075478 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 124} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:18:06.090853 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-1feb517c-a99c-4d54-9a99-2dadd3703bd7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Calling delete_port for 755b57cd-ff7c-497b-b5ac-7f56139dc2b1 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:06.091093 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbef6ee0-824b-40ae-a0f3-d0dc5087f9d7,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:06.105314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b87f063e-d800-4f8f-91eb-11c88973a4f1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.105654 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Added segment b87f063e-d800-4f8f-91eb-11c88973a4f1 of type vlan for network 60758fac-dd1e-4f59-9ff1-aee874ad86dc Mar 24 02:18:06.106964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cce263c9-308f-47fb-8acd-7360265e6888 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e9deb428-6192-4213-9844-4cb352560df1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.109561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cce263c9-308f-47fb-8acd-7360265e6888 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.110767 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cce263c9-308f-47fb-8acd-7360265e6888 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/e9deb428-6192-4213-9844-4cb352560df1 HTTP/1.1" status: 204 len: 168 time: 0.2157817 Mar 24 02:18:06.119978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33062) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.129506 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4a09578-487c-46bb-ac49-45a7f7d03eab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.149250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-d4a09578-487c-46bb-ac49-45a7f7d03eab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Calling delete_port for aee2f7ee-569a-4b32-9981-c7cefe350ef1 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:06.156771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cce263c9-308f-47fb-8acd-7360265e6888 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9deb428-6192-4213-9844-4cb352560df1,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:06.169003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0e79548e-ffa9-41a0-b2c0-37343b8f4cd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (17fb882c-6eff-4650-ba6f-c10c720662b6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.185664 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (60758fac-dd1e-4f59-9ff1-aee874ad86dc), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.201706 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0e79548e-ffa9-41a0-b2c0-37343b8f4cd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (17fb882c-6eff-4650-ba6f-c10c720662b6), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.229343 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-521b88cf-55b0-4d5f-905c-e3296e6397ca tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1063454 Mar 24 02:18:06.233556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33064) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.240086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-cf8df936-cb3d-4ef9-9693-e1709c8381be tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--1913447762'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:06.242701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a556ca5d-ed98-488b-8079-7f9b8d39c082 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:06.256621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (60758fac-dd1e-4f59-9ff1-aee874ad86dc), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.257694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:06.258475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.266025 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: a556ca5d-ed98-488b-8079-7f9b8d39c082 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:06.267035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a556ca5d-ed98-488b-8079-7f9b8d39c082 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:06.301989 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0e79548e-ffa9-41a0-b2c0-37343b8f4cd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (17fb882c-6eff-4650-ba6f-c10c720662b6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.302488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e79548e-ffa9-41a0-b2c0-37343b8f4cd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Fanout notify agent at l3_agent the message router_deleted on router 17fb882c-6eff-4650-ba6f-c10c720662b6 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:18:06.316864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0e79548e-ffa9-41a0-b2c0-37343b8f4cd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.317968 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0e79548e-ffa9-41a0-b2c0-37343b8f4cd4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/17fb882c-6eff-4650-ba6f-c10c720662b6 HTTP/1.1" status: 204 len: 168 time: 0.6175275 Mar 24 02:18:06.321216 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33066) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.332046 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf8df936-cb3d-4ef9-9693-e1709c8381be tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.343980 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5137484 Mar 24 02:18:06.346468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33068) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.358847 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Request body: {'subnet': {'network_id': '60758fac-dd1e-4f59-9ff1-aee874ad86dc', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-653705172-subnet', 'tenant_id': 'd1ea2c09df3341759fd289649513d9e3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:06.365731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bba8407e-50b9-4ba3-93a8-21481edb22f2 admin admin] Pushing event updated for resources: {'Network': ['ID=60758fac-dd1e-4f59-9ff1-aee874ad86dc,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:06.384389 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 60758fac-dd1e-4f59-9ff1-aee874ad86dc details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:18:06.388439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1feb517c-a99c-4d54-9a99-2dadd3703bd7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (755b57cd-ff7c-497b-b5ac-7f56139dc2b1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.402426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-e4b655ac-fc46-4431-a117-49294fe84c85 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting subnet 9f9fea3e-31d0-443c-a06b-ff1b47b07b4c {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:06.404691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4a09578-487c-46bb-ac49-45a7f7d03eab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (aee2f7ee-569a-4b32-9981-c7cefe350ef1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.410276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Made reservation on behalf of d1ea2c09df3341759fd289649513d9e3 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:06.412813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.430560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b655ac-fc46-4431-a117-49294fe84c85 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (9f9fea3e-31d0-443c-a06b-ff1b47b07b4c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.456703 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1feb517c-a99c-4d54-9a99-2dadd3703bd7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event deleted for resources: {'Port': ['ID=755b57cd-ff7c-497b-b5ac-7f56139dc2b1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:06.497411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf8df936-cb3d-4ef9-9693-e1709c8381be tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (855e16b3-664e-4096-b873-0fcba6df775e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.498792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1feb517c-a99c-4d54-9a99-2dadd3703bd7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.505397 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1feb517c-a99c-4d54-9a99-2dadd3703bd7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "DELETE /v2.0/ports/755b57cd-ff7c-497b-b5ac-7f56139dc2b1 HTTP/1.1" status: 204 len: 168 time: 1.3691955 Mar 24 02:18:06.505986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf8df936-cb3d-4ef9-9693-e1709c8381be tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (855e16b3-664e-4096-b873-0fcba6df775e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.506470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33070) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.508718 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4a09578-487c-46bb-ac49-45a7f7d03eab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Port': ['ID=aee2f7ee-569a-4b32-9981-c7cefe350ef1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:06.520746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d4a09578-487c-46bb-ac49-45a7f7d03eab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.526105 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d4a09578-487c-46bb-ac49-45a7f7d03eab tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/ports/aee2f7ee-569a-4b32-9981-c7cefe350ef1 HTTP/1.1" status: 204 len: 168 time: 1.3706822 Mar 24 02:18:06.526820 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b655ac-fc46-4431-a117-49294fe84c85 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (9f9fea3e-31d0-443c-a06b-ff1b47b07b4c), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.528960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33072) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.554836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cf8df936-cb3d-4ef9-9693-e1709c8381be tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.556035 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cf8df936-cb3d-4ef9-9693-e1709c8381be tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3213627 Mar 24 02:18:06.568991 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33074) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.577083 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-27b2b595-969e-4907-bd8c-345239abd6dd tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '855e16b3-664e-4096-b873-0fcba6df775e', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:06.577861 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-27b2b595-969e-4907-bd8c-345239abd6dd tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Mar 24 02:18:06.578346 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-27b2b595-969e-4907-bd8c-345239abd6dd tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:06.579385 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-27b2b595-969e-4907-bd8c-345239abd6dd tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0090826 Mar 24 02:18:06.580380 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-dd719748-36fa-4dda-90b4-ff88199d2a9c tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] GET failed (client error): The resource could not be found. Mar 24 02:18:06.582838 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dd719748-36fa-4dda-90b4-ff88199d2a9c tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "GET /v2.0/ports/755b57cd-ff7c-497b-b5ac-7f56139dc2b1 HTTP/1.1" status: 404 len: 333 time: 0.0710478 Mar 24 02:18:06.585649 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33076) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.586470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33078) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.599082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-476053035', 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:06.603029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf8df936-cb3d-4ef9-9693-e1709c8381be tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=855e16b3-664e-4096-b873-0fcba6df775e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:06.652964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (8ec9fea4-b38d-4612-9d1d-87145ce2366f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.670622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Made reservation on behalf of c067301dc45b4f2aba081cc64b7888c1 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:06.673487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.706632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] device_id is not set on port 1252f865-0895-4436-8d71-4d7218f365f6 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:18:06.718585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b655ac-fc46-4431-a117-49294fe84c85 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (9f9fea3e-31d0-443c-a06b-ff1b47b07b4c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.774439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d16d39ea-036b-4a4d-9a2f-33ffc6408b74 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (855e16b3-664e-4096-b873-0fcba6df775e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.782844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (c8b7b0df-575a-4283-b87a-2cdfbf0e6a0f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.792698 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (8ec9fea4-b38d-4612-9d1d-87145ce2366f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.832865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d16d39ea-036b-4a4d-9a2f-33ffc6408b74 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (855e16b3-664e-4096-b873-0fcba6df775e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.851430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8ec9fea4-b38d-4612-9d1d-87145ce2366f']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:06.871459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '90bce2cd-2d9e-4697-bef8-e219d1c040c9') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:06.871708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '90bce2cd-2d9e-4697-bef8-e219d1c040c9') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:06.874886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c8b7b0df-575a-4283-b87a-2cdfbf0e6a0f,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:06.878976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b655ac-fc46-4431-a117-49294fe84c85 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (9f9fea3e-31d0-443c-a06b-ff1b47b07b4c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.887893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (90bce2cd-2d9e-4697-bef8-e219d1c040c9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.895706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Checking segment: {'id': 'b87f063e-d800-4f8f-91eb-11c88973a4f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '60758fac-dd1e-4f59-9ff1-aee874ad86dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:06.896059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Network hostable DHCP agents. Network: 60758fac-dd1e-4f59-9ff1-aee874ad86dc, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:18:06.909971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (90bce2cd-2d9e-4697-bef8-e219d1c040c9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.919812 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Releasing vlan 118 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:06.920203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (90bce2cd-2d9e-4697-bef8-e219d1c040c9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:06.923772 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:06.933295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Network 60758fac-dd1e-4f59-9ff1-aee874ad86dc is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:18:06.959735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b655ac-fc46-4431-a117-49294fe84c85 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Subnet': ['ID=9f9fea3e-31d0-443c-a06b-ff1b47b07b4c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:06.969118 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b655ac-fc46-4431-a117-49294fe84c85 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.973237 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e4b655ac-fc46-4431-a117-49294fe84c85 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/9f9fea3e-31d0-443c-a06b-ff1b47b07b4c HTTP/1.1" status: 204 len: 168 time: 0.6498177 Mar 24 02:18:06.974830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 60758fac-dd1e-4f59-9ff1-aee874ad86dc) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:06.977930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33082) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:06.988024 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d5b148a-79a6-4912-b021-95402f2e842f None None] Network 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:06.989163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d16d39ea-036b-4a4d-9a2f-33ffc6408b74 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (855e16b3-664e-4096-b873-0fcba6df775e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.991574 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d16d39ea-036b-4a4d-9a2f-33ffc6408b74 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.991841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:06.995069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:06.995215 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d16d39ea-036b-4a4d-9a2f-33ffc6408b74 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/855e16b3-664e-4096-b873-0fcba6df775e HTTP/1.1" status: 204 len: 168 time: 0.4070306 Mar 24 02:18:07.002767 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33084) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.023821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks [] for port (1252f865-0895-4436-8d71-4d7218f365f6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.030648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d16d39ea-036b-4a4d-9a2f-33ffc6408b74 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=855e16b3-664e-4096-b873-0fcba6df775e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:07.048631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (8ec9fea4-b38d-4612-9d1d-87145ce2366f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.049260 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-002e555e-357c-499c-b6cf-62746306e0e3 None None] Network 60758fac-dd1e-4f59-9ff1-aee874ad86dc requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:07.064900 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.068237 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] 10.222.0.20 "DELETE /v2.0/networks/8ec9fea4-b38d-4612-9d1d-87145ce2366f HTTP/1.1" status: 204 len: 168 time: 0.5378184 Mar 24 02:18:07.083538 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-aca35d62-4d6c-4e12-b54c-be904fab24a6 admin admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.7310774 Mar 24 02:18:07.093132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5017eb1-3716-421c-a5e1-792015f240ad tempest-PortsIpV6TestJSON-206325795 tempest-PortsIpV6TestJSON-206325795-project] Pushing event deleted for resources: {'Network': ['ID=8ec9fea4-b38d-4612-9d1d-87145ce2366f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:07.093326 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-14bf4ee9-dffd-44c6-8595-b5a61b6c4666 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0861833 Mar 24 02:18:07.093419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33090) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.099807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1ff20705-7ad0-4ed2-8dba-5d3897ac7f09 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--2140146994'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:07.100250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (8e4318a8-0a0c-46ae-a03a-45d69e971ed8), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.134051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (1252f865-0895-4436-8d71-4d7218f365f6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.175651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Network 68479eb8-4769-40a2-a486-b1f8a55226e1 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:07.177912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ff20705-7ad0-4ed2-8dba-5d3897ac7f09 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.199912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:07.200262 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.237556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:07.240801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:07.243491 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:07.243625 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33092) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.243734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.248476 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56951f62-0e26-4b87-8229-67f33280de82 None None] Network 60758fac-dd1e-4f59-9ff1-aee874ad86dc requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:07.338154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'Port': ['ID=1252f865-0895-4436-8d71-4d7218f365f6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:07.356518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd0b1ace-9ee3-4ec9-a7f8-57caa210e0b0 None None] DHCP port deletion for 8e4318a8-0a0c-46ae-a03a-45d69e971ed8 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:18:07.424794 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ff20705-7ad0-4ed2-8dba-5d3897ac7f09 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (417a1bcd-8a1e-4a29-bd9b-4aabf537cb72), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.434593 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8e463875-c491-41cf-b162-db0663bd13f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 0.8441663 Mar 24 02:18:07.434928 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ff20705-7ad0-4ed2-8dba-5d3897ac7f09 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (417a1bcd-8a1e-4a29-bd9b-4aabf537cb72), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.447423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33096) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.452445 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-cd0b1ace-9ee3-4ec9-a7f8-57caa210e0b0 None None] Deleting port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:07.452746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cd0b1ace-9ee3-4ec9-a7f8-57caa210e0b0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.517227 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ff20705-7ad0-4ed2-8dba-5d3897ac7f09 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=417a1bcd-8a1e-4a29-bd9b-4aabf537cb72,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:07.521832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1ff20705-7ad0-4ed2-8dba-5d3897ac7f09 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.527045 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1ff20705-7ad0-4ed2-8dba-5d3897ac7f09 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4325716 Mar 24 02:18:07.530361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33100) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.542213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8b4bde71-5a0a-422f-a71a-6c552f38ae8b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '417a1bcd-8a1e-4a29-bd9b-4aabf537cb72', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:07.543869 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-8b4bde71-5a0a-422f-a71a-6c552f38ae8b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Mar 24 02:18:07.545423 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-8b4bde71-5a0a-422f-a71a-6c552f38ae8b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:07.550460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-cd0b1ace-9ee3-4ec9-a7f8-57caa210e0b0 None None] For port 2e96e7b6-cf4b-46f6-b960-ada79914ac66, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2e96e7b6-cf4b-46f6-b960-ada79914ac66,segment=NetworkSegment(29ff5209-ca7a-4e4b-b3e0-ef87894e6465),segment_id=29ff5209-ca7a-4e4b-b3e0-ef87894e6465)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:07.551061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cd0b1ace-9ee3-4ec9-a7f8-57caa210e0b0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.551215 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8b4bde71-5a0a-422f-a71a-6c552f38ae8b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0193422 Mar 24 02:18:07.552306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33106) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.553694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-021664c7-31e3-4805-a1bb-cfc6c9ad0596 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:07.557587 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-021664c7-31e3-4805-a1bb-cfc6c9ad0596 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "GET /v2.0/ports/1252f865-0895-4436-8d71-4d7218f365f6 HTTP/1.1" status: 200 len: 958 time: 0.0775270 Mar 24 02:18:07.575580 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-cd0b1ace-9ee3-4ec9-a7f8-57caa210e0b0 None None] Calling delete_port for 2e96e7b6-cf4b-46f6-b960-ada79914ac66 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:07.595660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33108) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.672452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port 2e96e7b6-cf4b-46f6-b960-ada79914ac66, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=2e96e7b6-cf4b-46f6-b960-ada79914ac66,segment=NetworkSegment(29ff5209-ca7a-4e4b-b3e0-ef87894e6465),segment_id=29ff5209-ca7a-4e4b-b3e0-ef87894e6465)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:07.672897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.675809 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cd0b1ace-9ee3-4ec9-a7f8-57caa210e0b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.680639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33110) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.681488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d1f34c2-9ea6-4dae-9203-4e3565aaa51f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (417a1bcd-8a1e-4a29-bd9b-4aabf537cb72), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.701988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 2e96e7b6-cf4b-46f6-b960-ada79914ac66 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:07.711908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd0b1ace-9ee3-4ec9-a7f8-57caa210e0b0 None None] Pushing event deleted for resources: {'Port': ['ID=2e96e7b6-cf4b-46f6-b960-ada79914ac66,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:07.713427 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d1f34c2-9ea6-4dae-9203-4e3565aaa51f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (417a1bcd-8a1e-4a29-bd9b-4aabf537cb72), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.724999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd0b1ace-9ee3-4ec9-a7f8-57caa210e0b0 None None] No DVR routers for this DVR port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:07.795450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a8dbc6fa-87b0-4232-8bbd-320b025f45cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Deleting port 1252f865-0895-4436-8d71-4d7218f365f6 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:07.795784 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8dbc6fa-87b0-4232-8bbd-320b025f45cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1252f865-0895-4436-8d71-4d7218f365f6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.848254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d1f34c2-9ea6-4dae-9203-4e3565aaa51f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (417a1bcd-8a1e-4a29-bd9b-4aabf537cb72), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.851524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0d1f34c2-9ea6-4dae-9203-4e3565aaa51f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.855327 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0d1f34c2-9ea6-4dae-9203-4e3565aaa51f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/417a1bcd-8a1e-4a29-bd9b-4aabf537cb72 HTTP/1.1" status: 204 len: 168 time: 0.2992177 Mar 24 02:18:07.855934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33114) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.874870 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8dbc6fa-87b0-4232-8bbd-320b025f45cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1252f865-0895-4436-8d71-4d7218f365f6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.888791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (2e96e7b6-cf4b-46f6-b960-ada79914ac66), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:07.929675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=2e96e7b6-cf4b-46f6-b960-ada79914ac66,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:07.932064 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No DVR routers for this DVR port 2e96e7b6-cf4b-46f6-b960-ada79914ac66 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:07.939406 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-722ac76b-3177-4ebe-a790-57c9b3033d77 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0710437 Mar 24 02:18:07.940499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33120) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:07.947593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-42ef0b36-ecee-412c-bb83-b256d8dac2e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--1492743983'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:07.947862 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d1f34c2-9ea6-4dae-9203-4e3565aaa51f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=417a1bcd-8a1e-4a29-bd9b-4aabf537cb72,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:07.960483 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a8dbc6fa-87b0-4232-8bbd-320b025f45cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Calling delete_port for 1252f865-0895-4436-8d71-4d7218f365f6 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:08.044077 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-203cd606-e3fc-4c04-b062-b5bc50e52000 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=7b8dee850d65489ba8498576f69edde9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2957423 Mar 24 02:18:08.049916 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33126) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.111616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8dbc6fa-87b0-4232-8bbd-320b025f45cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (1252f865-0895-4436-8d71-4d7218f365f6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.119678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc7918d4-3a59-4729-a301-cf22a68236f3 admin admin] Publish callbacks [] for security_group (143913a0-76e0-4f07-91a1-eaea0e844366), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.141852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8dbc6fa-87b0-4232-8bbd-320b025f45cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event deleted for resources: {'Port': ['ID=1252f865-0895-4436-8d71-4d7218f365f6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:08.154624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a8dbc6fa-87b0-4232-8bbd-320b025f45cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.160668 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a8dbc6fa-87b0-4232-8bbd-320b025f45cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "DELETE /v2.0/ports/1252f865-0895-4436-8d71-4d7218f365f6 HTTP/1.1" status: 204 len: 168 time: 0.5596082 Mar 24 02:18:08.160936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33128) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.162636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-42ef0b36-ecee-412c-bb83-b256d8dac2e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.182733 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (8e4318a8-0a0c-46ae-a03a-45d69e971ed8), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.195846 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc7918d4-3a59-4729-a301-cf22a68236f3 admin admin] Publish callbacks [] for security_group (143913a0-76e0-4f07-91a1-eaea0e844366), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.202621 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b047427-e7b9-4038-ada7-6fb08f7a5be8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] GET failed (client error): The resource could not be found. Mar 24 02:18:08.204107 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1b047427-e7b9-4038-ada7-6fb08f7a5be8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "GET /v2.0/ports/1252f865-0895-4436-8d71-4d7218f365f6 HTTP/1.1" status: 404 len: 333 time: 0.0423212 Mar 24 02:18:08.208814 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33130) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.217044 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Request body: {'port': {'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1546555914'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:08.248869 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Made reservation on behalf of c067301dc45b4f2aba081cc64b7888c1 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:08.252399 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.253284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8e4318a8-0a0c-46ae-a03a-45d69e971ed8']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:08.257907 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2e96e7b6-cf4b-46f6-b960-ada79914ac66 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:08.268910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] device_id is not set on port 98559743-a6e1-4f2a-9784-6c0f73fd3754 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:18:08.276699 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '29ff5209-ca7a-4e4b-b3e0-ef87894e6465') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:08.277027 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '29ff5209-ca7a-4e4b-b3e0-ef87894e6465') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:08.284702 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 2e96e7b6-cf4b-46f6-b960-ada79914ac66 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:08.285166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 2e96e7b6-cf4b-46f6-b960-ada79914ac66 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:08.294579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-82a5dfd5-ca1c-4c6c-ad43-cf2d60f89d14 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:08.296050 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-82a5dfd5-ca1c-4c6c-ad43-cf2d60f89d14 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/networks?id=da1aec0d-a786-4656-9380-f71f1c64ba05 HTTP/1.1" status: 200 len: 812 time: 0.3059375 Mar 24 02:18:08.299873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (29ff5209-ca7a-4e4b-b3e0-ef87894e6465), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.307911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc7918d4-3a59-4729-a301-cf22a68236f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (143913a0-76e0-4f07-91a1-eaea0e844366), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.310651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc7918d4-3a59-4729-a301-cf22a68236f3 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.311792 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dc7918d4-3a59-4729-a301-cf22a68236f3 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/143913a0-76e0-4f07-91a1-eaea0e844366 HTTP/1.1" status: 204 len: 168 time: 0.2609816 Mar 24 02:18:08.328903 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc7918d4-3a59-4729-a301-cf22a68236f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=143913a0-76e0-4f07-91a1-eaea0e844366,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:08.339025 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-ed38a200-affe-4405-acae-122074ee9c11 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/quotas/4419a48020f546a6abf15b6c1b4cdbdb HTTP/1.1" status: 200 len: 375 time: 0.0296175 Mar 24 02:18:08.354410 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (29ff5209-ca7a-4e4b-b3e0-ef87894e6465), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.428263 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-854d931d-b3be-4576-85d4-f864ab7dcfc6 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=4419a48020f546a6abf15b6c1b4cdbdb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0799580 Mar 24 02:18:08.429343 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Releasing vlan 120 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:08.429825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (29ff5209-ca7a-4e4b-b3e0-ef87894e6465), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:08.436232 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:08.461067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks [] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.504098 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.527647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-42ef0b36-ecee-412c-bb83-b256d8dac2e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (d0996eff-f3ca-4253-b081-73a6babbe18d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.557078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Network 68479eb8-4769-40a2-a486-b1f8a55226e1 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:08.560727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:08.565920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-42ef0b36-ecee-412c-bb83-b256d8dac2e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d0996eff-f3ca-4253-b081-73a6babbe18d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.568134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:08.569061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:08.569662 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.577624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'Port': ['ID=98559743-a6e1-4f2a-9784-6c0f73fd3754,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:08.599735 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b68a6e7a-9b06-4d7b-a624-34cb5dcd7bb6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 0.3879163 Mar 24 02:18:08.600357 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33140) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.602638 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (8e4318a8-0a0c-46ae-a03a-45d69e971ed8), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.607636 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.611773 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/networks/8e4318a8-0a0c-46ae-a03a-45d69e971ed8 HTTP/1.1" status: 204 len: 168 time: 1.6313527 Mar 24 02:18:08.613842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8348'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:08.621031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33142) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.647206 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-42ef0b36-ecee-412c-bb83-b256d8dac2e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.648442 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-42ef0b36-ecee-412c-bb83-b256d8dac2e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.7069192 Mar 24 02:18:08.649700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ef0b36-ecee-412c-bb83-b256d8dac2e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d0996eff-f3ca-4253-b081-73a6babbe18d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:08.653259 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d091793-bb2f-4f95-a47b-6cda667f04a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Network': ['ID=8e4318a8-0a0c-46ae-a03a-45d69e971ed8,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:08.655447 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33146) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.664049 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e4b91cc2-8926-4ddd-985c-8115930bb009 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1347720512', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:08.689890 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f846355b-08be-43fe-afae-326ca9d687d6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': 'd0996eff-f3ca-4253-b081-73a6babbe18d', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:08.705634 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-f846355b-08be-43fe-afae-326ca9d687d6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Mar 24 02:18:08.706307 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-f846355b-08be-43fe-afae-326ca9d687d6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:08.707601 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f846355b-08be-43fe-afae-326ca9d687d6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0510697 Mar 24 02:18:08.716573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33150) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.722419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8bf8ad97-2bfe-465e-b49d-32fbf83cfa56 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': 'd0996eff-f3ca-4253-b081-73a6babbe18d', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:08.723929 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-8bf8ad97-2bfe-465e-b49d-32fbf83cfa56 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Mar 24 02:18:08.724431 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-8bf8ad97-2bfe-465e-b49d-32fbf83cfa56 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:08.726752 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8bf8ad97-2bfe-465e-b49d-32fbf83cfa56 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0079296 Mar 24 02:18:08.730242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33152) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.735472 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-dbd161dd-228c-414e-a347-5be98bdba8ae tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': 'd0996eff-f3ca-4253-b081-73a6babbe18d', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:08.736503 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-dbd161dd-228c-414e-a347-5be98bdba8ae tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Mar 24 02:18:08.736998 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-dbd161dd-228c-414e-a347-5be98bdba8ae tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:08.740621 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dbd161dd-228c-414e-a347-5be98bdba8ae tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0067747 Mar 24 02:18:08.741048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b91cc2-8926-4ddd-985c-8115930bb009 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (e6831f90-e567-436b-a709-5ee103af3439), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.742086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b91cc2-8926-4ddd-985c-8115930bb009 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (e6831f90-e567-436b-a709-5ee103af3439), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.746888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33154) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.751953 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5f4afde8-ceb5-466f-9e33-091efbf0e99f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': 'd0996eff-f3ca-4253-b081-73a6babbe18d', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '256'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:08.752809 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-5f4afde8-ceb5-466f-9e33-091efbf0e99f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Mar 24 02:18:08.753296 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-5f4afde8-ceb5-466f-9e33-091efbf0e99f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:08.754579 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5f4afde8-ceb5-466f-9e33-091efbf0e99f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0064483 Mar 24 02:18:08.756280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.760278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33156) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.791051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.849256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b91cc2-8926-4ddd-985c-8115930bb009 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (e6831f90-e567-436b-a709-5ee103af3439), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.902101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b91cc2-8926-4ddd-985c-8115930bb009 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (e6831f90-e567-436b-a709-5ee103af3439), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.926180 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-1d011e17-c808-4219-bd6b-4113dd37e7a5 service neutron] 10.222.0.20 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4632087 Mar 24 02:18:08.944890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e4b91cc2-8926-4ddd-985c-8115930bb009 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:08.948749 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e4b91cc2-8926-4ddd-985c-8115930bb009 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.3228993 Mar 24 02:18:08.949133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33164) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:08.965385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'network': {'name': 'tempest-RoutersTest-1574169687'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:08.973381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aab51afe-9ba5-414f-a7f2-27ca3a44cd38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (d0996eff-f3ca-4253-b081-73a6babbe18d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.025577 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] device_id is not set on port 98559743-a6e1-4f2a-9784-6c0f73fd3754 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:18:09.035577 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks [] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.043934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.047309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aab51afe-9ba5-414f-a7f2-27ca3a44cd38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (d0996eff-f3ca-4253-b081-73a6babbe18d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.071457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:09.074783 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.109685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'Port': ['ID=98559743-a6e1-4f2a-9784-6c0f73fd3754,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:09.130247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.130724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.131119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.136382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.136709 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.137238 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 2 to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 Mar 24 02:18:09.151532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33170) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:09.153645 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.153976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.154303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.162596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.162858 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.166742 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 3 to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 Mar 24 02:18:09.177462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 114} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:18:09.183567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.184141 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.184472 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.190320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.190686 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.191114 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 4 to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 Mar 24 02:18:09.193237 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-9a6c81bd-6f17-47b2-97bb-bc13f4239bab service neutron] 10.222.0.20 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2592549 Mar 24 02:18:09.200690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aab51afe-9ba5-414f-a7f2-27ca3a44cd38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d0996eff-f3ca-4253-b081-73a6babbe18d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.203711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-aab51afe-9ba5-414f-a7f2-27ca3a44cd38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.205544 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-aab51afe-9ba5-414f-a7f2-27ca3a44cd38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/d0996eff-f3ca-4253-b081-73a6babbe18d HTTP/1.1" status: 204 len: 168 time: 0.4443395 Mar 24 02:18:09.215406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e5448d4b-b8e7-4934-ac13-fef0780c703c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.215945 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added segment e5448d4b-b8e7-4934-ac13-fef0780c703c of type vlan for network c4069fde-e378-4094-98fe-405d58aa3139 Mar 24 02:18:09.218622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33174) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:09.244752 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.245000 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.245339 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.256702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab51afe-9ba5-414f-a7f2-27ca3a44cd38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0996eff-f3ca-4253-b081-73a6babbe18d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:09.302735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-435cc910-e0c2-4ef3-96d6-014a20579544 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'default'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:09.302951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (c4069fde-e378-4094-98fe-405d58aa3139), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.303477 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-435cc910-e0c2-4ef3-96d6-014a20579544 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Mar 24 02:18:09.304264 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-435cc910-e0c2-4ef3-96d6-014a20579544 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): There was a conflict when trying to complete your request. Mar 24 02:18:09.309257 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-435cc910-e0c2-4ef3-96d6-014a20579544 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.1565709 Mar 24 02:18:09.309984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33176) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:09.310133 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.310459 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.311894 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 5 to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 Mar 24 02:18:09.318604 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'tempest-secgroup--1837982662'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:09.329928 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-96b5365c-1c27-442f-ae5c-618de32bb110 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1093624 Mar 24 02:18:09.334470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33180) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:09.340010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5b727976-28df-4b65-890e-884f4317dab0 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--1969431784'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:09.348910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.349235 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.349664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.358813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.359169 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.361297 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 6 to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 Mar 24 02:18:09.376338 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.377369 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.377839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.381719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5b727976-28df-4b65-890e-884f4317dab0 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.392799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.393123 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.395197 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 7 to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 Mar 24 02:18:09.413740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.413946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.414238 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.414377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (c4069fde-e378-4094-98fe-405d58aa3139), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.419305 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:09.420096 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.424537 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.424863 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.426272 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 8 to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 Mar 24 02:18:09.432054 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-deece267-fc2e-4b57-a9a5-7c804af1eea3 req-87efea9f-5288-41e1-947c-2543f9c254db tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 210 time: 0.0498896 Mar 24 02:18:09.436651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.440556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.17 (0a3a0bb4-4db4-4907-a006-67d97a634086/47e13ca4-a1b5-4f9e-95ce-b93533455f10/e15ac081-eb34-4427-bd35-22f6bcb2e344) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:09.450979 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.451404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.451687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.465354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.465354 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.465354 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 9 to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 Mar 24 02:18:09.488155 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.490436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.490893 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.494342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.500978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.501429 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.506724 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempt 10 to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 Mar 24 02:18:09.511433 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5b727976-28df-4b65-890e-884f4317dab0 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (582b7a49-cca8-442a-9b95-df198d0e6a77), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.515283 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.5609908 Mar 24 02:18:09.515772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33184) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:09.521659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'subnet': {'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:09.530401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01d06273-7d81-4671-b0f3-3f48eaa4f8ab tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Network': ['ID=c4069fde-e378-4094-98fe-405d58aa3139,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:09.543374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5b727976-28df-4b65-890e-884f4317dab0 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (582b7a49-cca8-442a-9b95-df198d0e6a77), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.543582 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network c4069fde-e378-4094-98fe-405d58aa3139 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:18:09.595376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:09.595756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] {{(pid=104036) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:09.596083 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempting to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:09.617982 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104036) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:09.618317 dv-neutron-834874-3-hyperv neutron-server[104036]: ERROR neutron.plugins.ml2.managers [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Failed to bind port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on host hv-neutron-8348 for vnic_type normal using segments [{'id': 'cfbb7394-f014-4306-945c-f87e60c522b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '68479eb8-4769-40a2-a486-b1f8a55226e1'}] Mar 24 02:18:09.618720 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.641876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5b727976-28df-4b65-890e-884f4317dab0 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.647427 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5b727976-28df-4b65-890e-884f4317dab0 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3074803 Mar 24 02:18:09.648934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33190) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:09.655295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-26d3843e-c777-4b41-a3f2-73c6809d7b05 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '582b7a49-cca8-442a-9b95-df198d0e6a77', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:09.656114 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-26d3843e-c777-4b41-a3f2-73c6809d7b05 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Mar 24 02:18:09.656848 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-26d3843e-c777-4b41-a3f2-73c6809d7b05 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:09.660338 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-26d3843e-c777-4b41-a3f2-73c6809d7b05 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0059214 Mar 24 02:18:09.661476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33192) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:09.671244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b727976-28df-4b65-890e-884f4317dab0 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=582b7a49-cca8-442a-9b95-df198d0e6a77,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:09.674981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6065f453-4182-46f0-bd6e-8fdcd6880542 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '582b7a49-cca8-442a-9b95-df198d0e6a77', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:09.687707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.705889 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:09.709262 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.735974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (a8638e5f-136b-4f47-926a-c04303c9c6ed), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.746058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a8638e5f-136b-4f47-926a-c04303c9c6ed), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.797901 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] For port 98559743-a6e1-4f2a-9784-6c0f73fd3754, host hv-neutron-8348, cleared binding levels {{(pid=104036) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:09.798271 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attempted to set empty binding levels {{(pid=104036) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Mar 24 02:18:09.798956 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-6065f453-4182-46f0-bd6e-8fdcd6880542 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:09.800066 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6065f453-4182-46f0-bd6e-8fdcd6880542 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1349359 Mar 24 02:18:09.801225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.803122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33196) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:09.811853 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.824264 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-13b0fb3c-f851-41ab-892c-c18c62b80949 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '582b7a49-cca8-442a-9b95-df198d0e6a77', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:09.825242 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-13b0fb3c-f851-41ab-892c-c18c62b80949 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Mar 24 02:18:09.827149 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-13b0fb3c-f851-41ab-892c-c18c62b80949 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:09.827149 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-13b0fb3c-f851-41ab-892c-c18c62b80949 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0136375 Mar 24 02:18:09.856973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33198) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:09.857702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a8638e5f-136b-4f47-926a-c04303c9c6ed,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:09.866442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-9a2120da-dc9c-4b26-b3aa-d1eba29c5eee tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '582b7a49-cca8-442a-9b95-df198d0e6a77', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:09.919247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 0a3a0bb4-4db4-4907-a006-67d97a634086 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:09.923560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=e15ac081-eb34-4427-bd35-22f6bcb2e344,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:09.933809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:09.937593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (61b3f2ad-772c-4f61-98e0-9338b87ddc90), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.939437 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:09.946759 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (61b3f2ad-772c-4f61-98e0-9338b87ddc90), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.947863 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] In _notify_port_updated(), no bound segment for port 98559743-a6e1-4f2a-9784-6c0f73fd3754 on network 68479eb8-4769-40a2-a486-b1f8a55226e1 {{(pid=104036) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:18:09.950732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:09.952028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:09.957585 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "PUT /v2.0/ports/98559743-a6e1-4f2a-9784-6c0f73fd3754 HTTP/1.1" status: 200 len: 981 time: 1.3559344 Mar 24 02:18:09.966378 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33200) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:10.011519 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-9a2120da-dc9c-4b26-b3aa-d1eba29c5eee tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:10.012579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9a2120da-dc9c-4b26-b3aa-d1eba29c5eee tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1518841 Mar 24 02:18:10.018090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33202) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:10.030088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.031344 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.7182021 Mar 24 02:18:10.034607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-df954a32-7984-446d-88ba-518243851eba tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '582b7a49-cca8-442a-9b95-df198d0e6a77', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:10.035089 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-df954a32-7984-446d-88ba-518243851eba tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Mar 24 02:18:10.035573 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-df954a32-7984-446d-88ba-518243851eba tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:10.036520 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-df954a32-7984-446d-88ba-518243851eba tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0134544 Mar 24 02:18:10.038234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33204) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:10.040096 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33206) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:10.042022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (1f63a954-e411-4138-b423-94a29a3b7505), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.047765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fa9844-345d-4543-ab9f-171472c7c1ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event updated for resources: {'Port': ['ID=98559743-a6e1-4f2a-9784-6c0f73fd3754,revision_number=3']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:10.048311 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-dbd79ca4-efc4-433a-9741-f7ccf8256a38 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '61b3f2ad-772c-4f61-98e0-9338b87ddc90', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:10.055648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d3c1e574-a9ee-48fd-9735-99dc6c1f9076 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '582b7a49-cca8-442a-9b95-df198d0e6a77', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:10.059466 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70d95664-91a8-412a-8f11-99762ae218ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=61b3f2ad-772c-4f61-98e0-9338b87ddc90,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:10.142191 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-d3c1e574-a9ee-48fd-9735-99dc6c1f9076 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Project f54394d36b9845de8f8a90f9218de610 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:18:10.204879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbd79ca4-efc4-433a-9741-f7ccf8256a38 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group_rule (5a384b47-7551-42c6-8fdb-8e26b30db0c5), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.218879 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-d3c1e574-a9ee-48fd-9735-99dc6c1f9076 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:10.220284 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d3c1e574-a9ee-48fd-9735-99dc6c1f9076 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.1792140 Mar 24 02:18:10.237832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33208) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:10.245111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-03f37f06-ecaa-4f50-9f86-2fc1f54eb33c tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '582b7a49-cca8-442a-9b95-df198d0e6a77', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:10.245583 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-03f37f06-ecaa-4f50-9f86-2fc1f54eb33c tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Mar 24 02:18:10.246080 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-03f37f06-ecaa-4f50-9f86-2fc1f54eb33c tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:10.250876 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-03f37f06-ecaa-4f50-9f86-2fc1f54eb33c tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0118661 Mar 24 02:18:10.259063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33210) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:10.276524 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-cc32134a-b8f3-400a-97df-42dd0fa14877 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '582b7a49-cca8-442a-9b95-df198d0e6a77', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:10.351122 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-cc32134a-b8f3-400a-97df-42dd0fa14877 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Project f54394d36b9845de8f8a90f9218de610 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:18:10.359571 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a0e6a287-2b5f-4290-9793-d321724970e3 None None] Provisioning complete for port e15ac081-eb34-4427-bd35-22f6bcb2e344 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:10.359946 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a0e6a287-2b5f-4290-9793-d321724970e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.383083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbd79ca4-efc4-433a-9741-f7ccf8256a38 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group_rule (5a384b47-7551-42c6-8fdb-8e26b30db0c5), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.387750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.401550 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-cc32134a-b8f3-400a-97df-42dd0fa14877 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:10.403014 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cc32134a-b8f3-400a-97df-42dd0fa14877 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.1426756 Mar 24 02:18:10.403905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbd79ca4-efc4-433a-9741-f7ccf8256a38 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (5a384b47-7551-42c6-8fdb-8e26b30db0c5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.405702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33212) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:10.416869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-070fd732-eccc-441f-8981-e0f7cf9c981f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '582b7a49-cca8-442a-9b95-df198d0e6a77', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:10.426904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a0e6a287-2b5f-4290-9793-d321724970e3 None None] Port e15ac081-eb34-4427-bd35-22f6bcb2e344 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:10.472881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd79ca4-efc4-433a-9741-f7ccf8256a38 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5a384b47-7551-42c6-8fdb-8e26b30db0c5,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:10.493007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dbd79ca4-efc4-433a-9741-f7ccf8256a38 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.494637 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dbd79ca4-efc4-433a-9741-f7ccf8256a38 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4554095 Mar 24 02:18:10.500188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33216) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:10.503271 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-070fd732-eccc-441f-8981-e0f7cf9c981f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Project f54394d36b9845de8f8a90f9218de610 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:18:10.508140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1189ee94-ac67-45c3-b4db-bb0dc3b4d01a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '61b3f2ad-772c-4f61-98e0-9338b87ddc90', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:10.529506 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (0ab02836-20c6-4f02-8006-9965fb6ba43b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.611808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-68a848ab-7ab7-4ac3-9d27-2eb196d311e9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Deleting port 98559743-a6e1-4f2a-9784-6c0f73fd3754 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:10.612252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-68a848ab-7ab7-4ac3-9d27-2eb196d311e9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.615049 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Subnet': ['ID=0ab02836-20c6-4f02-8006-9965fb6ba43b,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:10.626913 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8f2b4069-4ccc-4c79-9bc9-b1339f700bd5 req-ea56aaa2-7c73-47b0-bcc9-ecf4370601a0 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 210 time: 0.0736830 Mar 24 02:18:10.632452 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-070fd732-eccc-441f-8981-e0f7cf9c981f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:10.633889 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-070fd732-eccc-441f-8981-e0f7cf9c981f tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2223470 Mar 24 02:18:10.639659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33218) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:10.665169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1189ee94-ac67-45c3-b4db-bb0dc3b4d01a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group_rule (b78b6f1d-fc4e-419f-963c-664cb5ea6f54), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.701254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Checking segment: {'id': 'e5448d4b-b8e7-4934-ac13-fef0780c703c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:10.701616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network hostable DHCP agents. Network: c4069fde-e378-4094-98fe-405d58aa3139, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:18:10.726101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-68a848ab-7ab7-4ac3-9d27-2eb196d311e9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] For port 98559743-a6e1-4f2a-9784-6c0f73fd3754, host hv-neutron-8348, got binding levels [] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:10.726554 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-68a848ab-7ab7-4ac3-9d27-2eb196d311e9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.750007 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-68a848ab-7ab7-4ac3-9d27-2eb196d311e9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Calling delete_port for 98559743-a6e1-4f2a-9784-6c0f73fd3754 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:10.821006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network c4069fde-e378-4094-98fe-405d58aa3139 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:18:10.841172 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0cdc0673-fca0-4ba8-aafb-f14461caac9b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (582b7a49-cca8-442a-9b95-df198d0e6a77), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.844411 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, c4069fde-e378-4094-98fe-405d58aa3139) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:10.850939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:10.852126 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:10.861837 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10438b5f-8cf4-47dd-abb5-e186b78595c3 None None] Network c4069fde-e378-4094-98fe-405d58aa3139 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:10.899922 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a58cb985-26a2-475c-9f76-b9ff02c2d6d6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3827927 Mar 24 02:18:10.909236 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33220) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:11.031295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-c4069fde-e378-4094-98fe-405d58aa3139', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:18:11.032824 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.106361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-68a848ab-7ab7-4ac3-9d27-2eb196d311e9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (98559743-a6e1-4f2a-9784-6c0f73fd3754), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.208003 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-1189ee94-ac67-45c3-b4db-bb0dc3b4d01a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): There was a conflict when trying to complete your request. Mar 24 02:18:11.209471 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1189ee94-ac67-45c3-b4db-bb0dc3b4d01a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.7071724 Mar 24 02:18:11.209852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a848ab-7ab7-4ac3-9d27-2eb196d311e9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Pushing event deleted for resources: {'Port': ['ID=98559743-a6e1-4f2a-9784-6c0f73fd3754,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:11.219264 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33226) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:11.223044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Allocated IP 172.20.0.2 (c4069fde-e378-4094-98fe-405d58aa3139/0ab02836-20c6-4f02-8006-9965fb6ba43b/5b488b4c-3f04-4938-b387-a53b920028a8) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:11.226556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-68a848ab-7ab7-4ac3-9d27-2eb196d311e9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.233437 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-68a848ab-7ab7-4ac3-9d27-2eb196d311e9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "DELETE /v2.0/ports/98559743-a6e1-4f2a-9784-6c0f73fd3754 HTTP/1.1" status: 204 len: 168 time: 1.2630446 Mar 24 02:18:11.235173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33228) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:11.248427 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0cdc0673-fca0-4ba8-aafb-f14461caac9b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (582b7a49-cca8-442a-9b95-df198d0e6a77), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.292040 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-79ea7644-c9dc-4650-8c5d-1e2a8a3ed257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] GET failed (client error): The resource could not be found. Mar 24 02:18:11.298337 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-79ea7644-c9dc-4650-8c5d-1e2a8a3ed257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234 tempest-PortsAdminExtendedAttrsIpV6TestJSON-569972234-project-admin] 10.222.0.20 "GET /v2.0/ports/98559743-a6e1-4f2a-9784-6c0f73fd3754 HTTP/1.1" status: 404 len: 333 time: 0.0555613 Mar 24 02:18:11.298337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33230) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:11.367795 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-8b78937b-e007-443c-8c4a-cd9e442940be tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:11.369379 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-8b78937b-e007-443c-8c4a-cd9e442940be tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.30 "GET /v2.0/networks?id=da1aec0d-a786-4656-9380-f71f1c64ba05 HTTP/1.1" status: 200 len: 812 time: 0.6076639 Mar 24 02:18:11.384864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Request body: {'port': {'device_id': 'b03f43c2-4dc7-4d74-9408-c99b15cf4661', 'network_id': 'da1aec0d-a786-4656-9380-f71f1c64ba05', 'admin_state_up': True, 'tenant_id': '4419a48020f546a6abf15b6c1b4cdbdb'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:11.444168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Publish callbacks [] for port (5b488b4c-3f04-4938-b387-a53b920028a8), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.447418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-936affbd-8f21-473d-b97a-0508a9e69064 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (61b3f2ad-772c-4f61-98e0-9338b87ddc90), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.455805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0cdc0673-fca0-4ba8-aafb-f14461caac9b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (582b7a49-cca8-442a-9b95-df198d0e6a77), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.456375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.458507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0cdc0673-fca0-4ba8-aafb-f14461caac9b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.459761 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0cdc0673-fca0-4ba8-aafb-f14461caac9b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/582b7a49-cca8-442a-9b95-df198d0e6a77 HTTP/1.1" status: 204 len: 168 time: 0.8189609 Mar 24 02:18:11.475969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33232) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:11.487345 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (68479eb8-4769-40a2-a486-b1f8a55226e1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.488951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.518858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.520214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.520774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Network c4069fde-e378-4094-98fe-405d58aa3139 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:11.528356 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:11.534223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cdc0673-fca0-4ba8-aafb-f14461caac9b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=582b7a49-cca8-442a-9b95-df198d0e6a77,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:11.544984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-936affbd-8f21-473d-b97a-0508a9e69064 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (61b3f2ad-772c-4f61-98e0-9338b87ddc90), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.547345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:11.570237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Pushing event updated for resources: {'Port': ['ID=5b488b4c-3f04-4938-b387-a53b920028a8,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:11.691087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (1f63a954-e411-4138-b423-94a29a3b7505), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.695967 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ca856082-cd20-4722-ac6d-f00928a123be tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.2104852 Mar 24 02:18:11.696634 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=e15ac081-eb34-4427-bd35-22f6bcb2e344,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:11.704530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33236) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:11.719819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7b95f71b-d836-4d54-9293-b6da80686a38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--789262746'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:11.725165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Attempting to bind port 5b488b4c-3f04-4938-b387-a53b920028a8 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:11.727287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Attempting to bind port 5b488b4c-3f04-4938-b387-a53b920028a8 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'e5448d4b-b8e7-4934-ac13-fef0780c703c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:11.728846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Attempting to bind port 5b488b4c-3f04-4938-b387-a53b920028a8 on network c4069fde-e378-4094-98fe-405d58aa3139 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:11.749372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:11.755315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Checking segment: {'id': 'e5448d4b-b8e7-4934-ac13-fef0780c703c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:11.758530 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.759255 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Bound using segment: {'id': 'e5448d4b-b8e7-4934-ac13-fef0780c703c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:11.760096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Bound port: 5b488b4c-3f04-4938-b387-a53b920028a8, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5448d4b-b8e7-4934-ac13-fef0780c703c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:11.761957 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.793602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Made reservation on behalf of 4419a48020f546a6abf15b6c1b4cdbdb for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:11.797422 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.804875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b95f71b-d836-4d54-9293-b6da80686a38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.820927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-936affbd-8f21-473d-b97a-0508a9e69064 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (61b3f2ad-772c-4f61-98e0-9338b87ddc90), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.823750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-936affbd-8f21-473d-b97a-0508a9e69064 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.827658 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-936affbd-8f21-473d-b97a-0508a9e69064 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/61b3f2ad-772c-4f61-98e0-9338b87ddc90 HTTP/1.1" status: 204 len: 168 time: 0.6009049 Mar 24 02:18:11.844168 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33238) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:11.848627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.20.0.1 (c4069fde-e378-4094-98fe-405d58aa3139/0ab02836-20c6-4f02-8006-9965fb6ba43b/598fe3d0-0070-459b-95be-d5bd56f20a86) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:11.896377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-936affbd-8f21-473d-b97a-0508a9e69064 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=61b3f2ad-772c-4f61-98e0-9338b87ddc90,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:11.934969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (68479eb8-4769-40a2-a486-b1f8a55226e1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.952798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] For port 5b488b4c-3f04-4938-b387-a53b920028a8, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:11.956125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b95f71b-d836-4d54-9293-b6da80686a38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (b834544b-f32e-4849-ae74-71c4d0d3fa1f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.961911 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] For port 5b488b4c-3f04-4938-b387-a53b920028a8, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5b488b4c-3f04-4938-b387-a53b920028a8,segment=NetworkSegment(e5448d4b-b8e7-4934-ac13-fef0780c703c),segment_id=e5448d4b-b8e7-4934-ac13-fef0780c703c)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:11.974449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:11.983597 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6c265df1-33aa-4a2e-b1f9-1c53b13e8607 req-a4b814f6-97ca-4ec4-8a28-30ddbc112d28 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 210 time: 0.1401823 Mar 24 02:18:11.984276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b95f71b-d836-4d54-9293-b6da80686a38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b834544b-f32e-4849-ae74-71c4d0d3fa1f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.019436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['68479eb8-4769-40a2-a486-b1f8a55226e1']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:12.033364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cfbb7394-f014-4306-945c-f87e60c522b6') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:12.033666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cfbb7394-f014-4306-945c-f87e60c522b6') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:12.056808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (cfbb7394-f014-4306-945c-f87e60c522b6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.070425 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15d33a2-35ff-4e3d-989a-49dbf9cb3ffb None None] Pushing event updated for resources: {'Port': ['ID=5b488b4c-3f04-4938-b387-a53b920028a8,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:12.084476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (cfbb7394-f014-4306-945c-f87e60c522b6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.100057 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:12.100461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (cfbb7394-f014-4306-945c-f87e60c522b6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:12.103939 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:12.171139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.203002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (68479eb8-4769-40a2-a486-b1f8a55226e1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.211643 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.216685 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] 10.222.0.20 "DELETE /v2.0/networks/68479eb8-4769-40a2-a486-b1f8a55226e1 HTTP/1.1" status: 204 len: 168 time: 0.9180591 Mar 24 02:18:12.227308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 0a3a0bb4-4db4-4907-a006-67d97a634086 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:12.234391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:12.240542 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9f4c95c-1ecf-4d85-93bd-69479deccd08 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035780816-project] Pushing event deleted for resources: {'Network': ['ID=68479eb8-4769-40a2-a486-b1f8a55226e1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:12.242555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b95f71b-d836-4d54-9293-b6da80686a38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.244045 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7b95f71b-d836-4d54-9293-b6da80686a38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5335643 Mar 24 02:18:12.251646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33242) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:12.258579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-596134bc-f8e8-4405-8be9-8e549b96da00 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.4067335 Mar 24 02:18:12.258998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1ca942d8-65f9-4ffd-a9ee-fe8980b3e1a9 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': 'b834544b-f32e-4849-ae74-71c4d0d3fa1f', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'bad_group_id'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:12.259504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b95f71b-d836-4d54-9293-b6da80686a38 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b834544b-f32e-4849-ae74-71c4d0d3fa1f,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:12.262377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Allocated IP 172.20.0.8 (da1aec0d-a786-4656-9380-f71f1c64ba05/1a07dda3-b4d8-484a-9399-92d0432cd074/c2f85444-f14d-48c1-9fd1-76fe9741f263) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:12.264448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33244) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:12.269993 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-cdd49e7e-de9f-4e85-b5ee-8d31e380f184 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'tempest-secgroup--378670636'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:12.325541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.425059 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-1ca942d8-65f9-4ffd-a9ee-fe8980b3e1a9 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The resource could not be found. Mar 24 02:18:12.429142 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1ca942d8-65f9-4ffd-a9ee-fe8980b3e1a9 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.1721659 Mar 24 02:18:12.433432 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network c4069fde-e378-4094-98fe-405d58aa3139 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:12.434064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33246) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:12.446218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b905033b-2a6e-4563-9bf4-4c29e8c0dfc3 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': 'b834544b-f32e-4849-ae74-71c4d0d3fa1f', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'ceefdb16-2245-482a-bec2-e53ea73e0371'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:12.451667 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:12.465241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cdd49e7e-de9f-4e85-b5ee-8d31e380f184 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.484983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:12.494824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=598fe3d0-0070-459b-95be-d5bd56f20a86,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:12.570037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.633550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 1f63a954-e411-4138-b423-94a29a3b7505 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:12.689493 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-b905033b-2a6e-4563-9bf4-4c29e8c0dfc3 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The resource could not be found. Mar 24 02:18:12.691219 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b905033b-2a6e-4563-9bf4-4c29e8c0dfc3 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.2520657 Mar 24 02:18:12.701953 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33250) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:12.724302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fab0a095-cacf-4dc8-9604-463259a167f5 None None] Provisioning complete for port e15ac081-eb34-4427-bd35-22f6bcb2e344 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:12.724798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fab0a095-cacf-4dc8-9604-463259a167f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.768710 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33252) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:12.777766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fab0a095-cacf-4dc8-9604-463259a167f5 None None] Port e15ac081-eb34-4427-bd35-22f6bcb2e344 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:12.798027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.818682 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0b83018f-9e55-4b1b-af4e-bcc10cabb2df tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (b834544b-f32e-4849-ae74-71c4d0d3fa1f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.867734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0b83018f-9e55-4b1b-af4e-bcc10cabb2df tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (b834544b-f32e-4849-ae74-71c4d0d3fa1f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.895138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cdd49e7e-de9f-4e85-b5ee-8d31e380f184 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (17e8d18d-3c64-4799-9b69-697b5e1d4105), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.903679 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cdd49e7e-de9f-4e85-b5ee-8d31e380f184 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (17e8d18d-3c64-4799-9b69-697b5e1d4105), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.951973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cdd49e7e-de9f-4e85-b5ee-8d31e380f184 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:12.953198 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cdd49e7e-de9f-4e85-b5ee-8d31e380f184 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.6868241 Mar 24 02:18:12.958211 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33256) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:12.969346 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdd49e7e-de9f-4e85-b5ee-8d31e380f184 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=17e8d18d-3c64-4799-9b69-697b5e1d4105,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:12.975730 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-04a7e2ac-5485-4f2f-8da7-321eca2a911c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '17e8d18d-3c64-4799-9b69-697b5e1d4105', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:12.976509 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-04a7e2ac-5485-4f2f-8da7-321eca2a911c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Mar 24 02:18:12.976866 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-04a7e2ac-5485-4f2f-8da7-321eca2a911c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:12.977639 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-04a7e2ac-5485-4f2f-8da7-321eca2a911c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0170019 Mar 24 02:18:12.983123 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33258) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:13.030577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Publish callbacks [] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.031512 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1fdb5eb2-4b23-47fa-96ff-708d17b1683f admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=6ee3fe330bf54d91be862188aace04d6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2617657 Mar 24 02:18:13.034450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33262) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:13.036524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0b83018f-9e55-4b1b-af4e-bcc10cabb2df tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b834544b-f32e-4849-ae74-71c4d0d3fa1f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.039218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0b83018f-9e55-4b1b-af4e-bcc10cabb2df tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.042622 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0b83018f-9e55-4b1b-af4e-bcc10cabb2df tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/b834544b-f32e-4849-ae74-71c4d0d3fa1f HTTP/1.1" status: 204 len: 168 time: 0.3373301 Mar 24 02:18:13.042957 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33264) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:13.076917 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b83018f-9e55-4b1b-af4e-bcc10cabb2df tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b834544b-f32e-4849-ae74-71c4d0d3fa1f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:13.081188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:13.093758 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5746bc01-6040-45d6-a414-07d752ac15df tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/1f63a954-e411-4138-b423-94a29a3b7505/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.8489993 Mar 24 02:18:13.109917 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Sync routers for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:13.129287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:13.129927 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:13.176780 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6176600a-fac4-4699-8b84-31e4ead11831 req-8a327674-b78c-4884-96fa-343ad97a2d31 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 210 time: 0.0783091 Mar 24 02:18:13.179580 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22145a7b-7884-46ec-b3d2-fb2078f6229c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (17e8d18d-3c64-4799-9b69-697b5e1d4105), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.191116 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0f7c8698-caed-4958-93bf-6b9a804d9bc9 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1422410 Mar 24 02:18:13.192717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33268) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:13.198085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-0c72bf5f-72b3-4e65-a817-d0a67554c483 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '3f9fffaa-2019-48d8-825e-d5278dd36d50', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:13.213415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dea31f6c-3a5b-430d-8565-1b478ab8b8c1 admin admin] Publish callbacks [] for security_group (69f00836-6a91-467e-baf7-88e4c46a5b9e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.244532 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22145a7b-7884-46ec-b3d2-fb2078f6229c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (17e8d18d-3c64-4799-9b69-697b5e1d4105), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.256111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.280143 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dea31f6c-3a5b-430d-8565-1b478ab8b8c1 admin admin] Publish callbacks [] for security_group (69f00836-6a91-467e-baf7-88e4c46a5b9e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.294084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:13.335542 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-0c72bf5f-72b3-4e65-a817-d0a67554c483 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The resource could not be found. Mar 24 02:18:13.335782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.336989 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0c72bf5f-72b3-4e65-a817-d0a67554c483 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.1439545 Mar 24 02:18:13.341307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33272) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:13.346303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9fd2a088-65a9-411f-a6b9-3adf289761d2 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--2011222676'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:13.355075 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.355323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Network da1aec0d-a786-4656-9380-f71f1c64ba05 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:13.360735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:13.363405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Pushing event updated for resources: {'Port': ['ID=c2f85444-f14d-48c1-9fd1-76fe9741f263,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:13.365830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:13.404160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22145a7b-7884-46ec-b3d2-fb2078f6229c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (17e8d18d-3c64-4799-9b69-697b5e1d4105), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.407677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22145a7b-7884-46ec-b3d2-fb2078f6229c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.409261 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-22145a7b-7884-46ec-b3d2-fb2078f6229c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/17e8d18d-3c64-4799-9b69-697b5e1d4105 HTTP/1.1" status: 204 len: 168 time: 0.4239581 Mar 24 02:18:13.418930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33274) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:13.447127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22145a7b-7884-46ec-b3d2-fb2078f6229c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=17e8d18d-3c64-4799-9b69-697b5e1d4105,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:13.457467 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dea31f6c-3a5b-430d-8565-1b478ab8b8c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (69f00836-6a91-467e-baf7-88e4c46a5b9e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.462011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dea31f6c-3a5b-430d-8565-1b478ab8b8c1 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.469884 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dea31f6c-3a5b-430d-8565-1b478ab8b8c1 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/69f00836-6a91-467e-baf7-88e4c46a5b9e HTTP/1.1" status: 204 len: 168 time: 0.4342587 Mar 24 02:18:13.476020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:13.476687 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.488466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9fd2a088-65a9-411f-a6b9-3adf289761d2 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.494313 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=598fe3d0-0070-459b-95be-d5bd56f20a86,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:13.513297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea31f6c-3a5b-430d-8565-1b478ab8b8c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69f00836-6a91-467e-baf7-88e4c46a5b9e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:13.516924 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.527561 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33278) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:13.528894 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b15eab56-c8b2-42d2-8e19-09be467965c6 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0983667 Mar 24 02:18:13.534547 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f26fa923-b9ea-4b0a-b619-1c177ea5eea5 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1547604 Mar 24 02:18:13.545530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-03cf20e5-f813-4c51-afd7-71b1094f67a5 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'tempest-secgroup--877081753'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:13.548550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Request body: {'port': {'device_id': 'b03f43c2-4dc7-4d74-9408-c99b15cf4661', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:13.657403 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03cf20e5-f813-4c51-afd7-71b1094f67a5 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.664871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.719364 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:18:10Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '774a5962-6c17-496b-8d49-ec290d2538c5', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.10', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 792, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:16:15Z', 'updated_at': '2022-03-24T02:16:22Z', 'revision_number': 1, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e15ac081-eb34-4427-bd35-22f6bcb2e344', 'name': '', 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:e4:97:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 1120, 'fixed_ips': [{'subnet_id': '47e13ca4-a1b5-4f9e-95ce-b93533455f10', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:09Z', 'updated_at': '2022-03-24T02:18:10Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '47e13ca4-a1b5-4f9e-95ce-b93533455f10', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:13.757268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Checking router: 1f63a954-e411-4138-b423-94a29a3b7505 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:13.757882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Updating router 1f63a954-e411-4138-b423-94a29a3b7505 port e15ac081-eb34-4427-bd35-22f6bcb2e344 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:18:13.782544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network c4069fde-e378-4094-98fe-405d58aa3139 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:13.793605 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:13.797370 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.809237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9fd2a088-65a9-411f-a6b9-3adf289761d2 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (f96d0cfb-be56-44b5-ab9a-a849b0fc764b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.820447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-776a7dc7-f045-453a-b3fb-a33a33585a36 None None] Network c4069fde-e378-4094-98fe-405d58aa3139 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:13.822006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9fd2a088-65a9-411f-a6b9-3adf289761d2 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f96d0cfb-be56-44b5-ab9a-a849b0fc764b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.920014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33282) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:13.941446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9fd2a088-65a9-411f-a6b9-3adf289761d2 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.946505 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9fd2a088-65a9-411f-a6b9-3adf289761d2 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.6015913 Mar 24 02:18:13.947743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33284) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:13.955838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-80532742-3ced-4c95-8f09-2e94e4dc9753 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--813029528'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:13.965625 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03cf20e5-f813-4c51-afd7-71b1094f67a5 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (be665051-b884-4b3b-87f5-ae17b569f36f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.970731 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fd2a088-65a9-411f-a6b9-3adf289761d2 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f96d0cfb-be56-44b5-ab9a-a849b0fc764b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:13.983442 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:18:13.994163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03cf20e5-f813-4c51-afd7-71b1094f67a5 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (be665051-b884-4b3b-87f5-ae17b569f36f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:13.997600 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80532742-3ced-4c95-8f09-2e94e4dc9753 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.051474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-03cf20e5-f813-4c51-afd7-71b1094f67a5 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.055905 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-03cf20e5-f813-4c51-afd7-71b1094f67a5 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5156994 Mar 24 02:18:14.056672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33286) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.064381 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1c5ca31f-fd70-40eb-96e0-d5e07282f7d1 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=c067301dc45b4f2aba081cc64b7888c1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1354644 Mar 24 02:18:14.064599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33288) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.064694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-eeefb03c-6198-41aa-acf0-b93b45a78d6f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'be665051-b884-4b3b-87f5-ae17b569f36f', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:14.065463 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-eeefb03c-6198-41aa-acf0-b93b45a78d6f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Mar 24 02:18:14.065955 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-eeefb03c-6198-41aa-acf0-b93b45a78d6f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:14.069476 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-eeefb03c-6198-41aa-acf0-b93b45a78d6f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0084887 Mar 24 02:18:14.071499 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33290) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.072166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03cf20e5-f813-4c51-afd7-71b1094f67a5 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be665051-b884-4b3b-87f5-ae17b569f36f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:14.113736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c2f85444-f14d-48c1-9fd1-76fe9741f263 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:18:14.133924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Publish callbacks [] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.139814 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:18:14.149245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ccc9d263-a6c7-488a-abbc-2130dc16babf tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (be665051-b884-4b3b-87f5-ae17b569f36f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.181390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Transition to ACTIVE for port object c2f85444-f14d-48c1-9fd1-76fe9741f263 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:18:14.185552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80532742-3ced-4c95-8f09-2e94e4dc9753 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (0ef1da80-f4e7-4a81-9682-2c44c8f8181d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.189255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.194263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ba2b53b8-b519-44fd-a0e3-fbf5e9eb5deb admin admin] Publish callbacks [] for security_group (63ec2533-df14-4cb3-983a-183175e73942), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.200287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80532742-3ced-4c95-8f09-2e94e4dc9753 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0ef1da80-f4e7-4a81-9682-2c44c8f8181d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.256543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-aee9d85c-8563-4483-8567-a7947999726e None None] Provisioning complete for port 5b488b4c-3f04-4938-b387-a53b920028a8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:14.257094 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aee9d85c-8563-4483-8567-a7947999726e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.283690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ba2b53b8-b519-44fd-a0e3-fbf5e9eb5deb admin admin] Publish callbacks [] for security_group (63ec2533-df14-4cb3-983a-183175e73942), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.292576 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80532742-3ced-4c95-8f09-2e94e4dc9753 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.296949 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-80532742-3ced-4c95-8f09-2e94e4dc9753 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3457367 Mar 24 02:18:14.298834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33294) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.304247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Pushing event updated for resources: {'Port': ['ID=c2f85444-f14d-48c1-9fd1-76fe9741f263,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:14.306411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80532742-3ced-4c95-8f09-2e94e4dc9753 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0ef1da80-f4e7-4a81-9682-2c44c8f8181d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:14.306924 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ead6b797-9a41-4e33-851a-8deec6ec334c tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': 'f96d0cfb-be56-44b5-ab9a-a849b0fc764b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '2001:db8::/48', 'remote_group_id': '0ef1da80-f4e7-4a81-9682-2c44c8f8181d'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:14.314467 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ccc9d263-a6c7-488a-abbc-2130dc16babf tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (be665051-b884-4b3b-87f5-ae17b569f36f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.388173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:14.395497 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2323fb77-4f5a-4b9d-b41b-518420314952 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4852226 Mar 24 02:18:14.398880 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33296) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.412029 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'network': {'name': 'tempest-RoutersTest-828932567'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:14.412378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5b488b4c-3f04-4938-b387-a53b920028a8 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:14.414503 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:14.426781 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-ead6b797-9a41-4e33-851a-8deec6ec334c tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:14.430364 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ead6b797-9a41-4e33-851a-8deec6ec334c tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.1264458 Mar 24 02:18:14.430364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ccc9d263-a6c7-488a-abbc-2130dc16babf tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (be665051-b884-4b3b-87f5-ae17b569f36f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.430764 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33298) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.431749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ccc9d263-a6c7-488a-abbc-2130dc16babf tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.436677 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ccc9d263-a6c7-488a-abbc-2130dc16babf tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/be665051-b884-4b3b-87f5-ae17b569f36f HTTP/1.1" status: 204 len: 168 time: 0.3598416 Mar 24 02:18:14.440999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33300) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.449991 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525d9d4d-f8a8-49b6-b3df-7dfa3209bfb4 req-db433f69-0b9a-4f91-8089-426008ece704 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:14.451723 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-525d9d4d-f8a8-49b6-b3df-7dfa3209bfb4 req-db433f69-0b9a-4f91-8089-426008ece704 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 943 time: 0.1502645 Mar 24 02:18:14.462532 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:14.463543 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:14.470079 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccc9d263-a6c7-488a-abbc-2130dc16babf tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=be665051-b884-4b3b-87f5-ae17b569f36f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:14.490122 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:14.491079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ba2b53b8-b519-44fd-a0e3-fbf5e9eb5deb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (63ec2533-df14-4cb3-983a-183175e73942), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.494307 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.495006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ba2b53b8-b519-44fd-a0e3-fbf5e9eb5deb admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.496164 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ba2b53b8-b519-44fd-a0e3-fbf5e9eb5deb admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/63ec2533-df14-4cb3-983a-183175e73942 HTTP/1.1" status: 204 len: 168 time: 0.4313776 Mar 24 02:18:14.519986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Attempting to bind port c2f85444-f14d-48c1-9fd1-76fe9741f263 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:14.520324 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Attempting to bind port c2f85444-f14d-48c1-9fd1-76fe9741f263 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '0ecb8365-8c6b-4988-93b0-262a15edd551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'da1aec0d-a786-4656-9380-f71f1c64ba05'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:14.520698 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Attempting to bind port c2f85444-f14d-48c1-9fd1-76fe9741f263 on network da1aec0d-a786-4656-9380-f71f1c64ba05 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:14.530866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba2b53b8-b519-44fd-a0e3-fbf5e9eb5deb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63ec2533-df14-4cb3-983a-183175e73942,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:14.540862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Port c2f85444-f14d-48c1-9fd1-76fe9741f263 on network da1aec0d-a786-4656-9380-f71f1c64ba05 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:18:14.541193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Attempting to bind port c2f85444-f14d-48c1-9fd1-76fe9741f263 on network da1aec0d-a786-4656-9380-f71f1c64ba05 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:14.567913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 17, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:14.568245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Checking segment: {'id': '0ecb8365-8c6b-4988-93b0-262a15edd551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'da1aec0d-a786-4656-9380-f71f1c64ba05'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:14.568568 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Bound using segment: {'id': '0ecb8365-8c6b-4988-93b0-262a15edd551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'da1aec0d-a786-4656-9380-f71f1c64ba05'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:14.569020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Bound port: c2f85444-f14d-48c1-9fd1-76fe9741f263, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0ecb8365-8c6b-4988-93b0-262a15edd551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'da1aec0d-a786-4656-9380-f71f1c64ba05'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:14.569387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.594242 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-525d9d4d-f8a8-49b6-b3df-7dfa3209bfb4 req-6dc633d8-b1a0-4a68-91c8-693eb4daa5a0 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1334672 Mar 24 02:18:14.597628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c36bea77-d447-43c6-9a62-705cdd770546 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (0ef1da80-f4e7-4a81-9682-2c44c8f8181d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.611218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-aee9d85c-8563-4483-8567-a7947999726e None None] Current status of the port 5b488b4c-3f04-4938-b387-a53b920028a8 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:14.611608 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aee9d85c-8563-4483-8567-a7947999726e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.652995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Publish callbacks [] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.671533 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-096c8a66-a7df-448f-b936-0506c1b3138d tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.2256174 Mar 24 02:18:14.678794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33304) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.680401 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.681958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 122} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:18:14.693610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1187411d-daef-42ee-b77a-d59e04b6038f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'tempest-secgroup--177063448'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:14.708605 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d471af30-0721-4c91-b018-d23d6aaaf555), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.709494 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added segment d471af30-0721-4c91-b018-d23d6aaaf555 of type vlan for network b3b50e37-6e44-4cab-afa4-d07e2f3e809b Mar 24 02:18:14.727258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c36bea77-d447-43c6-9a62-705cdd770546 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (0ef1da80-f4e7-4a81-9682-2c44c8f8181d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.746814 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a2374d-512e-4160-ae6d-502905b28223 None None] Pushing event updated for resources: {'Port': ['ID=e15ac081-eb34-4427-bd35-22f6bcb2e344,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:14.750204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 5b488b4c-3f04-4938-b387-a53b920028a8 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:14.751746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.787952 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:14.797186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-aee9d85c-8563-4483-8567-a7947999726e None None] For port 5b488b4c-3f04-4938-b387-a53b920028a8, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5b488b4c-3f04-4938-b387-a53b920028a8,segment=NetworkSegment(e5448d4b-b8e7-4934-ac13-fef0780c703c),segment_id=e5448d4b-b8e7-4934-ac13-fef0780c703c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:14.827804 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aee9d85c-8563-4483-8567-a7947999726e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.836936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (b3b50e37-6e44-4cab-afa4-d07e2f3e809b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.874178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1187411d-daef-42ee-b77a-d59e04b6038f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.907210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (b3b50e37-6e44-4cab-afa4-d07e2f3e809b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.917197 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:14.917913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.918065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] For port c2f85444-f14d-48c1-9fd1-76fe9741f263, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:14.964122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c36bea77-d447-43c6-9a62-705cdd770546 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0ef1da80-f4e7-4a81-9682-2c44c8f8181d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.966782 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c36bea77-d447-43c6-9a62-705cdd770546 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:14.967945 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c36bea77-d447-43c6-9a62-705cdd770546 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/0ef1da80-f4e7-4a81-9682-2c44c8f8181d HTTP/1.1" status: 204 len: 168 time: 0.5362403 Mar 24 02:18:14.969941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] For port c2f85444-f14d-48c1-9fd1-76fe9741f263, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=c2f85444-f14d-48c1-9fd1-76fe9741f263,segment=NetworkSegment(0ecb8365-8c6b-4988-93b0-262a15edd551),segment_id=0ecb8365-8c6b-4988-93b0-262a15edd551)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:14.982045 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.5786552 Mar 24 02:18:14.987418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33308) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.987985 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33310) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:14.992032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.026574 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c36bea77-d447-43c6-9a62-705cdd770546 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ef1da80-f4e7-4a81-9682-2c44c8f8181d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:15.040609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5b488b4c-3f04-4938-b387-a53b920028a8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:15.046007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.055881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aee9d85c-8563-4483-8567-a7947999726e None None] Pushing event updated for resources: {'Port': ['ID=5b488b4c-3f04-4938-b387-a53b920028a8,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:15.068884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Attempting to bind port e15ac081-eb34-4427-bd35-22f6bcb2e344 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:15.069367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Attempting to bind port e15ac081-eb34-4427-bd35-22f6bcb2e344 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:15.069806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Attempting to bind port e15ac081-eb34-4427-bd35-22f6bcb2e344 on network 0a3a0bb4-4db4-4907-a006-67d97a634086 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:15.086748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:15.087223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Checking segment: {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:15.087715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.088173 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Bound using segment: {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:15.089182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Bound port: e15ac081-eb34-4427-bd35-22f6bcb2e344, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14f47a5d-c68c-4d67-a6e3-4402aa07610f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:15.089647 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.109108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1fdb7d33-cab8-43fb-847b-acb2b80a1ce0 None None] Provisioning complete for port 5b488b4c-3f04-4938-b387-a53b920028a8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:15.109599 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1fdb7d33-cab8-43fb-847b-acb2b80a1ce0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.189196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:15.198110 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.199727 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] 10.222.0.30 "PUT /v2.0/ports/c2f85444-f14d-48c1-9fd1-76fe9741f263 HTTP/1.1" status: 200 len: 1093 time: 1.6570690 Mar 24 02:18:15.203405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b03f43c2-4dc7-4d74-9408-c99b15cf4661', 'tag': 'c2f85444-f14d-48c1-9fd1-76fe9741f263'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:18:15.212976 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d185585-c563-42ef-a805-c15bab2d2ae7" -d '{"events": [{"name": "network-changed", "server_uuid": "b03f43c2-4dc7-4d74-9408-c99b15cf4661", "tag": "c2f85444-f14d-48c1-9fd1-76fe9741f263"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:18:15.227510 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] For port e15ac081-eb34-4427-bd35-22f6bcb2e344, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:15.241483 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] For port e15ac081-eb34-4427-bd35-22f6bcb2e344, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e15ac081-eb34-4427-bd35-22f6bcb2e344,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:15.242004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'subnet': {'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:15.268113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.299024 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:12Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:13Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:15.369606 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e97eaf-719f-430b-bb29-dbb7c06e79fe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Network': ['ID=b3b50e37-6e44-4cab-afa4-d07e2f3e809b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:15.380955 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:18:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-567d4d59-61d4-41ef-9d2b-1847218ce39f x-openstack-request-id: req-567d4d59-61d4-41ef-9d2b-1847218ce39f {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:18:15.381503 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b03f43c2-4dc7-4d74-9408-c99b15cf4661", "tag": "c2f85444-f14d-48c1-9fd1-76fe9741f263", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:18:15.381745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-567d4d59-61d4-41ef-9d2b-1847218ce39f {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:18:15.382412 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-567d4d59-61d4-41ef-9d2b-1847218ce39f'] response: {'name': 'network-changed', 'server_uuid': 'b03f43c2-4dc7-4d74-9408-c99b15cf4661', 'tag': 'c2f85444-f14d-48c1-9fd1-76fe9741f263', 'status': 'completed', 'code': 200} Mar 24 02:18:15.392304 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:15.392650 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Updating router e6831f90-e567-436b-a709-5ee103af3439 port 598fe3d0-0070-459b-95be-d5bd56f20a86 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:18:15.393973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c137dd1e-884a-46a7-bda6-ad56333df89c service neutron] Pushing event updated for resources: {'Port': ['ID=c2f85444-f14d-48c1-9fd1-76fe9741f263,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:15.411318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network b3b50e37-6e44-4cab-afa4-d07e2f3e809b details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:18:15.418728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1187411d-daef-42ee-b77a-d59e04b6038f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (51bb2e86-44ab-412c-a13d-dfd8c32cff65), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.429438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1187411d-daef-42ee-b77a-d59e04b6038f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (51bb2e86-44ab-412c-a13d-dfd8c32cff65), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.435586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:15.436238 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:15.455865 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.517741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1187411d-daef-42ee-b77a-d59e04b6038f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.519420 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1187411d-daef-42ee-b77a-d59e04b6038f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.8393874 Mar 24 02:18:15.523126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-3293dfa7-8d46-441c-9d42-261c4db702bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:15.529242 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-3293dfa7-8d46-441c-9d42-261c4db702bd service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4419a48020f546a6abf15b6c1b4cdbdb&device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 1127 time: 0.2584877 Mar 24 02:18:15.530248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33320) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:15.535676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-fc9d055a-6b38-4887-9b91-2a2e61ee6001 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '51bb2e86-44ab-412c-a13d-dfd8c32cff65', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:15.536775 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-fc9d055a-6b38-4887-9b91-2a2e61ee6001 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Mar 24 02:18:15.537699 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-fc9d055a-6b38-4887-9b91-2a2e61ee6001 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:15.543872 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fc9d055a-6b38-4887-9b91-2a2e61ee6001 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0123336 Mar 24 02:18:15.544678 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1187411d-daef-42ee-b77a-d59e04b6038f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=51bb2e86-44ab-412c-a13d-dfd8c32cff65,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:15.550987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33324) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:15.570932 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1d7b70ff-782b-4a1e-9912-d37d52777f51 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '51bb2e86-44ab-412c-a13d-dfd8c32cff65', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:15.576185 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-1d7b70ff-782b-4a1e-9912-d37d52777f51 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Mar 24 02:18:15.578083 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-1d7b70ff-782b-4a1e-9912-d37d52777f51 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:15.592509 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2c5b3553-c5b9-4e8f-8acf-7d6190b7fa3e tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.4200890 Mar 24 02:18:15.593517 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33326) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:15.615881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1fdb7d33-cab8-43fb-847b-acb2b80a1ce0 None None] Current status of the port 5b488b4c-3f04-4938-b387-a53b920028a8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:15.619061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a2374d-512e-4160-ae6d-502905b28223 None None] Pushing event updated for resources: {'Port': ['ID=e15ac081-eb34-4427-bd35-22f6bcb2e344,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:15.620826 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1d7b70ff-782b-4a1e-9912-d37d52777f51 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0673401 Mar 24 02:18:15.627584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33332) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:15.671489 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:15.676268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.687265 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1fdb7d33-cab8-43fb-847b-acb2b80a1ce0 None None] Provisioning complete for port 598fe3d0-0070-459b-95be-d5bd56f20a86 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:15.687926 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1fdb7d33-cab8-43fb-847b-acb2b80a1ce0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:15.709024 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b3738b42-a367-4a5d-a640-31772ca210ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '51bb2e86-44ab-412c-a13d-dfd8c32cff65', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:15.709866 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-b3738b42-a367-4a5d-a640-31772ca210ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Mar 24 02:18:15.710369 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-b3738b42-a367-4a5d-a640-31772ca210ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:15.715727 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b3738b42-a367-4a5d-a640-31772ca210ee tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0847042 Mar 24 02:18:15.723582 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33334) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:15.738054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-70cb1396-7533-4482-b62b-e9d6ba58aada tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '51bb2e86-44ab-412c-a13d-dfd8c32cff65', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '256'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:15.739302 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-70cb1396-7533-4482-b62b-e9d6ba58aada tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Mar 24 02:18:15.739966 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-70cb1396-7533-4482-b62b-e9d6ba58aada tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:15.741152 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-70cb1396-7533-4482-b62b-e9d6ba58aada tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0163524 Mar 24 02:18:15.743331 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-0080efe7-f970-47e2-a986-78d0f7194359 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c2f85444-f14d-48c1-9fd1-76fe9741f263 HTTP/1.1" status: 200 len: 217 time: 0.1911421 Mar 24 02:18:15.743958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33336) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:15.779791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:15.792367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1fdb7d33-cab8-43fb-847b-acb2b80a1ce0 None None] Port 598fe3d0-0070-459b-95be-d5bd56f20a86 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:15.933350 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f8030aff-6f35-48a4-8df0-cadffe268be4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:15.934931 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-f8030aff-6f35-48a4-8df0-cadffe268be4 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=1a07dda3-b4d8-484a-9399-92d0432cd074 HTTP/1.1" status: 200 len: 852 time: 0.1739411 Mar 24 02:18:15.972163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (174226f3-58df-4f34-8172-0281943babb1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.014975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90faf2f3-a23f-40e0-a5fb-f416ec66a398 req-3e672344-8337-43e8-9ad2-e3f597195a1c tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:16.016585 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-90faf2f3-a23f-40e0-a5fb-f416ec66a398 req-3e672344-8337-43e8-9ad2-e3f597195a1c tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 943 time: 0.2271652 Mar 24 02:18:16.021147 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-3d9cccf8-df54-440a-8cd5-8ad769f9cbdd service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=da1aec0d-a786-4656-9380-f71f1c64ba05&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0725181 Mar 24 02:18:16.023334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2be80172-8867-407a-849b-34e10be54c7c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (51bb2e86-44ab-412c-a13d-dfd8c32cff65), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.038035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cecec815-261e-471f-83a4-7a8f30b359e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (f96d0cfb-be56-44b5-ab9a-a849b0fc764b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.042451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Provisioning complete for port e15ac081-eb34-4427-bd35-22f6bcb2e344 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:16.042851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.075942 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cecec815-261e-471f-83a4-7a8f30b359e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (f96d0cfb-be56-44b5-ab9a-a849b0fc764b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.123382 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Publish callbacks [] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.124850 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2be80172-8867-407a-849b-34e10be54c7c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (51bb2e86-44ab-412c-a13d-dfd8c32cff65), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.136161 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.145526 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Subnet': ['ID=174226f3-58df-4f34-8172-0281943babb1,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:16.154171 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cecec815-261e-471f-83a4-7a8f30b359e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f96d0cfb-be56-44b5-ab9a-a849b0fc764b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.158485 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cecec815-261e-471f-83a4-7a8f30b359e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.162994 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cecec815-261e-471f-83a4-7a8f30b359e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/f96d0cfb-be56-44b5-ab9a-a849b0fc764b HTTP/1.1" status: 204 len: 168 time: 0.5661829 Mar 24 02:18:16.163920 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33346) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:16.208166 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-90faf2f3-a23f-40e0-a5fb-f416ec66a398 req-ae527a47-4c84-4f91-811d-097190df8f47 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1850951 Mar 24 02:18:16.261667 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cecec815-261e-471f-83a4-7a8f30b359e6 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f96d0cfb-be56-44b5-ab9a-a849b0fc764b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:16.269826 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33348) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:16.299259 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-401309c0-3651-40dd-98fd-dd39232d160e tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1167777 Mar 24 02:18:16.300184 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33352) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:16.302663 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Pushing event updated for resources: {'Port': ['ID=598fe3d0-0070-459b-95be-d5bd56f20a86,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:16.307821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-14ef2eb9-b0b9-4f97-b9af-f416e565d2ac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--58576969'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:16.313598 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5b488b4c-3f04-4938-b387-a53b920028a8 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:16.346635 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-8dfc38d2-4efb-4fe7-8dbb-a6d4feec53c2 service neutron] 10.222.0.30 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3102508 Mar 24 02:18:16.349809 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.350153 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.350531 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.350867 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.351722 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.352214 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.352595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Current status of the port e15ac081-eb34-4427-bd35-22f6bcb2e344 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:16.352835 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.352994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.353442 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.354231 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.355081 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.361987 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.363316 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.365999 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.366445 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.367032 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:16.400231 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Checking segment: {'id': 'd471af30-0721-4c91-b018-d23d6aaaf555', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:16.401816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network hostable DHCP agents. Network: b3b50e37-6e44-4cab-afa4-d07e2f3e809b, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:18:16.410045 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Attempting to bind port 598fe3d0-0070-459b-95be-d5bd56f20a86 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:16.411433 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2be80172-8867-407a-849b-34e10be54c7c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (51bb2e86-44ab-412c-a13d-dfd8c32cff65), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.412128 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Attempting to bind port 598fe3d0-0070-459b-95be-d5bd56f20a86 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'e5448d4b-b8e7-4934-ac13-fef0780c703c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:16.412569 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Attempting to bind port 598fe3d0-0070-459b-95be-d5bd56f20a86 on network c4069fde-e378-4094-98fe-405d58aa3139 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:16.413332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] For port e15ac081-eb34-4427-bd35-22f6bcb2e344, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e15ac081-eb34-4427-bd35-22f6bcb2e344,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:16.419296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2be80172-8867-407a-849b-34e10be54c7c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.423887 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2be80172-8867-407a-849b-34e10be54c7c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/51bb2e86-44ab-412c-a13d-dfd8c32cff65 HTTP/1.1" status: 204 len: 168 time: 0.6765406 Mar 24 02:18:16.425332 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33354) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:16.425464 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:16.426202 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Checking segment: {'id': 'e5448d4b-b8e7-4934-ac13-fef0780c703c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:16.426625 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.428452 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Bound using segment: {'id': 'e5448d4b-b8e7-4934-ac13-fef0780c703c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:16.429432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.430190 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Bound port: 598fe3d0-0070-459b-95be-d5bd56f20a86, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5448d4b-b8e7-4934-ac13-fef0780c703c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:16.431087 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.443086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14ef2eb9-b0b9-4f97-b9af-f416e565d2ac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.447612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:18:10Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '774a5962-6c17-496b-8d49-ec290d2538c5', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.10', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 792, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:16:15Z', 'updated_at': '2022-03-24T02:16:22Z', 'revision_number': 1, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e15ac081-eb34-4427-bd35-22f6bcb2e344', 'name': '', 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:e4:97:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 1120, 'fixed_ips': [{'subnet_id': '47e13ca4-a1b5-4f9e-95ce-b93533455f10', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:09Z', 'updated_at': '2022-03-24T02:18:15Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '47e13ca4-a1b5-4f9e-95ce-b93533455f10', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:16.487257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 5b488b4c-3f04-4938-b387-a53b920028a8 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:16.487638 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.494136 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2be80172-8867-407a-849b-34e10be54c7c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=51bb2e86-44ab-412c-a13d-dfd8c32cff65,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:16.532482 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] For port 598fe3d0-0070-459b-95be-d5bd56f20a86, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:16.535885 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network b3b50e37-6e44-4cab-afa4-d07e2f3e809b is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:18:16.537182 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] For port 598fe3d0-0070-459b-95be-d5bd56f20a86, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=598fe3d0-0070-459b-95be-d5bd56f20a86,segment=NetworkSegment(e5448d4b-b8e7-4934-ac13-fef0780c703c),segment_id=e5448d4b-b8e7-4934-ac13-fef0780c703c)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:16.546892 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af1f2917-6f97-4f06-830e-188bac1008a6 req-a8c0dbbb-4ba9-4e1d-bf70-65b59186c5e0 service neutron] 10.222.0.30 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1893747 Mar 24 02:18:16.548516 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.609548 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-test-network-2084037195'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:16.658658 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:16.659309 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:16.696068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14ef2eb9-b0b9-4f97-b9af-f416e565d2ac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (13d36584-067c-4f8d-92e4-645bd12825a7), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.708077 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0903b2a2-2600-4508-b3f8-01e2538a1756 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.2794414 Mar 24 02:18:16.713377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33356) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:16.719158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5be8a033-a33d-4ca4-9476-41f29d84724c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'tempest-secgroup--778626085'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:16.719866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14ef2eb9-b0b9-4f97-b9af-f416e565d2ac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (13d36584-067c-4f8d-92e4-645bd12825a7), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.727208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Made reservation on behalf of 4f11674605a349f28f6886bf409a1207 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:16.731611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.743814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.813041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ef2eb9-b0b9-4f97-b9af-f416e565d2ac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=13d36584-067c-4f8d-92e4-645bd12825a7,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:16.821167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, b3b50e37-6e44-4cab-afa4-d07e2f3e809b) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:16.827385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:16.827983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.847745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for security_group (d39136af-d648-403d-809b-53a1a8bcdd1b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.852998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14ef2eb9-b0b9-4f97-b9af-f416e565d2ac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:16.854761 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-14ef2eb9-b0b9-4f97-b9af-f416e565d2ac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5529985 Mar 24 02:18:16.860294 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-946a8662-305c-41e9-bb90-840a16ee0457 None None] Network b3b50e37-6e44-4cab-afa4-d07e2f3e809b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:16.864022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fdb3f68-8fea-4eb9-933e-a542cbf689a0 None None] The sync data for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv is: [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:18:10Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '774a5962-6c17-496b-8d49-ec290d2538c5', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.10', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 792, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:16:15Z', 'updated_at': '2022-03-24T02:16:22Z', 'revision_number': 1, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e15ac081-eb34-4427-bd35-22f6bcb2e344', 'name': '', 'network_id': '0a3a0bb4-4db4-4907-a006-67d97a634086', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:e4:97:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 1120, 'fixed_ips': [{'subnet_id': '47e13ca4-a1b5-4f9e-95ce-b93533455f10', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:09Z', 'updated_at': '2022-03-24T02:18:15Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '47e13ca4-a1b5-4f9e-95ce-b93533455f10', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:16.865145 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33358) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:16.865481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33360) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:16.873353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-4dcecde6-d6a2-439b-a278-ad10c4b56780 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:16.875442 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-67b359b2-9a16-4a4d-a723-07e561363041 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6325777 Mar 24 02:18:16.880781 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-4dcecde6-d6a2-439b-a278-ad10c4b56780 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4419a48020f546a6abf15b6c1b4cdbdb&device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 1127 time: 0.2635140 Mar 24 02:18:16.887719 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a0714d-78c9-452e-9cbc-280f532610d4 None None] Pushing event updated for resources: {'Port': ['ID=598fe3d0-0070-459b-95be-d5bd56f20a86,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:16.907688 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:16.989851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Provisioning complete for port 598fe3d0-0070-459b-95be-d5bd56f20a86 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:16.990132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.002065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b34141ca-8b6d-4dc7-9441-1f792fec19c9 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '13d36584-067c-4f8d-92e4-645bd12825a7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:17.007212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d39136af-d648-403d-809b-53a1a8bcdd1b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.023533 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Pushing event updated for resources: {'Port': ['ID=e15ac081-eb34-4427-bd35-22f6bcb2e344,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:17.173339 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:18:17.174343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.195097 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 5b488b4c-3f04-4938-b387-a53b920028a8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:17.207315 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:12Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:16Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:17.221529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Current status of the port 598fe3d0-0070-459b-95be-d5bd56f20a86 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:17.221919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.242079 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae592472-8014-493f-a511-0aa26fec53ef None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:12Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:16Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:17.261092 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] For port 598fe3d0-0070-459b-95be-d5bd56f20a86, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=598fe3d0-0070-459b-95be-d5bd56f20a86,segment=NetworkSegment(e5448d4b-b8e7-4934-ac13-fef0780c703c),segment_id=e5448d4b-b8e7-4934-ac13-fef0780c703c)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:17.337900 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.467745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60de24b-c3cd-4261-968d-ffc3f43904d5 None None] Pushing event updated for resources: {'Port': ['ID=598fe3d0-0070-459b-95be-d5bd56f20a86,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:17.489190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Allocated IP 172.21.0.2 (b3b50e37-6e44-4cab-afa4-d07e2f3e809b/174226f3-58df-4f34-8172-0281943babb1/da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:17.491585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7161a69b-8cf9-4df4-bd3d-8af992733155 None None] Provisioning complete for port 598fe3d0-0070-459b-95be-d5bd56f20a86 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:17.492055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7161a69b-8cf9-4df4-bd3d-8af992733155 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.492408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5be8a033-a33d-4ca4-9476-41f29d84724c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.648029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 135} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:18:17.685940 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d39136af-d648-403d-809b-53a1a8bcdd1b,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:17.694939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7161a69b-8cf9-4df4-bd3d-8af992733155 None None] Current status of the port 598fe3d0-0070-459b-95be-d5bd56f20a86 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:17.717857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (c982c793-584e-47e2-b9d8-70812f2a84ad), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.718061 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Added segment c982c793-584e-47e2-b9d8-70812f2a84ad of type vlan for network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe Mar 24 02:18:17.776102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Publish callbacks [] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.785464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.813148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e6b9c3-b8b6-4f30-b680-4037cb4a9fdb req-9de45fac-e8d5-43a8-8b9f-0b216f6c5c0e tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:17.814978 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a2e6b9c3-b8b6-4f30-b680-4037cb4a9fdb req-9de45fac-e8d5-43a8-8b9f-0b216f6c5c0e tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 943 time: 0.3104320 Mar 24 02:18:17.823631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Network b3b50e37-6e44-4cab-afa4-d07e2f3e809b is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:17.825371 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-b34141ca-8b6d-4dc7-9441-1f792fec19c9 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:17.829437 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b34141ca-8b6d-4dc7-9441-1f792fec19c9 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.9447129 Mar 24 02:18:17.829623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:17.829623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:17.830224 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33364) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:17.836777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a71f5f61-8d36-4a72-b402-c35724fdce0d tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group_rule': {'security_group_id': '13d36584-067c-4f8d-92e4-645bd12825a7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:17.843923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-301be45f-6b58-4907-9efc-b1288827ab5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:17.845999 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-301be45f-6b58-4907-9efc-b1288827ab5b service neutron] 10.222.0.30 "GET /v2.0/networks?id=da1aec0d-a786-4656-9380-f71f1c64ba05 HTTP/1.1" status: 200 len: 913 time: 0.8556957 Mar 24 02:18:17.848149 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Pushing event updated for resources: {'Port': ['ID=da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:17.856344 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (383df69d-c9d6-4f76-a384-f1c5ebdd10fe), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.920044 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-a71f5f61-8d36-4a72-b402-c35724fdce0d tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:17.923311 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Attempting to bind port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:17.923679 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Attempting to bind port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'd471af30-0721-4c91-b018-d23d6aaaf555', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:17.924041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Attempting to bind port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 on network b3b50e37-6e44-4cab-afa4-d07e2f3e809b {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:17.926775 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a71f5f61-8d36-4a72-b402-c35724fdce0d tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.0932875 Mar 24 02:18:17.928140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33366) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:17.934028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:17.934411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Checking segment: {'id': 'd471af30-0721-4c91-b018-d23d6aaaf555', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:17.934854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.935303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Bound using segment: {'id': 'd471af30-0721-4c91-b018-d23d6aaaf555', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:17.935789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Bound port: da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd471af30-0721-4c91-b018-d23d6aaaf555', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:17.936178 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:17.995510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.db.resource_extend [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Mar 24 02:18:18.013160 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-a81d951e-cef1-4a76-8ac1-0dfe212f1dce service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c2f85444-f14d-48c1-9fd1-76fe9741f263 HTTP/1.1" status: 200 len: 217 time: 0.1595271 Mar 24 02:18:18.024437 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5be8a033-a33d-4ca4-9476-41f29d84724c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.027699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] For port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:18.027854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-567154c9-f1ae-4273-a1cd-47cf286b8eac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (13d36584-067c-4f8d-92e4-645bd12825a7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.033034 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] For port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9,segment=NetworkSegment(d471af30-0721-4c91-b018-d23d6aaaf555),segment_id=d471af30-0721-4c91-b018-d23d6aaaf555)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:18.043507 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.056684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5be8a033-a33d-4ca4-9476-41f29d84724c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.060282 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-567154c9-f1ae-4273-a1cd-47cf286b8eac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (13d36584-067c-4f8d-92e4-645bd12825a7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.123671 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-095ca924-d699-4db7-b436-8826bf7d8c05 None None] Pushing event updated for resources: {'Port': ['ID=da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:18.127870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (383df69d-c9d6-4f76-a384-f1c5ebdd10fe), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.145738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-567154c9-f1ae-4273-a1cd-47cf286b8eac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (13d36584-067c-4f8d-92e4-645bd12825a7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.147183 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:18.147863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.151076 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-567154c9-f1ae-4273-a1cd-47cf286b8eac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.158426 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-567154c9-f1ae-4273-a1cd-47cf286b8eac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/13d36584-067c-4f8d-92e4-645bd12825a7 HTTP/1.1" status: 204 len: 168 time: 0.2262998 Mar 24 02:18:18.170535 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33370) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.171482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-567154c9-f1ae-4273-a1cd-47cf286b8eac tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=13d36584-067c-4f8d-92e4-645bd12825a7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:18.193874 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a2e6b9c3-b8b6-4f30-b680-4037cb4a9fdb req-9f2c6615-9489-40d6-8a29-58613d536b98 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3587840 Mar 24 02:18:18.263349 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5be8a033-a33d-4ca4-9476-41f29d84724c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.266816 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5be8a033-a33d-4ca4-9476-41f29d84724c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 1.5498822 Mar 24 02:18:18.269186 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0cef4563-a09b-416d-a705-ce4d33ffa6cd tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0936282 Mar 24 02:18:18.269655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33372) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.270042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33374) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.276473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6d685358-45bd-4827-85a7-773d80e3714f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.277099 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-6d685358-45bd-4827-85a7-773d80e3714f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Mar 24 02:18:18.277643 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-6d685358-45bd-4827-85a7-773d80e3714f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:18.281224 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6d685358-45bd-4827-85a7-773d80e3714f tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0075948 Mar 24 02:18:18.282100 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-60c3bd05-90c6-4e84-bbf3-a52e51f41f77 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'tempest-secgroup--893355246'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.290360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33376) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.293258 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b30a1325-e226-4585-a520-002bcc45eb76 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.302256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be8a033-a33d-4ca4-9476-41f29d84724c tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:18.315647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-661cc3ba-0f98-47cc-98fe-65c13d08770c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:18.317364 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-661cc3ba-0f98-47cc-98fe-65c13d08770c service neutron] 10.222.0.30 "GET /v2.0/subnets?id=1a07dda3-b4d8-484a-9399-92d0432cd074 HTTP/1.1" status: 200 len: 852 time: 0.2895706 Mar 24 02:18:18.323852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60c3bd05-90c6-4e84-bbf3-a52e51f41f77 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.327152 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 2.0543416 Mar 24 02:18:18.338543 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33378) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.345309 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'subnet': {'network_id': '383df69d-c9d6-4f76-a384-f1c5ebdd10fe', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.366549 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-ec2d7d1c-fcd0-4d8b-92ee-e3941c6e29ac service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=da1aec0d-a786-4656-9380-f71f1c64ba05&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0381155 Mar 24 02:18:18.367207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94ee5129-6d65-4247-b945-f5516aa5e40e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Network': ['ID=383df69d-c9d6-4f76-a384-f1c5ebdd10fe,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:18.388654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:18:18.420084 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-b30a1325-e226-4585-a520-002bcc45eb76 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:18.421167 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b30a1325-e226-4585-a520-002bcc45eb76 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1312270 Mar 24 02:18:18.428573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33380) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.471677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-79d10ced-fb5a-4def-9af2-6d957a6f265e tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.472421 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-79d10ced-fb5a-4def-9af2-6d957a6f265e tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Mar 24 02:18:18.473098 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-79d10ced-fb5a-4def-9af2-6d957a6f265e tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:18.474327 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-79d10ced-fb5a-4def-9af2-6d957a6f265e tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0408092 Mar 24 02:18:18.478977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33382) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.490602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b7bff9d1-72a9-4bf6-ab49-9c689c28d87e tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.508738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e15ac081-eb34-4427-bd35-22f6bcb2e344 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:18.524039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.571009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60c3bd05-90c6-4e84-bbf3-a52e51f41f77 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (befb31bb-47a3-4b75-bfe3-b2840adaae1a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.571914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device c2f85444-f14d-48c1-9fd1-76fe9741f263 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:18:18.581639 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60c3bd05-90c6-4e84-bbf3-a52e51f41f77 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (befb31bb-47a3-4b75-bfe3-b2840adaae1a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.635821 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port e15ac081-eb34-4427-bd35-22f6bcb2e344 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:18.636499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.647044 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60c3bd05-90c6-4e84-bbf3-a52e51f41f77 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=befb31bb-47a3-4b75-bfe3-b2840adaae1a,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:18.649335 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Made reservation on behalf of 4f11674605a349f28f6886bf409a1207 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:18.652581 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-38e1391e-4f05-47d6-b49c-68ec0bfdb29f service neutron] 10.222.0.30 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2769074 Mar 24 02:18:18.653181 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.719797 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-b7bff9d1-72a9-4bf6-ab49-9c689c28d87e tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:18.723731 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b7bff9d1-72a9-4bf6-ab49-9c689c28d87e tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.2424986 Mar 24 02:18:18.723987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33384) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.735683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4ef062a5-597a-411d-946f-2ec9feec8548 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.736167 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-4ef062a5-597a-411d-946f-2ec9feec8548 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Mar 24 02:18:18.736659 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-4ef062a5-597a-411d-946f-2ec9feec8548 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:18.737633 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4ef062a5-597a-411d-946f-2ec9feec8548 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0088005 Mar 24 02:18:18.741858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-60c3bd05-90c6-4e84-bbf3-a52e51f41f77 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.742439 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33386) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.743190 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-60c3bd05-90c6-4e84-bbf3-a52e51f41f77 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4709406 Mar 24 02:18:18.747587 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33388) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.752865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d04c84d2-f717-45c8-b79c-28fcfb4a2d5a tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Request body: {'security_group': {'name': 'default'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.753281 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-d04c84d2-f717-45c8-b79c-28fcfb4a2d5a tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Mar 24 02:18:18.753806 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-d04c84d2-f717-45c8-b79c-28fcfb4a2d5a tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] update failed (client error): There was a conflict when trying to complete your request. Mar 24 02:18:18.754330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-eb1b0757-f431-43a4-8fcd-273b8d930c78 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.758053 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d04c84d2-f717-45c8-b79c-28fcfb4a2d5a tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "PUT /v2.0/security-groups/befb31bb-47a3-4b75-bfe3-b2840adaae1a HTTP/1.1" status: 409 len: 330 time: 0.0068915 Mar 24 02:18:18.759935 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33390) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.792720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port c2f85444-f14d-48c1-9fd1-76fe9741f263, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=c2f85444-f14d-48c1-9fd1-76fe9741f263,segment=NetworkSegment(0ecb8365-8c6b-4988-93b0-262a15edd551),segment_id=0ecb8365-8c6b-4988-93b0-262a15edd551)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:18.827309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': 'c2f85444-f14d-48c1-9fd1-76fe9741f263', 'network_id': 'da1aec0d-a786-4656-9380-f71f1c64ba05', 'port_id': 'c2f85444-f14d-48c1-9fd1-76fe9741f263', 'mac_address': 'fa:16:3e:30:d3:e1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 109, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1a07dda3-b4d8-484a-9399-92d0432cd074', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:18:18.841050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1df76eca-d87d-4df7-b12c-27f532912be3 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (befb31bb-47a3-4b75-bfe3-b2840adaae1a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.861824 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port e15ac081-eb34-4427-bd35-22f6bcb2e344 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:18.863100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 598fe3d0-0070-459b-95be-d5bd56f20a86 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:18.866687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1df76eca-d87d-4df7-b12c-27f532912be3 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (befb31bb-47a3-4b75-bfe3-b2840adaae1a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.896993 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d185585-c563-42ef-a805-c15bab2d2ae7 req-15efdad5-62f7-457f-8aa0-3331da62bd61 service neutron] 10.222.0.30 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2328076 Mar 24 02:18:18.897972 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-eb1b0757-f431-43a4-8fcd-273b8d930c78 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:18.898836 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eb1b0757-f431-43a4-8fcd-273b8d930c78 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.1538758 Mar 24 02:18:18.903974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33392) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.909382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-88f49219-98a2-4b64-a25a-3e6ab0676e60 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.909831 dv-neutron-834874-3-hyperv neutron-server[104037]: WARNING neutron.api.v2.base [None req-88f49219-98a2-4b64-a25a-3e6ab0676e60 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Mar 24 02:18:18.910321 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-88f49219-98a2-4b64-a25a-3e6ab0676e60 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:18.911450 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-88f49219-98a2-4b64-a25a-3e6ab0676e60 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0063670 Mar 24 02:18:18.915898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port c2f85444-f14d-48c1-9fd1-76fe9741f263 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:18.916279 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.919412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33394) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:18.928162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e264ea68-0163-40ef-8ea6-82a922584ddb tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:18.934265 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c2f85444-f14d-48c1-9fd1-76fe9741f263 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:18:18.955245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 598fe3d0-0070-459b-95be-d5bd56f20a86 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:18.955628 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.960364 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port c2f85444-f14d-48c1-9fd1-76fe9741f263, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=c2f85444-f14d-48c1-9fd1-76fe9741f263,segment=NetworkSegment(0ecb8365-8c6b-4988-93b0-262a15edd551),segment_id=0ecb8365-8c6b-4988-93b0-262a15edd551)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:18.978037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1df76eca-d87d-4df7-b12c-27f532912be3 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (befb31bb-47a3-4b75-bfe3-b2840adaae1a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.980802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.987667 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1df76eca-d87d-4df7-b12c-27f532912be3 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:18.988466 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1df76eca-d87d-4df7-b12c-27f532912be3 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/befb31bb-47a3-4b75-bfe3-b2840adaae1a HTTP/1.1" status: 204 len: 168 time: 0.2271585 Mar 24 02:18:18.994882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33396) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.028540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df76eca-d87d-4df7-b12c-27f532912be3 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=befb31bb-47a3-4b75-bfe3-b2840adaae1a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:19.039822 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-e264ea68-0163-40ef-8ea6-82a922584ddb tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:19.040884 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e264ea68-0163-40ef-8ea6-82a922584ddb tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.1200154 Mar 24 02:18:19.047363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33398) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.051321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=c2f85444-f14d-48c1-9fd1-76fe9741f263,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:19.053881 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a2cef0df-3ecb-49ff-82c6-77851afbdba1 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:19.059276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.21.0.1 (b3b50e37-6e44-4cab-afa4-d07e2f3e809b/174226f3-58df-4f34-8172-0281943babb1/f3626bc4-ba10-450e-b6bd-3dc7422635cd) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:19.084481 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f6507d35-d15d-444e-b383-f5e1b5cb44a7 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0888753 Mar 24 02:18:19.085133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33400) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.095696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (35936600-4794-4c7a-9459-34f9b2293644), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.107904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 598fe3d0-0070-459b-95be-d5bd56f20a86 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:19.119013 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-4bbea6dd-9d3f-47bd-b2b5-cd6dee625d7b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] delete failed (client error): The resource could not be found. Mar 24 02:18:19.121540 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4bbea6dd-9d3f-47bd-b2b5-cd6dee625d7b tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "DELETE /v2.0/security-groups/73ea0794-029f-42ee-ae77-3d27855a1f5a HTTP/1.1" status: 404 len: 347 time: 0.0339813 Mar 24 02:18:19.122171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33402) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.152174 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-a2cef0df-3ecb-49ff-82c6-77851afbdba1 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:19.153209 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a2cef0df-3ecb-49ff-82c6-77851afbdba1 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.1034770 Mar 24 02:18:19.157810 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33404) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.162712 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-5d497e12-18ac-4b7a-a59c-6883ddbbaeae tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] show failed (client error): The resource could not be found. Mar 24 02:18:19.166617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Subnet': ['ID=35936600-4794-4c7a-9459-34f9b2293644,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:19.167576 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5d497e12-18ac-4b7a-a59c-6883ddbbaeae tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-groups/5ec7cc0f-4d1d-4b23-a8fa-4ad2bff3999f HTTP/1.1" status: 404 len: 347 time: 0.0194893 Mar 24 02:18:19.170485 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33406) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.209011 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-29a583b1-3889-4843-a814-20fca955b2d7 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] show failed (client error): The resource could not be found. Mar 24 02:18:19.210086 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-29a583b1-3889-4843-a814-20fca955b2d7 tempest-NegativeSecGroupIPv6Test-2093743962 tempest-NegativeSecGroupIPv6Test-2093743962-project] 10.222.0.20 "GET /v2.0/security-group-rules/86dc1662-2139-466d-8c09-7dfde6769d32 HTTP/1.1" status: 404 len: 356 time: 0.0386128 Mar 24 02:18:19.218382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Checking segment: {'id': 'c982c793-584e-47e2-b9d8-70812f2a84ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '383df69d-c9d6-4f76-a384-f1c5ebdd10fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:19.218777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network hostable DHCP agents. Network: 383df69d-c9d6-4f76-a384-f1c5ebdd10fe, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:18:19.254420 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb0225a-5d4e-48e2-ade1-f516918e1e93 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.257311 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:18:19.285658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 383df69d-c9d6-4f76-a384-f1c5ebdd10fe) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:19.288326 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb0225a-5d4e-48e2-ade1-f516918e1e93 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.292694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.298760 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:19.299353 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.307861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-833d5479-45fc-4dfa-af9c-da7c00ce6283 None None] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:19.335955 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1b1ad8bb-fabf-4d23-858d-0369aeea4f3a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 0.9965003 Mar 24 02:18:19.339274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33412) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.345802 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-1314859431', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:19.380675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (089a3ef4-d121-4511-bd42-87d878f1416f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.382252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (089a3ef4-d121-4511-bd42-87d878f1416f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.390301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['c2f85444-f14d-48c1-9fd1-76fe9741f263'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:18:19.413018 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.480965 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=f3626bc4-ba10-450e-b6bd-3dc7422635cd,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:19.486306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_controller (089a3ef4-d121-4511-bd42-87d878f1416f), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.488051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb0225a-5d4e-48e2-ade1-f516918e1e93 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.500017 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1cb0225a-5d4e-48e2-ade1-f516918e1e93 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.505540 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1cb0225a-5d4e-48e2-ade1-f516918e1e93 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7 HTTP/1.1" status: 204 len: 168 time: 0.3465207 Mar 24 02:18:19.506421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33414) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.526338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network b3b50e37-6e44-4cab-afa4-d07e2f3e809b is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:19.527979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:19.531025 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:19.574659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cb0225a-5d4e-48e2-ade1-f516918e1e93 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc869ce4-ddd8-41e2-aa9b-ea45d270b2a7,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:19.624855 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93dd840b-147d-49f1-a696-39dd314750c0 req-fe039a86-31ca-46df-9f8c-35e21cd0d54a tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:19.627382 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-93dd840b-147d-49f1-a696-39dd314750c0 req-fe039a86-31ca-46df-9f8c-35e21cd0d54a tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 944 time: 0.3167851 Mar 24 02:18:19.635998 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33418) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.658803 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b012c041-7981-44cf-9f40-4aa242ad01ac None None] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:19.679224 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.812002 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-93dd840b-147d-49f1-a696-39dd314750c0 req-d59dcffa-40c6-4f8b-88bc-97ce9ff1c775 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1556423 Mar 24 02:18:19.870082 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5aae70b1-8d37-44fe-94ca-0977bbf51fa0 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=f54394d36b9845de8f8a90f9218de610&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2303619 Mar 24 02:18:19.870082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33422) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:19.871593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fe3f1e4-a8f4-49a3-9c03-e27ff2fad61b None None] Network b3b50e37-6e44-4cab-afa4-d07e2f3e809b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:19.947528 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.974027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d8efc00c-c975-42b9-84a4-e387488dd016 None None] Provisioning complete for port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:19.974398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8efc00c-c975-42b9-84a4-e387488dd016 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:19.995410 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2790f161-fa27-4d20-bc72-dc377160af5f admin admin] Publish callbacks [] for security_group (b16d6671-01ab-4b03-be36-5c7cd0c7c655), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.027889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2790f161-fa27-4d20-bc72-dc377160af5f admin admin] Publish callbacks [] for security_group (b16d6671-01ab-4b03-be36-5c7cd0c7c655), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.052076 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9711f0bd-0cfb-477e-ba57-2dde11b7e1c8 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.5311594 Mar 24 02:18:20.052680 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33424) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:20.059039 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-533a004c-f3b8-401c-a7ab-2dfc35fc043a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'tempest-secgroup--1511597107'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:20.081729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_gateway (089a3ef4-d121-4511-bd42-87d878f1416f), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.085417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-533a004c-f3b8-401c-a7ab-2dfc35fc043a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.106027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d8efc00c-c975-42b9-84a4-e387488dd016 None None] Current status of the port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:20.106511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8efc00c-c975-42b9-84a4-e387488dd016 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.143438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d8efc00c-c975-42b9-84a4-e387488dd016 None None] For port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9,segment=NetworkSegment(d471af30-0721-4c91-b018-d23d6aaaf555),segment_id=d471af30-0721-4c91-b018-d23d6aaaf555)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:20.149358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8efc00c-c975-42b9-84a4-e387488dd016 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.213104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2790f161-fa27-4d20-bc72-dc377160af5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b16d6671-01ab-4b03-be36-5c7cd0c7c655), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.214498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2790f161-fa27-4d20-bc72-dc377160af5f admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.219893 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2790f161-fa27-4d20-bc72-dc377160af5f admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/b16d6671-01ab-4b03-be36-5c7cd0c7c655 HTTP/1.1" status: 204 len: 168 time: 0.3452015 Mar 24 02:18:20.242538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8efc00c-c975-42b9-84a4-e387488dd016 None None] Pushing event updated for resources: {'Port': ['ID=da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:20.285188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2790f161-fa27-4d20-bc72-dc377160af5f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b16d6671-01ab-4b03-be36-5c7cd0c7c655,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:20.310719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-533a004c-f3b8-401c-a7ab-2dfc35fc043a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (2433273f-2eb3-4ed0-9b0e-a4f70b94fd55), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.340717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-533a004c-f3b8-401c-a7ab-2dfc35fc043a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2433273f-2eb3-4ed0-9b0e-a4f70b94fd55), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.376219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:20.431643 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-533a004c-f3b8-401c-a7ab-2dfc35fc043a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.432883 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-533a004c-f3b8-401c-a7ab-2dfc35fc043a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3795996 Mar 24 02:18:20.450865 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33430) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:20.451268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533a004c-f3b8-401c-a7ab-2dfc35fc043a tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2433273f-2eb3-4ed0-9b0e-a4f70b94fd55,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:20.470062 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ac10997a-7994-46bf-a708-c2b78088d470 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '2433273f-2eb3-4ed0-9b0e-a4f70b94fd55', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'bad_group_id'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:20.494150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.503395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-277528c5-d104-48bd-8fc2-40180be7a257 None None] Provisioning complete for port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:20.504003 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-277528c5-d104-48bd-8fc2-40180be7a257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.505500 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:20.506071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.526941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.628675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_gateway (089a3ef4-d121-4511-bd42-87d878f1416f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.668734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.704985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.709981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=f3626bc4-ba10-450e-b6bd-3dc7422635cd,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:20.713958 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-ac10997a-7994-46bf-a708-c2b78088d470 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The resource could not be found. Mar 24 02:18:20.715420 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ac10997a-7994-46bf-a708-c2b78088d470 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.2560687 Mar 24 02:18:20.719788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33432) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:20.725513 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d76b83dc-d086-4b1f-bbaa-fba6e3413383 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '2433273f-2eb3-4ed0-9b0e-a4f70b94fd55', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': '852f6a35-ca33-4669-8d8c-1fee3b21958d'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:20.736715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-277528c5-d104-48bd-8fc2-40180be7a257 None None] Current status of the port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:20.752927 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:20.765451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-277528c5-d104-48bd-8fc2-40180be7a257 None None] Provisioning complete for port f3626bc4-ba10-450e-b6bd-3dc7422635cd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:20.767389 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-277528c5-d104-48bd-8fc2-40180be7a257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:20.819507 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-277528c5-d104-48bd-8fc2-40180be7a257 None None] Port f3626bc4-ba10-450e-b6bd-3dc7422635cd cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:20.866751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network b3b50e37-6e44-4cab-afa4-d07e2f3e809b is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:20.867704 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-d76b83dc-d086-4b1f-bbaa-fba6e3413383 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The resource could not be found. Mar 24 02:18:20.871316 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d76b83dc-d086-4b1f-bbaa-fba6e3413383 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.1472733 Mar 24 02:18:20.871595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33436) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:20.878132 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.26.2.2 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/443ae422-1387-4a4d-8be1-2b56c4de4e8d) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:20.880009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:20.946791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-73e87e0d-a501-4b07-a1a7-035c34dfe39c None None] Provisioning complete for port f3626bc4-ba10-450e-b6bd-3dc7422635cd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:20.947171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-73e87e0d-a501-4b07-a1a7-035c34dfe39c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.009309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-73e87e0d-a501-4b07-a1a7-035c34dfe39c None None] Port f3626bc4-ba10-450e-b6bd-3dc7422635cd cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:21.040000 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (443ae422-1387-4a4d-8be1-2b56c4de4e8d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.065569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ef98e03-46d2-4da6-b4d8-b636f0d34c0b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (2433273f-2eb3-4ed0-9b0e-a4f70b94fd55), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.082244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (443ae422-1387-4a4d-8be1-2b56c4de4e8d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.113597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ef98e03-46d2-4da6-b4d8-b636f0d34c0b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (2433273f-2eb3-4ed0-9b0e-a4f70b94fd55), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.123669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:21.133173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:21.134299 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430ceb3d-d199-4606-bb6c-1383b9f57658 req-088f7019-5e5e-4b01-b24d-65e1ef838064 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:21.135913 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-430ceb3d-d199-4606-bb6c-1383b9f57658 req-088f7019-5e5e-4b01-b24d-65e1ef838064 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 944 time: 0.1914639 Mar 24 02:18:21.138424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:21.140897 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:21.181833 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=443ae422-1387-4a4d-8be1-2b56c4de4e8d,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:21.239649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-174f7a6c-dbbc-4453-9c83-ae1d3f83a000 None None] Provisioning complete for port f3626bc4-ba10-450e-b6bd-3dc7422635cd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:21.240199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-174f7a6c-dbbc-4453-9c83-ae1d3f83a000 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.285628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ef98e03-46d2-4da6-b4d8-b636f0d34c0b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2433273f-2eb3-4ed0-9b0e-a4f70b94fd55), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.288864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ef98e03-46d2-4da6-b4d8-b636f0d34c0b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.290460 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6ef98e03-46d2-4da6-b4d8-b636f0d34c0b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/2433273f-2eb3-4ed0-9b0e-a4f70b94fd55 HTTP/1.1" status: 204 len: 168 time: 0.4177203 Mar 24 02:18:21.293936 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-174f7a6c-dbbc-4453-9c83-ae1d3f83a000 None None] Port f3626bc4-ba10-450e-b6bd-3dc7422635cd cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:21.297482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33438) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:21.307978 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-430ceb3d-d199-4606-bb6c-1383b9f57658 req-c74172af-515b-42fc-961e-211ca301a776 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1546357 Mar 24 02:18:21.319025 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ef98e03-46d2-4da6-b4d8-b636f0d34c0b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2433273f-2eb3-4ed0-9b0e-a4f70b94fd55,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:21.324624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:21.337075 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f7c048d0-b31a-45a7-a13e-145ba289405c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4539573 Mar 24 02:18:21.338406 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:21.341662 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33440) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:21.348425 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'network': {'name': 'tempest-RoutersTest-228934450'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:21.354283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:21.355058 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:21.441370 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e94637b1-f1cd-47a5-b93e-e59969027628 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1420896 Mar 24 02:18:21.445707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33442) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:21.450836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ce551f92-677e-4280-b32a-5f19f973f6e0 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': '395d6c91-71fe-4518-947d-1daf98c90f9d', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:21.451051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:21.455083 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.494277 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-ce551f92-677e-4280-b32a-5f19f973f6e0 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The resource could not be found. Mar 24 02:18:21.499188 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ce551f92-677e-4280-b32a-5f19f973f6e0 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0487130 Mar 24 02:18:21.500140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33444) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:21.502408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 138} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:18:21.506427 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c7fb214f-b1d3-4a3b-8a10-2a4cc31dc402 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'tempest-secgroup--1805111595'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:21.525284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (7121d99a-e8b1-4010-a870-f48f170564fe), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.525653 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added segment 7121d99a-e8b1-4010-a870-f48f170564fe of type vlan for network 43fab518-494b-4f36-9f94-b357dfa5fb11 Mar 24 02:18:21.532494 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7fb214f-b1d3-4a3b-8a10-2a4cc31dc402 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.535264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_gateway (089a3ef4-d121-4511-bd42-87d878f1416f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.615071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:21.616334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7fb214f-b1d3-4a3b-8a10-2a4cc31dc402 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (c2ac7b4c-97eb-481b-9b24-dbf8b38608e3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.622930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7fb214f-b1d3-4a3b-8a10-2a4cc31dc402 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (c2ac7b4c-97eb-481b-9b24-dbf8b38608e3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.642217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (43fab518-494b-4f36-9f94-b357dfa5fb11), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.656775 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7fb214f-b1d3-4a3b-8a10-2a4cc31dc402 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.661386 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c7fb214f-b1d3-4a3b-8a10-2a4cc31dc402 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1568618 Mar 24 02:18:21.661652 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33446) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:21.662821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7fb214f-b1d3-4a3b-8a10-2a4cc31dc402 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c2ac7b4c-97eb-481b-9b24-dbf8b38608e3,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:21.674551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a32b5dba-95e4-4ffc-82a7-0b649883927b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'tempest-secgroup--2034827092'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:21.710793 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (43fab518-494b-4f36-9f94-b357dfa5fb11), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.716743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:21.717355 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.738159 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-87892505-d138-4a5d-861a-cf0c828d64fc service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0498748 Mar 24 02:18:21.740772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a32b5dba-95e4-4ffc-82a7-0b649883927b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.797043 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.4517612 Mar 24 02:18:21.808055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33448) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:21.816369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'subnet': {'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'cidr': '172.22.0.0/28', 'ip_version': 4, 'gateway_ip': '172.22.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:21.855467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:19Z', 'revision_number': 3, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:20Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:21.881936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5fe6efd-d101-4470-acbf-a4eb7d16003e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Network': ['ID=43fab518-494b-4f36-9f94-b357dfa5fb11,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:21.889129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:21.889482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Updating router e6831f90-e567-436b-a709-5ee103af3439 port f3626bc4-ba10-450e-b6bd-3dc7422635cd binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:18:21.893371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-f6b17770-25a5-4bf1-9f90-b0a9d1895a03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:21.894876 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-f6b17770-25a5-4bf1-9f90-b0a9d1895a03 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 1129 time: 0.1138749 Mar 24 02:18:21.925435 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:21.926015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 43fab518-494b-4f36-9f94-b357dfa5fb11 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:18:21.928889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.956779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (089a3ef4-d121-4511-bd42-87d878f1416f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.964584 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a32b5dba-95e4-4ffc-82a7-0b649883927b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (f2bee82a-2fff-4ce9-8fb9-4d25908bc83a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.967774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:21.973851 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a32b5dba-95e4-4ffc-82a7-0b649883927b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f2bee82a-2fff-4ce9-8fb9-4d25908bc83a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.083105 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a32b5dba-95e4-4ffc-82a7-0b649883927b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f2bee82a-2fff-4ce9-8fb9-4d25908bc83a,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:22.090599 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a32b5dba-95e4-4ffc-82a7-0b649883927b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.094568 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a32b5dba-95e4-4ffc-82a7-0b649883927b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4297380 Mar 24 02:18:22.094731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-afd47fa7-765e-4912-9af1-afb7f1ab891b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:22.095170 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-afd47fa7-765e-4912-9af1-afb7f1ab891b service neutron] 10.222.0.30 "GET /v2.0/networks?id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d HTTP/1.1" status: 200 len: 897 time: 0.1616597 Mar 24 02:18:22.095622 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33450) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:22.100343 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-64413bdb-e6f7-473b-b9eb-d048574f4427 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group_rule': {'security_group_id': 'c2ac7b4c-97eb-481b-9b24-dbf8b38608e3', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '172.20.0.0/16', 'remote_group_id': 'f2bee82a-2fff-4ce9-8fb9-4d25908bc83a'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:22.164331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:18:22.267764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:22.315707 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:22.322504 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Publish callbacks [] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.329529 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc49199d-1efc-42b7-bd09-0f1576b35af5 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:22.336199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.341089 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.341967 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7ef37a4c-33f6-416c-9c09-b93a0438d3a0 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 3.0011151 Mar 24 02:18:22.345444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33454) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:22.350293 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc49199d-1efc-42b7-bd09-0f1576b35af5 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:22.350956 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-fc49199d-1efc-42b7-bd09-0f1576b35af5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:22.397676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065cac78-050e-4df7-aca1-38afe6f12086 None None] Pushing event updated for resources: {'Port': ['ID=f3626bc4-ba10-450e-b6bd-3dc7422635cd,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:22.416638 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:22.417021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.423248 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-fc49199d-1efc-42b7-bd09-0f1576b35af5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:22.436437 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc49199d-1efc-42b7-bd09-0f1576b35af5 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:22.437408 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-fc49199d-1efc-42b7-bd09-0f1576b35af5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:22.486297 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-fc49199d-1efc-42b7-bd09-0f1576b35af5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:22.487342 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc49199d-1efc-42b7-bd09-0f1576b35af5 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:22.513124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Attempting to bind port f3626bc4-ba10-450e-b6bd-3dc7422635cd on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:22.513496 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Attempting to bind port f3626bc4-ba10-450e-b6bd-3dc7422635cd by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'd471af30-0721-4c91-b018-d23d6aaaf555', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:22.513858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Attempting to bind port f3626bc4-ba10-450e-b6bd-3dc7422635cd on network b3b50e37-6e44-4cab-afa4-d07e2f3e809b {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:22.519984 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device c2f85444-f14d-48c1-9fd1-76fe9741f263 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:22.553479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:22.553861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Checking segment: {'id': 'd471af30-0721-4c91-b018-d23d6aaaf555', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:22.554277 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.554719 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Bound using segment: {'id': 'd471af30-0721-4c91-b018-d23d6aaaf555', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:22.555213 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Bound port: f3626bc4-ba10-450e-b6bd-3dc7422635cd, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd471af30-0721-4c91-b018-d23d6aaaf555', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:22.555656 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.634814 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-c9bf80bb-9721-49f9-ae51-ddc28c76dd5e service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=79123375-136b-4c1b-ba67-948e46e33a7c HTTP/1.1" status: 200 len: 1000 time: 0.5276878 Mar 24 02:18:22.652431 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] For port f3626bc4-ba10-450e-b6bd-3dc7422635cd, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:22.657879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] For port f3626bc4-ba10-450e-b6bd-3dc7422635cd, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f3626bc4-ba10-450e-b6bd-3dc7422635cd,segment=NetworkSegment(d471af30-0721-4c91-b018-d23d6aaaf555),segment_id=d471af30-0721-4c91-b018-d23d6aaaf555)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:22.668017 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-64413bdb-e6f7-473b-b9eb-d048574f4427 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Mar 24 02:18:22.669133 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-64413bdb-e6f7-473b-b9eb-d048574f4427 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.5724778 Mar 24 02:18:22.673140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33458) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:22.698544 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.711800 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:22.730002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.749435 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814e9c24-7cbc-4f1f-8770-5319ff637cf5 req-ea77099c-0091-40fa-8619-ea983b095001 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:22.757142 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port c2f85444-f14d-48c1-9fd1-76fe9741f263 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:18:22.757708 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-814e9c24-7cbc-4f1f-8770-5319ff637cf5 req-ea77099c-0091-40fa-8619-ea983b095001 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 944 time: 0.1805661 Mar 24 02:18:22.778043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port c2f85444-f14d-48c1-9fd1-76fe9741f263 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:22.778422 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.792680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6d4fc607-e7f8-415c-9f6b-f1de535a8c73 None None] Provisioning complete for port f3626bc4-ba10-450e-b6bd-3dc7422635cd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:22.793053 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6d4fc607-e7f8-415c-9f6b-f1de535a8c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.796215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-892806cb-0d0e-40cb-b696-7763f8d0b1bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:22.798231 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-892806cb-0d0e-40cb-b696-7763f8d0b1bf service neutron] 10.222.0.30 "GET /v2.0/subnets?id=852aacbf-87d9-49af-b73c-786b9253307e HTTP/1.1" status: 200 len: 835 time: 0.1368906 Mar 24 02:18:22.814929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:22.816096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:22.827678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f53de564-9db2-4831-8cba-bc1bec3a0d69 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (f2bee82a-2fff-4ce9-8fb9-4d25908bc83a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.829505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065cac78-050e-4df7-aca1-38afe6f12086 None None] Pushing event updated for resources: {'Port': ['ID=f3626bc4-ba10-450e-b6bd-3dc7422635cd,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:22.853163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f53de564-9db2-4831-8cba-bc1bec3a0d69 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (f2bee82a-2fff-4ce9-8fb9-4d25908bc83a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.885825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Subnet': ['ID=cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:22.926884 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-814e9c24-7cbc-4f1f-8770-5319ff637cf5 req-513d3e4f-e93f-4c6c-becc-1b73cca3bf6f tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1679819 Mar 24 02:18:22.927560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f53de564-9db2-4831-8cba-bc1bec3a0d69 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f2bee82a-2fff-4ce9-8fb9-4d25908bc83a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.928696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Checking segment: {'id': '7121d99a-e8b1-4010-a870-f48f170564fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:22.929080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network hostable DHCP agents. Network: 43fab518-494b-4f36-9f94-b357dfa5fb11, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:18:22.930541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f53de564-9db2-4831-8cba-bc1bec3a0d69 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:22.934195 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f53de564-9db2-4831-8cba-bc1bec3a0d69 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/f2bee82a-2fff-4ce9-8fb9-4d25908bc83a HTTP/1.1" status: 204 len: 168 time: 0.2572415 Mar 24 02:18:22.936641 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33460) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:22.951251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-c431ea76-7a33-409a-9403-32e8f8b73b3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:22.951482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53de564-9db2-4831-8cba-bc1bec3a0d69 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2bee82a-2fff-4ce9-8fb9-4d25908bc83a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:22.952845 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-c431ea76-7a33-409a-9403-32e8f8b73b3e service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.1423795 Mar 24 02:18:22.985819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:23.032838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 43fab518-494b-4f36-9f94-b357dfa5fb11 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:18:23.050463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 43fab518-494b-4f36-9f94-b357dfa5fb11) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:23.062185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:23.062870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.087765 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-82b42214-e126-4589-9c36-501ccccf0046 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2774084 Mar 24 02:18:23.088123 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-019c782f-33ba-4e82-918c-f02399458ffe None None] Network 43fab518-494b-4f36-9f94-b357dfa5fb11 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:23.088469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33462) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:23.118846 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0473e72b-f3bd-41ab-bb13-efdd10d687ea tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.1692269 Mar 24 02:18:23.121416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33464) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:23.185737 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-83ddc07f-c4a9-4cde-84a5-423335f18696 service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2252994 Mar 24 02:18:23.212033 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.215051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8edbee1-7a79-404b-a8c0-5ad0502f2350 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (c2ac7b4c-97eb-481b-9b24-dbf8b38608e3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.305617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port c2f85444-f14d-48c1-9fd1-76fe9741f263 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:23.306019 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.309346 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8edbee1-7a79-404b-a8c0-5ad0502f2350 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (c2ac7b4c-97eb-481b-9b24-dbf8b38608e3), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.373447 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9d6366bd-01eb-4e7e-b4e5-b2d9f90242b5 req-152e2d26-31a0-401c-958f-4db1321ac1fd service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1804783 Mar 24 02:18:23.380864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-43fab518-494b-4f36-9f94-b357dfa5fb11', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:18:23.381790 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.384757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6d4fc607-e7f8-415c-9f6b-f1de535a8c73 None None] Current status of the port f3626bc4-ba10-450e-b6bd-3dc7422635cd is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:23.385133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6d4fc607-e7f8-415c-9f6b-f1de535a8c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.387084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8edbee1-7a79-404b-a8c0-5ad0502f2350 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (c2ac7b4c-97eb-481b-9b24-dbf8b38608e3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.389917 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d8edbee1-7a79-404b-a8c0-5ad0502f2350 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.393779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33466) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:23.394747 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d8edbee1-7a79-404b-a8c0-5ad0502f2350 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/c2ac7b4c-97eb-481b-9b24-dbf8b38608e3 HTTP/1.1" status: 204 len: 168 time: 0.2724905 Mar 24 02:18:23.406230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b03f43c2-4dc7-4d74-9408-c99b15cf4661', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2f85444-f14d-48c1-9fd1-76fe9741f263'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:18:23.409212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3628ac1-8faa-47ec-9ff6-61332fea21fe" -d '{"events": [{"server_uuid": "b03f43c2-4dc7-4d74-9408-c99b15cf4661", "name": "network-vif-plugged", "status": "completed", "tag": "c2f85444-f14d-48c1-9fd1-76fe9741f263"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:18:23.428541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8edbee1-7a79-404b-a8c0-5ad0502f2350 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2ac7b4c-97eb-481b-9b24-dbf8b38608e3,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:23.460842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port c2f85444-f14d-48c1-9fd1-76fe9741f263, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=c2f85444-f14d-48c1-9fd1-76fe9741f263,segment=NetworkSegment(0ecb8365-8c6b-4988-93b0-262a15edd551),segment_id=0ecb8365-8c6b-4988-93b0-262a15edd551)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:23.477865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:18:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7424bfc7-7a19-431f-85f5-53631f21b7fb x-openstack-request-id: req-7424bfc7-7a19-431f-85f5-53631f21b7fb {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:18:23.478154 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b03f43c2-4dc7-4d74-9408-c99b15cf4661", "name": "network-vif-plugged", "status": "completed", "tag": "c2f85444-f14d-48c1-9fd1-76fe9741f263", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:18:23.478411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-7424bfc7-7a19-431f-85f5-53631f21b7fb {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:18:23.481711 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7424bfc7-7a19-431f-85f5-53631f21b7fb'] response: {'server_uuid': 'b03f43c2-4dc7-4d74-9408-c99b15cf4661', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2f85444-f14d-48c1-9fd1-76fe9741f263', 'code': 200} Mar 24 02:18:23.505069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.537328 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-99445632-1b92-42f8-9d42-837cdea895cd tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1423564 Mar 24 02:18:23.541799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33470) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:23.548941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-0fd09e8b-e0d4-49be-9f93-0976a703a78b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'tempest-secgroup--1170552030'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:23.594059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0fd09e8b-e0d4-49be-9f93-0976a703a78b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.603542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6d4fc607-e7f8-415c-9f6b-f1de535a8c73 None None] For port f3626bc4-ba10-450e-b6bd-3dc7422635cd, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f3626bc4-ba10-450e-b6bd-3dc7422635cd,segment=NetworkSegment(d471af30-0721-4c91-b018-d23d6aaaf555),segment_id=d471af30-0721-4c91-b018-d23d6aaaf555)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:23.620622 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6d4fc607-e7f8-415c-9f6b-f1de535a8c73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.672648 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.20.0.1 (383df69d-c9d6-4f76-a384-f1c5ebdd10fe/35936600-4794-4c7a-9459-34f9b2293644/831c0189-d6f7-4368-adf2-210b0bcf3a84) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:23.728809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.760361 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0fd09e8b-e0d4-49be-9f93-0976a703a78b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (8fbfe05b-42ce-43eb-ab6b-ba2a824917bb), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.802613 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0fd09e8b-e0d4-49be-9f93-0976a703a78b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8fbfe05b-42ce-43eb-ab6b-ba2a824917bb), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.812397 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (831c0189-d6f7-4368-adf2-210b0bcf3a84), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.822360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=c2f85444-f14d-48c1-9fd1-76fe9741f263,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:23.834051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0b3f8bc-331f-41aa-a3ec-e5dd3cc20f74 req-94bd1b2c-fbb1-4afc-afc2-4d96c5bc93b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:23.835709 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e0b3f8bc-331f-41aa-a3ec-e5dd3cc20f74 req-94bd1b2c-fbb1-4afc-afc2-4d96c5bc93b9 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 1129 time: 0.1778324 Mar 24 02:18:23.854733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (831c0189-d6f7-4368-adf2-210b0bcf3a84), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.884492 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:19Z', 'revision_number': 3, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:22Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:23.894089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0fd09e8b-e0d4-49be-9f93-0976a703a78b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.898017 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0fd09e8b-e0d4-49be-9f93-0976a703a78b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3503737 Mar 24 02:18:23.898841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33472) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:23.905663 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6d604db4-c660-4017-a572-48e755ecd69d tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Request body: {'security_group': {'name': 'default'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:23.906338 dv-neutron-834874-3-hyperv neutron-server[104036]: WARNING neutron.api.v2.base [None req-6d604db4-c660-4017-a572-48e755ecd69d tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Mar 24 02:18:23.907143 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-6d604db4-c660-4017-a572-48e755ecd69d tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] update failed (client error): There was a conflict when trying to complete your request. Mar 24 02:18:23.910762 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6d604db4-c660-4017-a572-48e755ecd69d tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "PUT /v2.0/security-groups/8fbfe05b-42ce-43eb-ab6b-ba2a824917bb HTTP/1.1" status: 409 len: 330 time: 0.0087073 Mar 24 02:18:23.916809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33474) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:23.919352 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:23.924554 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7a96c747-edb9-4878-9bc8-099b29c5dc97 None None] Provisioning complete for port f3626bc4-ba10-450e-b6bd-3dc7422635cd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:23.924931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7a96c747-edb9-4878-9bc8-099b29c5dc97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:23.930981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd09e8b-e0d4-49be-9f93-0976a703a78b tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8fbfe05b-42ce-43eb-ab6b-ba2a824917bb,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:23.931168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec98f57-fd18-4622-ab90-f00fd2afdbed None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:19Z', 'revision_number': 3, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:22Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:23.934964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:23.939551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=831c0189-d6f7-4368-adf2-210b0bcf3a84,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:23.942658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:23.944161 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e0b3f8bc-331f-41aa-a3ec-e5dd3cc20f74 req-c36d4e7f-9f5d-4a9d-9619-fb99f11adbc4 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1001637 Mar 24 02:18:23.965781 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Allocated IP 172.22.0.2 (43fab518-494b-4f36-9f94-b357dfa5fb11/cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd/b54559d0-a54b-44bf-b356-76d35383ec0c) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:24.028058 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d4fc607-e7f8-415c-9f6b-f1de535a8c73 None None] Pushing event updated for resources: {'Port': ['ID=f3626bc4-ba10-450e-b6bd-3dc7422635cd,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:24.052146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (089a3ef4-d121-4511-bd42-87d878f1416f), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.170475 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-86ae7298-bd3d-434a-894d-c3a06a2a6810 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (8fbfe05b-42ce-43eb-ab6b-ba2a824917bb), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.221491 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7a96c747-edb9-4878-9bc8-099b29c5dc97 None None] Current status of the port f3626bc4-ba10-450e-b6bd-3dc7422635cd is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:24.237983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-86ae7298-bd3d-434a-894d-c3a06a2a6810 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (8fbfe05b-42ce-43eb-ab6b-ba2a824917bb), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.247233 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96bbf64c-9139-44fa-accc-d3aea3cdbdcc req-d10cf5be-9c5d-489e-a2d4-bc720e794f1e tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:24.254810 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-96bbf64c-9139-44fa-accc-d3aea3cdbdcc req-d10cf5be-9c5d-489e-a2d4-bc720e794f1e tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.1536698 Mar 24 02:18:24.273881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Publish callbacks [] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.285502 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.329220 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f3626bc4-ba10-450e-b6bd-3dc7422635cd up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:24.372317 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Network 43fab518-494b-4f36-9f94-b357dfa5fb11 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:24.380956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:24.385613 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-96bbf64c-9139-44fa-accc-d3aea3cdbdcc req-7224105e-87a6-48bc-9d43-8c773346bf0b tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1295269 Mar 24 02:18:24.405225 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:24.409451 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.22.0.1 (43fab518-494b-4f36-9f94-b357dfa5fb11/cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd/7100d4a6-192d-4447-ba11-d5212867031c) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:24.415184 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Pushing event updated for resources: {'Port': ['ID=b54559d0-a54b-44bf-b356-76d35383ec0c,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:24.513462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f3626bc4-ba10-450e-b6bd-3dc7422635cd triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:24.513912 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.517308 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Attempting to bind port b54559d0-a54b-44bf-b356-76d35383ec0c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:24.517760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Attempting to bind port b54559d0-a54b-44bf-b356-76d35383ec0c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '7121d99a-e8b1-4010-a870-f48f170564fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:24.518215 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Attempting to bind port b54559d0-a54b-44bf-b356-76d35383ec0c on network 43fab518-494b-4f36-9f94-b357dfa5fb11 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:24.544264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:24.544798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Checking segment: {'id': '7121d99a-e8b1-4010-a870-f48f170564fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:24.545345 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.545965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Bound using segment: {'id': '7121d99a-e8b1-4010-a870-f48f170564fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:24.546584 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Bound port: b54559d0-a54b-44bf-b356-76d35383ec0c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7121d99a-e8b1-4010-a870-f48f170564fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:24.547217 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.550130 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (7100d4a6-192d-4447-ba11-d5212867031c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.589570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (7100d4a6-192d-4447-ba11-d5212867031c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.614340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-86ae7298-bd3d-434a-894d-c3a06a2a6810 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8fbfe05b-42ce-43eb-ab6b-ba2a824917bb), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.618420 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-86ae7298-bd3d-434a-894d-c3a06a2a6810 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.622199 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-86ae7298-bd3d-434a-894d-c3a06a2a6810 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/8fbfe05b-42ce-43eb-ab6b-ba2a824917bb HTTP/1.1" status: 204 len: 168 time: 0.7026644 Mar 24 02:18:24.624757 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33478) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:24.645570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 43fab518-494b-4f36-9f94-b357dfa5fb11 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:24.649196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:24.653364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:24.668899 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] For port b54559d0-a54b-44bf-b356-76d35383ec0c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:24.677068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ae7298-bd3d-434a-894d-c3a06a2a6810 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fbfe05b-42ce-43eb-ab6b-ba2a824917bb,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:24.678411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] For port b54559d0-a54b-44bf-b356-76d35383ec0c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b54559d0-a54b-44bf-b356-76d35383ec0c,segment=NetworkSegment(7121d99a-e8b1-4010-a870-f48f170564fe),segment_id=7121d99a-e8b1-4010-a870-f48f170564fe)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:24.688583 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=7100d4a6-192d-4447-ba11-d5212867031c,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:24.699435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (831c0189-d6f7-4368-adf2-210b0bcf3a84), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.713015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.715513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f3626bc4-ba10-450e-b6bd-3dc7422635cd is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:24.723706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:24.735998 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9b4ebd8f-0b32-4e4a-8e3e-8819c2af3bf9 tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1035042 Mar 24 02:18:24.736749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33480) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:24.781050 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-7007a8c5-bbc3-48db-bd46-26b6de50d4fe tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] delete failed (client error): The resource could not be found. Mar 24 02:18:24.782651 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7007a8c5-bbc3-48db-bd46-26b6de50d4fe tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "DELETE /v2.0/security-groups/ad5995df-e734-426c-ba67-23c504105791 HTTP/1.1" status: 404 len: 347 time: 0.0212212 Mar 24 02:18:24.786389 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33482) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:24.800103 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1721822d-ac42-4d21-966f-8fe3bf4043c2 None None] Pushing event updated for resources: {'Port': ['ID=b54559d0-a54b-44bf-b356-76d35383ec0c,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:24.835345 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-1db570cf-0903-440b-b013-af931b02a2fa tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] show failed (client error): The resource could not be found. Mar 24 02:18:24.836687 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1db570cf-0903-440b-b013-af931b02a2fa tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-groups/9de460dd-cfb0-46c1-ab42-7426ed20e392 HTTP/1.1" status: 404 len: 347 time: 0.0486674 Mar 24 02:18:24.847132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33484) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:24.869777 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-ceda6b04-f67c-4a40-b98a-73d6aa208daa tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] show failed (client error): The resource could not be found. Mar 24 02:18:24.870947 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ceda6b04-f67c-4a40-b98a-73d6aa208daa tempest-NegativeSecGroupTest-119023620 tempest-NegativeSecGroupTest-119023620-project] 10.222.0.20 "GET /v2.0/security-group-rules/98a0ca4e-a48f-4d0d-b703-13b16fd94b36 HTTP/1.1" status: 404 len: 356 time: 0.0207288 Mar 24 02:18:24.939330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7100d4a6-192d-4447-ba11-d5212867031c), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.117573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (831c0189-d6f7-4368-adf2-210b0bcf3a84), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.126674 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (831c0189-d6f7-4368-adf2-210b0bcf3a84), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.210501 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=831c0189-d6f7-4368-adf2-210b0bcf3a84,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:25.213786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (089a3ef4-d121-4511-bd42-87d878f1416f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.314571 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33492) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:25.332060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:25.333796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (7100d4a6-192d-4447-ba11-d5212867031c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.333943 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:25.343890 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (7100d4a6-192d-4447-ba11-d5212867031c), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.460685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.463836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=7100d4a6-192d-4447-ba11-d5212867031c,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:25.509691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:25.516748 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-22a7d685-5a98-4011-9101-e2260f294a00 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=355076afe0a54f45b895422485a6e1b9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2000310 Mar 24 02:18:25.519304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33498) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:25.593211 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8861ae6-c560-4e83-b390-5d5a8ec7a882 req-41ab2806-5f7b-498f-be7a-51ecca2e4dc4 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:25.600476 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d8861ae6-c560-4e83-b390-5d5a8ec7a882 req-41ab2806-5f7b-498f-be7a-51ecca2e4dc4 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.1277604 Mar 24 02:18:25.630507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network 43fab518-494b-4f36-9f94-b357dfa5fb11 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:25.635513 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:25.651749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5b141334-2315-4c40-a96c-246c612a2779 admin admin] Publish callbacks [] for security_group (a8638e5f-136b-4f47-926a-c04303c9c6ed), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.683703 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5b141334-2315-4c40-a96c-246c612a2779 admin admin] Publish callbacks [] for security_group (a8638e5f-136b-4f47-926a-c04303c9c6ed), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.686610 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:25.696946 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-776d69c3-b754-45ae-849f-522671276dd1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/routers/089a3ef4-d121-4511-bd42-87d878f1416f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3504055 Mar 24 02:18:25.699579 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33500) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:25.706904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'port': {'network_id': '383df69d-c9d6-4f76-a384-f1c5ebdd10fe', 'name': 'tempest-FloatingIPTestJSON-826551221'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:25.710195 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1907a972-7a40-41f2-bf92-79a70d2efbcf None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:25.726569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1907a972-7a40-41f2-bf92-79a70d2efbcf None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:25.727463 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1907a972-7a40-41f2-bf92-79a70d2efbcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:25.741043 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d8861ae6-c560-4e83-b390-5d5a8ec7a882 req-9d2da9b5-38cb-475a-859d-45390a6ebc70 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1368387 Mar 24 02:18:25.780962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1907a972-7a40-41f2-bf92-79a70d2efbcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:25.791706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:25.794121 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1907a972-7a40-41f2-bf92-79a70d2efbcf None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:25.795705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1907a972-7a40-41f2-bf92-79a70d2efbcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:25.851464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5b141334-2315-4c40-a96c-246c612a2779 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a8638e5f-136b-4f47-926a-c04303c9c6ed), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.854021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5b141334-2315-4c40-a96c-246c612a2779 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.855236 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5b141334-2315-4c40-a96c-246c612a2779 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/a8638e5f-136b-4f47-926a-c04303c9c6ed HTTP/1.1" status: 204 len: 168 time: 0.3349464 Mar 24 02:18:25.869077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b141334-2315-4c40-a96c-246c612a2779 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8638e5f-136b-4f47-926a-c04303c9c6ed,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:25.875155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1907a972-7a40-41f2-bf92-79a70d2efbcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:25.875337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1907a972-7a40-41f2-bf92-79a70d2efbcf None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:25.904583 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Made reservation on behalf of 4f11674605a349f28f6886bf409a1207 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:25.908390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:25.932954 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] device_id is not set on port a1677890-315b-44e2-8649-adab791f7e84 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:18:25.982209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:25.989245 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a07003a4-fcc6-4b4e-a2ec-1717081852a4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8963990 Mar 24 02:18:25.997823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c724217-e988-45e2-bf77-097c0646bc02 req-73d1de7f-2ffd-4164-beec-7b9e3e4b4707 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:25.999069 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:25.999528 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c724217-e988-45e2-bf77-097c0646bc02 req-73d1de7f-2ffd-4164-beec-7b9e3e4b4707 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.1421168 Mar 24 02:18:25.999864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33506) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:26.005208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'network': {'name': 'tempest-RoutersTest-2084785597'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:26.035807 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:26.036439 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:26.101738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.20.0.9 (383df69d-c9d6-4f76-a384-f1c5ebdd10fe/35936600-4794-4c7a-9459-34f9b2293644/a1677890-315b-44e2-8649-adab791f7e84) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:26.124995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:26.128295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.138511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-702da049-b4cc-4b5e-8eef-99b54e7d3c33 None None] Network 43fab518-494b-4f36-9f94-b357dfa5fb11 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:26.146611 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c724217-e988-45e2-bf77-097c0646bc02 req-235866ae-c87c-4b88-98ba-0159dde94551 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323497 Mar 24 02:18:26.178827 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:26.238179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 116} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:18:26.253542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-de71a718-08c0-4a68-95b7-d315769741ff None None] Provisioning complete for port b54559d0-a54b-44bf-b356-76d35383ec0c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:26.253915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de71a718-08c0-4a68-95b7-d315769741ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.273508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (978a9dee-7c2d-420f-888b-a2937c1e1fc6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.275104 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added segment 978a9dee-7c2d-420f-888b-a2937c1e1fc6 of type vlan for network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 Mar 24 02:18:26.367954 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (a1677890-315b-44e2-8649-adab791f7e84), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.380504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (b8d0efd1-3f15-406c-a0a3-f0e019e9f055), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.390692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b54559d0-a54b-44bf-b356-76d35383ec0c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:26.419048 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (b8d0efd1-3f15-406c-a0a3-f0e019e9f055), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.428623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:26.430134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.446408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a1677890-315b-44e2-8649-adab791f7e84), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.536192 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.5351744 Mar 24 02:18:26.540913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33522) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:26.549727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:26.557203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:26.560166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'subnet': {'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055', 'cidr': '172.23.0.0/28', 'ip_version': 4, 'gateway_ip': '172.23.0.1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:26.566489 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:26.575787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-de71a718-08c0-4a68-95b7-d315769741ff None None] Current status of the port b54559d0-a54b-44bf-b356-76d35383ec0c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:26.576179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de71a718-08c0-4a68-95b7-d315769741ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.585597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port b54559d0-a54b-44bf-b356-76d35383ec0c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:26.585597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.642962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebfb6a74-698a-4dfb-b2e9-ccd31704dbb0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Network': ['ID=b8d0efd1-3f15-406c-a0a3-f0e019e9f055,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:26.653887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=a1677890-315b-44e2-8649-adab791f7e84,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:26.676595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:18:26.741222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:26.744946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.775265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Made reservation on behalf of 6efecbddf1644634a26bf8ef5221c9e1 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:26.783700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.791137 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-86054cef-dc70-4e27-a141-5fcbd33df0b5 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 1.0904982 Mar 24 02:18:26.791855 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33526) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:26.795620 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-de71a718-08c0-4a68-95b7-d315769741ff None None] For port b54559d0-a54b-44bf-b356-76d35383ec0c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b54559d0-a54b-44bf-b356-76d35383ec0c,segment=NetworkSegment(7121d99a-e8b1-4010-a870-f48f170564fe),segment_id=7121d99a-e8b1-4010-a870-f48f170564fe)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:26.803574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de71a718-08c0-4a68-95b7-d315769741ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.803755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'port': {'network_id': '383df69d-c9d6-4f76-a384-f1c5ebdd10fe', 'name': 'tempest-FloatingIPTestJSON-757755589'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:26.881770 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:24Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:25Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:26.922641 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:26.922996 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Updating router e6831f90-e567-436b-a709-5ee103af3439 port 7100d4a6-192d-4447-ba11-d5212867031c binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:18:26.935243 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce7eedf-8b38-4ced-92a7-3989ae69b200 req-fca905d6-5cda-42ef-b9d3-14659415b4f2 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:26.936989 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fce7eedf-8b38-4ced-92a7-3989ae69b200 req-fca905d6-5cda-42ef-b9d3-14659415b4f2 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.2413194 Mar 24 02:18:26.972754 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7100d4a6-192d-4447-ba11-d5212867031c), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:26.994309 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Made reservation on behalf of 4f11674605a349f28f6886bf409a1207 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:26.999888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.031484 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] device_id is not set on port 0e8c22c9-70ad-4c3f-b2a4-f20c99a95528 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:18:27.065690 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fce7eedf-8b38-4ced-92a7-3989ae69b200 req-a47745e5-1fc6-4829-a0eb-f42c313cd19c tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1186979 Mar 24 02:18:27.119280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de71a718-08c0-4a68-95b7-d315769741ff None None] Pushing event updated for resources: {'Port': ['ID=b54559d0-a54b-44bf-b356-76d35383ec0c,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:27.142556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port b54559d0-a54b-44bf-b356-76d35383ec0c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:27.150802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1fd3e176-1515-4fed-b6b3-8365df0b21c4 None None] Provisioning complete for port 7100d4a6-192d-4447-ba11-d5212867031c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:27.151269 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1fd3e176-1515-4fed-b6b3-8365df0b21c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7100d4a6-192d-4447-ba11-d5212867031c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.213570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (d2fb3747-7322-42ce-834a-9f72be9b98b6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.239807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1fd3e176-1515-4fed-b6b3-8365df0b21c4 None None] Port 7100d4a6-192d-4447-ba11-d5212867031c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:27.271521 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1fd3e176-1515-4fed-b6b3-8365df0b21c4 None None] Provisioning complete for port b54559d0-a54b-44bf-b356-76d35383ec0c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:27.271982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1fd3e176-1515-4fed-b6b3-8365df0b21c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.280340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.20.0.12 (383df69d-c9d6-4f76-a384-f1c5ebdd10fe/35936600-4794-4c7a-9459-34f9b2293644/0e8c22c9-70ad-4c3f-b2a4-f20c99a95528) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:27.323965 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Checking segment: {'id': '978a9dee-7c2d-420f-888b-a2937c1e1fc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:27.324336 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network hostable DHCP agents. Network: b8d0efd1-3f15-406c-a0a3-f0e019e9f055, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:18:27.332125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Subnet': ['ID=d2fb3747-7322-42ce-834a-9f72be9b98b6,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:27.358612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:18:27.368891 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Publish callbacks [] for port (7100d4a6-192d-4447-ba11-d5212867031c), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.380512 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7100d4a6-192d-4447-ba11-d5212867031c), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.383942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, b8d0efd1-3f15-406c-a0a3-f0e019e9f055) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:27.389171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:27.390210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.423021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ae68ac1-ffbd-4912-aa08-e3bd18ce7f70 None None] Network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:27.429266 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b15e6ffe-7b0a-4ce1-918e-9ae4c68cb74e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8844709 Mar 24 02:18:27.430235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33536) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:27.522510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33538) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:27.576630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (0e8c22c9-70ad-4c3f-b2a4-f20c99a95528), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.618064 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Attempting to bind port 7100d4a6-192d-4447-ba11-d5212867031c on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:27.618064 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Attempting to bind port 7100d4a6-192d-4447-ba11-d5212867031c by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '7121d99a-e8b1-4010-a870-f48f170564fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:27.618064 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Attempting to bind port 7100d4a6-192d-4447-ba11-d5212867031c on network 43fab518-494b-4f36-9f94-b357dfa5fb11 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:27.626661 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:27.627979 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Checking segment: {'id': '7121d99a-e8b1-4010-a870-f48f170564fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:27.628883 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.629456 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Bound using segment: {'id': '7121d99a-e8b1-4010-a870-f48f170564fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:27.630319 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Bound port: 7100d4a6-192d-4447-ba11-d5212867031c, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7121d99a-e8b1-4010-a870-f48f170564fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:27.630921 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7100d4a6-192d-4447-ba11-d5212867031c), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.650473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0e8c22c9-70ad-4c3f-b2a4-f20c99a95528), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.662362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-62a2be38-ff1b-4e36-ad28-39054024a02f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.709144 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25e9b411-61ce-4c95-a463-3cbf9c2c0252 None None] Pushing event updated for resources: {'Port': ['ID=7100d4a6-192d-4447-ba11-d5212867031c,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:27.732321 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8f260daf-5df8-40a7-a936-984cef0ae295 tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools-629759886', 'prefixes': ['172.20.0.0/16']}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:27.732570 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1fd3e176-1515-4fed-b6b3-8365df0b21c4 None None] Current status of the port b54559d0-a54b-44bf-b356-76d35383ec0c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:27.748296 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61176def-5864-47f5-858e-3141b4441328 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-b8d0efd1-3f15-406c-a0a3-f0e019e9f055', 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055', 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'fixed_ips': [{'subnet_id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:18:27.749262 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-61176def-5864-47f5-858e-3141b4441328 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.760092 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] For port 7100d4a6-192d-4447-ba11-d5212867031c, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:27.765076 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] For port 7100d4a6-192d-4447-ba11-d5212867031c, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7100d4a6-192d-4447-ba11-d5212867031c,segment=NetworkSegment(7121d99a-e8b1-4010-a870-f48f170564fe),segment_id=7121d99a-e8b1-4010-a870-f48f170564fe)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:27.770024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:27.785570 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7100d4a6-192d-4447-ba11-d5212867031c), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.811964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:27.816324 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:27.881931 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25e9b411-61ce-4c95-a463-3cbf9c2c0252 None None] Pushing event updated for resources: {'Port': ['ID=7100d4a6-192d-4447-ba11-d5212867031c,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:27.895556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=0e8c22c9-70ad-4c3f-b2a4-f20c99a95528,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:27.916031 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-0f5ec64f-2900-455b-875f-f580d6cf2a7f None None] Provisioning complete for port 7100d4a6-192d-4447-ba11-d5212867031c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:27.916612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8f260daf-5df8-40a7-a936-984cef0ae295 tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] Publish callbacks [] for subnetpool (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.916709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0f5ec64f-2900-455b-875f-f580d6cf2a7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7100d4a6-192d-4447-ba11-d5212867031c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.917510 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8f260daf-5df8-40a7-a936-984cef0ae295 tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] 10.222.0.20 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 736 time: 0.3932843 Mar 24 02:18:27.920163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33542) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:27.924093 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:27.924809 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:27.936476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:27.937437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:27.986986 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-62c9af3e-51bd-48b5-8b43-1178329073d0 tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] 10.222.0.20 "GET /v2.0/subnetpools/70336de9-6c9a-4edc-a899-16e1360a608b HTTP/1.1" status: 200 len: 731 time: 0.0649984 Mar 24 02:18:27.992909 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-41651173-3a19-4872-b500-6cbc07058042 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.1990561 Mar 24 02:18:27.994096 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33544) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:28.000130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-16b5c24c-c9ef-4b6e-a40e-11caabfb6d0f tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools_update-255930552'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:28.005971 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-61176def-5864-47f5-858e-3141b4441328 None None] Allocated IP 172.23.0.2 (b8d0efd1-3f15-406c-a0a3-f0e019e9f055/d2fb3747-7322-42ce-834a-9f72be9b98b6/ab49ef6b-69c9-41b8-81b8-04461db330e9) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:28.036780 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33546) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:28.071224 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:28.132284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-0f5ec64f-2900-455b-875f-f580d6cf2a7f None None] Current status of the port 7100d4a6-192d-4447-ba11-d5212867031c is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:28.132595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0f5ec64f-2900-455b-875f-f580d6cf2a7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7100d4a6-192d-4447-ba11-d5212867031c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.134023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '0e8c22c9-70ad-4c3f-b2a4-f20c99a95528', 'fixed_ip_address': '172.20.0.12'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:28.152871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-16b5c24c-c9ef-4b6e-a40e-11caabfb6d0f tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] Publish callbacks [] for subnetpool (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.156536 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-16b5c24c-c9ef-4b6e-a40e-11caabfb6d0f tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] 10.222.0.20 "PUT /v2.0/subnetpools/70336de9-6c9a-4edc-a899-16e1360a608b HTTP/1.1" status: 200 len: 683 time: 0.1609063 Mar 24 02:18:28.171376 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33550) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:28.280436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.380288 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b54559d0-a54b-44bf-b356-76d35383ec0c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:28.391890 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36a420d6-becf-4328-a0fd-d9afd1451b8d req-705c292e-478d-4899-b4a2-83e2ae8419fb tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:28.394061 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36a420d6-becf-4328-a0fd-d9afd1451b8d req-705c292e-478d-4899-b4a2-83e2ae8419fb tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.1339555 Mar 24 02:18:28.433675 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:24Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:27Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:28.443478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c45e6acd-7287-451a-b9e4-0318735c94a9 tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] Publish callbacks [] for subnetpool (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.447734 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c45e6acd-7287-451a-b9e4-0318735c94a9 tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] 10.222.0.20 "DELETE /v2.0/subnetpools/70336de9-6c9a-4edc-a899-16e1360a608b HTTP/1.1" status: 204 len: 168 time: 0.2699609 Mar 24 02:18:28.450841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33552) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:28.494443 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-4ec501c6-e028-4abe-b70e-cb9b4c199b7b tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] show failed (client error): The resource could not be found. Mar 24 02:18:28.499324 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4ec501c6-e028-4abe-b70e-cb9b4c199b7b tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] 10.222.0.20 "GET /v2.0/subnetpools/70336de9-6c9a-4edc-a899-16e1360a608b HTTP/1.1" status: 404 len: 346 time: 0.0476761 Mar 24 02:18:28.501352 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad314042-b0a1-4d6e-a719-3ccb156e8c10 None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:24Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:27Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:28.501552 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33554) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:28.504799 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-0f5ec64f-2900-455b-875f-f580d6cf2a7f None None] For port 7100d4a6-192d-4447-ba11-d5212867031c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7100d4a6-192d-4447-ba11-d5212867031c,segment=NetworkSegment(7121d99a-e8b1-4010-a870-f48f170564fe),segment_id=7121d99a-e8b1-4010-a870-f48f170564fe)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:28.521411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0f5ec64f-2900-455b-875f-f580d6cf2a7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (7100d4a6-192d-4447-ba11-d5212867031c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.538582 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-3bf678f7-7a50-44e5-8d9e-a6d5395789fe tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] delete failed (client error): The resource could not be found. Mar 24 02:18:28.559372 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3bf678f7-7a50-44e5-8d9e-a6d5395789fe tempest-SubnetPoolsTestJSON-1859257626 tempest-SubnetPoolsTestJSON-1859257626-project] 10.222.0.20 "DELETE /v2.0/subnetpools/70336de9-6c9a-4edc-a899-16e1360a608b HTTP/1.1" status: 404 len: 346 time: 0.0428863 Mar 24 02:18:28.611831 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.620345 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-36a420d6-becf-4328-a0fd-d9afd1451b8d req-e3ec33ce-3f13-4144-afc9-7b0595e24356 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1618402 Mar 24 02:18:28.633116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port b54559d0-a54b-44bf-b356-76d35383ec0c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:28.633593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.684562 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-61176def-5864-47f5-858e-3141b4441328 None None] Publish callbacks [] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.697060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f5ec64f-2900-455b-875f-f580d6cf2a7f None None] Pushing event updated for resources: {'Port': ['ID=7100d4a6-192d-4447-ba11-d5212867031c,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:28.704240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-01ffcaee-c5e1-4e47-bb71-fd8e61fa7abb None None] Provisioning complete for port 7100d4a6-192d-4447-ba11-d5212867031c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:28.705077 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-01ffcaee-c5e1-4e47-bb71-fd8e61fa7abb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7100d4a6-192d-4447-ba11-d5212867031c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.748479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-61176def-5864-47f5-858e-3141b4441328 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.776326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:28.796240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.26.2.97 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/fe5f235c-d7fb-421a-9c4d-7e555fd5e337) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:28.908381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61176def-5864-47f5-858e-3141b4441328 None None] Network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:28.926871 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-61176def-5864-47f5-858e-3141b4441328 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:28.936198 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61176def-5864-47f5-858e-3141b4441328 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:28.939113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61176def-5864-47f5-858e-3141b4441328 None None] Pushing event updated for resources: {'Port': ['ID=ab49ef6b-69c9-41b8-81b8-04461db330e9,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:29.021381 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (fe5f235c-d7fb-421a-9c4d-7e555fd5e337), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.075688 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (fe5f235c-d7fb-421a-9c4d-7e555fd5e337), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.122248 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port b54559d0-a54b-44bf-b356-76d35383ec0c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:29.134852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-61176def-5864-47f5-858e-3141b4441328 None None] Attempting to bind port ab49ef6b-69c9-41b8-81b8-04461db330e9 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:29.135231 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-61176def-5864-47f5-858e-3141b4441328 None None] Attempting to bind port ab49ef6b-69c9-41b8-81b8-04461db330e9 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '978a9dee-7c2d-420f-888b-a2937c1e1fc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:29.135597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61176def-5864-47f5-858e-3141b4441328 None None] Attempting to bind port ab49ef6b-69c9-41b8-81b8-04461db330e9 on network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:29.139109 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33564) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:29.146691 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61176def-5864-47f5-858e-3141b4441328 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:29.147083 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61176def-5864-47f5-858e-3141b4441328 None None] Checking segment: {'id': '978a9dee-7c2d-420f-888b-a2937c1e1fc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:29.147496 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-61176def-5864-47f5-858e-3141b4441328 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.147893 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61176def-5864-47f5-858e-3141b4441328 None None] Bound using segment: {'id': '978a9dee-7c2d-420f-888b-a2937c1e1fc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:29.148380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-61176def-5864-47f5-858e-3141b4441328 None None] Bound port: ab49ef6b-69c9-41b8-81b8-04461db330e9, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '978a9dee-7c2d-420f-888b-a2937c1e1fc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:29.148759 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-61176def-5864-47f5-858e-3141b4441328 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.153707 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=fe5f235c-d7fb-421a-9c4d-7e555fd5e337,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:29.159698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-01ffcaee-c5e1-4e47-bb71-fd8e61fa7abb None None] Current status of the port 7100d4a6-192d-4447-ba11-d5212867031c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:29.188681 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:29.190697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:29.196394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:29.236643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-61176def-5864-47f5-858e-3141b4441328 None None] For port ab49ef6b-69c9-41b8-81b8-04461db330e9, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:29.245025 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-61176def-5864-47f5-858e-3141b4441328 None None] For port ab49ef6b-69c9-41b8-81b8-04461db330e9, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ab49ef6b-69c9-41b8-81b8-04461db330e9,segment=NetworkSegment(978a9dee-7c2d-420f-888b-a2937c1e1fc6),segment_id=978a9dee-7c2d-420f-888b-a2937c1e1fc6)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:29.253222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-61176def-5864-47f5-858e-3141b4441328 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.304535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b98528c-a2a1-441a-af04-e54091026bdd req-e1bdfae8-2637-425c-8d83-018de5ed52fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:29.306120 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1b98528c-a2a1-441a-af04-e54091026bdd req-e1bdfae8-2637-425c-8d83-018de5ed52fe service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4419a48020f546a6abf15b6c1b4cdbdb&device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 1129 time: 0.2386432 Mar 24 02:18:29.317398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53b7537-1b21-433c-a7e7-f5b29b85fef5 req-d241a065-5564-4a6e-8f16-d78f808fd226 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:29.319512 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a53b7537-1b21-433c-a7e7-f5b29b85fef5 req-d241a065-5564-4a6e-8f16-d78f808fd226 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.2504137 Mar 24 02:18:29.347380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61176def-5864-47f5-858e-3141b4441328 None None] Pushing event updated for resources: {'Port': ['ID=ab49ef6b-69c9-41b8-81b8-04461db330e9,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:29.473690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26cfe70d-ca86-4d42-947b-d9c7eb697b80 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.539008 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Allocated IP 172.23.0.1 (b8d0efd1-3f15-406c-a0a3-f0e019e9f055/d2fb3747-7322-42ce-834a-9f72be9b98b6/842602f9-c0b5-43d0-96b6-4d14d457cf83) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:29.560357 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a53b7537-1b21-433c-a7e7-f5b29b85fef5 req-34369e44-ed19-4c10-bde2-ba81955c8475 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2172639 Mar 24 02:18:29.658069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b98528c-a2a1-441a-af04-e54091026bdd req-a6edadd0-d5ba-4b56-9869-43422b09af55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:29.659650 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1b98528c-a2a1-441a-af04-e54091026bdd req-a6edadd0-d5ba-4b56-9869-43422b09af55 service neutron] 10.222.0.30 "GET /v2.0/networks?id=da1aec0d-a786-4656-9380-f71f1c64ba05 HTTP/1.1" status: 200 len: 913 time: 0.3392196 Mar 24 02:18:29.712787 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (4aaac2f8-8f18-4021-90d6-949dea09f7d3), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.720931 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1b98528c-a2a1-441a-af04-e54091026bdd req-364e7af0-cef6-45af-aeee-c1e9ad54b3b0 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c2f85444-f14d-48c1-9fd1-76fe9741f263 HTTP/1.1" status: 200 len: 217 time: 0.0501049 Mar 24 02:18:29.784744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fe5f235c-d7fb-421a-9c4d-7e555fd5e337), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.814179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26cfe70d-ca86-4d42-947b-d9c7eb697b80 admin admin] Publish callbacks [] for security_group (dd39fdec-9d97-4a17-bcf9-db67928ae400), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.823465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26cfe70d-ca86-4d42-947b-d9c7eb697b80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (dd39fdec-9d97-4a17-bcf9-db67928ae400), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.841737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b98528c-a2a1-441a-af04-e54091026bdd req-5da968fc-9941-4a4e-9fba-620bef5eda84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:29.843241 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1b98528c-a2a1-441a-af04-e54091026bdd req-5da968fc-9941-4a4e-9fba-620bef5eda84 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=1a07dda3-b4d8-484a-9399-92d0432cd074 HTTP/1.1" status: 200 len: 852 time: 0.1148875 Mar 24 02:18:29.856495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.906111 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1b98528c-a2a1-441a-af04-e54091026bdd req-c25a2bbc-dec1-4f99-b755-5ffa2a7f7332 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=da1aec0d-a786-4656-9380-f71f1c64ba05&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0528393 Mar 24 02:18:29.908863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26cfe70d-ca86-4d42-947b-d9c7eb697b80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd39fdec-9d97-4a17-bcf9-db67928ae400,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:29.912974 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-26cfe70d-ca86-4d42-947b-d9c7eb697b80 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=244f4f5059eb48939f94b2aab2ae6613&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7727008 Mar 24 02:18:29.915728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33570) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:29.970827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (fe5f235c-d7fb-421a-9c4d-7e555fd5e337), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:29.978084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (fe5f235c-d7fb-421a-9c4d-7e555fd5e337), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.005300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.018788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-970cd391-5379-4910-aa4a-3db34a7632a4 admin admin] Publish callbacks [] for security_group (dd39fdec-9d97-4a17-bcf9-db67928ae400), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.050880 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1b98528c-a2a1-441a-af04-e54091026bdd req-129a5f07-3d11-4ec1-a5e0-996af3077d73 service neutron] 10.222.0.30 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1349485 Mar 24 02:18:30.072126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:30.084304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-970cd391-5379-4910-aa4a-3db34a7632a4 admin admin] Publish callbacks [] for security_group (dd39fdec-9d97-4a17-bcf9-db67928ae400), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.089722 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:30.095257 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=fe5f235c-d7fb-421a-9c4d-7e555fd5e337,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:30.105929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (4aaac2f8-8f18-4021-90d6-949dea09f7d3), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.121552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:30.126677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=842602f9-c0b5-43d0-96b6-4d14d457cf83,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:30.177209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.221844 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP 4aaac2f8-8f18-4021-90d6-949dea09f7d3 associated. External IP: 172.26.2.97, port: 0e8c22c9-70ad-4c3f-b2a4-f20c99a95528. Mar 24 02:18:30.272077 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1b98528c-a2a1-441a-af04-e54091026bdd req-c7d37921-0131-4a81-950a-dfe2eb93c8a3 service neutron] 10.222.0.30 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2116876 Mar 24 02:18:30.351452 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ab49ef6b-69c9-41b8-81b8-04461db330e9 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:30.385265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.413277 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ab49ef6b-69c9-41b8-81b8-04461db330e9 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:30.413963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.521459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-eeb0b1ec-d31c-476c-838c-d1893ad8da01 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.523745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ab49ef6b-69c9-41b8-81b8-04461db330e9 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:30.524166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.539684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbf3a78e-4fa6-48bf-89f8-4c43908fc7f7 None None] Network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:30.645757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port ab49ef6b-69c9-41b8-81b8-04461db330e9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ab49ef6b-69c9-41b8-81b8-04461db330e9,segment=NetworkSegment(978a9dee-7c2d-420f-888b-a2937c1e1fc6),segment_id=978a9dee-7c2d-420f-888b-a2937c1e1fc6)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:30.655883 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.656540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-970cd391-5379-4910-aa4a-3db34a7632a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (dd39fdec-9d97-4a17-bcf9-db67928ae400), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.657260 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7100d4a6-192d-4447-ba11-d5212867031c up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:30.660602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-970cd391-5379-4910-aa4a-3db34a7632a4 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.674707 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-970cd391-5379-4910-aa4a-3db34a7632a4 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/dd39fdec-9d97-4a17-bcf9-db67928ae400 HTTP/1.1" status: 204 len: 168 time: 0.7476203 Mar 24 02:18:30.685631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-34be8556-5b89-4efb-8cbe-1f01da9c8543 None None] Provisioning complete for port ab49ef6b-69c9-41b8-81b8-04461db330e9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:30.686008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-34be8556-5b89-4efb-8cbe-1f01da9c8543 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.720922 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-970cd391-5379-4910-aa4a-3db34a7632a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd39fdec-9d97-4a17-bcf9-db67928ae400,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:30.767291 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17aee9e4-bfc1-445f-920d-03140be65f40 req-a47ca0d3-f41c-492c-b30e-aaee4f0a51a8 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:30.768786 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-17aee9e4-bfc1-445f-920d-03140be65f40 req-a47ca0d3-f41c-492c-b30e-aaee4f0a51a8 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.0958943 Mar 24 02:18:30.820804 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=ab49ef6b-69c9-41b8-81b8-04461db330e9,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:30.837035 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-17aee9e4-bfc1-445f-920d-03140be65f40 req-17ee2e8f-5613-45be-9917-6f891c9ff30f tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590081 Mar 24 02:18:30.839492 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.846755 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.870140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 7100d4a6-192d-4447-ba11-d5212867031c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:30.870853 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (7100d4a6-192d-4447-ba11-d5212867031c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.899697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:30.936145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:30.942979 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-34be8556-5b89-4efb-8cbe-1f01da9c8543 None None] Current status of the port ab49ef6b-69c9-41b8-81b8-04461db330e9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:30.959120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event updated for resources: {'Port': ['ID=842602f9-c0b5-43d0-96b6-4d14d457cf83,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:30.962028 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.070002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 7100d4a6-192d-4447-ba11-d5212867031c is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:31.111596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:31.113761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:31.132295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:31.143470 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6013c127-f3b9-47e6-ba5d-61f4fe9a3611 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:31.152995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.178196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6013c127-f3b9-47e6-ba5d-61f4fe9a3611 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:31.178879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6013c127-f3b9-47e6-ba5d-61f4fe9a3611 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:31.188925 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6e6ab553-d285-4c67-a784-752cf89a8426 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 3.0809445 Mar 24 02:18:31.192034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33576) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:31.197851 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-712a4e92-38cd-486d-9e34-216c39675c96 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'port_id': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:31.212869 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6013c127-f3b9-47e6-ba5d-61f4fe9a3611 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:31.224222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6013c127-f3b9-47e6-ba5d-61f4fe9a3611 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:31.224834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6013c127-f3b9-47e6-ba5d-61f4fe9a3611 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:31.247384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:31.265406 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-712a4e92-38cd-486d-9e34-216c39675c96 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (4aaac2f8-8f18-4021-90d6-949dea09f7d3), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.283977 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6013c127-f3b9-47e6-ba5d-61f4fe9a3611 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:31.284623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6013c127-f3b9-47e6-ba5d-61f4fe9a3611 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:31.310106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c2269b2c-b95e-431b-8339-1097fe1ccb49 None None] Provisioning complete for port 842602f9-c0b5-43d0-96b6-4d14d457cf83 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:31.310489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c2269b2c-b95e-431b-8339-1097fe1ccb49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.368186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c2269b2c-b95e-431b-8339-1097fe1ccb49 None None] Port 842602f9-c0b5-43d0-96b6-4d14d457cf83 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:31.387915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c2269b2c-b95e-431b-8339-1097fe1ccb49 None None] Provisioning complete for port ab49ef6b-69c9-41b8-81b8-04461db330e9 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:31.388303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c2269b2c-b95e-431b-8339-1097fe1ccb49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.400770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:31.409778 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-50ca5cb2-7e22-4560-946a-72e447308bc6 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9781804 Mar 24 02:18:31.410567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33580) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:31.417891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'routes': [{'nexthop': '172.20.0.2', 'destination': '172.20.0.0/28'}, {'nexthop': '172.21.0.2', 'destination': '172.21.0.0/28'}, {'nexthop': '172.22.0.2', 'destination': '172.22.0.0/28'}, {'nexthop': '172.23.0.2', 'destination': '172.23.0.0/28'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:31.418130 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:31.431159 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:31.434271 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:31.460010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-712a4e92-38cd-486d-9e34-216c39675c96 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.469780 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-712a4e92-38cd-486d-9e34-216c39675c96 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (4aaac2f8-8f18-4021-90d6-949dea09f7d3), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.470339 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-712a4e92-38cd-486d-9e34-216c39675c96 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP 4aaac2f8-8f18-4021-90d6-949dea09f7d3 disassociated. External IP: 172.26.2.97, port: 0e8c22c9-70ad-4c3f-b2a4-f20c99a95528. Mar 24 02:18:31.502047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c2269b2c-b95e-431b-8339-1097fe1ccb49 None None] Current status of the port ab49ef6b-69c9-41b8-81b8-04461db330e9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:31.562507 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:31.624641 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f088ba66-dd3c-4f11-9c11-aa9fe2526361 None None] Provisioning complete for port 842602f9-c0b5-43d0-96b6-4d14d457cf83 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:31.626138 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f088ba66-dd3c-4f11-9c11-aa9fe2526361 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.675061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f088ba66-dd3c-4f11-9c11-aa9fe2526361 None None] Port 842602f9-c0b5-43d0-96b6-4d14d457cf83 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:31.725442 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-712a4e92-38cd-486d-9e34-216c39675c96 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:31.824257 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:30Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:28Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '842602f9-c0b5-43d0-96b6-4d14d457cf83', 'name': '', 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:1f:7d:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1207, 'fixed_ips': [{'subnet_id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:28Z', 'updated_at': '2022-03-24T02:18:30Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:31.846819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-712a4e92-38cd-486d-9e34-216c39675c96 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:31.852349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-712a4e92-38cd-486d-9e34-216c39675c96 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.856647 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:31.857204 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Updating router e6831f90-e567-436b-a709-5ee103af3439 port 842602f9-c0b5-43d0-96b6-4d14d457cf83 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:18:31.858931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66933120-8151-4115-936d-92d95cd42313 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:31.871764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66933120-8151-4115-936d-92d95cd42313 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:31.872134 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-66933120-8151-4115-936d-92d95cd42313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:31.890475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.extraroute_db [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added routes are [{'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}] {{(pid=104037) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Mar 24 02:18:31.894255 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.907337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.extraroute_db [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Removed routes are [] {{(pid=104037) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Mar 24 02:18:31.908195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (e6831f90-e567-436b-a709-5ee103af3439), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:31.920844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-66933120-8151-4115-936d-92d95cd42313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:31.930190 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-712a4e92-38cd-486d-9e34-216c39675c96 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/floatingips/4aaac2f8-8f18-4021-90d6-949dea09f7d3 HTTP/1.1" status: 200 len: 687 time: 0.7362647 Mar 24 02:18:31.932394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33584) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:31.942084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66933120-8151-4115-936d-92d95cd42313 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:31.942976 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-66933120-8151-4115-936d-92d95cd42313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:31.946366 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9cd8be02-360a-4806-9008-eb5ca34bda02 None None] Provisioning complete for port 842602f9-c0b5-43d0-96b6-4d14d457cf83 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:31.947193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9cd8be02-360a-4806-9008-eb5ca34bda02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.015616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9cd8be02-360a-4806-9008-eb5ca34bda02 None None] Port 842602f9-c0b5-43d0-96b6-4d14d457cf83 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:18:32.017530 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-66933120-8151-4115-936d-92d95cd42313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:32.018190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66933120-8151-4115-936d-92d95cd42313 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:32.085902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port fe5f235c-d7fb-421a-9c4d-7e555fd5e337 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:32.086276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fe5f235c-d7fb-421a-9c4d-7e555fd5e337), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.113777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0cf07f7-a03d-41dc-8d4b-855aee632beb req-afe80ee6-224a-4cb0-b758-93994e6e158e tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:32.123015 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f0cf07f7-a03d-41dc-8d4b-855aee632beb req-afe80ee6-224a-4cb0-b758-93994e6e158e tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.1252120 Mar 24 02:18:32.169702 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fe5f235c-d7fb-421a-9c4d-7e555fd5e337), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.170598 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (fe5f235c-d7fb-421a-9c4d-7e555fd5e337), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.186669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for fe5f235c-d7fb-421a-9c4d-7e555fd5e337 owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:32.198561 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Publish callbacks [] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.202060 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (e6831f90-e567-436b-a709-5ee103af3439), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.206168 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.213802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (e6831f90-e567-436b-a709-5ee103af3439), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.262890 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ac8e66-9c62-4050-a74c-f27bdff9e006 None None] Pushing event updated for resources: {'Port': ['ID=842602f9-c0b5-43d0-96b6-4d14d457cf83,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:32.264523 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ab49ef6b-69c9-41b8-81b8-04461db330e9 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:32.358193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (fe5f235c-d7fb-421a-9c4d-7e555fd5e337), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.362716 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ab49ef6b-69c9-41b8-81b8-04461db330e9 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:32.363416 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.402719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=fe5f235c-d7fb-421a-9c4d-7e555fd5e337,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:32.485899 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.491499 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (4aaac2f8-8f18-4021-90d6-949dea09f7d3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.495228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.502150 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6cfa8652-2c99-47d8-83c4-c9e81ec37436 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/floatingips/4aaac2f8-8f18-4021-90d6-949dea09f7d3 HTTP/1.1" status: 204 len: 168 time: 0.5686281 Mar 24 02:18:32.502957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33586) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:32.506208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ab49ef6b-69c9-41b8-81b8-04461db330e9 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:32.509816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': 'a1677890-315b-44e2-8649-adab791f7e84'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:32.520187 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Attempting to bind port 842602f9-c0b5-43d0-96b6-4d14d457cf83 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:32.521630 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Attempting to bind port 842602f9-c0b5-43d0-96b6-4d14d457cf83 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '978a9dee-7c2d-420f-888b-a2937c1e1fc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:32.522061 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Attempting to bind port 842602f9-c0b5-43d0-96b6-4d14d457cf83 on network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:32.530140 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:32.530945 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Checking segment: {'id': '978a9dee-7c2d-420f-888b-a2937c1e1fc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:32.532637 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.533077 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Bound using segment: {'id': '978a9dee-7c2d-420f-888b-a2937c1e1fc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:32.533934 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Bound port: 842602f9-c0b5-43d0-96b6-4d14d457cf83, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '978a9dee-7c2d-420f-888b-a2937c1e1fc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:32.534696 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.535943 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.605793 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] For port 842602f9-c0b5-43d0-96b6-4d14d457cf83, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:32.609105 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] For port 842602f9-c0b5-43d0-96b6-4d14d457cf83, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=842602f9-c0b5-43d0-96b6-4d14d457cf83,segment=NetworkSegment(978a9dee-7c2d-420f-888b-a2937c1e1fc6),segment_id=978a9dee-7c2d-420f-888b-a2937c1e1fc6)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:32.616709 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.646684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-35725ee5-ec07-4f6c-9486-64caf7592bd3 None None] Provisioning complete for port 842602f9-c0b5-43d0-96b6-4d14d457cf83 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:32.647587 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-35725ee5-ec07-4f6c-9486-64caf7592bd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.666221 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.690470 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:32.696667 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:32.698349 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:32.699823 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f0cf07f7-a03d-41dc-8d4b-855aee632beb req-56df5fa3-ae09-4a78-9539-b17374e71541 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5507698 Mar 24 02:18:32.795472 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ac8e66-9c62-4050-a74c-f27bdff9e006 None None] Pushing event updated for resources: {'Port': ['ID=842602f9-c0b5-43d0-96b6-4d14d457cf83,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:32.815743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:32.832781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.834064 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5d37332b-adb9-4548-8b8d-590d56052e3e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439 HTTP/1.1" status: 200 len: 934 time: 1.4219317 Mar 24 02:18:32.836289 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-35725ee5-ec07-4f6c-9486-64caf7592bd3 None None] Current status of the port 842602f9-c0b5-43d0-96b6-4d14d457cf83 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:32.836709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33590) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:32.838438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-35725ee5-ec07-4f6c-9486-64caf7592bd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.858763 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:32.902237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-35725ee5-ec07-4f6c-9486-64caf7592bd3 None None] For port 842602f9-c0b5-43d0-96b6-4d14d457cf83, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=842602f9-c0b5-43d0-96b6-4d14d457cf83,segment=NetworkSegment(978a9dee-7c2d-420f-888b-a2937c1e1fc6),segment_id=978a9dee-7c2d-420f-888b-a2937c1e1fc6)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:32.907573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-35725ee5-ec07-4f6c-9486-64caf7592bd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:32.909406 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.26.2.135 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/a8319431-d4d8-44a8-97a1-57c7ee379bb4) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:32.981752 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35725ee5-ec07-4f6c-9486-64caf7592bd3 None None] Pushing event updated for resources: {'Port': ['ID=842602f9-c0b5-43d0-96b6-4d14d457cf83,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:33.038321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a3bcbcf6-21ad-4fc3-9abb-6ac009576f1d None None] Provisioning complete for port 842602f9-c0b5-43d0-96b6-4d14d457cf83 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:33.038321 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a3bcbcf6-21ad-4fc3-9abb-6ac009576f1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.041809 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eb6cb26e-da6d-47b6-bf44-8da91c9696d1 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439 HTTP/1.1" status: 200 len: 934 time: 0.2015972 Mar 24 02:18:33.042300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33594) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:33.048735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'routes': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:33.117595 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (a8319431-d4d8-44a8-97a1-57c7ee379bb4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.120261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a3bcbcf6-21ad-4fc3-9abb-6ac009576f1d None None] Current status of the port 842602f9-c0b5-43d0-96b6-4d14d457cf83 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:33.158295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a8319431-d4d8-44a8-97a1-57c7ee379bb4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.184605 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:31Z', 'revision_number': 6, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:28Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '842602f9-c0b5-43d0-96b6-4d14d457cf83', 'name': '', 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:1f:7d:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1207, 'fixed_ips': [{'subnet_id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:28Z', 'updated_at': '2022-03-24T02:18:32Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:33.195188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:33.198089 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:33.201867 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:33.213412 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de866b48-0760-4352-8d0a-4262b2be0e72 None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:31Z', 'revision_number': 6, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:28Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '842602f9-c0b5-43d0-96b6-4d14d457cf83', 'name': '', 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:1f:7d:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1207, 'fixed_ips': [{'subnet_id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:28Z', 'updated_at': '2022-03-24T02:18:32Z', 'revision_number': 4, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:33.214955 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84c08cfe-c5dc-46c6-b483-7f1b99766f73 req-df13e5bd-c49a-446c-a827-482de58a493e tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:33.216118 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-84c08cfe-c5dc-46c6-b483-7f1b99766f73 req-df13e5bd-c49a-446c-a827-482de58a493e tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.0754039 Mar 24 02:18:33.234480 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=a8319431-d4d8-44a8-97a1-57c7ee379bb4,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:33.371076 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-84c08cfe-c5dc-46c6-b483-7f1b99766f73 req-c08b222a-9a4f-457d-8ae3-7f7e58a5baba tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1450052 Mar 24 02:18:33.577572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.extraroute_db [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added routes are [] {{(pid=104037) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Mar 24 02:18:33.578173 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.extraroute_db [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Removed routes are [{'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}] {{(pid=104037) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Mar 24 02:18:33.610017 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (e6831f90-e567-436b-a709-5ee103af3439), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.631769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (8e33330c-f71b-4790-b69e-b89b3c5834ca), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.697010 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.707706 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a8319431-d4d8-44a8-97a1-57c7ee379bb4), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.831814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (e6831f90-e567-436b-a709-5ee103af3439), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.836780 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (e6831f90-e567-436b-a709-5ee103af3439), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.887476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (a8319431-d4d8-44a8-97a1-57c7ee379bb4), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.892589 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (a8319431-d4d8-44a8-97a1-57c7ee379bb4), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:33.944825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:33.977860 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=a8319431-d4d8-44a8-97a1-57c7ee379bb4,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:33.986679 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (8e33330c-f71b-4790-b69e-b89b3c5834ca), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:34.057212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:34.065039 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:34.069026 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-499f5260-1c62-430b-a358-c40f3061963e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439 HTTP/1.1" status: 200 len: 700 time: 1.0227981 Mar 24 02:18:34.070341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33598) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:34.095785 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP 8e33330c-f71b-4790-b69e-b89b3c5834ca associated. External IP: 172.26.2.135, port: a1677890-315b-44e2-8649-adab791f7e84. Mar 24 02:18:34.103758 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:34.114429 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:34.115098 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:34.180059 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-220737bd-c0c3-474f-92b6-09a4ffabb24b tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439 HTTP/1.1" status: 200 len: 700 time: 0.1061358 Mar 24 02:18:34.180216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33600) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:34.223739 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:34.297740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 842602f9-c0b5-43d0-96b6-4d14d457cf83 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:34.355225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:34.464883 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:33Z', 'revision_number': 7, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:28Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '842602f9-c0b5-43d0-96b6-4d14d457cf83', 'name': '', 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:1f:7d:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1207, 'fixed_ips': [{'subnet_id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:28Z', 'updated_at': '2022-03-24T02:18:32Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:34.496046 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:34.502287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:34.507662 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:34.508357 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:34.536449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:34.552690 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0151372c-bd59-4708-95f6-585cab8037c2 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:34.557918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2dea88-b901-422e-8eb3-77b73eb3d2c5 req-81dc1bf7-00bd-4397-9b18-9a0e2d4f00f2 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:34.559568 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fd2dea88-b901-422e-8eb3-77b73eb3d2c5 req-81dc1bf7-00bd-4397-9b18-9a0e2d4f00f2 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.0777252 Mar 24 02:18:34.573919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0151372c-bd59-4708-95f6-585cab8037c2 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:34.575006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0151372c-bd59-4708-95f6-585cab8037c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:34.586757 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b4f606d0-d5f3-403d-b4b3-961a5f705600 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 2.0821557 Mar 24 02:18:34.587492 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33604) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:34.612806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0151372c-bd59-4708-95f6-585cab8037c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:34.623480 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 842602f9-c0b5-43d0-96b6-4d14d457cf83 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:34.623860 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:34.626360 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:34.646798 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fd2dea88-b901-422e-8eb3-77b73eb3d2c5 req-649f03e4-818f-456c-a879-73949b33e385 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763400 Mar 24 02:18:34.654607 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7e083a35-d69e-482a-8aa7-aa27112cbe6b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "GET /v2.0/floatingips/8e33330c-f71b-4790-b69e-b89b3c5834ca HTTP/1.1" status: 200 len: 977 time: 0.0657969 Mar 24 02:18:34.656898 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33606) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:34.687595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0151372c-bd59-4708-95f6-585cab8037c2 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:34.688766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0151372c-bd59-4708-95f6-585cab8037c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:34.725910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0151372c-bd59-4708-95f6-585cab8037c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:34.726612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0151372c-bd59-4708-95f6-585cab8037c2 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:34.731014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:34.772906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 842602f9-c0b5-43d0-96b6-4d14d457cf83 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:34.785718 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b92b2ad6-76e3-428e-abfb-2d09ca3195f7 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 980 time: 0.1276777 Mar 24 02:18:34.789628 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33610) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:34.805129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'port_id': '0e8c22c9-70ad-4c3f-b2a4-f20c99a95528'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:34.921926 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:33Z', 'revision_number': 7, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:28Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '842602f9-c0b5-43d0-96b6-4d14d457cf83', 'name': '', 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:1f:7d:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1207, 'fixed_ips': [{'subnet_id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:28Z', 'updated_at': '2022-03-24T02:18:32Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:34.953642 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b4046e9-1046-4a46-8ada-7d8201709be1 None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:33Z', 'revision_number': 7, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:28Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '842602f9-c0b5-43d0-96b6-4d14d457cf83', 'name': '', 'network_id': 'b8d0efd1-3f15-406c-a0a3-f0e019e9f055', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:1f:7d:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1207, 'fixed_ips': [{'subnet_id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:28Z', 'updated_at': '2022-03-24T02:18:32Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'd2fb3747-7322-42ce-834a-9f72be9b98b6', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:35.060794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d21c0040-f4b0-413e-a1a9-56c11d570102 req-959343c1-28db-42d1-ba98-1c3a1437d1db tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:35.062348 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d21c0040-f4b0-413e-a1a9-56c11d570102 req-959343c1-28db-42d1-ba98-1c3a1437d1db tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.1746793 Mar 24 02:18:35.068443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-abcf44be-34be-4bcc-9ead-51036c1ac299 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:35.069897 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-abcf44be-34be-4bcc-9ead-51036c1ac299 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4419a48020f546a6abf15b6c1b4cdbdb&device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 1129 time: 0.1360788 Mar 24 02:18:35.170087 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (8e33330c-f71b-4790-b69e-b89b3c5834ca), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:35.192806 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d21c0040-f4b0-413e-a1a9-56c11d570102 req-698b922f-5dd7-4bc9-91bc-9f20bcab9eba tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211917 Mar 24 02:18:35.238391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-21c11d49-a669-475d-baf0-a181fa0f50ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:35.239911 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-21c11d49-a669-475d-baf0-a181fa0f50ee service neutron] 10.222.0.30 "GET /v2.0/networks?id=da1aec0d-a786-4656-9380-f71f1c64ba05 HTTP/1.1" status: 200 len: 913 time: 0.1614826 Mar 24 02:18:35.284259 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-bde10997-e948-4a83-85e9-6431c30f53e7 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c2f85444-f14d-48c1-9fd1-76fe9741f263 HTTP/1.1" status: 200 len: 217 time: 0.0383911 Mar 24 02:18:35.638410 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-ff28c45b-7351-4ea2-9a5c-7e8bffa17af3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:35.639915 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-ff28c45b-7351-4ea2-9a5c-7e8bffa17af3 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=1a07dda3-b4d8-484a-9399-92d0432cd074 HTTP/1.1" status: 200 len: 852 time: 0.3386061 Mar 24 02:18:35.648658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:35.652177 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (8e33330c-f71b-4790-b69e-b89b3c5834ca), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:35.661921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 842602f9-c0b5-43d0-96b6-4d14d457cf83 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:35.662260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:35.680313 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-ae46d342-5031-4a50-8721-2bd68d8c33e0 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=da1aec0d-a786-4656-9380-f71f1c64ba05&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0322280 Mar 24 02:18:35.755856 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP 8e33330c-f71b-4790-b69e-b89b3c5834ca associated. External IP: 172.26.2.135, port: a1677890-315b-44e2-8649-adab791f7e84. Mar 24 02:18:35.828358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port 842602f9-c0b5-43d0-96b6-4d14d457cf83, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=842602f9-c0b5-43d0-96b6-4d14d457cf83,segment=NetworkSegment(978a9dee-7c2d-420f-888b-a2937c1e1fc6),segment_id=978a9dee-7c2d-420f-888b-a2937c1e1fc6)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:35.828725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:35.844287 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-ea419081-30af-4729-b7e1-816ad42f7b5f service neutron] 10.222.0.30 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1539414 Mar 24 02:18:35.845136 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 842602f9-c0b5-43d0-96b6-4d14d457cf83 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:35.967095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:36.017598 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-962fe704-0e53-47cd-b5e6-b79911cedcaa req-7121b37e-b0c3-4798-bcf2-aa5a4b3cf1fc service neutron] 10.222.0.30 "GET /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1667602 Mar 24 02:18:36.077410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:36.086752 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab802951-1e28-48e6-805a-72c17cad5ffb None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:36.096967 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab802951-1e28-48e6-805a-72c17cad5ffb None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:36.097679 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ab802951-1e28-48e6-805a-72c17cad5ffb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:36.098312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (842602f9-c0b5-43d0-96b6-4d14d457cf83), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:36.128256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=842602f9-c0b5-43d0-96b6-4d14d457cf83,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:36.135830 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ab802951-1e28-48e6-805a-72c17cad5ffb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:36.156156 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab802951-1e28-48e6-805a-72c17cad5ffb None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:36.156923 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ab802951-1e28-48e6-805a-72c17cad5ffb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:36.213766 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-ab802951-1e28-48e6-805a-72c17cad5ffb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:36.214966 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab802951-1e28-48e6-805a-72c17cad5ffb None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:36.350873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:36.357651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:36.376163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5027e6f-b5c4-40f2-86be-8bbe1633c893 req-7b679106-4090-42c3-8a01-0a52823631f6 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:36.377887 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c5027e6f-b5c4-40f2-86be-8bbe1633c893 req-7b679106-4090-42c3-8a01-0a52823631f6 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.0792875 Mar 24 02:18:36.463979 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:36.468326 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:36.473969 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5140e4e9-968c-44db-a576-e55ee983fcb2 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:36.482885 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5140e4e9-968c-44db-a576-e55ee983fcb2 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:36.483502 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5140e4e9-968c-44db-a576-e55ee983fcb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:36.505113 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c5027e6f-b5c4-40f2-86be-8bbe1633c893 req-1c6cbbe6-5045-4d33-803d-4ba79378bd03 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0897996 Mar 24 02:18:36.525959 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5140e4e9-968c-44db-a576-e55ee983fcb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:36.530868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5140e4e9-968c-44db-a576-e55ee983fcb2 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:36.531520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5140e4e9-968c-44db-a576-e55ee983fcb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:36.540838 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3cd61113-5f8d-4d10-895a-ab0f078e7ef1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/floatingips/8e33330c-f71b-4790-b69e-b89b3c5834ca HTTP/1.1" status: 200 len: 978 time: 1.7501523 Mar 24 02:18:36.543436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33618) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:36.549434 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b38cc7e6-7d22-4c50-b53a-cb4d30712356 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'port_id': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:36.571842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5140e4e9-968c-44db-a576-e55ee983fcb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:36.572486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5140e4e9-968c-44db-a576-e55ee983fcb2 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:36.609091 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b38cc7e6-7d22-4c50-b53a-cb4d30712356 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (8e33330c-f71b-4790-b69e-b89b3c5834ca), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:36.610374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:36.706841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:36.711777 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6dd873c6-c762-419d-ae58-932ce342af13 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5304339 Mar 24 02:18:36.714534 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33620) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:36.717126 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:36.726991 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:36.727609 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:36.789744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b38cc7e6-7d22-4c50-b53a-cb4d30712356 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:36.795722 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b38cc7e6-7d22-4c50-b53a-cb4d30712356 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (8e33330c-f71b-4790-b69e-b89b3c5834ca), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:36.796072 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-b38cc7e6-7d22-4c50-b53a-cb4d30712356 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP 8e33330c-f71b-4790-b69e-b89b3c5834ca disassociated. External IP: 172.26.2.135, port: 0e8c22c9-70ad-4c3f-b2a4-f20c99a95528. Mar 24 02:18:36.863791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-326afc67-dc71-4dc6-a19a-cf0597cb72dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting subnet d2fb3747-7322-42ce-834a-9f72be9b98b6 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:36.869329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-326afc67-dc71-4dc6-a19a-cf0597cb72dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (d2fb3747-7322-42ce-834a-9f72be9b98b6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:36.917869 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:36.927249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-326afc67-dc71-4dc6-a19a-cf0597cb72dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (d2fb3747-7322-42ce-834a-9f72be9b98b6), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.089040 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-326afc67-dc71-4dc6-a19a-cf0597cb72dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (d2fb3747-7322-42ce-834a-9f72be9b98b6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.134418 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:36Z', 'revision_number': 8, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:28Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:37.160031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b38cc7e6-7d22-4c50-b53a-cb4d30712356 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:37.169703 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:37.170927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-326afc67-dc71-4dc6-a19a-cf0597cb72dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (d2fb3747-7322-42ce-834a-9f72be9b98b6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.178862 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:37.179474 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:37.256772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-326afc67-dc71-4dc6-a19a-cf0597cb72dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Subnet': ['ID=d2fb3747-7322-42ce-834a-9f72be9b98b6,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:37.264595 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-326afc67-dc71-4dc6-a19a-cf0597cb72dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.268336 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-326afc67-dc71-4dc6-a19a-cf0597cb72dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/d2fb3747-7322-42ce-834a-9f72be9b98b6 HTTP/1.1" status: 204 len: 168 time: 0.5526776 Mar 24 02:18:37.271065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33622) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:37.272906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54cca51e-d992-439b-ae6e-89e4ecd43e8f None None] Network b8d0efd1-3f15-406c-a0a3-f0e019e9f055 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:37.276555 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:37.305952 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b38cc7e6-7d22-4c50-b53a-cb4d30712356 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:37.318909 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b38cc7e6-7d22-4c50-b53a-cb4d30712356 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.324100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c87cdaae-57a7-4784-994a-a57c3b92d08d None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:37.367777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (b8d0efd1-3f15-406c-a0a3-f0e019e9f055), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.368016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c87cdaae-57a7-4784-994a-a57c3b92d08d None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:37.368499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-c87cdaae-57a7-4784-994a-a57c3b92d08d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:37.373981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33624) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:37.374164 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b38cc7e6-7d22-4c50-b53a-cb4d30712356 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/floatingips/8e33330c-f71b-4790-b69e-b89b3c5834ca HTTP/1.1" status: 200 len: 688 time: 0.8283968 Mar 24 02:18:37.407718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-c87cdaae-57a7-4784-994a-a57c3b92d08d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:37.424876 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c87cdaae-57a7-4784-994a-a57c3b92d08d None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:37.425474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-c87cdaae-57a7-4784-994a-a57c3b92d08d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:37.470087 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-c87cdaae-57a7-4784-994a-a57c3b92d08d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:37.470774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c87cdaae-57a7-4784-994a-a57c3b92d08d None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:37.517064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75ef82ca-5d35-4f8e-8563-02483ac0d175 None None] DHCP port deletion for b8d0efd1-3f15-406c-a0a3-f0e019e9f055 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:18:37.521812 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:36Z', 'revision_number': 8, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:28Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:37.536057 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port ab49ef6b-69c9-41b8-81b8-04461db330e9 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:37.536418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.557490 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d3b17a4-162a-47f4-87ee-f4091f6b72a9 None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:36Z', 'revision_number': 8, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7100d4a6-192d-4447-ba11-d5212867031c', 'name': '', 'network_id': '43fab518-494b-4f36-9f94-b357dfa5fb11', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:2f:fc:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1198, 'fixed_ips': [{'subnet_id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:23Z', 'updated_at': '2022-03-24T02:18:28Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': 'cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:37.581390 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-75ef82ca-5d35-4f8e-8563-02483ac0d175 None None] Deleting port ab49ef6b-69c9-41b8-81b8-04461db330e9 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:37.582144 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-75ef82ca-5d35-4f8e-8563-02483ac0d175 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.585828 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port a8319431-d4d8-44a8-97a1-57c7ee379bb4 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:37.586172 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a8319431-d4d8-44a8-97a1-57c7ee379bb4), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.653437 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-75ef82ca-5d35-4f8e-8563-02483ac0d175 None None] For port ab49ef6b-69c9-41b8-81b8-04461db330e9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ab49ef6b-69c9-41b8-81b8-04461db330e9,segment=NetworkSegment(978a9dee-7c2d-420f-888b-a2937c1e1fc6),segment_id=978a9dee-7c2d-420f-888b-a2937c1e1fc6)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:37.653930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-75ef82ca-5d35-4f8e-8563-02483ac0d175 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.666444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-75ef82ca-5d35-4f8e-8563-02483ac0d175 None None] Calling delete_port for ab49ef6b-69c9-41b8-81b8-04461db330e9 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:37.680558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port ab49ef6b-69c9-41b8-81b8-04461db330e9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ab49ef6b-69c9-41b8-81b8-04461db330e9,segment=NetworkSegment(978a9dee-7c2d-420f-888b-a2937c1e1fc6),segment_id=978a9dee-7c2d-420f-888b-a2937c1e1fc6)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:37.680958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.709213 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for ab49ef6b-69c9-41b8-81b8-04461db330e9 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:37.744444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfe7dc69-7842-4afb-93d9-228a9ae0d20f req-8b719c87-d1e6-49cb-8955-ba28db680b0f tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:37.746085 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dfe7dc69-7842-4afb-93d9-228a9ae0d20f req-8b719c87-d1e6-49cb-8955-ba28db680b0f tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.1451547 Mar 24 02:18:37.748132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-75ef82ca-5d35-4f8e-8563-02483ac0d175 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.774032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75ef82ca-5d35-4f8e-8563-02483ac0d175 None None] Pushing event deleted for resources: {'Port': ['ID=ab49ef6b-69c9-41b8-81b8-04461db330e9,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:37.777394 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75ef82ca-5d35-4f8e-8563-02483ac0d175 None None] No DVR routers for this DVR port ab49ef6b-69c9-41b8-81b8-04461db330e9 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:37.778510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a8319431-d4d8-44a8-97a1-57c7ee379bb4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.778863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (a8319431-d4d8-44a8-97a1-57c7ee379bb4), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.814572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for a8319431-d4d8-44a8-97a1-57c7ee379bb4 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:37.909897 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dfe7dc69-7842-4afb-93d9-228a9ae0d20f req-1534db8e-9a93-452f-a8e9-003427c16024 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282108 Mar 24 02:18:37.933340 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ab49ef6b-69c9-41b8-81b8-04461db330e9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:37.969473 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=ab49ef6b-69c9-41b8-81b8-04461db330e9,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:37.973467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No DVR routers for this DVR port ab49ef6b-69c9-41b8-81b8-04461db330e9 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:38.088073 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (b8d0efd1-3f15-406c-a0a3-f0e019e9f055), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:38.117670 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b8d0efd1-3f15-406c-a0a3-f0e019e9f055']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:38.132971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a8319431-d4d8-44a8-97a1-57c7ee379bb4), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:38.148586 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '978a9dee-7c2d-420f-888b-a2937c1e1fc6') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:38.148884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '978a9dee-7c2d-420f-888b-a2937c1e1fc6') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:38.180579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (978a9dee-7c2d-420f-888b-a2937c1e1fc6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:38.200479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=a8319431-d4d8-44a8-97a1-57c7ee379bb4,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:38.229330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (978a9dee-7c2d-420f-888b-a2937c1e1fc6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:38.234248 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ab49ef6b-69c9-41b8-81b8-04461db330e9 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:38.257370 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Releasing vlan 116 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:38.257759 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (978a9dee-7c2d-420f-888b-a2937c1e1fc6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:38.259105 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: ab49ef6b-69c9-41b8-81b8-04461db330e9 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:38.259452 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ab49ef6b-69c9-41b8-81b8-04461db330e9 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:38.259856 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 842602f9-c0b5-43d0-96b6-4d14d457cf83 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: self.session.flush() Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:38.260702 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:38.279879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 842602f9-c0b5-43d0-96b6-4d14d457cf83 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:38.280233 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 842602f9-c0b5-43d0-96b6-4d14d457cf83 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:38.340916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43c065a-5635-4e88-9e3e-f25b045e8666 req-131a4975-347a-4c58-8b8d-e4dcfd42b114 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:38.342391 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d43c065a-5635-4e88-9e3e-f25b045e8666 req-131a4975-347a-4c58-8b8d-e4dcfd42b114 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.2129943 Mar 24 02:18:38.345720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (8e33330c-f71b-4790-b69e-b89b3c5834ca), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:38.348286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:38.349340 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3bdef7bf-769f-4031-8133-606259735b65 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/floatingips/8e33330c-f71b-4790-b69e-b89b3c5834ca HTTP/1.1" status: 204 len: 168 time: 0.9747210 Mar 24 02:18:38.352473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33634) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:38.364612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (b8d0efd1-3f15-406c-a0a3-f0e019e9f055), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:38.373135 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:38.376786 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/networks/b8d0efd1-3f15-406c-a0a3-f0e019e9f055 HTTP/1.1" status: 204 len: 168 time: 1.1041949 Mar 24 02:18:38.386737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33636) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:38.394483 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-a2326011-f04a-425b-a739-0433e7cba0c2 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] delete failed (client error): The resource could not be found. Mar 24 02:18:38.399793 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a2326011-f04a-425b-a739-0433e7cba0c2 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/floatingips/8e33330c-f71b-4790-b69e-b89b3c5834ca HTTP/1.1" status: 404 len: 345 time: 0.0418673 Mar 24 02:18:38.399992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a674c5ae-5c43-476e-a5cd-9357adede78c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Network': ['ID=b8d0efd1-3f15-406c-a0a3-f0e019e9f055,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:38.400091 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33638) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:38.481011 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d43c065a-5635-4e88-9e3e-f25b045e8666 req-67c312d4-b9aa-49ac-9cd2-3b19cbc7a7a8 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1304121 Mar 24 02:18:38.490511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56d06de1-f78a-415f-bcde-588ffefbb13e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:38.495946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56d06de1-f78a-415f-bcde-588ffefbb13e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:38.501844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56d06de1-f78a-415f-bcde-588ffefbb13e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:38.506462 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-56d06de1-f78a-415f-bcde-588ffefbb13e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "GET /v2.0/ports?network_id=383df69d-c9d6-4f76-a384-f1c5ebdd10fe HTTP/1.1" status: 200 len: 2357 time: 0.1033108 Mar 24 02:18:38.506462 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33640) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:38.560408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8dc1665-0a75-4785-b1c9-ca09c26dc7bf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:38.561937 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f8dc1665-0a75-4785-b1c9-ca09c26dc7bf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "GET /v2.0/subnets/35936600-4794-4c7a-9459-34f9b2293644 HTTP/1.1" status: 200 len: 797 time: 0.0546145 Mar 24 02:18:38.567645 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33642) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:38.572510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'port': {'network_id': '383df69d-c9d6-4f76-a384-f1c5ebdd10fe', 'name': 'tempest-FloatingIPTestJSON-1136890203', 'fixed_ips': [{'ip_address': '172.20.0.14'}, {'ip_address': '172.20.0.13'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:38.677068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Made reservation on behalf of 4f11674605a349f28f6886bf409a1207 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:38.761657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.018552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 7100d4a6-192d-4447-ba11-d5212867031c {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:39.018798 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (7100d4a6-192d-4447-ba11-d5212867031c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.032351 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.049139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] device_id is not set on port fbde2e94-a536-46cd-98da-1e9963bb223a yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:18:39.104964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port 7100d4a6-192d-4447-ba11-d5212867031c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7100d4a6-192d-4447-ba11-d5212867031c,segment=NetworkSegment(7121d99a-e8b1-4010-a870-f48f170564fe),segment_id=7121d99a-e8b1-4010-a870-f48f170564fe)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:39.105324 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (7100d4a6-192d-4447-ba11-d5212867031c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.119014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 7100d4a6-192d-4447-ba11-d5212867031c owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:39.341848 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.20.0.14 (383df69d-c9d6-4f76-a384-f1c5ebdd10fe/35936600-4794-4c7a-9459-34f9b2293644/fbde2e94-a536-46cd-98da-1e9963bb223a) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:39.348056 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.20.0.13 (383df69d-c9d6-4f76-a384-f1c5ebdd10fe/35936600-4794-4c7a-9459-34f9b2293644/fbde2e94-a536-46cd-98da-1e9963bb223a) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:39.495288 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (fbde2e94-a536-46cd-98da-1e9963bb223a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.528776 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (fbde2e94-a536-46cd-98da-1e9963bb223a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.584893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (7100d4a6-192d-4447-ba11-d5212867031c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.585539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:39.592564 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:39.595148 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:39.602226 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=fbde2e94-a536-46cd-98da-1e9963bb223a,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:39.629154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=7100d4a6-192d-4447-ba11-d5212867031c,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:39.653690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:39.653889 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.670027 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a42c8e1d-5345-4d6f-bef3-a8456ded26db tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1010 time: 1.1012909 Mar 24 02:18:39.673231 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33646) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:39.678183 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': 'fbde2e94-a536-46cd-98da-1e9963bb223a', 'fixed_ip_address': '172.20.0.14'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:39.700886 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.712044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93605665-7487-4d70-90e1-3538ac289d23 req-67c2b87b-ac4f-49cb-8a3f-15853f044281 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:39.713648 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-93605665-7487-4d70-90e1-3538ac289d23 req-67c2b87b-ac4f-49cb-8a3f-15853f044281 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.1443591 Mar 24 02:18:39.814008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.849235 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-93605665-7487-4d70-90e1-3538ac289d23 req-7eee8177-3085-48f9-9ea9-ce1bc64dea0d tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/security-groups?id=b5a73a5a-e374-42bc-a7d1-6c0708d9a337&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859456 Mar 24 02:18:39.850201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:39.933526 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.26.2.133 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/0c72f389-83b4-4414-a057-a58104f9f945) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:40.044156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (0c72f389-83b4-4414-a057-a58104f9f945), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.057873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:40.085987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0c72f389-83b4-4414-a057-a58104f9f945), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.124327 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:40.127239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:40.132867 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:40.138476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=0c72f389-83b4-4414-a057-a58104f9f945,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:40.159313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:40.167935 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d22df9ab-6b6d-4a90-ad03-5030eacbc5a0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7780690 Mar 24 02:18:40.170628 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33648) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:40.172538 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:40.197013 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:40.197629 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:40.263401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-85572b88-fbec-4efe-89a0-911a950953d8 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:40.266733 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-85572b88-fbec-4efe-89a0-911a950953d8 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.30 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 945 time: 0.0723710 Mar 24 02:18:40.293226 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:40.298453 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f024244-997e-4faa-8310-3a9841934e61 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting subnet cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:40.303494 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f024244-997e-4faa-8310-3a9841934e61 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.381709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Deleting port c2f85444-f14d-48c1-9fd1-76fe9741f263 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:40.381948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.394586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f024244-997e-4faa-8310-3a9841934e61 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.479081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] For port c2f85444-f14d-48c1-9fd1-76fe9741f263, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=c2f85444-f14d-48c1-9fd1-76fe9741f263,segment=NetworkSegment(0ecb8365-8c6b-4988-93b0-262a15edd551),segment_id=0ecb8365-8c6b-4988-93b0-262a15edd551)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:40.479487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.501401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Calling delete_port for c2f85444-f14d-48c1-9fd1-76fe9741f263 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:40.506609 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:39Z', 'revision_number': 9, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:40.533716 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:40.535695 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f024244-997e-4faa-8310-3a9841934e61 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.544178 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:40.544797 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:40.640467 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:40.645960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (c2f85444-f14d-48c1-9fd1-76fe9741f263), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.658899 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['c2f85444-f14d-48c1-9fd1-76fe9741f263'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:18:40.679883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Pushing event deleted for resources: {'Port': ['ID=c2f85444-f14d-48c1-9fd1-76fe9741f263,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:40.695113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f024244-997e-4faa-8310-3a9841934e61 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.727519 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f024244-997e-4faa-8310-3a9841934e61 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Subnet': ['ID=cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:40.731869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] No DVR routers for this DVR port c2f85444-f14d-48c1-9fd1-76fe9741f263 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:40.735332 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1f024244-997e-4faa-8310-3a9841934e61 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.736510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.741388 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1f024244-997e-4faa-8310-3a9841934e61 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd HTTP/1.1" status: 204 len: 168 time: 0.5673862 Mar 24 02:18:40.741706 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9eb7300b-6eb4-465b-a92f-20b2a5c9f5f2 req-852aa518-5212-4604-9fe3-64338fd9c2ad tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.30 "DELETE /v2.0/ports/c2f85444-f14d-48c1-9fd1-76fe9741f263 HTTP/1.1" status: 204 len: 173 time: 0.4685616 Mar 24 02:18:40.741706 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b03f43c2-4dc7-4d74-9408-c99b15cf4661', 'name': 'network-vif-deleted', 'tag': 'c2f85444-f14d-48c1-9fd1-76fe9741f263'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:18:40.742626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33652) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:40.747561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-239f448e-65a3-4fc3-9e08-0c4bafc4306d None None] Network 43fab518-494b-4f36-9f94-b357dfa5fb11 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:40.754533 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (6a9e2247-4d41-4ba4-802a-3b1482d31e0c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.755097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-872df3dc-743e-4e41-89dc-6a2b9eef0f66" -d '{"events": [{"server_uuid": "b03f43c2-4dc7-4d74-9408-c99b15cf4661", "name": "network-vif-deleted", "tag": "c2f85444-f14d-48c1-9fd1-76fe9741f263"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:18:40.799738 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:18:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe19cadb-3fa0-4837-9133-3592beaa7d9b x-openstack-request-id: req-fe19cadb-3fa0-4837-9133-3592beaa7d9b {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:18:40.802187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b03f43c2-4dc7-4d74-9408-c99b15cf4661", "name": "network-vif-deleted", "tag": "c2f85444-f14d-48c1-9fd1-76fe9741f263", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:18:40.802575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-fe19cadb-3fa0-4837-9133-3592beaa7d9b {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:18:40.803089 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fe19cadb-3fa0-4837-9133-3592beaa7d9b'] response: {'server_uuid': 'b03f43c2-4dc7-4d74-9408-c99b15cf4661', 'name': 'network-vif-deleted', 'tag': 'c2f85444-f14d-48c1-9fd1-76fe9741f263', 'status': 'completed', 'code': 200} Mar 24 02:18:40.900182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (43fab518-494b-4f36-9f94-b357dfa5fb11), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.916965 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:39Z', 'revision_number': 9, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:40.954911 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db6e1f28-4dad-4830-8199-e8c27d3b2e4d None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:39Z', 'revision_number': 9, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f3626bc4-ba10-450e-b6bd-3dc7422635cd', 'name': '', 'network_id': 'b3b50e37-6e44-4cab-afa4-d07e2f3e809b', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:c0:63:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1177, 'fixed_ips': [{'subnet_id': '174226f3-58df-4f34-8172-0281943babb1', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:18Z', 'updated_at': '2022-03-24T02:18:23Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '174226f3-58df-4f34-8172-0281943babb1', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:40.971428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0c72f389-83b4-4414-a057-a58104f9f945), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:40.978021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25f4204a-f199-49d2-a3ce-ecc700a09120 None None] DHCP port deletion for 43fab518-494b-4f36-9f94-b357dfa5fb11 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:18:40.980217 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c0a8ed2d-a842-4c17-95fd-57dbc9f5adf5 req-8cf2f59f-b112-472c-8a56-4e4ff00ce374 tempest-TestServerAdvancedOps-1509351534 tempest-TestServerAdvancedOps-1509351534-project] 10.222.0.20 "GET /v2.0/ports?device_id=b03f43c2-4dc7-4d74-9408-c99b15cf4661 HTTP/1.1" status: 200 len: 210 time: 0.0346074 Mar 24 02:18:41.035796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-25f4204a-f199-49d2-a3ce-ecc700a09120 None None] Deleting port b54559d0-a54b-44bf-b356-76d35383ec0c {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:41.036166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-25f4204a-f199-49d2-a3ce-ecc700a09120 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.040965 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port b54559d0-a54b-44bf-b356-76d35383ec0c {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:41.041299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.099389 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-25f4204a-f199-49d2-a3ce-ecc700a09120 None None] For port b54559d0-a54b-44bf-b356-76d35383ec0c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b54559d0-a54b-44bf-b356-76d35383ec0c,segment=NetworkSegment(7121d99a-e8b1-4010-a870-f48f170564fe),segment_id=7121d99a-e8b1-4010-a870-f48f170564fe)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:41.099788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-25f4204a-f199-49d2-a3ce-ecc700a09120 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.112713 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-25f4204a-f199-49d2-a3ce-ecc700a09120 None None] Calling delete_port for b54559d0-a54b-44bf-b356-76d35383ec0c owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:41.157623 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port b54559d0-a54b-44bf-b356-76d35383ec0c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=b54559d0-a54b-44bf-b356-76d35383ec0c,segment=NetworkSegment(7121d99a-e8b1-4010-a870-f48f170564fe),segment_id=7121d99a-e8b1-4010-a870-f48f170564fe)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:41.157982 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.181590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for b54559d0-a54b-44bf-b356-76d35383ec0c owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:41.200136 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-25f4204a-f199-49d2-a3ce-ecc700a09120 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.222811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f4204a-f199-49d2-a3ce-ecc700a09120 None None] Pushing event deleted for resources: {'Port': ['ID=b54559d0-a54b-44bf-b356-76d35383ec0c,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:41.228374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25f4204a-f199-49d2-a3ce-ecc700a09120 None None] No DVR routers for this DVR port b54559d0-a54b-44bf-b356-76d35383ec0c on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:41.261671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (0c72f389-83b4-4414-a057-a58104f9f945), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.273300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (0c72f389-83b4-4414-a057-a58104f9f945), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.361121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=0c72f389-83b4-4414-a057-a58104f9f945,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:41.367852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b54559d0-a54b-44bf-b356-76d35383ec0c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.374803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (6a9e2247-4d41-4ba4-802a-3b1482d31e0c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.426666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=b54559d0-a54b-44bf-b356-76d35383ec0c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:41.460219 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No DVR routers for this DVR port b54559d0-a54b-44bf-b356-76d35383ec0c on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:41.554033 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (43fab518-494b-4f36-9f94-b357dfa5fb11), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.581396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['43fab518-494b-4f36-9f94-b357dfa5fb11']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:41.584262 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP 6a9e2247-4d41-4ba4-802a-3b1482d31e0c associated. External IP: 172.26.2.133, port: fbde2e94-a536-46cd-98da-1e9963bb223a. Mar 24 02:18:41.648677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7121d99a-e8b1-4010-a870-f48f170564fe') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:41.648935 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7121d99a-e8b1-4010-a870-f48f170564fe') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:41.661465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (7121d99a-e8b1-4010-a870-f48f170564fe), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.682089 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (7121d99a-e8b1-4010-a870-f48f170564fe), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.691233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:41.691602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (7121d99a-e8b1-4010-a870-f48f170564fe), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: self.session.flush() Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:41.694408 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:41.759149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (43fab518-494b-4f36-9f94-b357dfa5fb11), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.794729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:41.797921 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/networks/43fab518-494b-4f36-9f94-b357dfa5fb11 HTTP/1.1" status: 204 len: 168 time: 1.0543785 Mar 24 02:18:41.800714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33658) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:41.838487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e1da23-6e35-43db-8021-108a9f6e2f17 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Network': ['ID=43fab518-494b-4f36-9f94-b357dfa5fb11,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:41.882349 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:42.053196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33662) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:42.108400 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-f4c2cf0d-282d-4c22-87bf-5186c9b85615 admin admin] Deleting subnet 1a07dda3-b4d8-484a-9399-92d0432cd074 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:42.114908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4c2cf0d-282d-4c22-87bf-5186c9b85615 admin admin] Publish callbacks [] for subnet (1a07dda3-b4d8-484a-9399-92d0432cd074), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.166982 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4c2cf0d-282d-4c22-87bf-5186c9b85615 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (1a07dda3-b4d8-484a-9399-92d0432cd074), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.232099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4c2cf0d-282d-4c22-87bf-5186c9b85615 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (1a07dda3-b4d8-484a-9399-92d0432cd074), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.254202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b54559d0-a54b-44bf-b356-76d35383ec0c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:42.274928 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:42.279200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: b54559d0-a54b-44bf-b356-76d35383ec0c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:42.279797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device b54559d0-a54b-44bf-b356-76d35383ec0c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:42.280496 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7100d4a6-192d-4447-ba11-d5212867031c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:42.285705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.298009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.302070 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-665dee10-2afb-404f-bc5d-7ea606f06f59 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:42.305335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 7100d4a6-192d-4447-ba11-d5212867031c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:42.305752 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7100d4a6-192d-4447-ba11-d5212867031c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:42.315939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-665dee10-2afb-404f-bc5d-7ea606f06f59 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:42.317061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-665dee10-2afb-404f-bc5d-7ea606f06f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:42.335215 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8404ec4d-5f2a-473f-9163-f5951d87b01e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 984 time: 2.6608553 Mar 24 02:18:42.337973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33664) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:42.342812 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8e143a3c-c6ff-413a-884c-cec9ef59951e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'port_id': 'fbde2e94-a536-46cd-98da-1e9963bb223a', 'fixed_ip_address': '172.20.0.13'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:42.354767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-665dee10-2afb-404f-bc5d-7ea606f06f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:42.366122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4c2cf0d-282d-4c22-87bf-5186c9b85615 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (1a07dda3-b4d8-484a-9399-92d0432cd074), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.367040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-665dee10-2afb-404f-bc5d-7ea606f06f59 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:42.367676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-665dee10-2afb-404f-bc5d-7ea606f06f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:42.399849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c2cf0d-282d-4c22-87bf-5186c9b85615 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1a07dda3-b4d8-484a-9399-92d0432cd074,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:42.409996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f4c2cf0d-282d-4c22-87bf-5186c9b85615 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.410986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-665dee10-2afb-404f-bc5d-7ea606f06f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:42.411901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-665dee10-2afb-404f-bc5d-7ea606f06f59 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:42.415758 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f4c2cf0d-282d-4c22-87bf-5186c9b85615 admin admin] 10.222.0.20 "DELETE /v2.0/subnets/1a07dda3-b4d8-484a-9399-92d0432cd074 HTTP/1.1" status: 204 len: 168 time: 0.3590364 Mar 24 02:18:42.415758 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33666) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:42.426360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e143a3c-c6ff-413a-884c-cec9ef59951e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (6a9e2247-4d41-4ba4-802a-3b1482d31e0c), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.536541 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (da1aec0d-a786-4656-9380-f71f1c64ba05), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.652074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (da1aec0d-a786-4656-9380-f71f1c64ba05), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.682497 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['da1aec0d-a786-4656-9380-f71f1c64ba05']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:42.711715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0ecb8365-8c6b-4988-93b0-262a15edd551') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:42.712010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0ecb8365-8c6b-4988-93b0-262a15edd551') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:42.723895 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (0ecb8365-8c6b-4988-93b0-262a15edd551), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.746968 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0ecb8365-8c6b-4988-93b0-262a15edd551), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.755392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] Releasing vlan 109 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:42.755776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (0ecb8365-8c6b-4988-93b0-262a15edd551), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:42.757394 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:42.804671 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port f3626bc4-ba10-450e-b6bd-3dc7422635cd {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:42.805376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.853956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (da1aec0d-a786-4656-9380-f71f1c64ba05), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.860379 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.863513 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] 10.222.0.20 "DELETE /v2.0/networks/da1aec0d-a786-4656-9380-f71f1c64ba05 HTTP/1.1" status: 204 len: 168 time: 0.4468327 Mar 24 02:18:42.866901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33670) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:42.890879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc1e2c5a-d56f-4839-92ea-0c97c77866a6 admin admin] Pushing event deleted for resources: {'Network': ['ID=da1aec0d-a786-4656-9380-f71f1c64ba05,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:42.910753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33672) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:42.914285 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e143a3c-c6ff-413a-884c-cec9ef59951e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.921278 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e143a3c-c6ff-413a-884c-cec9ef59951e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (6a9e2247-4d41-4ba4-802a-3b1482d31e0c), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.951387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-249fb56d-f472-419d-b0bd-c403eeff5440 admin admin] Deleting subnet c8b7b0df-575a-4283-b87a-2cdfbf0e6a0f {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:42.959871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-249fb56d-f472-419d-b0bd-c403eeff5440 admin admin] Publish callbacks [] for subnet (c8b7b0df-575a-4283-b87a-2cdfbf0e6a0f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.962536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port f3626bc4-ba10-450e-b6bd-3dc7422635cd, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f3626bc4-ba10-450e-b6bd-3dc7422635cd,segment=NetworkSegment(d471af30-0721-4c91-b018-d23d6aaaf555),segment_id=d471af30-0721-4c91-b018-d23d6aaaf555)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:42.962890 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:42.996226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for f3626bc4-ba10-450e-b6bd-3dc7422635cd owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:43.021535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-249fb56d-f472-419d-b0bd-c403eeff5440 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (c8b7b0df-575a-4283-b87a-2cdfbf0e6a0f), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.110711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-249fb56d-f472-419d-b0bd-c403eeff5440 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (c8b7b0df-575a-4283-b87a-2cdfbf0e6a0f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.210147 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-249fb56d-f472-419d-b0bd-c403eeff5440 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (c8b7b0df-575a-4283-b87a-2cdfbf0e6a0f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.260916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-249fb56d-f472-419d-b0bd-c403eeff5440 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c8b7b0df-575a-4283-b87a-2cdfbf0e6a0f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:43.263059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-249fb56d-f472-419d-b0bd-c403eeff5440 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.266288 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-249fb56d-f472-419d-b0bd-c403eeff5440 admin admin] 10.222.0.20 "DELETE /v2.0/subnets/c8b7b0df-575a-4283-b87a-2cdfbf0e6a0f HTTP/1.1" status: 204 len: 168 time: 0.3984654 Mar 24 02:18:43.269231 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33674) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:43.348978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (f3626bc4-ba10-450e-b6bd-3dc7422635cd), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.363189 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8e143a3c-c6ff-413a-884c-cec9ef59951e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:43.386363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (60758fac-dd1e-4f59-9ff1-aee874ad86dc), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.389617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=f3626bc4-ba10-450e-b6bd-3dc7422635cd,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:43.554287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e143a3c-c6ff-413a-884c-cec9ef59951e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:43.559383 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e143a3c-c6ff-413a-884c-cec9ef59951e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.567549 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71cdce1a-f0bd-4121-9078-5f30b008fe0d None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:43.583502 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71cdce1a-f0bd-4121-9078-5f30b008fe0d None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:43.584983 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-71cdce1a-f0bd-4121-9078-5f30b008fe0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:43.633172 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-71cdce1a-f0bd-4121-9078-5f30b008fe0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:43.638657 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8e143a3c-c6ff-413a-884c-cec9ef59951e tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/floatingips/6a9e2247-4d41-4ba4-802a-3b1482d31e0c HTTP/1.1" status: 200 len: 979 time: 1.2966251 Mar 24 02:18:43.639803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33676) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:43.649731 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71cdce1a-f0bd-4121-9078-5f30b008fe0d None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:43.650388 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-71cdce1a-f0bd-4121-9078-5f30b008fe0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:43.689701 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (1f63a954-e411-4138-b423-94a29a3b7505), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.786603 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-71cdce1a-f0bd-4121-9078-5f30b008fe0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:43.787702 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71cdce1a-f0bd-4121-9078-5f30b008fe0d None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:43.892378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (60758fac-dd1e-4f59-9ff1-aee874ad86dc), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.921487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['60758fac-dd1e-4f59-9ff1-aee874ad86dc']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:43.934954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b87f063e-d800-4f8f-91eb-11c88973a4f1') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:43.935246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b87f063e-d800-4f8f-91eb-11c88973a4f1') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:43.946194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.948784 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (b87f063e-d800-4f8f-91eb-11c88973a4f1), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:43.967951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (b87f063e-d800-4f8f-91eb-11c88973a4f1), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.010857 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port 0c72f389-83b4-4414-a057-a58104f9f945 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:44.011479 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0c72f389-83b4-4414-a057-a58104f9f945), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.032376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] Releasing vlan 124 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:44.032779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (b87f063e-d800-4f8f-91eb-11c88973a4f1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:44.034450 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:44.099993 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (60758fac-dd1e-4f59-9ff1-aee874ad86dc), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.107093 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.110246 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] 10.222.0.20 "DELETE /v2.0/networks/60758fac-dd1e-4f59-9ff1-aee874ad86dc HTTP/1.1" status: 204 len: 168 time: 0.8397930 Mar 24 02:18:44.113247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0c72f389-83b4-4414-a057-a58104f9f945), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.113580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (0c72f389-83b4-4414-a057-a58104f9f945), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.122495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdbac767-3d3b-43a7-9e6f-c47312e08005 admin admin] Pushing event deleted for resources: {'Network': ['ID=60758fac-dd1e-4f59-9ff1-aee874ad86dc,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:44.146790 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for 0c72f389-83b4-4414-a057-a58104f9f945 owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:44.239098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:44.321117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33680) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:44.380944 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2c87c518-de78-4750-bc88-98aa001f6ec8 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=4419a48020f546a6abf15b6c1b4cdbdb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0585918 Mar 24 02:18:44.382082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:44.383582 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33682) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:44.393092 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d51ce383-a327-4271-a85e-f2f5b593c57f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5912640 Mar 24 02:18:44.395765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33684) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:44.396883 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:44.409292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:44.410631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:44.479618 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-2d0db35b-47dc-4d87-a417-323575ba9bbc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting subnet 174226f3-58df-4f34-8172-0281943babb1 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:44.489640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2d0db35b-47dc-4d87-a417-323575ba9bbc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (174226f3-58df-4f34-8172-0281943babb1), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.501591 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:44.513948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43ae7a41-1518-4bfd-9dbb-9e2fb623b455 admin admin] Publish callbacks [] for security_group (b5a73a5a-e374-42bc-a7d1-6c0708d9a337), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.549038 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2d0db35b-47dc-4d87-a417-323575ba9bbc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (174226f3-58df-4f34-8172-0281943babb1), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.552762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43ae7a41-1518-4bfd-9dbb-9e2fb623b455 admin admin] Publish callbacks [] for security_group (b5a73a5a-e374-42bc-a7d1-6c0708d9a337), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.602367 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port e15ac081-eb34-4427-bd35-22f6bcb2e344 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:44.602841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.628279 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device c2f85444-f14d-48c1-9fd1-76fe9741f263 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:44.652973 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: c2f85444-f14d-48c1-9fd1-76fe9741f263 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:44.653210 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device c2f85444-f14d-48c1-9fd1-76fe9741f263 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:44.679166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43ae7a41-1518-4bfd-9dbb-9e2fb623b455 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b5a73a5a-e374-42bc-a7d1-6c0708d9a337), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.682050 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-43ae7a41-1518-4bfd-9dbb-9e2fb623b455 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.685627 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-43ae7a41-1518-4bfd-9dbb-9e2fb623b455 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/b5a73a5a-e374-42bc-a7d1-6c0708d9a337 HTTP/1.1" status: 204 len: 168 time: 0.2987783 Mar 24 02:18:44.688697 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2d0db35b-47dc-4d87-a417-323575ba9bbc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (174226f3-58df-4f34-8172-0281943babb1), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.717334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43ae7a41-1518-4bfd-9dbb-9e2fb623b455 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5a73a5a-e374-42bc-a7d1-6c0708d9a337,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:44.741388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port e15ac081-eb34-4427-bd35-22f6bcb2e344, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e15ac081-eb34-4427-bd35-22f6bcb2e344,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:44.741770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.761943 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for e15ac081-eb34-4427-bd35-22f6bcb2e344 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:44.776478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0c72f389-83b4-4414-a057-a58104f9f945), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.779134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2d0db35b-47dc-4d87-a417-323575ba9bbc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (174226f3-58df-4f34-8172-0281943babb1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.795871 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:43Z', 'revision_number': 10, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:44.808394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=0c72f389-83b4-4414-a057-a58104f9f945,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:44.812245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d0db35b-47dc-4d87-a417-323575ba9bbc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Subnet': ['ID=174226f3-58df-4f34-8172-0281943babb1,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:44.825462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2d0db35b-47dc-4d87-a417-323575ba9bbc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.833320 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2d0db35b-47dc-4d87-a417-323575ba9bbc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/174226f3-58df-4f34-8172-0281943babb1 HTTP/1.1" status: 204 len: 168 time: 0.4361718 Mar 24 02:18:44.833945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33688) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:44.837271 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:44.840222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-399aefb9-c32d-4f80-8e15-59c421c2a6b3 None None] Network b3b50e37-6e44-4cab-afa4-d07e2f3e809b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:44.924065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (b3b50e37-6e44-4cab-afa4-d07e2f3e809b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.934011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (6a9e2247-4d41-4ba4-802a-3b1482d31e0c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:44.934451 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP 6a9e2247-4d41-4ba4-802a-3b1482d31e0c disassociated (deleted). External IP: 172.26.2.133, port: fbde2e94-a536-46cd-98da-1e9963bb223a. Mar 24 02:18:44.970167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:44.971395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:45.002216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:45.002919 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.011199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.082023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9,segment=NetworkSegment(d471af30-0721-4c91-b018-d23d6aaaf555),segment_id=d471af30-0721-4c91-b018-d23d6aaaf555)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:45.082771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.106204 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:45.180948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33692) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:45.237009 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:45.258494 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a8aa07bc-d880-4454-bf90-72d02e7f6c22 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=d1ea2c09df3341759fd289649513d9e3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0725987 Mar 24 02:18:45.258494 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33694) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:45.280397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.292657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:45.326257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe8eb9a7-0769-4aaf-a528-d1de3b5558e5 None None] DHCP port deletion for b3b50e37-6e44-4cab-afa4-d07e2f3e809b request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:18:45.333431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:45.347486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No DVR routers for this DVR port da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:45.354552 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (e15ac081-eb34-4427-bd35-22f6bcb2e344), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.425267 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=e15ac081-eb34-4427-bd35-22f6bcb2e344,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:45.433715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (b3b50e37-6e44-4cab-afa4-d07e2f3e809b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.457271 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b3b50e37-6e44-4cab-afa4-d07e2f3e809b']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:45.473145 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd471af30-0721-4c91-b018-d23d6aaaf555') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:45.473441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd471af30-0721-4c91-b018-d23d6aaaf555') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:45.483447 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6eedd4b1-d77c-44df-a39f-927a413b212f admin admin] Publish callbacks [] for security_group (dbef6ee0-824b-40ae-a0f3-d0dc5087f9d7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.494000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:43Z', 'revision_number': 10, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:45.512997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (d471af30-0721-4c91-b018-d23d6aaaf555), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.537284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4f01d9-3375-43e0-ac5e-1ea99cf431fd None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:43Z', 'revision_number': 10, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None, '_interfaces': [{'id': '598fe3d0-0070-459b-95be-d5bd56f20a86', 'name': '', 'network_id': 'c4069fde-e378-4094-98fe-405d58aa3139', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'mac_address': 'fa:16:3e:3d:1f:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6831f90-e567-436b-a709-5ee103af3439', 'device_owner': 'network:router_interface', 'standard_attr_id': 1137, 'fixed_ips': [{'subnet_id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:11Z', 'updated_at': '2022-03-24T02:18:17Z', 'revision_number': 5, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'subnets': [{'id': '0ab02836-20c6-4f02-8006-9965fb6ba43b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:45.542633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6eedd4b1-d77c-44df-a39f-927a413b212f admin admin] Publish callbacks [] for security_group (dbef6ee0-824b-40ae-a0f3-d0dc5087f9d7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.544911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (d471af30-0721-4c91-b018-d23d6aaaf555), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.556237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:45.560817 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Releasing vlan 122 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:45.561313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (d471af30-0721-4c91-b018-d23d6aaaf555), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:45.565572 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:45.579799 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c323ecc8-fc4e-4223-8f0c-0131c6d97429 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:45.595634 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c323ecc8-fc4e-4223-8f0c-0131c6d97429 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:45.596273 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-c323ecc8-fc4e-4223-8f0c-0131c6d97429 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:45.605629 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.640971 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-84074b7d-842e-4639-9184-0af8f29836de tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/floatingips/6a9e2247-4d41-4ba4-802a-3b1482d31e0c HTTP/1.1" status: 204 len: 168 time: 1.9962397 Mar 24 02:18:45.641206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33696) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:45.650916 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-c323ecc8-fc4e-4223-8f0c-0131c6d97429 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:45.663756 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c323ecc8-fc4e-4223-8f0c-0131c6d97429 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:45.664396 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-c323ecc8-fc4e-4223-8f0c-0131c6d97429 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:45.686762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (b3b50e37-6e44-4cab-afa4-d07e2f3e809b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.692655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.695885 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/networks/b3b50e37-6e44-4cab-afa4-d07e2f3e809b HTTP/1.1" status: 204 len: 168 time: 0.8609810 Mar 24 02:18:45.699145 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33698) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:45.720926 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26b91e3b-7bc0-4bc5-9cef-6bd114830afe tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Network': ['ID=b3b50e37-6e44-4cab-afa4-d07e2f3e809b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:45.729024 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-c323ecc8-fc4e-4223-8f0c-0131c6d97429 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:45.730048 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c323ecc8-fc4e-4223-8f0c-0131c6d97429 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:45.730797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6eedd4b1-d77c-44df-a39f-927a413b212f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (dbef6ee0-824b-40ae-a0f3-d0dc5087f9d7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.736825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6eedd4b1-d77c-44df-a39f-927a413b212f admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.738425 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6eedd4b1-d77c-44df-a39f-927a413b212f admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/dbef6ee0-824b-40ae-a0f3-d0dc5087f9d7 HTTP/1.1" status: 204 len: 168 time: 0.4801555 Mar 24 02:18:45.748280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eedd4b1-d77c-44df-a39f-927a413b212f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbef6ee0-824b-40ae-a0f3-d0dc5087f9d7,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:45.826723 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (1f63a954-e411-4138-b423-94a29a3b7505), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:45.997190 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-cca98f13-dac0-4d89-8bf6-528e35c575cc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port fbde2e94-a536-46cd-98da-1e9963bb223a {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:45.997530 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cca98f13-dac0-4d89-8bf6-528e35c575cc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fbde2e94-a536-46cd-98da-1e9963bb223a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:46.162234 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cca98f13-dac0-4d89-8bf6-528e35c575cc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fbde2e94-a536-46cd-98da-1e9963bb223a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:46.241963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-cca98f13-dac0-4d89-8bf6-528e35c575cc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for fbde2e94-a536-46cd-98da-1e9963bb223a owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:46.289133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:46.308591 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:46.308925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device da03ea9b-5943-4f4a-b6c1-0d7c78dc3ba9 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:46.309327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f3626bc4-ba10-450e-b6bd-3dc7422635cd no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:46.327421 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: f3626bc4-ba10-450e-b6bd-3dc7422635cd {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:46.327759 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f3626bc4-ba10-450e-b6bd-3dc7422635cd not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:46.392976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 1f63a954-e411-4138-b423-94a29a3b7505 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:46.879191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:46.941713 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cca98f13-dac0-4d89-8bf6-528e35c575cc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (fbde2e94-a536-46cd-98da-1e9963bb223a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:46.980699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cca98f13-dac0-4d89-8bf6-528e35c575cc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=fbde2e94-a536-46cd-98da-1e9963bb223a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:46.985263 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:46.997667 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e1ac8440-2434-4f75-8c07-60c841e4787a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/1f63a954-e411-4138-b423-94a29a3b7505/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0830617 Mar 24 02:18:46.998436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] Sync routers for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:47.016404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:47.017242 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:47.137458 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cca98f13-dac0-4d89-8bf6-528e35c575cc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.141929 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cca98f13-dac0-4d89-8bf6-528e35c575cc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/ports/fbde2e94-a536-46cd-98da-1e9963bb223a HTTP/1.1" status: 204 len: 168 time: 1.4983003 Mar 24 02:18:47.144471 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33706) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:47.149898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:47.156189 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:47.177136 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.275742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 598fe3d0-0070-459b-95be-d5bd56f20a86 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:47.276082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.282301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782f0d71-5188-4627-8bc6-878b04dee25e req-873eb295-95e0-4331-96c7-57b250a59400 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:47.283933 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-782f0d71-5188-4627-8bc6-878b04dee25e req-873eb295-95e0-4331-96c7-57b250a59400 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 946 time: 0.1027260 Mar 24 02:18:47.352790 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-782f0d71-5188-4627-8bc6-878b04dee25e req-7be6bc82-6248-4d7d-96d5-96acc10f8a6a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0612831 Mar 24 02:18:47.376568 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.380301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port 598fe3d0-0070-459b-95be-d5bd56f20a86, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=598fe3d0-0070-459b-95be-d5bd56f20a86,segment=NetworkSegment(e5448d4b-b8e7-4934-ac13-fef0780c703c),segment_id=e5448d4b-b8e7-4934-ac13-fef0780c703c)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:47.381526 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.396474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 598fe3d0-0070-459b-95be-d5bd56f20a86 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:47.408855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:18:45Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '774a5962-6c17-496b-8d49-ec290d2538c5', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.10', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 792, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:16:15Z', 'updated_at': '2022-03-24T02:16:22Z', 'revision_number': 1, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:47.439016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] Checking router: 1f63a954-e411-4138-b423-94a29a3b7505 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:47.447687 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:47.448291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:47.478439 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.26.2.189 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/1cf44067-e1cd-42d7-ac00-ddc98f728b34) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:47.567022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:47.576668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (598fe3d0-0070-459b-95be-d5bd56f20a86), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.597298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (1cf44067-e1cd-42d7-ac00-ddc98f728b34), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.605323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=598fe3d0-0070-459b-95be-d5bd56f20a86,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:47.640056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (1cf44067-e1cd-42d7-ac00-ddc98f728b34), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.686159 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:47.695424 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:47.700346 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:47.703609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=1cf44067-e1cd-42d7-ac00-ddc98f728b34,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:47.783417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (e6831f90-e567-436b-a709-5ee103af3439), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.813982 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (e765f755-f403-41e9-921a-b2add2baeee0), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.840015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:18:45Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '774a5962-6c17-496b-8d49-ec290d2538c5', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.10', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 792, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:16:15Z', 'updated_at': '2022-03-24T02:16:22Z', 'revision_number': 1, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:47.865100 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1cf44067-e1cd-42d7-ac00-ddc98f728b34), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:47.876391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cfbfdca-4046-4315-b133-8fe5bcea2df2 None None] The sync data for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv is: [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:18:45Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '774a5962-6c17-496b-8d49-ec290d2538c5', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.10', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'port_id': '79123375-136b-4c1b-ba67-948e46e33a7c', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 792, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'mac_address': 'fa:16:3e:46:72:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:16:15Z', 'updated_at': '2022-03-24T02:16:22Z', 'revision_number': 1, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:47.957592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:48.023131 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (1cf44067-e1cd-42d7-ac00-ddc98f728b34), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.027732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (1cf44067-e1cd-42d7-ac00-ddc98f728b34), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.036378 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:48.043773 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c967916f-2793-4c38-894b-ac1d2412b8c0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3410285 Mar 24 02:18:48.044827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33708) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:48.047892 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:48.059143 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:48.060003 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:48.096997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=1cf44067-e1cd-42d7-ac00-ddc98f728b34,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:48.106867 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (e765f755-f403-41e9-921a-b2add2baeee0), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.111364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-cec29830-d440-4155-afe8-e6b972da3aec tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting subnet 0ab02836-20c6-4f02-8006-9965fb6ba43b {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:48.114572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cec29830-d440-4155-afe8-e6b972da3aec tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (0ab02836-20c6-4f02-8006-9965fb6ba43b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.129715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.131377 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a3dfc457-cf36-4353-bfd7-60c840051526 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.9854221 Mar 24 02:18:48.134088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33710) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:48.139482 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'port': {'network_id': '383df69d-c9d6-4f76-a384-f1c5ebdd10fe', 'name': 'tempest-FloatingIPTestJSON-1843839739'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:48.140300 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:48.155412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cec29830-d440-4155-afe8-e6b972da3aec tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (0ab02836-20c6-4f02-8006-9965fb6ba43b), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.198304 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:47Z', 'revision_number': 11, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:48.229138 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:48.239482 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:48.240329 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:48.264172 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cec29830-d440-4155-afe8-e6b972da3aec tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (0ab02836-20c6-4f02-8006-9965fb6ba43b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.278920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Made reservation on behalf of 4f11674605a349f28f6886bf409a1207 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:48.283466 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.304509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] device_id is not set on port 9a265075-eb91-4da5-b767-0c6dc1716366 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:18:48.342906 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:48.343209 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cec29830-d440-4155-afe8-e6b972da3aec tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (0ab02836-20c6-4f02-8006-9965fb6ba43b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.352889 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e15ac081-eb34-4427-bd35-22f6bcb2e344 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:48.377243 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec29830-d440-4155-afe8-e6b972da3aec tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Subnet': ['ID=0ab02836-20c6-4f02-8006-9965fb6ba43b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:48.379431 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cec29830-d440-4155-afe8-e6b972da3aec tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.402945 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cec29830-d440-4155-afe8-e6b972da3aec tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/0ab02836-20c6-4f02-8006-9965fb6ba43b HTTP/1.1" status: 204 len: 168 time: 0.3578029 Mar 24 02:18:48.405309 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33714) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:48.408526 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: e15ac081-eb34-4427-bd35-22f6bcb2e344 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:48.409012 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e15ac081-eb34-4427-bd35-22f6bcb2e344 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:48.415880 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:47Z', 'revision_number': 11, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:48.416436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf432bba-2244-415d-be73-9bda93d4d411 None None] Network c4069fde-e378-4094-98fe-405d58aa3139 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:48.454052 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a76a49f-3897-49a2-a834-bace1931f5b7 None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:47Z', 'revision_number': 11, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:48.488426 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.20.0.3 (383df69d-c9d6-4f76-a384-f1c5ebdd10fe/35936600-4794-4c7a-9459-34f9b2293644/9a265075-eb91-4da5-b767-0c6dc1716366) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:48.558153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (c4069fde-e378-4094-98fe-405d58aa3139), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.618627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Deleting port 5b488b4c-3f04-4938-b387-a53b920028a8 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:48.618973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.643294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9fb0a9-06cd-495c-b6fa-56e1f5f8b0f9 req-10acdc2b-64a4-4732-872e-51bba0f119f8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:48.644804 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ed9fb0a9-06cd-495c-b6fa-56e1f5f8b0f9 req-10acdc2b-64a4-4732-872e-51bba0f119f8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 946 time: 0.1307306 Mar 24 02:18:48.682953 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] For port 5b488b4c-3f04-4938-b387-a53b920028a8, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=5b488b4c-3f04-4938-b387-a53b920028a8,segment=NetworkSegment(e5448d4b-b8e7-4934-ac13-fef0780c703c),segment_id=e5448d4b-b8e7-4934-ac13-fef0780c703c)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:48.683210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.696337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Calling delete_port for 5b488b4c-3f04-4938-b387-a53b920028a8 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:48.734051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-774c53c9-a64e-4449-859c-26e5137135ed tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:48.735554 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-774c53c9-a64e-4449-859c-26e5137135ed tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 946 time: 0.1589677 Mar 24 02:18:48.778753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (5b488b4c-3f04-4938-b387-a53b920028a8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.804752 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Port': ['ID=5b488b4c-3f04-4938-b387-a53b920028a8,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:48.808242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No DVR routers for this DVR port 5b488b4c-3f04-4938-b387-a53b920028a8 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:48.808443 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ed9fb0a9-06cd-495c-b6fa-56e1f5f8b0f9 req-bd756df7-0b05-43c6-9f54-3bb6b7b2860c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1519365 Mar 24 02:18:48.839446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aeffacfe-0abb-4400-b913-3079cbe7bbac None None] DHCP port deletion for c4069fde-e378-4094-98fe-405d58aa3139 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:18:48.852595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (9a265075-eb91-4da5-b767-0c6dc1716366), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.902203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:48.902725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.915003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (c4069fde-e378-4094-98fe-405d58aa3139), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.939214 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c4069fde-e378-4094-98fe-405d58aa3139']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:48.949571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (9a265075-eb91-4da5-b767-0c6dc1716366), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.950237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e5448d4b-b8e7-4934-ac13-fef0780c703c') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:48.950578 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e5448d4b-b8e7-4934-ac13-fef0780c703c') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:48.962086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (e5448d4b-b8e7-4934-ac13-fef0780c703c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.975736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e5448d4b-b8e7-4934-ac13-fef0780c703c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.982085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Releasing vlan 114 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:48.982971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (e5448d4b-b8e7-4934-ac13-fef0780c703c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:48.985595 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:49.018500 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 383df69d-c9d6-4f76-a384-f1c5ebdd10fe is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:49.028380 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:49.032545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=9a265075-eb91-4da5-b767-0c6dc1716366,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:49.034730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:49.045652 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (c4069fde-e378-4094-98fe-405d58aa3139), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.054638 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.057885 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/networks/c4069fde-e378-4094-98fe-405d58aa3139 HTTP/1.1" status: 204 len: 168 time: 0.6394391 Mar 24 02:18:49.060500 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33716) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:49.074647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'routes': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:49.077936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c40f4f-7cce-40ea-aa46-8458191b9ef0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Pushing event deleted for resources: {'Network': ['ID=c4069fde-e378-4094-98fe-405d58aa3139,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:49.078220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:49.079084 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.097869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:49.113790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:49.114395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.165495 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4a628c4e-1f9a-4f84-9742-b875f3e244ea tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.0275376 Mar 24 02:18:49.165734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33718) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:49.170235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-cd194cfe-4cf4-4a83-b77a-9024ba74209d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'port_id': '9a265075-eb91-4da5-b767-0c6dc1716366'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:49.224220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd194cfe-4cf4-4a83-b77a-9024ba74209d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (e765f755-f403-41e9-921a-b2add2baeee0), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.242566 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.extraroute_db [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Added routes are [] {{(pid=104036) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Mar 24 02:18:49.242873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.extraroute_db [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Removed routes are [] {{(pid=104036) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Mar 24 02:18:49.243232 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (e6831f90-e567-436b-a709-5ee103af3439), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.389408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (e6831f90-e567-436b-a709-5ee103af3439), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.392734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (e6831f90-e567-436b-a709-5ee103af3439), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.452702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (1ee59cd7-c2ab-4bdd-aae1-75d878279ee1), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.473223 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router e6831f90-e567-436b-a709-5ee103af3439 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:49.487438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=1ee59cd7-c2ab-4bdd-aae1-75d878279ee1,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:49.539009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] No DVR routers for this DVR port 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:49.542488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.546449 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-20d32a2c-7b18-45ca-9b7d-4ff45d876d0f req-1f0022eb-0dfa-4657-a035-9e647187d6aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "DELETE /v2.0/ports/1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 HTTP/1.1" status: 204 len: 173 time: 0.7990181 Mar 24 02:18:49.546954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5', 'name': 'network-vif-deleted', 'tag': '1ee59cd7-c2ab-4bdd-aae1-75d878279ee1'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:18:49.549710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aaa4847a-2a14-4ee1-bcce-b11cbb024ac8" -d '{"events": [{"server_uuid": "8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5", "name": "network-vif-deleted", "tag": "1ee59cd7-c2ab-4bdd-aae1-75d878279ee1"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:18:49.553759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:49.566116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] Sync routers for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:49.567170 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.568354 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-130f4097-630c-41df-bacf-454af4a5e090 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439 HTTP/1.1" status: 200 len: 701 time: 0.5069439 Mar 24 02:18:49.571166 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33722) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:49.582316 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:49.583571 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:49.611899 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8b01fcab-425d-4596-9722-08f5a06788e0 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=e6831f90-e567-436b-a709-5ee103af3439 HTTP/1.1" status: 200 len: 205 time: 0.0396287 Mar 24 02:18:49.614312 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33724) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:49.631611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:18:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc3434fb-859c-4236-829d-9d17921cc713 x-openstack-request-id: req-cc3434fb-859c-4236-829d-9d17921cc713 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:18:49.632335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5", "name": "network-vif-deleted", "tag": "1ee59cd7-c2ab-4bdd-aae1-75d878279ee1", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:18:49.632815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-cc3434fb-859c-4236-829d-9d17921cc713 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:18:49.633439 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cc3434fb-859c-4236-829d-9d17921cc713'] response: {'server_uuid': '8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5', 'name': 'network-vif-deleted', 'tag': '1ee59cd7-c2ab-4bdd-aae1-75d878279ee1', 'status': 'completed', 'code': 200} Mar 24 02:18:49.678802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:49.691693 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b11f6159-256f-494d-945e-fcd08705f162 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (e6831f90-e567-436b-a709-5ee103af3439), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.741195 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:47Z', 'revision_number': 11, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:49.773479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] Checking router: e6831f90-e567-436b-a709-5ee103af3439 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:49.782992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] Routers {'e6831f90-e567-436b-a709-5ee103af3439'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:49.783624 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['e6831f90-e567-436b-a709-5ee103af3439'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:49.861003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b11f6159-256f-494d-945e-fcd08705f162 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (e6831f90-e567-436b-a709-5ee103af3439), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.863300 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b11f6159-256f-494d-945e-fcd08705f162 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (e6831f90-e567-436b-a709-5ee103af3439), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.867460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] Set router e6831f90-e567-436b-a709-5ee103af3439 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:49.934452 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b11f6159-256f-494d-945e-fcd08705f162 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (e6831f90-e567-436b-a709-5ee103af3439), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.935009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b11f6159-256f-494d-945e-fcd08705f162 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Fanout notify agent at l3_agent the message router_deleted on router e6831f90-e567-436b-a709-5ee103af3439 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:18:49.944437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b11f6159-256f-494d-945e-fcd08705f162 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.949414 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b11f6159-256f-494d-945e-fcd08705f162 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439 HTTP/1.1" status: 204 len: 168 time: 0.3302460 Mar 24 02:18:49.951086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33728) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:49.957569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7790f665-7c75-4f4e-87d8-c7341de32bf4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-12799791', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:49.990055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:47Z', 'revision_number': 11, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:49.991724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7790f665-7c75-4f4e-87d8-c7341de32bf4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:49.995067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7790f665-7c75-4f4e-87d8-c7341de32bf4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:50.034426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b308beb5-6b7d-4787-a82b-3791aa9e98d5 None None] The sync data for ids ['e6831f90-e567-436b-a709-5ee103af3439'] in dv-neutron-834874-3-hyperv is: [{'id': 'e6831f90-e567-436b-a709-5ee103af3439', 'name': 'tempest-RoutersTest-router-1347720512', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:08Z', 'updated_at': '2022-03-24T02:18:47Z', 'revision_number': 11, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:50.075535 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7790f665-7c75-4f4e-87d8-c7341de32bf4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:50.085369 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7790f665-7c75-4f4e-87d8-c7341de32bf4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:50.118099 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7790f665-7c75-4f4e-87d8-c7341de32bf4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:50.119384 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7790f665-7c75-4f4e-87d8-c7341de32bf4 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 698 time: 0.1668243 Mar 24 02:18:50.122297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33730) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:50.131732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-cd049db1-fd0e-4de2-8da8-b998236eaf0e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Request body: {'router': {'admin_state_up': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:50.189915 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ecb8ecb7-3ca6-40a5-a8ad-419e6fa772c6 req-69abe84c-6d55-4238-a704-4d3e53a3312d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8ffe40ad-eab1-43c5-bb3b-bc125a62c5e5 HTTP/1.1" status: 200 len: 210 time: 0.1006916 Mar 24 02:18:50.255595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 598fe3d0-0070-459b-95be-d5bd56f20a86 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:50.280765 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 598fe3d0-0070-459b-95be-d5bd56f20a86 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:50.281127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 598fe3d0-0070-459b-95be-d5bd56f20a86 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:50.282532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5b488b4c-3f04-4938-b387-a53b920028a8 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:50.302411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 5b488b4c-3f04-4938-b387-a53b920028a8 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:50.302833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 5b488b4c-3f04-4938-b387-a53b920028a8 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:50.508651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd049db1-fd0e-4de2-8da8-b998236eaf0e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1624275', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1637820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2689'] for router (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:50.523792 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd194cfe-4cf4-4a83-b77a-9024ba74209d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:50.525590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd049db1-fd0e-4de2-8da8-b998236eaf0e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1624282', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1624097', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1637771'] for router (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:50.528814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd194cfe-4cf4-4a83-b77a-9024ba74209d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (e765f755-f403-41e9-921a-b2add2baeee0), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:50.704093 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-cd194cfe-4cf4-4a83-b77a-9024ba74209d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP e765f755-f403-41e9-921a-b2add2baeee0 associated. External IP: 172.26.2.189, port: 9a265075-eb91-4da5-b767-0c6dc1716366. Mar 24 02:18:50.738022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd049db1-fd0e-4de2-8da8-b998236eaf0e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Router 41fa49a4-7199-44f7-aa5a-14a53a4e81fc is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:18:50.860421 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd049db1-fd0e-4de2-8da8-b998236eaf0e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:50.867882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd049db1-fd0e-4de2-8da8-b998236eaf0e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:50.869016 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cd049db1-fd0e-4de2-8da8-b998236eaf0e tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "PUT /v2.0/routers/41fa49a4-7199-44f7-aa5a-14a53a4e81fc HTTP/1.1" status: 200 len: 692 time: 0.7436426 Mar 24 02:18:50.869391 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] Sync routers for ids ['41fa49a4-7199-44f7-aa5a-14a53a4e81fc'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:50.871728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33732) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:50.881854 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] Routers {'41fa49a4-7199-44f7-aa5a-14a53a4e81fc'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:50.882474 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['41fa49a4-7199-44f7-aa5a-14a53a4e81fc'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:50.952892 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] Set router 41fa49a4-7199-44f7-aa5a-14a53a4e81fc gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:50.957665 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4390a904-95b9-4a17-9268-c7a0c6bc94b3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/routers/41fa49a4-7199-44f7-aa5a-14a53a4e81fc HTTP/1.1" status: 200 len: 698 time: 0.0823092 Mar 24 02:18:50.958015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33734) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:50.995017 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4f0394d6-3198-4d63-87f9-5cc64f4edd5c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=41fa49a4-7199-44f7-aa5a-14a53a4e81fc HTTP/1.1" status: 200 len: 205 time: 0.0358605 Mar 24 02:18:50.997620 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33736) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:51.013057 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '41fa49a4-7199-44f7-aa5a-14a53a4e81fc', 'name': 'tempest-RoutersTest-router-12799791', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:50Z', 'updated_at': '2022-03-24T02:18:50Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:51.020442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd194cfe-4cf4-4a83-b77a-9024ba74209d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:51.042863 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:18:51.043749 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] Checking router: 41fa49a4-7199-44f7-aa5a-14a53a4e81fc for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:51.053448 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] Routers {'41fa49a4-7199-44f7-aa5a-14a53a4e81fc'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:51.054128 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['41fa49a4-7199-44f7-aa5a-14a53a4e81fc'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:51.078154 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-02df6795-98ef-46bf-8d08-fb2b3c016ea2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.127526 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] Set router 41fa49a4-7199-44f7-aa5a-14a53a4e81fc gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:51.144869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd194cfe-4cf4-4a83-b77a-9024ba74209d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:51.149373 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cd194cfe-4cf4-4a83-b77a-9024ba74209d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.155751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dce333fb-04b4-44a0-8fde-87dbe07aa98c None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:51.174374 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dce333fb-04b4-44a0-8fde-87dbe07aa98c None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:51.175263 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-dce333fb-04b4-44a0-8fde-87dbe07aa98c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:51.185306 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cd194cfe-4cf4-4a83-b77a-9024ba74209d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/floatingips/e765f755-f403-41e9-921a-b2add2baeee0 HTTP/1.1" status: 200 len: 978 time: 2.0162842 Mar 24 02:18:51.185527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33738) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:51.190306 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '41fa49a4-7199-44f7-aa5a-14a53a4e81fc', 'name': 'tempest-RoutersTest-router-12799791', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:50Z', 'updated_at': '2022-03-24T02:18:50Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:51.224224 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4aad5219-c6a2-4ae1-b8d7-4cfb9569ed68 None None] The sync data for ids ['41fa49a4-7199-44f7-aa5a-14a53a4e81fc'] in dv-neutron-834874-3-hyperv is: [{'id': '41fa49a4-7199-44f7-aa5a-14a53a4e81fc', 'name': 'tempest-RoutersTest-router-12799791', 'tenant_id': '6efecbddf1644634a26bf8ef5221c9e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:50Z', 'updated_at': '2022-03-24T02:18:50Z', 'revision_number': 2, 'project_id': '6efecbddf1644634a26bf8ef5221c9e1', 'gw_port_host': None}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:51.227858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-dce333fb-04b4-44a0-8fde-87dbe07aa98c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:51.240433 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dce333fb-04b4-44a0-8fde-87dbe07aa98c None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:51.241074 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-dce333fb-04b4-44a0-8fde-87dbe07aa98c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:51.270398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33742) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:51.363011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c3125e03-b134-495a-b6e8-a1648393f298 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.366378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port 9a265075-eb91-4da5-b767-0c6dc1716366 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:51.366819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9a265075-eb91-4da5-b767-0c6dc1716366), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.457532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-dce333fb-04b4-44a0-8fde-87dbe07aa98c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:51.458245 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dce333fb-04b4-44a0-8fde-87dbe07aa98c None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:51.460119 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c3125e03-b134-495a-b6e8-a1648393f298 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.530231 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9a265075-eb91-4da5-b767-0c6dc1716366), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.584573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-02df6795-98ef-46bf-8d08-fb2b3c016ea2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.586736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-02df6795-98ef-46bf-8d08-fb2b3c016ea2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router_controller (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.629246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-02df6795-98ef-46bf-8d08-fb2b3c016ea2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (41fa49a4-7199-44f7-aa5a-14a53a4e81fc), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.629742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02df6795-98ef-46bf-8d08-fb2b3c016ea2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Fanout notify agent at l3_agent the message router_deleted on router 41fa49a4-7199-44f7-aa5a-14a53a4e81fc {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:18:51.638161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-02df6795-98ef-46bf-8d08-fb2b3c016ea2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.639493 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-02df6795-98ef-46bf-8d08-fb2b3c016ea2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/41fa49a4-7199-44f7-aa5a-14a53a4e81fc HTTP/1.1" status: 204 len: 168 time: 0.6409137 Mar 24 02:18:51.644119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33744) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:51.668011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c3125e03-b134-495a-b6e8-a1648393f298 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.671044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c3125e03-b134-495a-b6e8-a1648393f298 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:51.672220 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c3125e03-b134-495a-b6e8-a1648393f298 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/security-groups/6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7 HTTP/1.1" status: 204 len: 168 time: 0.4007452 Mar 24 02:18:51.673696 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9ce78013-3ec5-487b-8662-e15031137ef8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=41fa49a4-7199-44f7-aa5a-14a53a4e81fc HTTP/1.1" status: 200 len: 205 time: 0.0280559 Mar 24 02:18:51.675596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33748) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:51.709016 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33750) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:51.718369 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-bd8db50f-e5ad-42bb-8fe9-d9bb74209b58 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] delete failed (client error): The resource could not be found. Mar 24 02:18:51.722314 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bd8db50f-e5ad-42bb-8fe9-d9bb74209b58 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/41fa49a4-7199-44f7-aa5a-14a53a4e81fc HTTP/1.1" status: 404 len: 336 time: 0.0431650 Mar 24 02:18:51.722610 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33752) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:51.748712 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-14372925-c612-4e97-9b49-0c3ac2980ac2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:51.749161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-14372925-c612-4e97-9b49-0c3ac2980ac2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:51.751177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3125e03-b134-495a-b6e8-a1648393f298 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6da3fdc0-51b7-4427-b5b4-d4fcd5fce6a7,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:51.754658 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-14372925-c612-4e97-9b49-0c3ac2980ac2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/d2fb3747-7322-42ce-834a-9f72be9b98b6 HTTP/1.1" status: 404 len: 337 time: 0.0287862 Mar 24 02:18:51.760861 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33754) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.127268 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-41c08843-4f6f-4e48-ba47-c1edecf6a038 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:52.127739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-41c08843-4f6f-4e48-ba47-c1edecf6a038 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:52.130797 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-41c08843-4f6f-4e48-ba47-c1edecf6a038 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/cbb1e7cb-f6d0-4ac2-8785-ef42e9ebb7dd HTTP/1.1" status: 404 len: 337 time: 0.3676987 Mar 24 02:18:52.133563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33756) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.145744 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-35d94cce-3ef5-4ca5-8d9d-dada8fe44dc3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting subnet 47e13ca4-a1b5-4f9e-95ce-b93533455f10 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:18:52.150098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35d94cce-3ef5-4ca5-8d9d-dada8fe44dc3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (47e13ca4-a1b5-4f9e-95ce-b93533455f10), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.160083 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-d2f71c21-9b2e-49c1-96df-eae3187e049c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:52.160632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d2f71c21-9b2e-49c1-96df-eae3187e049c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:52.165943 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d2f71c21-9b2e-49c1-96df-eae3187e049c tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/174226f3-58df-4f34-8172-0281943babb1 HTTP/1.1" status: 404 len: 337 time: 0.0291164 Mar 24 02:18:52.166243 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33758) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.188958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.189325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (e765f755-f403-41e9-921a-b2add2baeee0), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.189639 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP e765f755-f403-41e9-921a-b2add2baeee0 disassociated. External IP: 172.26.2.189, port: 9a265075-eb91-4da5-b767-0c6dc1716366. Mar 24 02:18:52.189987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for 9a265075-eb91-4da5-b767-0c6dc1716366 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:52.193752 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-cc0fe760-0e80-4c70-8a6e-0f8b8cf99a88 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:52.194182 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cc0fe760-0e80-4c70-8a6e-0f8b8cf99a88 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:52.198427 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cc0fe760-0e80-4c70-8a6e-0f8b8cf99a88 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/0ab02836-20c6-4f02-8006-9965fb6ba43b HTTP/1.1" status: 404 len: 337 time: 0.0302198 Mar 24 02:18:52.200072 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33760) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.208983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35d94cce-3ef5-4ca5-8d9d-dada8fe44dc3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (47e13ca4-a1b5-4f9e-95ce-b93533455f10), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.229771 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0a11dade-f423-412c-86b3-6e253a6efa73 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=e6831f90-e567-436b-a709-5ee103af3439 HTTP/1.1" status: 200 len: 205 time: 0.0263805 Mar 24 02:18:52.230092 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33762) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.272874 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-b6103b05-f694-4794-a736-9023a45fb05f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] delete failed (client error): The resource could not be found. Mar 24 02:18:52.274019 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b6103b05-f694-4794-a736-9023a45fb05f tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/e6831f90-e567-436b-a709-5ee103af3439 HTTP/1.1" status: 404 len: 336 time: 0.0429516 Mar 24 02:18:52.276845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33764) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.307681 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9e2c269b-aaed-4e48-b0b0-184920da42db tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=17fb882c-6eff-4650-ba6f-c10c720662b6 HTTP/1.1" status: 200 len: 205 time: 0.0293319 Mar 24 02:18:52.310115 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33766) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.351879 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-57687e03-30ea-43db-b839-8dc4b5516eb3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] delete failed (client error): The resource could not be found. Mar 24 02:18:52.352909 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-57687e03-30ea-43db-b839-8dc4b5516eb3 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/17fb882c-6eff-4650-ba6f-c10c720662b6 HTTP/1.1" status: 404 len: 336 time: 0.0417457 Mar 24 02:18:52.355555 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33768) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.355961 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35d94cce-3ef5-4ca5-8d9d-dada8fe44dc3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (47e13ca4-a1b5-4f9e-95ce-b93533455f10), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.381675 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-ebbb5263-0f20-45f5-866e-5778760fec4a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:52.382113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ebbb5263-0f20-45f5-866e-5778760fec4a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:52.385059 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ebbb5263-0f20-45f5-866e-5778760fec4a tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/9f9fea3e-31d0-443c-a06b-ff1b47b07b4c HTTP/1.1" status: 404 len: 337 time: 0.0285916 Mar 24 02:18:52.387705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33770) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.413995 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9c9265d1-fc8d-4555-8337-089cb72acd90 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=8f5947fe-add3-477c-9328-aaba7d270bfd HTTP/1.1" status: 200 len: 205 time: 0.0252483 Mar 24 02:18:52.416505 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33772) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.449293 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (9a265075-eb91-4da5-b767-0c6dc1716366), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.460787 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-32629048-871d-46d2-8f21-accae2ef43cd tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] delete failed (client error): The resource could not be found. Mar 24 02:18:52.462314 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-32629048-871d-46d2-8f21-accae2ef43cd tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/8f5947fe-add3-477c-9328-aaba7d270bfd HTTP/1.1" status: 404 len: 336 time: 0.0447061 Mar 24 02:18:52.464978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33774) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.483738 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35d94cce-3ef5-4ca5-8d9d-dada8fe44dc3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (47e13ca4-a1b5-4f9e-95ce-b93533455f10), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.494175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=9a265075-eb91-4da5-b767-0c6dc1716366,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:52.499036 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-52c25c45-7f69-425d-b79a-d9c506809bd1 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=e327e313-0127-4476-b533-24ce9c089768 HTTP/1.1" status: 200 len: 205 time: 0.0307837 Mar 24 02:18:52.499421 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33776) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.523614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35d94cce-3ef5-4ca5-8d9d-dada8fe44dc3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Subnet': ['ID=47e13ca4-a1b5-4f9e-95ce-b93533455f10,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:52.530457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-35d94cce-3ef5-4ca5-8d9d-dada8fe44dc3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.534303 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-35d94cce-3ef5-4ca5-8d9d-dada8fe44dc3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/subnets/47e13ca4-a1b5-4f9e-95ce-b93533455f10 HTTP/1.1" status: 204 len: 168 time: 0.8203979 Mar 24 02:18:52.537172 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-a2a1a04f-8683-4aa4-9aba-8c0e49e1b0dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] delete failed (client error): The resource could not be found. Mar 24 02:18:52.540492 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a2a1a04f-8683-4aa4-9aba-8c0e49e1b0dc tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/e327e313-0127-4476-b533-24ce9c089768 HTTP/1.1" status: 404 len: 336 time: 0.0379882 Mar 24 02:18:52.540492 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33778) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.540751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf1542a3-7ac6-4077-b002-d555d2fc6df9 None None] Network 0a3a0bb4-4db4-4907-a006-67d97a634086 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:52.546485 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33780) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.617951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:52.621973 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-d4499203-3eb2-45ba-a374-7bba73562055 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:52.622423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d4499203-3eb2-45ba-a374-7bba73562055 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:52.627895 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d4499203-3eb2-45ba-a374-7bba73562055 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/f3841d7d-4008-4e44-9c89-698d071245fa HTTP/1.1" status: 404 len: 337 time: 0.0764267 Mar 24 02:18:52.628369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33782) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.645998 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:52.646337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 1ee59cd7-c2ab-4bdd-aae1-75d878279ee1 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:52.650511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (0a3a0bb4-4db4-4907-a006-67d97a634086), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.661635 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-75a8ed8a-c768-40f4-b0d4-de61ef30a399 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=4055f920-3ed7-429b-9e41-efea495aba65 HTTP/1.1" status: 200 len: 205 time: 0.0319304 Mar 24 02:18:52.664275 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33784) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.676883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:52.722341 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-5d5f6e5d-063f-456e-aea5-9d9a171145a2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] delete failed (client error): The resource could not be found. Mar 24 02:18:52.723450 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5d5f6e5d-063f-456e-aea5-9d9a171145a2 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/4055f920-3ed7-429b-9e41-efea495aba65 HTTP/1.1" status: 404 len: 336 time: 0.0578563 Mar 24 02:18:52.727318 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33786) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.731212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-568a9a16-f498-4409-849e-cd19c08cb15f None None] DHCP port deletion for 0a3a0bb4-4db4-4907-a006-67d97a634086 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:18:52.763474 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-e2dbb075-8e8c-4fca-83e2-69b8f5512939 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:52.764082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e2dbb075-8e8c-4fca-83e2-69b8f5512939 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:52.767877 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e2dbb075-8e8c-4fca-83e2-69b8f5512939 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/f2aeac0d-b287-4804-8bc6-c924f575a396 HTTP/1.1" status: 404 len: 337 time: 0.0382602 Mar 24 02:18:52.770469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33788) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.786283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-568a9a16-f498-4409-849e-cd19c08cb15f None None] Deleting port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:52.787287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-568a9a16-f498-4409-849e-cd19c08cb15f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.801232 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:52.802783 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-71b9284e-9650-42f7-baf3-f2503c0da187 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "GET /v2.0/ports?device_id=f61a0f8a-856d-44d1-b428-62e6b517c4c8 HTTP/1.1" status: 200 len: 205 time: 0.0310752 Mar 24 02:18:52.805096 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33790) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.816345 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00b084ae-538b-4077-bc5d-c12358056fe1 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:52.819423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:52.819775 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.833483 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00b084ae-538b-4077-bc5d-c12358056fe1 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:52.834855 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-00b084ae-538b-4077-bc5d-c12358056fe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:52.865957 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-5126ac17-6d05-43ed-ae0b-9109063fbda8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] delete failed (client error): The resource could not be found. Mar 24 02:18:52.867182 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5126ac17-6d05-43ed-ae0b-9109063fbda8 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/routers/f61a0f8a-856d-44d1-b428-62e6b517c4c8 HTTP/1.1" status: 404 len: 336 time: 0.0609288 Mar 24 02:18:52.867566 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-568a9a16-f498-4409-849e-cd19c08cb15f None None] For port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:52.867980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-568a9a16-f498-4409-849e-cd19c08cb15f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.870479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33792) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.882089 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-00b084ae-538b-4077-bc5d-c12358056fe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:52.884098 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-568a9a16-f498-4409-849e-cd19c08cb15f None None] Calling delete_port for 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:52.893241 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00b084ae-538b-4077-bc5d-c12358056fe1 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:52.894121 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-00b084ae-538b-4077-bc5d-c12358056fe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:52.900793 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e,segment=NetworkSegment(14f47a5d-c68c-4d67-a6e3-4402aa07610f),segment_id=14f47a5d-c68c-4d67-a6e3-4402aa07610f)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:52.901163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.917081 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:52.917717 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-344aa074-e1c6-4d20-be5b-8bf51b295699 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:52.918280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-344aa074-e1c6-4d20-be5b-8bf51b295699 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:52.921431 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-344aa074-e1c6-4d20-be5b-8bf51b295699 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/03b7d30a-5d44-4916-9c45-ac41eaae3a7f HTTP/1.1" status: 404 len: 337 time: 0.0499108 Mar 24 02:18:52.925840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33794) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:52.938295 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-00b084ae-538b-4077-bc5d-c12358056fe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:52.939407 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00b084ae-538b-4077-bc5d-c12358056fe1 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:52.957301 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-d138e4c6-5627-4e22-b9bd-c50309ad1376 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] DELETE failed (client error): The resource could not be found. Mar 24 02:18:52.957790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d138e4c6-5627-4e22-b9bd-c50309ad1376 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:18:52.963417 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d138e4c6-5627-4e22-b9bd-c50309ad1376 tempest-RoutersTest-1900858480 tempest-RoutersTest-1900858480-project] 10.222.0.20 "DELETE /v2.0/subnets/8d3c3070-7bf8-454a-81a0-f94828e5d1b4 HTTP/1.1" status: 404 len: 337 time: 0.0343480 Mar 24 02:18:52.971741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-568a9a16-f498-4409-849e-cd19c08cb15f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.979775 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:52.986663 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dc0b724e-18eb-4741-9e6d-e8f1a9a7a0e6 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/ports/9a265075-eb91-4da5-b767-0c6dc1716366 HTTP/1.1" status: 204 len: 168 time: 1.8000004 Mar 24 02:18:52.987343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33798) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:53.002010 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-568a9a16-f498-4409-849e-cd19c08cb15f None None] Pushing event deleted for resources: {'Port': ['ID=78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:53.007718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-568a9a16-f498-4409-849e-cd19c08cb15f None None] No DVR routers for this DVR port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:53.039554 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-80e232cd-a8df-4ba1-ae73-4e8d2b2f3e26 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "GET /v2.0/floatingips/e765f755-f403-41e9-921a-b2add2baeee0 HTTP/1.1" status: 200 len: 688 time: 0.0511017 Mar 24 02:18:53.043435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33800) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:53.052992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.109675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:53.149795 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] No DVR routers for this DVR port 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:53.249220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33804) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:53.252592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (0a3a0bb4-4db4-4907-a006-67d97a634086), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.275770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0a3a0bb4-4db4-4907-a006-67d97a634086']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:53.289391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '14f47a5d-c68c-4d67-a6e3-4402aa07610f') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:53.289684 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '14f47a5d-c68c-4d67-a6e3-4402aa07610f') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:53.297055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port 1cf44067-e1cd-42d7-ac00-ddc98f728b34 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:53.297386 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1cf44067-e1cd-42d7-ac00-ddc98f728b34), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.301890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (14f47a5d-c68c-4d67-a6e3-4402aa07610f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.355061 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (14f47a5d-c68c-4d67-a6e3-4402aa07610f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.364251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Releasing vlan 110 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:18:53.364630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (14f47a5d-c68c-4d67-a6e3-4402aa07610f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:18:53.367496 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:18:53.381418 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-43ba9b1e-d4f6-4f32-8562-ee6a67c3d18e admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=6efecbddf1644634a26bf8ef5221c9e1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1310339 Mar 24 02:18:53.384142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33808) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:53.435999 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54ce2906-8687-4db1-ae16-afd6bbcd6996 admin admin] Publish callbacks [] for security_group (ce27d226-d193-4136-9669-e00f6d2aeb5c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.442964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (0a3a0bb4-4db4-4907-a006-67d97a634086), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.445550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1cf44067-e1cd-42d7-ac00-ddc98f728b34), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.445886 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (1cf44067-e1cd-42d7-ac00-ddc98f728b34), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.460448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54ce2906-8687-4db1-ae16-afd6bbcd6996 admin admin] Publish callbacks [] for security_group (ce27d226-d193-4136-9669-e00f6d2aeb5c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.464004 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.467272 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/networks/0a3a0bb4-4db4-4907-a006-67d97a634086 HTTP/1.1" status: 204 len: 168 time: 0.9275632 Mar 24 02:18:53.470835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33810) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:53.481747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62e912dc-b023-4e11-b10a-ad3ae6556d34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Network': ['ID=0a3a0bb4-4db4-4907-a006-67d97a634086,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:53.483738 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for 1cf44067-e1cd-42d7-ac00-ddc98f728b34 owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:53.592464 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54ce2906-8687-4db1-ae16-afd6bbcd6996 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (ce27d226-d193-4136-9669-e00f6d2aeb5c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.595236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54ce2906-8687-4db1-ae16-afd6bbcd6996 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.596390 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-54ce2906-8687-4db1-ae16-afd6bbcd6996 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/ce27d226-d193-4136-9669-e00f6d2aeb5c HTTP/1.1" status: 204 len: 168 time: 0.2113237 Mar 24 02:18:53.613793 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54ce2906-8687-4db1-ae16-afd6bbcd6996 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce27d226-d193-4136-9669-e00f6d2aeb5c,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:53.645045 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (1cf44067-e1cd-42d7-ac00-ddc98f728b34), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.660663 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 05627719-647a-445d-9114-ab2629d1d724 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:53.661093 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (05627719-647a-445d-9114-ab2629d1d724), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.676246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=1cf44067-e1cd-42d7-ac00-ddc98f728b34,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:53.741803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (e765f755-f403-41e9-921a-b2add2baeee0), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.744745 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.745764 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (05627719-647a-445d-9114-ab2629d1d724), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.746093 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (05627719-647a-445d-9114-ab2629d1d724), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.750967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33816) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:53.751116 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fe2b3d35-4f9b-451d-ac41-03ef05d4ed6a tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/floatingips/e765f755-f403-41e9-921a-b2add2baeee0 HTTP/1.1" status: 204 len: 168 time: 0.7066088 Mar 24 02:18:53.761001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '0e8c22c9-70ad-4c3f-b2a4-f20c99a95528'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:53.773309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 05627719-647a-445d-9114-ab2629d1d724 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:53.792542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:53.995819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.048675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (05627719-647a-445d-9114-ab2629d1d724), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.083754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=05627719-647a-445d-9114-ab2629d1d724,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:54.183176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.26.2.197 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/af2fb0b6-f9b7-432a-afad-cab1a5afa8bc) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:54.185284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (774a5962-6c17-496b-8d49-ec290d2538c5), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.185624 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP 774a5962-6c17-496b-8d49-ec290d2538c5 disassociated (deleted). External IP: 172.26.2.10, port: 79123375-136b-4c1b-ba67-948e46e33a7c. Mar 24 02:18:54.246960 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:18:54.272642 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:18:54.273340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 78cf6f5b-110a-4f76-bb4c-f9ec34b19d4e not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:18:54.287043 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33834) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:54.293385 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [-] 10.222.0.20 "GET / HTTP/1.1" status: 200 len: 248 time: 0.0049937 Mar 24 02:18:54.294214 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33836) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:54.392894 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ba3e187a-fdfa-4b5f-95ca-99a716e11dd5 tempest-NetworksApiDiscovery-1581025788 tempest-NetworksApiDiscovery-1581025788-project] 10.222.0.20 "GET /v2.0/ HTTP/1.1" status: 200 len: 702 time: 0.0975220 Mar 24 02:18:54.405190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (af2fb0b6-f9b7-432a-afad-cab1a5afa8bc), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.492203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (af2fb0b6-f9b7-432a-afad-cab1a5afa8bc), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.527237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 1f63a954-e411-4138-b423-94a29a3b7505 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:54.539227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:54.548187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:54.550694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:54.553846 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=af2fb0b6-f9b7-432a-afad-cab1a5afa8bc,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:54.645002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33844) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:54.744322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:54.751697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff46a84e-cef2-4fe7-81e7-a0ee78ed4ea2 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.754022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.755604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] Sync routers for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:54.768457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:54.769257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:54.835665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff46a84e-cef2-4fe7-81e7-a0ee78ed4ea2 admin admin] Publish callbacks [] for security_group (9ae85407-ae88-44b8-abca-093b898af01b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.840947 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff46a84e-cef2-4fe7-81e7-a0ee78ed4ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (9ae85407-ae88-44b8-abca-093b898af01b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.844562 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-85e18201-c39c-4104-8ddb-211cac5280ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/floatingips/774a5962-6c17-496b-8d49-ec290d2538c5 HTTP/1.1" status: 204 len: 168 time: 1.3727067 Mar 24 02:18:54.846804 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:18:54.849103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd5e4530-30a1-4fd7-99cf-63c332665efa" -d '{"events": [{"name": "network-changed", "server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:18:54.888316 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ff46a84e-cef2-4fe7-81e7-a0ee78ed4ea2 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=d5a5c33804e2499893c132769f3f0704&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2419419 Mar 24 02:18:54.889095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33852) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:54.921474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff46a84e-cef2-4fe7-81e7-a0ee78ed4ea2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ae85407-ae88-44b8-abca-093b898af01b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:54.922722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:54.964207 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-119ff98a-429d-44e3-b8d7-9f23d9d15bf6 admin admin] Publish callbacks [] for security_group (9ae85407-ae88-44b8-abca-093b898af01b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:54.991291 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-119ff98a-429d-44e3-b8d7-9f23d9d15bf6 admin admin] Publish callbacks [] for security_group (9ae85407-ae88-44b8-abca-093b898af01b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:55.063774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-119ff98a-429d-44e3-b8d7-9f23d9d15bf6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (9ae85407-ae88-44b8-abca-093b898af01b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:55.070501 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-119ff98a-429d-44e3-b8d7-9f23d9d15bf6 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:55.077533 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-119ff98a-429d-44e3-b8d7-9f23d9d15bf6 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/9ae85407-ae88-44b8-abca-093b898af01b HTTP/1.1" status: 204 len: 168 time: 0.1811666 Mar 24 02:18:55.085756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119ff98a-429d-44e3-b8d7-9f23d9d15bf6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ae85407-ae88-44b8-abca-093b898af01b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:55.188675 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:18:45Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:55.225458 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] Checking router: 1f63a954-e411-4138-b423-94a29a3b7505 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:55.235029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:55.235819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:55.348718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:55.400104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:18:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5699a8b5-d5b7-4bed-bdef-4cfa52cac23c x-openstack-request-id: req-5699a8b5-d5b7-4bed-bdef-4cfa52cac23c {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:18:55.400395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:18:55.400651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-5699a8b5-d5b7-4bed-bdef-4cfa52cac23c {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:18:55.401055 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-5699a8b5-d5b7-4bed-bdef-4cfa52cac23c'] response: {'name': 'network-changed', 'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c', 'status': 'completed', 'code': 200} Mar 24 02:18:55.505806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (d3cbb102-fe06-4e79-8e5e-9295bc55ca72), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:55.518449 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5028a188-b261-49b9-865a-46878d6d30cc req-3285b725-631d-4e67-9af1-bbcac87b309d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:55.519986 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5028a188-b261-49b9-865a-46878d6d30cc req-3285b725-631d-4e67-9af1-bbcac87b309d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 945 time: 0.1240942 Mar 24 02:18:55.539872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-ed8922b4-a580-48f3-8bcb-08961a88e73e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:55.541383 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-ed8922b4-a580-48f3-8bcb-08961a88e73e service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 1129 time: 0.1433511 Mar 24 02:18:55.572035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:18:45Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:55.598412 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7af37af3-7513-4683-87ec-245af5e985bb None None] The sync data for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv is: [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:18:45Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '7b1d481b-3bfa-4756-b24a-0449c4204f8c', 'name': '', 'network_id': '4ce8d77b-f4f5-4987-9cce-04a12234cd5d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:ce:fc:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '852aacbf-87d9-49af-b73c-786b9253307e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:31Z', 'updated_at': '2022-03-24T02:15:43Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '852aacbf-87d9-49af-b73c-786b9253307e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:55.699550 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5028a188-b261-49b9-865a-46878d6d30cc req-d31210e2-78c7-4188-bbb0-25d6701cb279 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1556513 Mar 24 02:18:55.702278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (af2fb0b6-f9b7-432a-afad-cab1a5afa8bc), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:55.763733 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-e906e76b-f4ba-4c66-b9f9-8985f983af71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:55.765378 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-e906e76b-f4ba-4c66-b9f9-8985f983af71 service neutron] 10.222.0.30 "GET /v2.0/networks?id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d HTTP/1.1" status: 200 len: 897 time: 0.2094126 Mar 24 02:18:55.797703 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33876) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:55.846139 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-75094849-8491-49ae-bb09-ec0c6dedae7e service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=79123375-136b-4c1b-ba67-948e46e33a7c HTTP/1.1" status: 200 len: 217 time: 0.0731235 Mar 24 02:18:55.913572 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3135b43e-b5d9-4a0d-bcca-27a0c68cc885 None None] New status for floating IP 774a5962-6c17-496b-8d49-ec290d2538c5: DOWN {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:18:55.919586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-87137205-network', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:55.920228 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-c1e93c78-23f0-433b-beaf-31b35623e407 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:55.922214 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-c1e93c78-23f0-433b-beaf-31b35623e407 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=852aacbf-87d9-49af-b73c-786b9253307e HTTP/1.1" status: 200 len: 835 time: 0.0693922 Mar 24 02:18:55.940337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Made reservation on behalf of 534ec00707834d9cbfb4f670cfeda590 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:55.942924 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:55.951749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.008353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (af2fb0b6-f9b7-432a-afad-cab1a5afa8bc), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.014026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (af2fb0b6-f9b7-432a-afad-cab1a5afa8bc), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.025858 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-550bc846-f62e-4be6-8680-8ac8c3aa1f95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:56.027422 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-550bc846-f62e-4be6-8680-8ac8c3aa1f95 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=4ce8d77b-f4f5-4987-9cce-04a12234cd5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0966268 Mar 24 02:18:56.034412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Publish callbacks [] for security_group (e6255aad-3437-474a-958e-6d538ee75a4c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.038883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e6255aad-3437-474a-958e-6d538ee75a4c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.059711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 111} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:18:56.073357 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6255aad-3437-474a-958e-6d538ee75a4c,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:56.078505 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (cd8dc1cb-883d-457f-8089-73af87a1a574), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.078869 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Added segment cd8dc1cb-883d-457f-8089-73af87a1a574 of type vlan for network 1c7b4ca8-c501-4e72-9eba-3ca17999702e Mar 24 02:18:56.091540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.091872 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.092217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.092553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.092882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.093212 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.093559 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.094408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.094750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.095072 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.095394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.095710 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.096027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.096357 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.096657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:56.146905 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (1c7b4ca8-c501-4e72-9eba-3ca17999702e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.147368 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=af2fb0b6-f9b7-432a-afad-cab1a5afa8bc,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:56.165414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (d3cbb102-fe06-4e79-8e5e-9295bc55ca72), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.174742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (1c7b4ca8-c501-4e72-9eba-3ca17999702e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.175717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:56.176402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.251065 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.4493742 Mar 24 02:18:56.254104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33880) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:56.263599 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Request body: {'subnet': {'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-87137205-subnet', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'ip_version': 4}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:56.267654 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-6683a40b-9e80-493d-823b-1eadb3173578 service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2182372 Mar 24 02:18:56.271753 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a520d3a2-73b0-4f5b-afa2-9229e5e625f4 admin admin] Pushing event updated for resources: {'Network': ['ID=1c7b4ca8-c501-4e72-9eba-3ca17999702e,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:56.281835 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:18:56.288713 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Made reservation on behalf of 534ec00707834d9cbfb4f670cfeda590 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:56.291832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.343728 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP d3cbb102-fe06-4e79-8e5e-9295bc55ca72 associated. External IP: 172.26.2.197, port: 0e8c22c9-70ad-4c3f-b2a4-f20c99a95528. Mar 24 02:18:56.463345 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dd5e4530-30a1-4fd7-99cf-63c332665efa req-bf72c45d-97bc-48e7-9bda-f52621b32fc9 service neutron] 10.222.0.30 "GET /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1869435 Mar 24 02:18:56.472662 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (7098e0b3-a3e5-4826-921e-69dc9ba94ef6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.529668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Pushing event updated for resources: {'Subnet': ['ID=7098e0b3-a3e5-4826-921e-69dc9ba94ef6,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:56.539671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Checking segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:56.540030 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Network hostable DHCP agents. Network: 1c7b4ca8-c501-4e72-9eba-3ca17999702e, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:18:56.556796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:18:56.565726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 1c7b4ca8-c501-4e72-9eba-3ca17999702e) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:56.569993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:56.570732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.575474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d67eb79-ab84-47e3-932f-1179c5e3e938 None None] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:56.591396 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-83ebfc19-6da0-4b06-9978-62ddb2fa46cf admin admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3366032 Mar 24 02:18:56.593972 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33882) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:56.598167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:56.609236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:18:56.620364 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (d9d90a22-1adf-4945-a625-094e279f17a1), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.621643 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (d9d90a22-1adf-4945-a625-094e279f17a1), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.690788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:18:56.691768 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.694468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks [] for router_controller (d9d90a22-1adf-4945-a625-094e279f17a1), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.736387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:56.756142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.763273 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b0d9f9d-fe7f-4125-a81b-173d0abeebdf None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:56.787974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b0d9f9d-fe7f-4125-a81b-173d0abeebdf None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:56.788934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1b0d9f9d-fe7f-4125-a81b-173d0abeebdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:56.832117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1b0d9f9d-fe7f-4125-a81b-173d0abeebdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:56.852715 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1b0d03bf-cce1-489f-baa8-287df81deeab tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 3.0983093 Mar 24 02:18:56.853302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33886) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:56.858720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-510897143'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:56.867701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b0d9f9d-fe7f-4125-a81b-173d0abeebdf None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:56.868256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1b0d9f9d-fe7f-4125-a81b-173d0abeebdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:56.869922 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks [] for router_gateway (d9d90a22-1adf-4945-a625-094e279f17a1), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.895518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-dd8341ff-c324-43a2-bce0-ce3643602de1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:56.897005 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-dd8341ff-c324-43a2-bce0-ce3643602de1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 945 time: 0.1370847 Mar 24 02:18:56.904055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1b0d9f9d-fe7f-4125-a81b-173d0abeebdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:56.904663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b0d9f9d-fe7f-4125-a81b-173d0abeebdf None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:18:56.919906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Allocated IP 172.20.0.2 (1c7b4ca8-c501-4e72-9eba-3ca17999702e/7098e0b3-a3e5-4826-921e-69dc9ba94ef6/9290aaff-5709-409c-b6ed-11dc73f0c4e0) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:56.923251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe0203f-b594-4c22-a10b-608d1d67631d req-2cb133b6-1a61-437d-a262-425fd6f5a1fe tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:56.924773 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ebe0203f-b594-4c22-a10b-608d1d67631d req-2cb133b6-1a61-437d-a262-425fd6f5a1fe tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 945 time: 0.1361461 Mar 24 02:18:56.943777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Made reservation on behalf of 4f11674605a349f28f6886bf409a1207 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:56.947848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:56.996738 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 147} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:18:57.056971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0a6883c1-76e7-41d1-a530-50a73c5242ad), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.057307 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Added segment 0a6883c1-76e7-41d1-a530-50a73c5242ad of type vlan for network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 Mar 24 02:18:57.072858 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ebe0203f-b594-4c22-a10b-608d1d67631d req-35767d46-c654-4907-835f-3a95c7f1b0b9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=18484e4b-fd02-4452-91f3-85188a2c27cc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1300402 Mar 24 02:18:57.079645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Publish callbacks [] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.086235 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks [] for router_gateway (d9d90a22-1adf-4945-a625-094e279f17a1), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.086734 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.110395 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.125536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.126755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:57.129830 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:57.135069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 79123375-136b-4c1b-ba67-948e46e33a7c {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:18:57.135432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:57.135810 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.143577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Pushing event updated for resources: {'Port': ['ID=9290aaff-5709-409c-b6ed-11dc73f0c4e0,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:57.170168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.170287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.170609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.170951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.171286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.171617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.171978 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.172305 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.172630 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.172957 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.173283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.173669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.173995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.174317 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.174663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.211626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Attempting to bind port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:57.211998 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Attempting to bind port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:57.212364 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Attempting to bind port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:57.217411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.217622 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:57.217972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Checking segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:57.218405 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.218851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Bound using segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:57.219316 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Bound port: 9290aaff-5709-409c-b6ed-11dc73f0c4e0, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:57.219695 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.223272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:57.223872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.256877 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Allocated IP 172.26.2.72 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/272a6cba-c4b7-4416-a198-f7d9c9a96554) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:57.287707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] For port 9290aaff-5709-409c-b6ed-11dc73f0c4e0, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:57.290939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] For port 9290aaff-5709-409c-b6ed-11dc73f0c4e0, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9290aaff-5709-409c-b6ed-11dc73f0c4e0,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:57.297853 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.310566 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.4564779 Mar 24 02:18:57.314681 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33888) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:57.321761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'subnet': {'network_id': '24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:57.323912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 79123375-136b-4c1b-ba67-948e46e33a7c, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=79123375-136b-4c1b-ba67-948e46e33a7c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:57.324396 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.336738 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Network': ['ID=24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:57.342545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 79123375-136b-4c1b-ba67-948e46e33a7c owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:18:57.355258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.355611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.355959 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.356301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.356640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.356975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.357302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.357631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.357958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.358281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.358650 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.358968 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.359322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.359643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.359966 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6958cfa1-a269-40a1-b94b-9f6fffdf177c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:18:57.376718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c4aa5e-1d54-4c9d-b341-da410d23f0f9 None None] Pushing event updated for resources: {'Port': ['ID=9290aaff-5709-409c-b6ed-11dc73f0c4e0,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:57.379999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:18:57.438623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-265827d2-1e7a-4452-842d-8bcb87fd02b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.488453 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks [] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.490836 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Made reservation on behalf of 4f11674605a349f28f6886bf409a1207 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:18:57.494750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.512704 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (79123375-136b-4c1b-ba67-948e46e33a7c), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.542779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=79123375-136b-4c1b-ba67-948e46e33a7c,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:57.619685 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] No DVR routers for this DVR port 79123375-136b-4c1b-ba67-948e46e33a7c on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:18:57.622200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.626285 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7cf98caa-11e3-4c0a-934d-e937d91f7110 req-4370100c-8318-4932-820f-4af596cabe37 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "DELETE /v2.0/ports/79123375-136b-4c1b-ba67-948e46e33a7c HTTP/1.1" status: 204 len: 173 time: 0.7205043 Mar 24 02:18:57.626956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'name': 'network-vif-deleted', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:18:57.629340 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fd0c943-ca67-4a24-9865-c3e9d16401f5" -d '{"events": [{"server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "name": "network-vif-deleted", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:18:57.652553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.689321 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:18:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95b53cb1-1f60-4538-af87-81eec63f690a x-openstack-request-id: req-95b53cb1-1f60-4538-af87-81eec63f690a {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:18:57.689680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c6c01a5-494c-4054-974b-b7a4af055d46", "name": "network-vif-deleted", "tag": "79123375-136b-4c1b-ba67-948e46e33a7c", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:18:57.690005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-95b53cb1-1f60-4538-af87-81eec63f690a {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:18:57.690848 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-95b53cb1-1f60-4538-af87-81eec63f690a'] response: {'server_uuid': '8c6c01a5-494c-4054-974b-b7a4af055d46', 'name': 'network-vif-deleted', 'tag': '79123375-136b-4c1b-ba67-948e46e33a7c', 'status': 'completed', 'code': 200} Mar 24 02:18:57.734934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:57.745978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:57.753343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:57.774991 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Pushing event updated for resources: {'Port': ['ID=272a6cba-c4b7-4416-a198-f7d9c9a96554,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:57.897366 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (379c8d39-e33e-4364-9b79-5b017187320a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:57.996613 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Subnet': ['ID=379c8d39-e33e-4364-9b79-5b017187320a,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:58.046680 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Checking segment: {'id': '0a6883c1-76e7-41d1-a530-50a73c5242ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:58.047635 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network hostable DHCP agents. Network: 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:18:58.107140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:18:58.127705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:58.138069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea7842b1-679e-4726-a0be-ddb12c97fb3f None None] Network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:58.138617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:18:58.138967 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.148809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks [] for router_gateway (d9d90a22-1adf-4945-a625-094e279f17a1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.255168 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-268a80e3-a80c-4f69-a65b-a2773653b087 req-5d078d04-690d-4ea4-8a59-be99d8ec9827 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=8c6c01a5-494c-4054-974b-b7a4af055d46 HTTP/1.1" status: 200 len: 210 time: 0.0465524 Mar 24 02:18:58.369121 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1eb79590-bd5b-4aed-820d-286a829cb008 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0508981 Mar 24 02:18:58.369482 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33894) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:58.374589 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-588717692', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}, 'admin_state_up': False}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:18:58.415555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (404a6006-702c-492e-a6dd-7a90ec691028), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.417410 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (404a6006-702c-492e-a6dd-7a90ec691028), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.443105 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9290aaff-5709-409c-b6ed-11dc73f0c4e0 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:18:58.512990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5', 'network_id': '24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5', 'project_id': '4f11674605a349f28f6886bf409a1207', 'fixed_ips': [{'subnet_id': '379c8d39-e33e-4364-9b79-5b017187320a'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:18:58.514246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.573802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_controller (404a6006-702c-492e-a6dd-7a90ec691028), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.615187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:58.615957 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.729649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37fe896d-4ee6-4744-bf37-2a1c24a9dddf None None] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:18:58.744068 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_gateway (404a6006-702c-492e-a6dd-7a90ec691028), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.782822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (d9d90a22-1adf-4945-a625-094e279f17a1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.807569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Allocated IP 172.20.0.2 (24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5/379c8d39-e33e-4364-9b79-5b017187320a/39e6e0bd-b69e-4cbe-a167-9ac0634d796f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:58.811627 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:58.811627 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.848169 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-97cbc88f-764d-4430-bf88-53c3831597c2 None None] Provisioning complete for port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:58.848471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-97cbc88f-764d-4430-bf88-53c3831597c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.928177 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Router d9d90a22-1adf-4945-a625-094e279f17a1 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:18:58.961619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_gateway (404a6006-702c-492e-a6dd-7a90ec691028), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.967913 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 9290aaff-5709-409c-b6ed-11dc73f0c4e0, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9290aaff-5709-409c-b6ed-11dc73f0c4e0,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:18:58.975898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:58.982915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.048606 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:18:59.064612 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Sync routers for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:18:59.067865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.069332 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ae088bdf-5e17-47c7-af83-53831080e700 admin admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.4743054 Mar 24 02:18:59.071883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33896) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:59.085129 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:18:59.087017 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:59.106949 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.26.2.204 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/535de9dd-a9e6-4c24-a2f4-bda82f34ba5a) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:18:59.121179 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=9290aaff-5709-409c-b6ed-11dc73f0c4e0,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:59.161729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-97cbc88f-764d-4430-bf88-53c3831597c2 None None] Current status of the port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:59.167217 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Publish callbacks [] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.180636 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.232155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:59.237874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:59.241661 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:59.265888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (535de9dd-a9e6-4c24-a2f4-bda82f34ba5a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.274715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Pushing event updated for resources: {'Port': ['ID=39e6e0bd-b69e-4cbe-a167-9ac0634d796f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:59.327328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (535de9dd-a9e6-4c24-a2f4-bda82f34ba5a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.347012 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33900) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:18:59.369625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Attempting to bind port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:18:59.369993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Attempting to bind port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '0a6883c1-76e7-41d1-a530-50a73c5242ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:18:59.370350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Attempting to bind port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f on network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:18:59.375967 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:18:59.376339 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Checking segment: {'id': '0a6883c1-76e7-41d1-a530-50a73c5242ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:18:59.376741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.377206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Bound using segment: {'id': '0a6883c1-76e7-41d1-a530-50a73c5242ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:18:59.378324 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Bound port: 39e6e0bd-b69e-4cbe-a167-9ac0634d796f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0a6883c1-76e7-41d1-a530-50a73c5242ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:18:59.378736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.414892 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:18:59.430816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:18:59.440444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=535de9dd-a9e6-4c24-a2f4-bda82f34ba5a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:59.452032 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:18:59.453666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] For port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:18:59.457236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] For port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=39e6e0bd-b69e-4cbe-a167-9ac0634d796f,segment=NetworkSegment(0a6883c1-76e7-41d1-a530-50a73c5242ad),segment_id=0a6883c1-76e7-41d1-a530-50a73c5242ad)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:18:59.466604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.508003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:18:59.530406 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e32526-171b-46bd-9d85-5acb01878470 None None] Pushing event updated for resources: {'Port': ['ID=39e6e0bd-b69e-4cbe-a167-9ac0634d796f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:18:59.589589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fdbad117-5809-4328-9b3c-1c26fcd7c9f4 None None] Provisioning complete for port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:18:59.590044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fdbad117-5809-4328-9b3c-1c26fcd7c9f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.650830 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:18:57Z', 'revision_number': 3, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:18:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:18:59.673519 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.688131 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Checking router: d9d90a22-1adf-4945-a625-094e279f17a1 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:18:59.688480 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Updating router d9d90a22-1adf-4945-a625-094e279f17a1 port 272a6cba-c4b7-4416-a198-f7d9c9a96554 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:18:59.690272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c674dd5e-4356-4235-b724-fcc9764ddf47 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (18484e4b-fd02-4452-91f3-85188a2c27cc), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.703728 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fdbad117-5809-4328-9b3c-1c26fcd7c9f4 None None] Current status of the port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:18:59.724924 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:18:59.960703 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Allocated IP 172.20.0.1 (1c7b4ca8-c501-4e72-9eba-3ca17999702e/7098e0b3-a3e5-4826-921e-69dc9ba94ef6/dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:00.064635 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Publish callbacks [] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.072156 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.098796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Publish callbacks [] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.124023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c674dd5e-4356-4235-b724-fcc9764ddf47 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (18484e4b-fd02-4452-91f3-85188a2c27cc), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.132481 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Attempting to bind port 272a6cba-c4b7-4416-a198-f7d9c9a96554 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:00.132857 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Attempting to bind port 272a6cba-c4b7-4416-a198-f7d9c9a96554 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:00.133223 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Attempting to bind port 272a6cba-c4b7-4416-a198-f7d9c9a96554 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:00.139577 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.139851 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902b8b19-a62c-4c53-a293-8a0f772dd286 None None] Pushing event updated for resources: {'Port': ['ID=272a6cba-c4b7-4416-a198-f7d9c9a96554,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:00.144975 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 18, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:00.145353 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:00.145761 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.146545 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:00.146688 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Bound port: 272a6cba-c4b7-4416-a198-f7d9c9a96554, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:00.147004 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.192068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:00.198394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:00.203932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:00.237121 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] For port 272a6cba-c4b7-4416-a198-f7d9c9a96554, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:00.244953 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] For port 272a6cba-c4b7-4416-a198-f7d9c9a96554, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=272a6cba-c4b7-4416-a198-f7d9c9a96554,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:00.261856 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.275495 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Pushing event updated for resources: {'Port': ['ID=dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:00.308035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c674dd5e-4356-4235-b724-fcc9764ddf47 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (18484e4b-fd02-4452-91f3-85188a2c27cc), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.315082 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (d9d90a22-1adf-4945-a625-094e279f17a1), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.321589 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c674dd5e-4356-4235-b724-fcc9764ddf47 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.325615 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c674dd5e-4356-4235-b724-fcc9764ddf47 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/security-groups/18484e4b-fd02-4452-91f3-85188a2c27cc HTTP/1.1" status: 204 len: 168 time: 0.8893921 Mar 24 02:19:00.357034 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:00.357695 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:18:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:00.387277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c674dd5e-4356-4235-b724-fcc9764ddf47 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=18484e4b-fd02-4452-91f3-85188a2c27cc,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:00.392098 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33904) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:00.419327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_gateway (404a6006-702c-492e-a6dd-7a90ec691028), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.510542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cb67f94c-9816-4141-ac4f-1f65a53e827e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.524160 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902b8b19-a62c-4c53-a293-8a0f772dd286 None None] Pushing event updated for resources: {'Port': ['ID=272a6cba-c4b7-4416-a198-f7d9c9a96554,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:00.574276 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9290aaff-5709-409c-b6ed-11dc73f0c4e0 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:00.584523 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:00.655383 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 79123375-136b-4c1b-ba67-948e46e33a7c no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:19:00.727049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 79123375-136b-4c1b-ba67-948e46e33a7c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:19:00.729215 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 79123375-136b-4c1b-ba67-948e46e33a7c not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:19:00.770826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-de9ee64d-6864-402e-bf61-cd880af36671 None None] Provisioning complete for port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:00.771650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de9ee64d-6864-402e-bf61-cd880af36671 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.803790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (404a6006-702c-492e-a6dd-7a90ec691028), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.811512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.828113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-de9ee64d-6864-402e-bf61-cd880af36671 None None] Port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:00.838734 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:00.839458 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.860505 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:18:57Z', 'revision_number': 3, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:00.904792 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:00.909905 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bde67ec-f518-4a4a-bd88-272e7e278f54 None None] The sync data for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv is: [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:18:57Z', 'revision_number': 3, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:00.968210 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:00.970861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 39e6e0bd-b69e-4cbe-a167-9ac0634d796f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:01.019587 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 404a6006-702c-492e-a6dd-7a90ec691028 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:19:01.027299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-527a8b7e-9ce4-4a76-828d-a825c91404d5 None None] Network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:01.100643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3eff3cf4-bd38-469f-af66-c67e36443137 None None] Provisioning complete for port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:01.101291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3eff3cf4-bd38-469f-af66-c67e36443137 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.121551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Publish callbacks [] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.130998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.135273 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:01.135884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.185034 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:01.210310 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4017be1f-886e-4f4b-88c9-4047cadabf36 None None] Sync routers for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:01.217261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (d9d90a22-1adf-4945-a625-094e279f17a1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.220645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.224723 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-22719bfb-5765-4428-9f93-d98f2923c9aa tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 2.8515744 Mar 24 02:19:01.225776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33906) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:01.227310 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (1f63a954-e411-4138-b423-94a29a3b7505), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.268454 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Pushing event updated for resources: {'Port': ['ID=dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:01.274362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4017be1f-886e-4f4b-88c9-4047cadabf36 None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:01.278634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4017be1f-886e-4f4b-88c9-4047cadabf36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:01.366926 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4017be1f-886e-4f4b-88c9-4047cadabf36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:01.372745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3eff3cf4-bd38-469f-af66-c67e36443137 None None] Current status of the port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:01.373261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3eff3cf4-bd38-469f-af66-c67e36443137 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.401379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:01.401908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.466861 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3eff3cf4-bd38-469f-af66-c67e36443137 None None] For port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=39e6e0bd-b69e-4cbe-a167-9ac0634d796f,segment=NetworkSegment(0a6883c1-76e7-41d1-a530-50a73c5242ad),segment_id=0a6883c1-76e7-41d1-a530-50a73c5242ad)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:01.475870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4017be1f-886e-4f4b-88c9-4047cadabf36 None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:01.476538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4017be1f-886e-4f4b-88c9-4047cadabf36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:01.503849 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:01.507653 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:01.779497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4017be1f-886e-4f4b-88c9-4047cadabf36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:01.780167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4017be1f-886e-4f4b-88c9-4047cadabf36 None None] The sync data for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:01.782088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3eff3cf4-bd38-469f-af66-c67e36443137 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.901916 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eff3cf4-bd38-469f-af66-c67e36443137 None None] Pushing event updated for resources: {'Port': ['ID=39e6e0bd-b69e-4cbe-a167-9ac0634d796f,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:01.906965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:19:01.907315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:19:01.915928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-44deacd8-f5d7-4ac5-9f06-344d72a8d74f None None] Provisioning complete for port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:01.916550 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-44deacd8-f5d7-4ac5-9f06-344d72a8d74f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.961576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-44deacd8-f5d7-4ac5-9f06-344d72a8d74f None None] Port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:01.972239 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:01.979127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-44deacd8-f5d7-4ac5-9f06-344d72a8d74f None None] Provisioning complete for port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:01.979500 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-44deacd8-f5d7-4ac5-9f06-344d72a8d74f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:02.082192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-44deacd8-f5d7-4ac5-9f06-344d72a8d74f None None] Current status of the port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:02.159596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Router d9d90a22-1adf-4945-a625-094e279f17a1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:02.283921 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.20.0.1 (24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5/379c8d39-e33e-4364-9b79-5b017187320a/3f1c9ef7-712d-4b6e-9851-b720590d6de7) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:02.312813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 7b1d481b-3bfa-4756-b24a-0449c4204f8c {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:02.313055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:02.364409 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:02.370837 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0f1598f5-7b69-49d7-856b-83ab292c2434 admin admin] 10.222.0.20 "PUT /v2.0/routers/d9d90a22-1adf-4945-a625-094e279f17a1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2978816 Mar 24 02:19:02.415270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:02.425262 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 7b1d481b-3bfa-4756-b24a-0449c4204f8c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=7b1d481b-3bfa-4756-b24a-0449c4204f8c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:02.425629 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:02.448701 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:02.448978 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 7b1d481b-3bfa-4756-b24a-0449c4204f8c owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:02.457530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:02.463756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:02.522801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=3f1c9ef7-712d-4b6e-9851-b720590d6de7,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:02.530161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:02.533258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:02.537657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:02.595518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (404a6006-702c-492e-a6dd-7a90ec691028), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:02.716007 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 272a6cba-c4b7-4416-a198-f7d9c9a96554 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:02.730705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (7b1d481b-3bfa-4756-b24a-0449c4204f8c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:02.775955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=7b1d481b-3bfa-4756-b24a-0449c4204f8c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:02.823182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:02.852686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 272a6cba-c4b7-4416-a198-f7d9c9a96554 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:02.853159 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.036804 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 272a6cba-c4b7-4416-a198-f7d9c9a96554 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:03.037190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.067548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-cc5e5467-9a8e-431c-b77a-29142d9ddfa6 None None] Provisioning complete for port 3f1c9ef7-712d-4b6e-9851-b720590d6de7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:03.067925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cc5e5467-9a8e-431c-b77a-29142d9ddfa6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.107633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 272a6cba-c4b7-4416-a198-f7d9c9a96554, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=272a6cba-c4b7-4416-a198-f7d9c9a96554,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:03.120387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.121186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 39e6e0bd-b69e-4cbe-a167-9ac0634d796f up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:03.141928 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (1f63a954-e411-4138-b423-94a29a3b7505), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.153401 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33922) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:03.157806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-cc5e5467-9a8e-431c-b77a-29142d9ddfa6 None None] Port 3f1c9ef7-712d-4b6e-9851-b720590d6de7 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:03.173456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1243700301-network', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:03.208844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=272a6cba-c4b7-4416-a198-f7d9c9a96554,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:03.214999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:03.215378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.269657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Made reservation on behalf of ff354ea51c3e49b88dd9920ceae4dc09 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:03.271446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.278341 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Sync routers for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:03.282557 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.285009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.288099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.289855 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:03.290849 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:03.331226 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:03.367284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (404a6006-702c-492e-a6dd-7a90ec691028), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.369348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=3f1c9ef7-712d-4b6e-9851-b720590d6de7,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:03.428640 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:03.475709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Publish callbacks [] for security_group (0c135692-c0d5-484d-a14f-478919ec76e6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.477927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:03.479807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:03.481690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0c135692-c0d5-484d-a14f-478919ec76e6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.491148 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 1f63a954-e411-4138-b423-94a29a3b7505 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:03.515048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 138} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:03.536039 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (054b2715-ebd3-4b55-9daf-6e8904f5eae9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.536654 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Added segment 054b2715-ebd3-4b55-9daf-6e8904f5eae9 of type vlan for network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 Mar 24 02:19:03.580655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c135692-c0d5-484d-a14f-478919ec76e6,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:03.660197 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 404a6006-702c-492e-a6dd-7a90ec691028 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:03.672963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (5c3ada7d-b3db-49b1-9de8-6d179e82dad1), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.695681 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 2, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:03.707347 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.724750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:03.729366 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Checking router: d9d90a22-1adf-4945-a625-094e279f17a1 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:19:03.730064 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Updating router d9d90a22-1adf-4945-a625-094e279f17a1 port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:19:03.730215 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3ebb8fa7-0a10-4b53-8387-8cd41bd4f75e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/1f63a954-e411-4138-b423-94a29a3b7505/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3370500 Mar 24 02:19:03.731976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (5c3ada7d-b3db-49b1-9de8-6d179e82dad1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.733203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:03.733808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.737010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33924) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:03.743855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] Sync routers for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:03.767638 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.784234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:03.785202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:03.787760 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:03.792155 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3253f68f-091f-4854-97a1-fe563ce6d218 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/routers/404a6006-702c-492e-a6dd-7a90ec691028/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5657873 Mar 24 02:19:03.794760 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33926) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:03.799904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'port': {'network_id': '24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5', 'name': 'tempest-FloatingIPTestJSON-1232809918'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:03.809596 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c8966ba-b5c4-4523-b26c-5503f0eca26d None None] Sync routers for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:03.830102 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c8966ba-b5c4-4523-b26c-5503f0eca26d None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:03.830737 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8c8966ba-b5c4-4523-b26c-5503f0eca26d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:03.837335 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6802704 Mar 24 02:19:03.842134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33928) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:03.848847 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Request body: {'subnet': {'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1243700301-subnet', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'ip_version': 4}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:03.872732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f0842a-1af1-4a58-ad96-7440ba61c28d admin admin] Pushing event updated for resources: {'Network': ['ID=5c3ada7d-b3db-49b1-9de8-6d179e82dad1,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:03.884507 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-218bdce1-0cdc-4281-8d6a-0f07f0b47bdb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting subnet 852aacbf-87d9-49af-b73c-786b9253307e {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:19:03.888256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-218bdce1-0cdc-4281-8d6a-0f07f0b47bdb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (852aacbf-87d9-49af-b73c-786b9253307e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.930215 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-218bdce1-0cdc-4281-8d6a-0f07f0b47bdb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (852aacbf-87d9-49af-b73c-786b9253307e), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.932145 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8c8966ba-b5c4-4523-b26c-5503f0eca26d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:03.935968 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Made reservation on behalf of 4f11674605a349f28f6886bf409a1207 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:03.938167 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:03.941548 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.958676 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Made reservation on behalf of ff354ea51c3e49b88dd9920ceae4dc09 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:03.960154 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c8966ba-b5c4-4523-b26c-5503f0eca26d None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:03.960940 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8c8966ba-b5c4-4523-b26c-5503f0eca26d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:03.961076 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:03.964094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] device_id is not set on port b895780e-e5c1-4a3c-8f9b-e7063a4e80f2 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:19:03.999532 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-8c8966ba-b5c4-4523-b26c-5503f0eca26d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:04.000709 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c8966ba-b5c4-4523-b26c-5503f0eca26d None None] The sync data for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:04.056561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:04.059561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-39f9fd70-f66b-4dcb-9426-21e803d23398 None None] Provisioning complete for port 3f1c9ef7-712d-4b6e-9851-b720590d6de7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:04.059967 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-39f9fd70-f66b-4dcb-9426-21e803d23398 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.096520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-218bdce1-0cdc-4281-8d6a-0f07f0b47bdb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (852aacbf-87d9-49af-b73c-786b9253307e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.131498 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-39f9fd70-f66b-4dcb-9426-21e803d23398 None None] Port 3f1c9ef7-712d-4b6e-9851-b720590d6de7 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:04.158017 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Allocated IP 172.20.0.11 (24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5/379c8d39-e33e-4364-9b79-5b017187320a/b895780e-e5c1-4a3c-8f9b-e7063a4e80f2) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:04.235447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-218bdce1-0cdc-4281-8d6a-0f07f0b47bdb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (852aacbf-87d9-49af-b73c-786b9253307e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.269588 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (a7b61086-a0a8-47c4-8975-c7a7a2a41661), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.288399 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-218bdce1-0cdc-4281-8d6a-0f07f0b47bdb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.292548 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-218bdce1-0cdc-4281-8d6a-0f07f0b47bdb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/subnets/852aacbf-87d9-49af-b73c-786b9253307e HTTP/1.1" status: 204 len: 168 time: 0.5532517 Mar 24 02:19:04.294855 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-218bdce1-0cdc-4281-8d6a-0f07f0b47bdb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Subnet': ['ID=852aacbf-87d9-49af-b73c-786b9253307e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:04.306828 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Publish callbacks [] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.309168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80170af1-e70b-4d39-9ede-9b1345140ef4 None None] Network 4ce8d77b-f4f5-4987-9cce-04a12234cd5d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:04.314362 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.325347 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33930) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:04.377931 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a33cad59-cac1-401e-aa94-5705b5e3b90e None None] Pushing event updated for resources: {'Port': ['ID=dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:04.389778 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for port (b895780e-e5c1-4a3c-8f9b-e7063a4e80f2), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.444963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:19:02Z', 'revision_number': 7, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:04.445844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (b895780e-e5c1-4a3c-8f9b-e7063a4e80f2), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.459380 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Attempting to bind port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:04.459904 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Attempting to bind port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:04.460364 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Attempting to bind port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:04.466711 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:04.467333 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Checking segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:04.467830 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.468310 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Bound using segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:04.469021 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Bound port: dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:04.469496 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.493228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] Checking router: 1f63a954-e411-4138-b423-94a29a3b7505 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:19:04.506342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] Routers {'1f63a954-e411-4138-b423-94a29a3b7505'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:04.506748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['1f63a954-e411-4138-b423-94a29a3b7505'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:04.521200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:04.525188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a7b61086-a0a8-47c4-8975-c7a7a2a41661,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:04.530218 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:04.538115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:04.544931 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] For port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:04.548338 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] For port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:04.555771 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.625171 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:04.625838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Checking segment: {'id': '054b2715-ebd3-4b55-9daf-6e8904f5eae9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:04.626122 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:04.626747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Network hostable DHCP agents. Network: 5c3ada7d-b3db-49b1-9de8-6d179e82dad1, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:04.693445 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (1f63a954-e411-4138-b423-94a29a3b7505), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.698218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:04.706324 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event updated for resources: {'Port': ['ID=b895780e-e5c1-4a3c-8f9b-e7063a4e80f2,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:04.732473 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:04.748272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.762653 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:04.789859 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5960a81b-aa82-4538-8e98-9b9e95393c40 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 0.9913507 Mar 24 02:19:04.790115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33932) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:04.792688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] Set router 1f63a954-e411-4138-b423-94a29a3b7505 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:04.796852 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Request body: {'floatingip': {'port_id': 'b895780e-e5c1-4a3c-8f9b-e7063a4e80f2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:04.887698 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 5c3ada7d-b3db-49b1-9de8-6d179e82dad1) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:04.903012 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a101b525-7d0f-4c0d-8218-3d7a5c79798a None None] DHCP port deletion for 4ce8d77b-f4f5-4987-9cce-04a12234cd5d request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:19:04.905571 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 272a6cba-c4b7-4416-a198-f7d9c9a96554 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:04.913851 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a33cad59-cac1-401e-aa94-5705b5e3b90e None None] Pushing event updated for resources: {'Port': ['ID=dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:04.941105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (d3cbb102-fe06-4e79-8e5e-9295bc55ca72), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.941343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:04.944726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:04.969013 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92c7d792-e9b3-4ede-a1f8-8ab750bc8632 None None] Network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:04.987161 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d200bc31-5e94-41c0-a603-7be43e1f3897 admin admin] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.1439397 Mar 24 02:19:04.991907 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33934) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:04.997936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:05.027539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (1f63a954-e411-4138-b423-94a29a3b7505), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.041093 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (47fea142-65a5-4020-a53c-bd6100f56181), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.042662 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (47fea142-65a5-4020-a53c-bd6100f56181), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.060681 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:04Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:05.112351 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaa72d8a-b8c1-4532-b4e2-5bb23b24ac57 None None] The sync data for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv is: [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:04Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:05.137966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks [] for router_controller (47fea142-65a5-4020-a53c-bd6100f56181), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.153400 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port be6cc3d7-c553-4ab5-82ae-05b89ab5c636 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:05.153743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.217960 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-35cbcfae-d875-42b4-b2fb-10de587bfb19 None None] Provisioning complete for port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:05.218335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-35cbcfae-d875-42b4-b2fb-10de587bfb19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.368319 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks [] for router_gateway (47fea142-65a5-4020-a53c-bd6100f56181), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.402913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port be6cc3d7-c553-4ab5-82ae-05b89ab5c636, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=be6cc3d7-c553-4ab5-82ae-05b89ab5c636,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:05.404508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.474751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for be6cc3d7-c553-4ab5-82ae-05b89ab5c636 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:05.576837 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-5c3ada7d-b3db-49b1-9de8-6d179e82dad1', 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1', 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'fixed_ips': [{'subnet_id': 'a7b61086-a0a8-47c4-8975-c7a7a2a41661'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:05.577692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.609757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 272a6cba-c4b7-4416-a198-f7d9c9a96554 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:05.610126 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.722985 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a101b525-7d0f-4c0d-8218-3d7a5c79798a None None] Deleting port a8660dbb-71b0-408c-97bd-d62ccfd2232c {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:05.723354 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a101b525-7d0f-4c0d-8218-3d7a5c79798a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.798941 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks [] for router_gateway (47fea142-65a5-4020-a53c-bd6100f56181), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.825882 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.829110 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-35cbcfae-d875-42b4-b2fb-10de587bfb19 None None] Current status of the port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:05.829789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-35cbcfae-d875-42b4-b2fb-10de587bfb19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.920170 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (be6cc3d7-c553-4ab5-82ae-05b89ab5c636), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.958559 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=be6cc3d7-c553-4ab5-82ae-05b89ab5c636,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:05.964674 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-35cbcfae-d875-42b4-b2fb-10de587bfb19 None None] For port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:05.970801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a101b525-7d0f-4c0d-8218-3d7a5c79798a None None] For port a8660dbb-71b0-408c-97bd-d62ccfd2232c, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a8660dbb-71b0-408c-97bd-d62ccfd2232c,segment=NetworkSegment(5e901f2f-82e7-4a47-a540-857908c70ec7),segment_id=5e901f2f-82e7-4a47-a540-857908c70ec7)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:05.971518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a101b525-7d0f-4c0d-8218-3d7a5c79798a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:05.986242 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-35cbcfae-d875-42b4-b2fb-10de587bfb19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.024868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a101b525-7d0f-4c0d-8218-3d7a5c79798a None None] Calling delete_port for a8660dbb-71b0-408c-97bd-d62ccfd2232c owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:06.034042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Allocated IP 172.26.2.250 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/f5e80362-8679-4245-af8b-39639e759fd4) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:06.045468 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 272a6cba-c4b7-4416-a198-f7d9c9a96554 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:06.047646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.052268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Allocated IP 172.20.0.2 (5c3ada7d-b3db-49b1-9de8-6d179e82dad1/a7b61086-a0a8-47c4-8975-c7a7a2a41661/700c8088-095d-4a41-98e8-db1644d20754) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:06.059128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (d3cbb102-fe06-4e79-8e5e-9295bc55ca72), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.093261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:19:02Z', 'revision_number': 7, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:06.201603 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP d3cbb102-fe06-4e79-8e5e-9295bc55ca72 associated. External IP: 172.26.2.197, port: 0e8c22c9-70ad-4c3f-b2a4-f20c99a95528. Mar 24 02:19:06.205332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35cbcfae-d875-42b4-b2fb-10de587bfb19 None None] Pushing event updated for resources: {'Port': ['ID=dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:06.213657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dd9ce05-7076-4a5e-86ca-c79e8f691a87 None None] The sync data for ids ['1f63a954-e411-4138-b423-94a29a3b7505'] in dv-neutron-834874-3-hyperv is: [{'id': '1f63a954-e411-4138-b423-94a29a3b7505', 'name': 'tempest-TestNetworkBasicOps-router-1130758702', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82'}], 'enable_snat': True}, 'gw_port_id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:15:17Z', 'updated_at': '2022-03-24T02:19:02Z', 'revision_number': 7, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'be6cc3d7-c553-4ab5-82ae-05b89ab5c636', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:80:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f63a954-e411-4138-b423-94a29a3b7505', 'device_owner': 'network:router_gateway', 'standard_attr_id': 691, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:15:20Z', 'updated_at': '2022-03-24T02:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:06.222228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (1f63a954-e411-4138-b423-94a29a3b7505), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.242333 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-83768795-7418-45d3-ac29-45f117130097 None None] Provisioning complete for port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:06.247657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83768795-7418-45d3-ac29-45f117130097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.348906 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a101b525-7d0f-4c0d-8218-3d7a5c79798a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (a8660dbb-71b0-408c-97bd-d62ccfd2232c), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.413981 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a101b525-7d0f-4c0d-8218-3d7a5c79798a None None] Pushing event deleted for resources: {'Port': ['ID=a8660dbb-71b0-408c-97bd-d62ccfd2232c,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:06.424928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a101b525-7d0f-4c0d-8218-3d7a5c79798a None None] No DVR routers for this DVR port a8660dbb-71b0-408c-97bd-d62ccfd2232c on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:06.479805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:06.492795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Publish callbacks [] for port (700c8088-095d-4a41-98e8-db1644d20754), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.497492 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-83768795-7418-45d3-ac29-45f117130097 None None] Current status of the port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:06.507679 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (700c8088-095d-4a41-98e8-db1644d20754), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.549264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-83768795-7418-45d3-ac29-45f117130097 None None] Provisioning complete for port b895780e-e5c1-4a3c-8f9b-e7063a4e80f2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:06.549765 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83768795-7418-45d3-ac29-45f117130097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (b895780e-e5c1-4a3c-8f9b-e7063a4e80f2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.561844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:06.588323 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:06.595918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:06.600800 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Pushing event updated for resources: {'Port': ['ID=700c8088-095d-4a41-98e8-db1644d20754,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:06.621862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-83768795-7418-45d3-ac29-45f117130097 None None] Port b895780e-e5c1-4a3c-8f9b-e7063a4e80f2 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:06.632061 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:06.653860 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3843f6b0-9567-4098-b4b7-fc5068fa2476 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:06.698122 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Attempting to bind port 700c8088-095d-4a41-98e8-db1644d20754 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:06.698418 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Attempting to bind port 700c8088-095d-4a41-98e8-db1644d20754 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '054b2715-ebd3-4b55-9daf-6e8904f5eae9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:06.698823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Attempting to bind port 700c8088-095d-4a41-98e8-db1644d20754 on network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:06.706633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:06.707024 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Checking segment: {'id': '054b2715-ebd3-4b55-9daf-6e8904f5eae9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:06.707430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.707829 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Bound using segment: {'id': '054b2715-ebd3-4b55-9daf-6e8904f5eae9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:06.708309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Bound port: 700c8088-095d-4a41-98e8-db1644d20754, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '054b2715-ebd3-4b55-9daf-6e8904f5eae9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:06.708697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (700c8088-095d-4a41-98e8-db1644d20754), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.728442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3843f6b0-9567-4098-b4b7-fc5068fa2476 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:06.729081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-3843f6b0-9567-4098-b4b7-fc5068fa2476 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:06.812617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] For port 700c8088-095d-4a41-98e8-db1644d20754, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:06.812973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks [] for port (f5e80362-8679-4245-af8b-39639e759fd4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.816085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] For port 700c8088-095d-4a41-98e8-db1644d20754, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=700c8088-095d-4a41-98e8-db1644d20754,segment=NetworkSegment(054b2715-ebd3-4b55-9daf-6e8904f5eae9),segment_id=054b2715-ebd3-4b55-9daf-6e8904f5eae9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:06.845737 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (1f63a954-e411-4138-b423-94a29a3b7505), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.848204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (1f63a954-e411-4138-b423-94a29a3b7505), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.853888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (f5e80362-8679-4245-af8b-39639e759fd4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.864067 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:06.867095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-3843f6b0-9567-4098-b4b7-fc5068fa2476 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:06.870483 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (700c8088-095d-4a41-98e8-db1644d20754), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.904329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:06.926466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:06.935146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:06.940543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3843f6b0-9567-4098-b4b7-fc5068fa2476 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:06.941204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-3843f6b0-9567-4098-b4b7-fc5068fa2476 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:06.943569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (1f63a954-e411-4138-b423-94a29a3b7505), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.943742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Fanout notify agent at l3_agent the message router_deleted on router 1f63a954-e411-4138-b423-94a29a3b7505 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:19:06.972023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:06.975930 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5663d9e0-7147-4db8-be62-63532e6f6b93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/routers/1f63a954-e411-4138-b423-94a29a3b7505 HTTP/1.1" status: 204 len: 168 time: 2.6494339 Mar 24 02:19:06.976649 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33936) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:07.000912 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Pushing event updated for resources: {'Port': ['ID=f5e80362-8679-4245-af8b-39639e759fd4,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:07.010135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-3843f6b0-9567-4098-b4b7-fc5068fa2476 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:07.011164 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3843f6b0-9567-4098-b4b7-fc5068fa2476 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:07.022161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7eeb337-1207-47e6-9027-cb55ed8e3caf None None] Pushing event updated for resources: {'Port': ['ID=700c8088-095d-4a41-98e8-db1644d20754,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:07.036024 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:07.036558 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.080688 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 404a6006-702c-492e-a6dd-7a90ec691028 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:07.130840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:07.213332 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (4ce8d77b-f4f5-4987-9cce-04a12234cd5d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.214132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7b1d481b-3bfa-4756-b24a-0449c4204f8c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:19:07.266891 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 7b1d481b-3bfa-4756-b24a-0449c4204f8c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:19:07.267469 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 7b1d481b-3bfa-4756-b24a-0449c4204f8c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:19:07.267628 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a8660dbb-71b0-408c-97bd-d62ccfd2232c no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:19:07.296650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: a8660dbb-71b0-408c-97bd-d62ccfd2232c {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:19:07.297101 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a8660dbb-71b0-408c-97bd-d62ccfd2232c not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:19:07.381700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks [] for router_gateway (47fea142-65a5-4020-a53c-bd6100f56181), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.394796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:07.399892 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.407453 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f8553e9-0e15-4d79-a1d4-2dbe20523847 None None] Sync routers for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:07.408389 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (4ce8d77b-f4f5-4987-9cce-04a12234cd5d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.424221 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f8553e9-0e15-4d79-a1d4-2dbe20523847 None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:07.425135 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6f8553e9-0e15-4d79-a1d4-2dbe20523847 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:07.456693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4ce8d77b-f4f5-4987-9cce-04a12234cd5d']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:07.471933 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6f8553e9-0e15-4d79-a1d4-2dbe20523847 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:07.481379 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f8553e9-0e15-4d79-a1d4-2dbe20523847 None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:07.481910 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6f8553e9-0e15-4d79-a1d4-2dbe20523847 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:07.484635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5e901f2f-82e7-4a47-a540-857908c70ec7') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:07.484928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5e901f2f-82e7-4a47-a540-857908c70ec7') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:07.497565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (5e901f2f-82e7-4a47-a540-857908c70ec7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.509679 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-80f821d8-ecc5-433e-9225-bbe1ac350554 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/floatingips/d3cbb102-fe06-4e79-8e5e-9295bc55ca72 HTTP/1.1" status: 200 len: 979 time: 2.7185626 Mar 24 02:19:07.512531 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33938) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:07.517846 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6f8553e9-0e15-4d79-a1d4-2dbe20523847 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:07.518502 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f8553e9-0e15-4d79-a1d4-2dbe20523847 None None] The sync data for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:07.524423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (5e901f2f-82e7-4a47-a540-857908c70ec7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.554870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Releasing vlan 108 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:07.555346 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (5e901f2f-82e7-4a47-a540-857908c70ec7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:07.558476 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:07.617179 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (47fea142-65a5-4020-a53c-bd6100f56181), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.645806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (4ce8d77b-f4f5-4987-9cce-04a12234cd5d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.651269 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.654464 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/networks/4ce8d77b-f4f5-4987-9cce-04a12234cd5d HTTP/1.1" status: 204 len: 168 time: 0.6764224 Mar 24 02:19:07.674615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33940) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:07.681202 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'network': {'name': 'tempest-network-smoke--511827621', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'port_security_enabled': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:07.686283 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48bb4155-b545-44f1-90ec-24c02200c2fd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Network': ['ID=4ce8d77b-f4f5-4987-9cce-04a12234cd5d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:07.711808 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port b895780e-e5c1-4a3c-8f9b-e7063a4e80f2 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:07.712208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b895780e-e5c1-4a3c-8f9b-e7063a4e80f2), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.716662 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:07.720018 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.756830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Router 47fea142-65a5-4020-a53c-bd6100f56181 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:19:07.797669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 106} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:07.822097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.822447 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Added segment 0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30 of type vlan for network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 Mar 24 02:19:07.861612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b895780e-e5c1-4a3c-8f9b-e7063a4e80f2), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.881735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:07.889872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (8ee3ba97-1980-4303-b77a-6f5ad4d46166), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.897096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Sync routers for ids ['47fea142-65a5-4020-a53c-bd6100f56181'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:07.906425 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Routers {'47fea142-65a5-4020-a53c-bd6100f56181'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:07.907292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['47fea142-65a5-4020-a53c-bd6100f56181'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:07.908662 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:07.910585 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f5240081-d92d-4275-b5fc-2981885fecbc admin admin] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.9170897 Mar 24 02:19:07.913041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33942) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:07.994692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (8ee3ba97-1980-4303-b77a-6f5ad4d46166), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.000388 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:08.001096 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.062203 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Set router 47fea142-65a5-4020-a53c-bd6100f56181 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:08.082671 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.4068089 Mar 24 02:19:08.105211 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33944) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:08.110250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'admin_state_up': True, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:08.138795 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85fd13b9-8920-4a84-9c65-bae76abb17b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Network': ['ID=8ee3ba97-1980-4303-b77a-6f5ad4d46166,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:08.149413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:08.153074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.153449 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (d3cbb102-fe06-4e79-8e5e-9295bc55ca72), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.153763 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Floating IP d3cbb102-fe06-4e79-8e5e-9295bc55ca72 disassociated. External IP: 172.26.2.197, port: b895780e-e5c1-4a3c-8f9b-e7063a4e80f2. Mar 24 02:19:08.154107 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for b895780e-e5c1-4a3c-8f9b-e7063a4e80f2 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:08.209080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (f1e1a820-21ac-4c51-979d-f4b8742581f3), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.210310 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (f1e1a820-21ac-4c51-979d-f4b8742581f3), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.270953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f8b95b3-578e-4953-9fd5-2ff5e34f9bb5 None None] Network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:08.318257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (b895780e-e5c1-4a3c-8f9b-e7063a4e80f2), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.348047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=b895780e-e5c1-4a3c-8f9b-e7063a4e80f2,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:08.356859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (f1e1a820-21ac-4c51-979d-f4b8742581f3), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.387183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4a2eadc8-1558-4f6a-8abb-d8a50ca71505 None None] Provisioning complete for port 700c8088-095d-4a41-98e8-db1644d20754 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:08.387183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a2eadc8-1558-4f6a-8abb-d8a50ca71505 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (700c8088-095d-4a41-98e8-db1644d20754), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.496516 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 404a6006-702c-492e-a6dd-7a90ec691028 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:08.556422 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4a2eadc8-1558-4f6a-8abb-d8a50ca71505 None None] Current status of the port 700c8088-095d-4a41-98e8-db1644d20754 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:08.556422 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a2eadc8-1558-4f6a-8abb-d8a50ca71505 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (700c8088-095d-4a41-98e8-db1644d20754), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.579281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (f1e1a820-21ac-4c51-979d-f4b8742581f3), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.609175 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '47fea142-65a5-4020-a53c-bd6100f56181', 'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250'}], 'enable_snat': True}, 'gw_port_id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:07Z', 'revision_number': 3, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'gw_port': {'id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:9e:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:08.676606 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:08.687740 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0fbebde-c66e-433b-bf94-3db01e40ff89 None None] Sync routers for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:08.689474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 700c8088-095d-4a41-98e8-db1644d20754 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:08.692609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Checking router: 47fea142-65a5-4020-a53c-bd6100f56181 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:19:08.693297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Updating router 47fea142-65a5-4020-a53c-bd6100f56181 port f5e80362-8679-4245-af8b-39639e759fd4 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:19:08.703578 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0fbebde-c66e-433b-bf94-3db01e40ff89 None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:08.704537 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-d0fbebde-c66e-433b-bf94-3db01e40ff89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:08.766609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4a2eadc8-1558-4f6a-8abb-d8a50ca71505 None None] For port 700c8088-095d-4a41-98e8-db1644d20754, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=700c8088-095d-4a41-98e8-db1644d20754,segment=NetworkSegment(054b2715-ebd3-4b55-9daf-6e8904f5eae9),segment_id=054b2715-ebd3-4b55-9daf-6e8904f5eae9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:08.769979 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-d0fbebde-c66e-433b-bf94-3db01e40ff89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:08.779169 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f5e80362-8679-4245-af8b-39639e759fd4), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.782662 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4a2eadc8-1558-4f6a-8abb-d8a50ca71505 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (700c8088-095d-4a41-98e8-db1644d20754), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.788526 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0fbebde-c66e-433b-bf94-3db01e40ff89 None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:08.789143 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-d0fbebde-c66e-433b-bf94-3db01e40ff89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:08.826400 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.829862 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7e84bdbc-f2f6-4806-82b9-8dc893740a0c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/ports/b895780e-e5c1-4a3c-8f9b-e7063a4e80f2 HTTP/1.1" status: 204 len: 168 time: 1.3164048 Mar 24 02:19:08.834094 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-d0fbebde-c66e-433b-bf94-3db01e40ff89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:08.835255 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0fbebde-c66e-433b-bf94-3db01e40ff89 None None] The sync data for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:08.838615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33946) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:08.876878 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:08.935508 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a2eadc8-1558-4f6a-8abb-d8a50ca71505 None None] Pushing event updated for resources: {'Port': ['ID=700c8088-095d-4a41-98e8-db1644d20754,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:08.943757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 700c8088-095d-4a41-98e8-db1644d20754 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:08.944226 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (700c8088-095d-4a41-98e8-db1644d20754), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.149083 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (f1e1a820-21ac-4c51-979d-f4b8742581f3), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.173671 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-24cd4f90-8460-4916-934c-dade2d5814ae None None] Provisioning complete for port 700c8088-095d-4a41-98e8-db1644d20754 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:09.174194 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-24cd4f90-8460-4916-934c-dade2d5814ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (700c8088-095d-4a41-98e8-db1644d20754), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.177904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.193899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Allocated IP 172.20.0.1 (5c3ada7d-b3db-49b1-9de8-6d179e82dad1/a7b61086-a0a8-47c4-8975-c7a7a2a41661/46c15fce-88e8-4997-93a7-a523664f7da2) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:09.236735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (404a6006-702c-492e-a6dd-7a90ec691028), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.299750 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 700c8088-095d-4a41-98e8-db1644d20754 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:09.317260 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device be6cc3d7-c553-4ab5-82ae-05b89ab5c636 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:19:09.349590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: be6cc3d7-c553-4ab5-82ae-05b89ab5c636 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:19:09.349932 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device be6cc3d7-c553-4ab5-82ae-05b89ab5c636 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:19:09.354388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Publish callbacks [] for port (46c15fce-88e8-4997-93a7-a523664f7da2), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.389967 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.428453 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-24cd4f90-8460-4916-934c-dade2d5814ae None None] Current status of the port 700c8088-095d-4a41-98e8-db1644d20754 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:09.443598 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:09.446711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:09.448694 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Publish callbacks [] for port (f5e80362-8679-4245-af8b-39639e759fd4), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.450104 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:09.456104 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f5e80362-8679-4245-af8b-39639e759fd4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.518935 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Pushing event updated for resources: {'Port': ['ID=46c15fce-88e8-4997-93a7-a523664f7da2,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:09.521649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Attempting to bind port f5e80362-8679-4245-af8b-39639e759fd4 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:09.522023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Attempting to bind port f5e80362-8679-4245-af8b-39639e759fd4 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:09.522395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Attempting to bind port f5e80362-8679-4245-af8b-39639e759fd4 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:09.526112 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa5921c-91ce-4545-b88c-d6af754d3b89 None None] Pushing event updated for resources: {'Port': ['ID=f5e80362-8679-4245-af8b-39639e759fd4,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:09.531571 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:09.531950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:09.532351 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.532886 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:09.533188 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Bound port: f5e80362-8679-4245-af8b-39639e759fd4, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:09.533572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f5e80362-8679-4245-af8b-39639e759fd4), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.537854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (47fea142-65a5-4020-a53c-bd6100f56181), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.540879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port 3f1c9ef7-712d-4b6e-9851-b720590d6de7 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:09.541652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.591112 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.75 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/d14f8276-0a69-42c3-b78f-f19b41ffbc7b) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:09.600514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] For port f5e80362-8679-4245-af8b-39639e759fd4, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:09.604475 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] For port f5e80362-8679-4245-af8b-39639e759fd4, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f5e80362-8679-4245-af8b-39639e759fd4,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:09.613258 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f5e80362-8679-4245-af8b-39639e759fd4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.664315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.682430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for 3f1c9ef7-712d-4b6e-9851-b720590d6de7 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:09.699956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa5921c-91ce-4545-b88c-d6af754d3b89 None None] Pushing event updated for resources: {'Port': ['ID=f5e80362-8679-4245-af8b-39639e759fd4,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:09.716577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Routers {'47fea142-65a5-4020-a53c-bd6100f56181'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:09.717691 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['47fea142-65a5-4020-a53c-bd6100f56181'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:09.779373 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.783658 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.808527 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-be974e61-4d80-47e5-9948-c37e7829f0d9 None None] Provisioning complete for port 46c15fce-88e8-4997-93a7-a523664f7da2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:09.808888 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-be974e61-4d80-47e5-9948-c37e7829f0d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.853973 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-be974e61-4d80-47e5-9948-c37e7829f0d9 None None] Port 46c15fce-88e8-4997-93a7-a523664f7da2 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:09.870548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] Set router 47fea142-65a5-4020-a53c-bd6100f56181 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:09.939029 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.942871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3f1c9ef7-712d-4b6e-9851-b720590d6de7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:09.998993 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:10.003209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=3f1c9ef7-712d-4b6e-9851-b720590d6de7,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:10.013756 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:10.026217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:10.031633 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=d14f8276-0a69-42c3-b78f-f19b41ffbc7b,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:10.114724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '47fea142-65a5-4020-a53c-bd6100f56181', 'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250'}], 'enable_snat': True}, 'gw_port_id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:07Z', 'revision_number': 3, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'gw_port': {'id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:9e:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:10.119109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Publish callbacks [] for port (46c15fce-88e8-4997-93a7-a523664f7da2), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:10.127018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:10.158337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d49ab2ab-4ca7-44d8-8d5a-25db64636df7 None None] The sync data for ids ['47fea142-65a5-4020-a53c-bd6100f56181'] in dv-neutron-834874-3-hyperv is: [{'id': '47fea142-65a5-4020-a53c-bd6100f56181', 'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250'}], 'enable_snat': True}, 'gw_port_id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:07Z', 'revision_number': 3, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'gw_port': {'id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:9e:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:10.680946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (47fea142-65a5-4020-a53c-bd6100f56181), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:10.688232 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Pushing event updated for resources: {'Port': ['ID=46c15fce-88e8-4997-93a7-a523664f7da2,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:10.745415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 700c8088-095d-4a41-98e8-db1644d20754 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:10.746002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (404a6006-702c-492e-a6dd-7a90ec691028), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:10.870487 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 700c8088-095d-4a41-98e8-db1644d20754 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:10.870893 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (700c8088-095d-4a41-98e8-db1644d20754), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:10.909548 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:10.912761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:10.993131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 700c8088-095d-4a41-98e8-db1644d20754 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:10.994193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f5e80362-8679-4245-af8b-39639e759fd4 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:11.079412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 404a6006-702c-492e-a6dd-7a90ec691028 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:11.083320 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f5e80362-8679-4245-af8b-39639e759fd4 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:11.083488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f5e80362-8679-4245-af8b-39639e759fd4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.088821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (f1e1a820-21ac-4c51-979d-f4b8742581f3), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.213943 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f5e80362-8679-4245-af8b-39639e759fd4 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:11.214272 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f5e80362-8679-4245-af8b-39639e759fd4), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.241037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port f5e80362-8679-4245-af8b-39639e759fd4, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f5e80362-8679-4245-af8b-39639e759fd4,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:11.247578 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f5e80362-8679-4245-af8b-39639e759fd4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.261811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:11.268204 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7be83428-00fe-464e-8c8c-d2b2d1bd57ec tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/routers/404a6006-702c-492e-a6dd-7a90ec691028/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4281738 Mar 24 02:19:11.270481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33948) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:11.292994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5cf41b0-d824-4623-abe3-8a64e034d363 None None] Sync routers for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:11.315160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5cf41b0-d824-4623-abe3-8a64e034d363 None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:11.316048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e5cf41b0-d824-4623-abe3-8a64e034d363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:11.321360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Router 47fea142-65a5-4020-a53c-bd6100f56181 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:11.362892 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e5cf41b0-d824-4623-abe3-8a64e034d363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:11.390819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=f5e80362-8679-4245-af8b-39639e759fd4,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:11.404844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5cf41b0-d824-4623-abe3-8a64e034d363 None None] Routers {'404a6006-702c-492e-a6dd-7a90ec691028'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:11.405725 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e5cf41b0-d824-4623-abe3-8a64e034d363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['404a6006-702c-492e-a6dd-7a90ec691028'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:11.453649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e5cf41b0-d824-4623-abe3-8a64e034d363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:11.454407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5cf41b0-d824-4623-abe3-8a64e034d363 None None] The sync data for ids ['404a6006-702c-492e-a6dd-7a90ec691028'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:11.456441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router (404a6006-702c-492e-a6dd-7a90ec691028), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.462037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f22c1d4f-16fd-447c-b3ed-ddeae1b3f71c None None] Provisioning complete for port 46c15fce-88e8-4997-93a7-a523664f7da2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:11.462420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f22c1d4f-16fd-447c-b3ed-ddeae1b3f71c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.514343 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f22c1d4f-16fd-447c-b3ed-ddeae1b3f71c None None] Port 46c15fce-88e8-4997-93a7-a523664f7da2 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:11.561371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (f1e1a820-21ac-4c51-979d-f4b8742581f3), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.574482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:11.587403 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9a746e05-b6fb-4f38-8858-795e4481e6cd admin admin] 10.222.0.20 "PUT /v2.0/routers/47fea142-65a5-4020-a53c-bd6100f56181/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6656411 Mar 24 02:19:11.630282 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_gateway (404a6006-702c-492e-a6dd-7a90ec691028), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.697031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port 535de9dd-a9e6-4c24-a2f4-bda82f34ba5a {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:11.697615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (535de9dd-a9e6-4c24-a2f4-bda82f34ba5a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.728591 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router f1e1a820-21ac-4c51-979d-f4b8742581f3 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:19:11.791926 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (535de9dd-a9e6-4c24-a2f4-bda82f34ba5a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.809097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for 535de9dd-a9e6-4c24-a2f4-bda82f34ba5a owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:11.855177 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:11.868023 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Sync routers for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:11.883031 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:11.884306 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:11.890917 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:11.895615 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e3062b04-bd25-4111-bafb-ee4980839fc7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 3.7897222 Mar 24 02:19:11.896671 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33956) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:11.934604 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f1a8d0e0-6d56-481c-89d1-abc0c6b8124e tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=6c0b7eea99a4423dac22912b1fa60ca2&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0367880 Mar 24 02:19:11.935548 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33958) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:12.044413 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:12.072887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdab74f4-dfc1-4b37-b696-ba2bfbfe69ce tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:12.077099 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bdab74f4-dfc1-4b37-b696-ba2bfbfe69ce tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1376710 Mar 24 02:19:12.077441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33960) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:12.115064 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-379725df-a37f-417d-876f-7c176f6008e7 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0340743 Mar 24 02:19:12.116195 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33964) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:12.127260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (535de9dd-a9e6-4c24-a2f4-bda82f34ba5a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.128613 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-251890141', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:12.194680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=535de9dd-a9e6-4c24-a2f4-bda82f34ba5a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:12.222768 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:12.226403 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.283134 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:10Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:12.315176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (404a6006-702c-492e-a6dd-7a90ec691028), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.348392 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Checking router: f1e1a820-21ac-4c51-979d-f4b8742581f3 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:19:12.348800 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Updating router f1e1a820-21ac-4c51-979d-f4b8742581f3 port d14f8276-0a69-42c3-b78f-f19b41ffbc7b binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:19:12.381513 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.473519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (404a6006-702c-492e-a6dd-7a90ec691028), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.476884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_controller (404a6006-702c-492e-a6dd-7a90ec691028), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.505974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33966) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:12.519808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5f16139b-b235-4431-bcde-01cdd5fbd3a3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-425833467', 'description': 'tempest-secgroup-smoke-425833467 description', 'project_id': '534ec00707834d9cbfb4f670cfeda590'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:12.528770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (13b9dd73-653a-474d-904f-24c2031739ff), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.595854 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (404a6006-702c-492e-a6dd-7a90ec691028), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.599392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Fanout notify agent at l3_agent the message router_deleted on router 404a6006-702c-492e-a6dd-7a90ec691028 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:19:12.610112 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.615160 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5db29082-2838-475f-b4f1-15aa1f07a003 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/routers/404a6006-702c-492e-a6dd-7a90ec691028 HTTP/1.1" status: 204 len: 168 time: 1.3432124 Mar 24 02:19:12.616300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33968) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:12.644859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f16139b-b235-4431-bcde-01cdd5fbd3a3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.645113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f5e80362-8679-4245-af8b-39639e759fd4 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:12.677813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Subnet': ['ID=13b9dd73-653a-474d-904f-24c2031739ff,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:12.699798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Checking segment: {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:12.700560 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network hostable DHCP agents. Network: 8ee3ba97-1980-4303-b77a-6f5ad4d46166, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:12.737453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-b2774a4a-457f-4ab4-b341-eb7eaad8269c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting subnet 379c8d39-e33e-4364-9b79-5b017187320a {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:19:12.743800 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f5e80362-8679-4245-af8b-39639e759fd4 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:12.744198 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f5e80362-8679-4245-af8b-39639e759fd4), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.744939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2774a4a-457f-4ab4-b341-eb7eaad8269c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for subnet (379c8d39-e33e-4364-9b79-5b017187320a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.749655 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:12.776412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 8ee3ba97-1980-4303-b77a-6f5ad4d46166) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:12.785764 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:12.786630 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.801780 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2774a4a-457f-4ab4-b341-eb7eaad8269c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (379c8d39-e33e-4364-9b79-5b017187320a), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.811435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f16139b-b235-4431-bcde-01cdd5fbd3a3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group (8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.816685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f16139b-b235-4431-bcde-01cdd5fbd3a3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.819036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce1ee21c-edca-41ef-995b-5f782d02c63d None None] Network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:12.834620 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e93948a7-1524-435c-9311-e0b075f62eb1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.7171164 Mar 24 02:19:12.836714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33970) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:12.870987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f16139b-b235-4431-bcde-01cdd5fbd3a3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.871675 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Publish callbacks [] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.872537 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5f16139b-b235-4431-bcde-01cdd5fbd3a3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3654749 Mar 24 02:19:12.876934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33972) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:12.877726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f16139b-b235-4431-bcde-01cdd5fbd3a3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:12.892632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3ab43631-304c-42a4-a4dc-f178855267ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'security_group_rule': {'security_group_id': '8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182', 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:12.892949 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:12.939020 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ab43631-304c-42a4-a4dc-f178855267ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (e89f8c85-5406-40de-9f85-cd6a2c14e0d1), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.010000 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Attempting to bind port d14f8276-0a69-42c3-b78f-f19b41ffbc7b on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:13.010427 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Attempting to bind port d14f8276-0a69-42c3-b78f-f19b41ffbc7b by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:13.016728 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Attempting to bind port d14f8276-0a69-42c3-b78f-f19b41ffbc7b on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:13.026946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ab43631-304c-42a4-a4dc-f178855267ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (e89f8c85-5406-40de-9f85-cd6a2c14e0d1), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.030651 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15ddd15-ded5-4853-a50c-80f038bb2ba8 None None] Pushing event updated for resources: {'Port': ['ID=d14f8276-0a69-42c3-b78f-f19b41ffbc7b,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:13.033360 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:13.033735 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:13.034321 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.034554 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:13.035032 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Bound port: d14f8276-0a69-42c3-b78f-f19b41ffbc7b, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:13.035413 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.036018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ab43631-304c-42a4-a4dc-f178855267ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (e89f8c85-5406-40de-9f85-cd6a2c14e0d1), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.039896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:13.042616 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.050439 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Sync routers for ids ['47fea142-65a5-4020-a53c-bd6100f56181'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:13.066890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ab43631-304c-42a4-a4dc-f178855267ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e89f8c85-5406-40de-9f85-cd6a2c14e0d1,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:13.081742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f5e80362-8679-4245-af8b-39639e759fd4 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:13.082233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3ab43631-304c-42a4-a4dc-f178855267ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.084297 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3ab43631-304c-42a4-a4dc-f178855267ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2036157 Mar 24 02:19:13.091133 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33974) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:13.098733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3e0b9fdb-e738-4f76-8ed3-02dd0f186cca tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'security_group_rule': {'security_group_id': '8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182', 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:13.138055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e0b9fdb-e738-4f76-8ed3-02dd0f186cca tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (330896ae-3eb3-400a-8923-3638badfb419), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.138875 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] For port d14f8276-0a69-42c3-b78f-f19b41ffbc7b, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:13.143221 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] For port d14f8276-0a69-42c3-b78f-f19b41ffbc7b, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d14f8276-0a69-42c3-b78f-f19b41ffbc7b,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:13.151534 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.189731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2774a4a-457f-4ab4-b341-eb7eaad8269c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (379c8d39-e33e-4364-9b79-5b017187320a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.212164 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15ddd15-ded5-4853-a50c-80f038bb2ba8 None None] Pushing event updated for resources: {'Port': ['ID=d14f8276-0a69-42c3-b78f-f19b41ffbc7b,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:13.222845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e0b9fdb-e738-4f76-8ed3-02dd0f186cca tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (330896ae-3eb3-400a-8923-3638badfb419), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.228758 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e0b9fdb-e738-4f76-8ed3-02dd0f186cca tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (330896ae-3eb3-400a-8923-3638badfb419), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.239717 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Allocated IP 172.20.0.2 (8ee3ba97-1980-4303-b77a-6f5ad4d46166/13b9dd73-653a-474d-904f-24c2031739ff/59088ef0-7a68-43c1-86d4-bdbac19ceffd) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:13.240083 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:13.241839 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:13.262032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e0b9fdb-e738-4f76-8ed3-02dd0f186cca tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=330896ae-3eb3-400a-8923-3638badfb419,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:13.275819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3e0b9fdb-e738-4f76-8ed3-02dd0f186cca tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.281213 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3e0b9fdb-e738-4f76-8ed3-02dd0f186cca tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1888919 Mar 24 02:19:13.283486 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33976) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:13.290559 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d147d97a-b3cd-4a8d-95fd-3b42fb0563dc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'security_group_rule': {'security_group_id': '8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182', 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:13.326393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d147d97a-b3cd-4a8d-95fd-3b42fb0563dc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (c2080206-1cbb-4c79-87f6-e077a95aecd8), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.355104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2774a4a-457f-4ab4-b341-eb7eaad8269c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (379c8d39-e33e-4364-9b79-5b017187320a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.387444 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2774a4a-457f-4ab4-b341-eb7eaad8269c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Subnet': ['ID=379c8d39-e33e-4364-9b79-5b017187320a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:13.399562 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2774a4a-457f-4ab4-b341-eb7eaad8269c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.405700 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b2774a4a-457f-4ab4-b341-eb7eaad8269c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/subnets/379c8d39-e33e-4364-9b79-5b017187320a HTTP/1.1" status: 204 len: 168 time: 0.7881069 Mar 24 02:19:13.407254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33978) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:13.409349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Publish callbacks [] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.417421 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d31b07e-1c4f-4568-a270-a79b0064cd59 None None] Network 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:13.425699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.495085 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:13.530650 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.554893 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d147d97a-b3cd-4a8d-95fd-3b42fb0563dc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (c2080206-1cbb-4c79-87f6-e077a95aecd8), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.564661 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d147d97a-b3cd-4a8d-95fd-3b42fb0563dc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (c2080206-1cbb-4c79-87f6-e077a95aecd8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.601179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.605780 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d147d97a-b3cd-4a8d-95fd-3b42fb0563dc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c2080206-1cbb-4c79-87f6-e077a95aecd8,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:13.639831 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d147d97a-b3cd-4a8d-95fd-3b42fb0563dc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.641408 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d147d97a-b3cd-4a8d-95fd-3b42fb0563dc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3574944 Mar 24 02:19:13.644361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33980) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:13.649646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-fdb8ea20-04c4-4150-a5a0-c55331d998f8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'security_group_rule': {'security_group_id': '8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182', 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:13.673633 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:13.674291 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.677292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Routers {'47fea142-65a5-4020-a53c-bd6100f56181'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:13.677939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['47fea142-65a5-4020-a53c-bd6100f56181'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:13.726002 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:10Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:13.726788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:13.736967 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdb8ea20-04c4-4150-a5a0-c55331d998f8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (9d8782d5-7ac9-45ad-8b4a-beb39333f096), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.762475 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1cc598b-e16c-4ed1-a528-55195745f462 None None] The sync data for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv is: [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:10Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:13.768177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:13.773703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:13.777807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Pushing event updated for resources: {'Port': ['ID=59088ef0-7a68-43c1-86d4-bdbac19ceffd,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:13.780573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] For port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=39e6e0bd-b69e-4cbe-a167-9ac0634d796f,segment=NetworkSegment(0a6883c1-76e7-41d1-a530-50a73c5242ad),segment_id=0a6883c1-76e7-41d1-a530-50a73c5242ad)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:13.786451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.812234 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for 39e6e0bd-b69e-4cbe-a167-9ac0634d796f owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:13.888532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdb8ea20-04c4-4150-a5a0-c55331d998f8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (9d8782d5-7ac9-45ad-8b4a-beb39333f096), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.895217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdb8ea20-04c4-4150-a5a0-c55331d998f8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (9d8782d5-7ac9-45ad-8b4a-beb39333f096), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.904847 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Attempting to bind port 59088ef0-7a68-43c1-86d4-bdbac19ceffd on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:13.905085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Attempting to bind port 59088ef0-7a68-43c1-86d4-bdbac19ceffd by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:13.905336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Attempting to bind port 59088ef0-7a68-43c1-86d4-bdbac19ceffd on network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:13.916779 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:13.917068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Checking segment: {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:13.917338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.917710 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Bound using segment: {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:13.918191 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Bound port: 59088ef0-7a68-43c1-86d4-bdbac19ceffd, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:13.918592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.925038 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.1 (8ee3ba97-1980-4303-b77a-6f5ad4d46166/13b9dd73-653a-474d-904f-24c2031739ff/d3569980-3835-437c-aba6-4620efe7ee98) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:13.932843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb8ea20-04c4-4150-a5a0-c55331d998f8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9d8782d5-7ac9-45ad-8b4a-beb39333f096,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:13.946012 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fdb8ea20-04c4-4150-a5a0-c55331d998f8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.947425 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fdb8ea20-04c4-4150-a5a0-c55331d998f8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3018777 Mar 24 02:19:13.950310 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33982) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:13.955295 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3663c6b7-e244-4114-931f-c756a22f49ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'security_group_rule': {'security_group_id': '8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182', 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:13.971388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (39e6e0bd-b69e-4cbe-a167-9ac0634d796f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:13.974442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Set router 47fea142-65a5-4020-a53c-bd6100f56181 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:14.006144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=39e6e0bd-b69e-4cbe-a167-9ac0634d796f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:14.010835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] No DVR routers for this DVR port 39e6e0bd-b69e-4cbe-a167-9ac0634d796f on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:14.013581 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-3663c6b7-e244-4114-931f-c756a22f49ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Project 534ec00707834d9cbfb4f670cfeda590 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:19:14.048479 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3663c6b7-e244-4114-931f-c756a22f49ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (cedc392c-3515-42c7-b9b1-f4f9bb2be5cb), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.091255 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] For port 59088ef0-7a68-43c1-86d4-bdbac19ceffd, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:14.109198 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] For port 59088ef0-7a68-43c1-86d4-bdbac19ceffd, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=59088ef0-7a68-43c1-86d4-bdbac19ceffd,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:14.132699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dd5caf4-2495-4df8-8729-a24e62388c9c None None] DHCP port deletion for 24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:19:14.136305 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.139008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.142355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (d3569980-3835-437c-aba6-4620efe7ee98), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.172615 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:14.188010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3663c6b7-e244-4114-931f-c756a22f49ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (cedc392c-3515-42c7-b9b1-f4f9bb2be5cb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.189800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0a6883c1-76e7-41d1-a530-50a73c5242ad') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:14.190183 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0a6883c1-76e7-41d1-a530-50a73c5242ad') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:14.193097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (d3569980-3835-437c-aba6-4620efe7ee98), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.199263 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3663c6b7-e244-4114-931f-c756a22f49ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (cedc392c-3515-42c7-b9b1-f4f9bb2be5cb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.202204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (0a6883c1-76e7-41d1-a530-50a73c5242ad), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.244441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3663c6b7-e244-4114-931f-c756a22f49ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cedc392c-3515-42c7-b9b1-f4f9bb2be5cb,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:14.252425 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0a6883c1-76e7-41d1-a530-50a73c5242ad), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.262328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3663c6b7-e244-4114-931f-c756a22f49ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.263264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78cfbe5-d367-4df8-a0cd-f87293f29a9d None None] Pushing event updated for resources: {'Port': ['ID=59088ef0-7a68-43c1-86d4-bdbac19ceffd,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:14.264062 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3663c6b7-e244-4114-931f-c756a22f49ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3129048 Mar 24 02:19:14.266011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:14.266747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (0a6883c1-76e7-41d1-a530-50a73c5242ad), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:14.270177 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:14.273182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:14.274127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 33984) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:14.282347 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-36824097-546f-448a-8d31-f7e0431cf317 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'security_group_rule': {'security_group_id': '8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182', 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:14.292928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:14.295621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:14.375774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.382740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (f1e1a820-21ac-4c51-979d-f4b8742581f3), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.385342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=d3569980-3835-437c-aba6-4620efe7ee98,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:14.394171 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.401245 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/networks/24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5 HTTP/1.1" status: 204 len: 168 time: 0.9926307 Mar 24 02:19:14.402175 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 33986) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:14.427219 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0170473-3cee-44a7-9ad3-4248727bed0b tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Network': ['ID=24ccff6d-2dd6-4c2b-b18b-3ffd81b85bd5,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:14.445203 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-36824097-546f-448a-8d31-f7e0431cf317 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Project 534ec00707834d9cbfb4f670cfeda590 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:19:14.449928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '47fea142-65a5-4020-a53c-bd6100f56181', 'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250'}], 'enable_snat': True}, 'gw_port_id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:09Z', 'revision_number': 4, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'gw_port': {'id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:9e:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '46c15fce-88e8-4997-93a7-a523664f7da2', 'name': '', 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'mac_address': 'fa:16:3e:04:78:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_interface', 'standard_attr_id': 1264, 'fixed_ips': [{'subnet_id': 'a7b61086-a0a8-47c4-8975-c7a7a2a41661', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:09Z', 'revision_number': 2, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'subnets': [{'id': 'a7b61086-a0a8-47c4-8975-c7a7a2a41661', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:14.454689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-36824097-546f-448a-8d31-f7e0431cf317 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (7c466205-b4ad-4349-b111-a1f93f6bd82d), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.492479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Checking router: 47fea142-65a5-4020-a53c-bd6100f56181 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:19:14.494261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Updating router 47fea142-65a5-4020-a53c-bd6100f56181 port 46c15fce-88e8-4997-93a7-a523664f7da2 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:19:14.551901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.647978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-36824097-546f-448a-8d31-f7e0431cf317 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (7c466205-b4ad-4349-b111-a1f93f6bd82d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.653459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d14f8276-0a69-42c3-b78f-f19b41ffbc7b up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:14.682621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-36824097-546f-448a-8d31-f7e0431cf317 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (7c466205-b4ad-4349-b111-a1f93f6bd82d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.698306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port af2fb0b6-f9b7-432a-afad-cab1a5afa8bc {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:14.699023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (af2fb0b6-f9b7-432a-afad-cab1a5afa8bc), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.737231 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d3569980-3835-437c-aba6-4620efe7ee98), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.739560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36824097-546f-448a-8d31-f7e0431cf317 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7c466205-b4ad-4349-b111-a1f93f6bd82d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:14.743397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-36824097-546f-448a-8d31-f7e0431cf317 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.744793 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-36824097-546f-448a-8d31-f7e0431cf317 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4695771 Mar 24 02:19:14.860910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d14f8276-0a69-42c3-b78f-f19b41ffbc7b triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:14.861744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (af2fb0b6-f9b7-432a-afad-cab1a5afa8bc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.862185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.862759 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (af2fb0b6-f9b7-432a-afad-cab1a5afa8bc), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:14.884381 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for af2fb0b6-f9b7-432a-afad-cab1a5afa8bc owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:14.986574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.080796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d14f8276-0a69-42c3-b78f-f19b41ffbc7b is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:15.081302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.103353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d14f8276-0a69-42c3-b78f-f19b41ffbc7b, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d14f8276-0a69-42c3-b78f-f19b41ffbc7b,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:15.129447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.129776 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (af2fb0b6-f9b7-432a-afad-cab1a5afa8bc), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.185060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=af2fb0b6-f9b7-432a-afad-cab1a5afa8bc,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:15.232726 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 39e6e0bd-b69e-4cbe-a167-9ac0634d796f no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:19:15.276964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 39e6e0bd-b69e-4cbe-a167-9ac0634d796f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:19:15.277315 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 39e6e0bd-b69e-4cbe-a167-9ac0634d796f not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:19:15.295814 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d14f8276-0a69-42c3-b78f-f19b41ffbc7b,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:15.304327 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Publish callbacks [] for port (46c15fce-88e8-4997-93a7-a523664f7da2), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.316120 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.348856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for floatingip (d3cbb102-fe06-4e79-8e5e-9295bc55ca72), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.351607 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.359409 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-be7823b2-fcdf-4eac-bafa-f41995ac4ccf tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/floatingips/d3cbb102-fe06-4e79-8e5e-9295bc55ca72 HTTP/1.1" status: 204 len: 168 time: 0.9348931 Mar 24 02:19:15.360140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34036) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:15.393704 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dbf1482-9e5e-4ff7-8c16-7e6f3d3a4e91 None None] Pushing event updated for resources: {'Port': ['ID=46c15fce-88e8-4997-93a7-a523664f7da2,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:15.464103 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-38ebacbc-e238-4ef9-8e45-79676cee2c80 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:15.464687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-38ebacbc-e238-4ef9-8e45-79676cee2c80 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:15.470734 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-38ebacbc-e238-4ef9-8e45-79676cee2c80 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/ports/b895780e-e5c1-4a3c-8f9b-e7063a4e80f2 HTTP/1.1" status: 404 len: 333 time: 0.1068778 Mar 24 02:19:15.475182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34038) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:15.521592 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Attempting to bind port 46c15fce-88e8-4997-93a7-a523664f7da2 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:15.522156 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Attempting to bind port 46c15fce-88e8-4997-93a7-a523664f7da2 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '054b2715-ebd3-4b55-9daf-6e8904f5eae9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:15.522721 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Attempting to bind port 46c15fce-88e8-4997-93a7-a523664f7da2 on network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:15.524578 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-462f48b8-e475-4edb-b3b6-8b9109c5b33d tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "GET /v2.0/ports?device_id=404a6006-702c-492e-a6dd-7a90ec691028 HTTP/1.1" status: 200 len: 205 time: 0.0481894 Mar 24 02:19:15.527054 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34040) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:15.537563 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:15.538101 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Checking segment: {'id': '054b2715-ebd3-4b55-9daf-6e8904f5eae9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:15.545326 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.545916 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Bound using segment: {'id': '054b2715-ebd3-4b55-9daf-6e8904f5eae9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:15.547368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Bound port: 46c15fce-88e8-4997-93a7-a523664f7da2, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '054b2715-ebd3-4b55-9daf-6e8904f5eae9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:15.547807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.593890 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.api.v2.resource [None req-3acde129-616a-4c2e-970e-df70fc3d34fc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] delete failed (client error): The resource could not be found. Mar 24 02:19:15.595576 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3acde129-616a-4c2e-970e-df70fc3d34fc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/routers/404a6006-702c-492e-a6dd-7a90ec691028 HTTP/1.1" status: 404 len: 336 time: 0.0672548 Mar 24 02:19:15.597995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34042) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:15.641571 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-a12ce8a9-d6d9-415b-9f07-e9accba2b9e9 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:15.642301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a12ce8a9-d6d9-415b-9f07-e9accba2b9e9 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:15.646304 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a12ce8a9-d6d9-415b-9f07-e9accba2b9e9 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/subnets/379c8d39-e33e-4364-9b79-5b017187320a HTTP/1.1" status: 404 len: 337 time: 0.0472205 Mar 24 02:19:15.648782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34044) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:15.712512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] For port 46c15fce-88e8-4997-93a7-a523664f7da2, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:15.730652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] For port 46c15fce-88e8-4997-93a7-a523664f7da2, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=46c15fce-88e8-4997-93a7-a523664f7da2,segment=NetworkSegment(054b2715-ebd3-4b55-9daf-6e8904f5eae9),segment_id=054b2715-ebd3-4b55-9daf-6e8904f5eae9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:15.739822 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.815585 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-474f3caa-0e29-429c-8645-4e556ed6d20c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port 0e8c22c9-70ad-4c3f-b2a4-f20c99a95528 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:15.816518 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-474f3caa-0e29-429c-8645-4e556ed6d20c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (0e8c22c9-70ad-4c3f-b2a4-f20c99a95528), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.830961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dbf1482-9e5e-4ff7-8c16-7e6f3d3a4e91 None None] Pushing event updated for resources: {'Port': ['ID=46c15fce-88e8-4997-93a7-a523664f7da2,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:15.853966 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Routers {'47fea142-65a5-4020-a53c-bd6100f56181'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:15.855031 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['47fea142-65a5-4020-a53c-bd6100f56181'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:15.893621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (d3569980-3835-437c-aba6-4620efe7ee98), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:15.904942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (d3569980-3835-437c-aba6-4620efe7ee98), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.023408 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-474f3caa-0e29-429c-8645-4e556ed6d20c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (0e8c22c9-70ad-4c3f-b2a4-f20c99a95528), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.027842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ab27a135-9937-4e5d-aa41-b5ef80ef4b8d None None] Provisioning complete for port 46c15fce-88e8-4997-93a7-a523664f7da2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:16.028569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab27a135-9937-4e5d-aa41-b5ef80ef4b8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.044167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=d3569980-3835-437c-aba6-4620efe7ee98,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:16.057780 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-474f3caa-0e29-429c-8645-4e556ed6d20c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for 0e8c22c9-70ad-4c3f-b2a4-f20c99a95528 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:16.084873 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fa99cb3-7b6e-44ec-8b5c-729b736c9dd3 None None] Network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:16.085973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (f1e1a820-21ac-4c51-979d-f4b8742581f3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.196949 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] Set router 47fea142-65a5-4020-a53c-bd6100f56181 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:16.235987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:16.239191 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:16.285344 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-474f3caa-0e29-429c-8645-4e556ed6d20c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (0e8c22c9-70ad-4c3f-b2a4-f20c99a95528), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.317085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-474f3caa-0e29-429c-8645-4e556ed6d20c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=0e8c22c9-70ad-4c3f-b2a4-f20c99a95528,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:16.398468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-474f3caa-0e29-429c-8645-4e556ed6d20c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.404337 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-474f3caa-0e29-429c-8645-4e556ed6d20c tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/ports/0e8c22c9-70ad-4c3f-b2a4-f20c99a95528 HTTP/1.1" status: 204 len: 168 time: 0.7521837 Mar 24 02:19:16.404545 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34054) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:16.415822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router f1e1a820-21ac-4c51-979d-f4b8742581f3 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:16.470341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ab27a135-9937-4e5d-aa41-b5ef80ef4b8d None None] Current status of the port 46c15fce-88e8-4997-93a7-a523664f7da2 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:16.470790 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab27a135-9937-4e5d-aa41-b5ef80ef4b8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.516779 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ab27a135-9937-4e5d-aa41-b5ef80ef4b8d None None] For port 46c15fce-88e8-4997-93a7-a523664f7da2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=46c15fce-88e8-4997-93a7-a523664f7da2,segment=NetworkSegment(054b2715-ebd3-4b55-9daf-6e8904f5eae9),segment_id=054b2715-ebd3-4b55-9daf-6e8904f5eae9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:16.527480 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ab27a135-9937-4e5d-aa41-b5ef80ef4b8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.532845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a487f0bc-8db0-4d1e-a81f-c6fa3501d153 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port a1677890-315b-44e2-8649-adab791f7e84 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:16.533380 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a487f0bc-8db0-4d1e-a81f-c6fa3501d153 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a1677890-315b-44e2-8649-adab791f7e84), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.636875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a487f0bc-8db0-4d1e-a81f-c6fa3501d153 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a1677890-315b-44e2-8649-adab791f7e84), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.663084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a487f0bc-8db0-4d1e-a81f-c6fa3501d153 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for a1677890-315b-44e2-8649-adab791f7e84 owned by {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:16.732063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:16.755334 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b66ab496-c4b5-4536-8cb1-d601ba5be3d4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/f1e1a820-21ac-4c51-979d-f4b8742581f3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9175367 Mar 24 02:19:16.758108 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34084) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:16.790728 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 59088ef0-7a68-43c1-86d4-bdbac19ceffd up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:16.821285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab27a135-9937-4e5d-aa41-b5ef80ef4b8d None None] Pushing event updated for resources: {'Port': ['ID=46c15fce-88e8-4997-93a7-a523664f7da2,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:16.842377 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] Provisioning complete for port 59088ef0-7a68-43c1-86d4-bdbac19ceffd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:16.842827 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:16.903650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '47fea142-65a5-4020-a53c-bd6100f56181', 'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250'}], 'enable_snat': True}, 'gw_port_id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:09Z', 'revision_number': 4, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'gw_port': {'id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:9e:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '46c15fce-88e8-4997-93a7-a523664f7da2', 'name': '', 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'mac_address': 'fa:16:3e:04:78:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_interface', 'standard_attr_id': 1264, 'fixed_ips': [{'subnet_id': 'a7b61086-a0a8-47c4-8975-c7a7a2a41661', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'subnets': [{'id': 'a7b61086-a0a8-47c4-8975-c7a7a2a41661', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:16.959212 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2600d8b1-6b6f-45d8-a26e-6cbf325fa17e None None] The sync data for ids ['47fea142-65a5-4020-a53c-bd6100f56181'] in dv-neutron-834874-3-hyperv is: [{'id': '47fea142-65a5-4020-a53c-bd6100f56181', 'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250'}], 'enable_snat': True}, 'gw_port_id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:09Z', 'revision_number': 4, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'gw_port': {'id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:9e:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '46c15fce-88e8-4997-93a7-a523664f7da2', 'name': '', 'network_id': '5c3ada7d-b3db-49b1-9de8-6d179e82dad1', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'mac_address': 'fa:16:3e:04:78:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_interface', 'standard_attr_id': 1264, 'fixed_ips': [{'subnet_id': 'a7b61086-a0a8-47c4-8975-c7a7a2a41661', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'subnets': [{'id': 'a7b61086-a0a8-47c4-8975-c7a7a2a41661', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:16.984857 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 59088ef0-7a68-43c1-86d4-bdbac19ceffd triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:16.986813 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.061168 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Sync routers for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:17.085574 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:17.087442 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:17.107763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] Current status of the port 59088ef0-7a68-43c1-86d4-bdbac19ceffd is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:17.109375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.165139 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] For port 59088ef0-7a68-43c1-86d4-bdbac19ceffd, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=59088ef0-7a68-43c1-86d4-bdbac19ceffd,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:17.213356 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.312801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 59088ef0-7a68-43c1-86d4-bdbac19ceffd is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:17.318494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.344789 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:17.409464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] Provisioning complete for port 46c15fce-88e8-4997-93a7-a523664f7da2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:17.411402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.506285 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] Pushing event updated for resources: {'Port': ['ID=59088ef0-7a68-43c1-86d4-bdbac19ceffd,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:17.529065 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a487f0bc-8db0-4d1e-a81f-c6fa3501d153 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (a1677890-315b-44e2-8649-adab791f7e84), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.582464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:19:17.584111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:19:17.602578 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a487f0bc-8db0-4d1e-a81f-c6fa3501d153 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=a1677890-315b-44e2-8649-adab791f7e84,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:17.649114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-721acf46-94ca-4704-82d2-13f58e8630ad None None] Current status of the port 46c15fce-88e8-4997-93a7-a523664f7da2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:17.746791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68113042-a4c3-4fc4-af3d-f6198ae4d5c5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.747389 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68113042-a4c3-4fc4-af3d-f6198ae4d5c5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.747733 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68113042-a4c3-4fc4-af3d-f6198ae4d5c5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.748201 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68113042-a4c3-4fc4-af3d-f6198ae4d5c5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.748666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68113042-a4c3-4fc4-af3d-f6198ae4d5c5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.749126 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68113042-a4c3-4fc4-af3d-f6198ae4d5c5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.750167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68113042-a4c3-4fc4-af3d-f6198ae4d5c5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.752371 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-68113042-a4c3-4fc4-af3d-f6198ae4d5c5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4985 time: 0.9932837 Mar 24 02:19:17.755569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34090) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:17.773273 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:14Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'd3569980-3835-437c-aba6-4620efe7ee98', 'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:78:8e:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1274, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:13Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '13b9dd73-653a-474d-904f-24c2031739ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:17.780559 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4850a3c3-c053-4ee3-ae40-a51045367788 None None] Provisioning complete for port d3569980-3835-437c-aba6-4620efe7ee98 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:17.781503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a487f0bc-8db0-4d1e-a81f-c6fa3501d153 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.781962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4850a3c3-c053-4ee3-ae40-a51045367788 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3569980-3835-437c-aba6-4620efe7ee98), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.785382 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a487f0bc-8db0-4d1e-a81f-c6fa3501d153 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/ports/a1677890-315b-44e2-8649-adab791f7e84 HTTP/1.1" status: 204 len: 168 time: 1.3798695 Mar 24 02:19:17.792473 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34092) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:17.824705 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Checking router: f1e1a820-21ac-4c51-979d-f4b8742581f3 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:19:17.827199 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Updating router f1e1a820-21ac-4c51-979d-f4b8742581f3 port d3569980-3835-437c-aba6-4620efe7ee98 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:19:17.865416 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4850a3c3-c053-4ee3-ae40-a51045367788 None None] Port d3569980-3835-437c-aba6-4620efe7ee98 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:17.897173 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4850a3c3-c053-4ee3-ae40-a51045367788 None None] Provisioning complete for port 59088ef0-7a68-43c1-86d4-bdbac19ceffd triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:17.903603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4850a3c3-c053-4ee3-ae40-a51045367788 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.904793 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d3569980-3835-437c-aba6-4620efe7ee98), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:17.916659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85b56e11-b6e6-4bc5-a3a2-7b72d35bd813 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.930379 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-85b56e11-b6e6-4bc5-a3a2-7b72d35bd813 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "GET /v2.0/ports?device_id=089a3ef4-d121-4511-bd42-87d878f1416f HTTP/1.1" status: 200 len: 913 time: 0.1326454 Mar 24 02:19:17.932709 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34094) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:17.969275 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea4b5b48-9a0b-4ebe-b860-0b202fbfb14f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.969777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea4b5b48-9a0b-4ebe-b860-0b202fbfb14f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.970241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea4b5b48-9a0b-4ebe-b860-0b202fbfb14f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.970726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea4b5b48-9a0b-4ebe-b860-0b202fbfb14f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.977666 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea4b5b48-9a0b-4ebe-b860-0b202fbfb14f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.978216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea4b5b48-9a0b-4ebe-b860-0b202fbfb14f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.978712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea4b5b48-9a0b-4ebe-b860-0b202fbfb14f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:17.984407 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ea4b5b48-9a0b-4ebe-b860-0b202fbfb14f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4596 time: 0.2265999 Mar 24 02:19:17.985104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34096) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:18.026501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4850a3c3-c053-4ee3-ae40-a51045367788 None None] Current status of the port 59088ef0-7a68-43c1-86d4-bdbac19ceffd is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:18.172867 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 59088ef0-7a68-43c1-86d4-bdbac19ceffd is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:18.173926 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d14f8276-0a69-42c3-b78f-f19b41ffbc7b up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:18.275432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f33448e2-9e1a-424c-b5b5-a921e4895dd3 None None] Provisioning complete for port d3569980-3835-437c-aba6-4620efe7ee98 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:18.279961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f33448e2-9e1a-424c-b5b5-a921e4895dd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3569980-3835-437c-aba6-4620efe7ee98), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:18.344645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f33448e2-9e1a-424c-b5b5-a921e4895dd3 None None] Port d3569980-3835-437c-aba6-4620efe7ee98 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:18.370826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d14f8276-0a69-42c3-b78f-f19b41ffbc7b triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:18.371230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:18.373494 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Publish callbacks [] for port (d3569980-3835-437c-aba6-4620efe7ee98), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:18.382905 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d3569980-3835-437c-aba6-4620efe7ee98), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:18.497858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d14f8276-0a69-42c3-b78f-f19b41ffbc7b is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:18.547318 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-646110fc-ab0f-4280-8911-af6817aa2338 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3763 time: 0.5602381 Mar 24 02:19:18.664455 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Pushing event updated for resources: {'Port': ['ID=d3569980-3835-437c-aba6-4620efe7ee98,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:18.682165 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Attempting to bind port d3569980-3835-437c-aba6-4620efe7ee98 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:18.682571 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Attempting to bind port d3569980-3835-437c-aba6-4620efe7ee98 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:18.682916 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Attempting to bind port d3569980-3835-437c-aba6-4620efe7ee98 on network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:18.684438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (089a3ef4-d121-4511-bd42-87d878f1416f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:18.696663 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:18.697043 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Checking segment: {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:18.697447 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:18.697833 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Bound using segment: {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:18.698290 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Bound port: d3569980-3835-437c-aba6-4620efe7ee98, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:18.698707 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d3569980-3835-437c-aba6-4620efe7ee98), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:18.701390 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.701737 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.702094 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.702430 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.702819 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.703148 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.703472 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.703796 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.704308 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.704450 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.704788 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.705113 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.705429 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.705929 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.706064 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:18.784521 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 46c15fce-88e8-4997-93a7-a523664f7da2 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:18.851047 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] For port d3569980-3835-437c-aba6-4620efe7ee98, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:18.855762 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] For port d3569980-3835-437c-aba6-4620efe7ee98, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3569980-3835-437c-aba6-4620efe7ee98,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:18.869584 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d3569980-3835-437c-aba6-4620efe7ee98), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:18.918397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 46c15fce-88e8-4997-93a7-a523664f7da2 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:18.919230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:18.952170 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e04626-7403-45a5-bb40-0c42138e7115 None None] Pushing event updated for resources: {'Port': ['ID=d3569980-3835-437c-aba6-4620efe7ee98,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:18.965201 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:18.965833 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:18.995043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b4803449-e862-470f-a7c6-6698cbdde3c6 None None] Provisioning complete for port d3569980-3835-437c-aba6-4620efe7ee98 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:18.995668 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4803449-e862-470f-a7c6-6698cbdde3c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3569980-3835-437c-aba6-4620efe7ee98), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.137700 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:19.182824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port 831c0189-d6f7-4368-adf2-210b0bcf3a84 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:19.183262 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (831c0189-d6f7-4368-adf2-210b0bcf3a84), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.192574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 46c15fce-88e8-4997-93a7-a523664f7da2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:19.194638 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 59088ef0-7a68-43c1-86d4-bdbac19ceffd up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:19.197387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b4803449-e862-470f-a7c6-6698cbdde3c6 None None] Current status of the port d3569980-3835-437c-aba6-4620efe7ee98 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:19.197970 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4803449-e862-470f-a7c6-6698cbdde3c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d3569980-3835-437c-aba6-4620efe7ee98), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.318809 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-b4803449-e862-470f-a7c6-6698cbdde3c6 None None] For port d3569980-3835-437c-aba6-4620efe7ee98, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3569980-3835-437c-aba6-4620efe7ee98,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:19.318987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (831c0189-d6f7-4368-adf2-210b0bcf3a84), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.330633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b4803449-e862-470f-a7c6-6698cbdde3c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d3569980-3835-437c-aba6-4620efe7ee98), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.351236 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for 831c0189-d6f7-4368-adf2-210b0bcf3a84 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:19.374068 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34104) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:19.379593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4ad3e596-8491-4c1b-9df9-52819f4a3b4d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1689280590', 'description': 'tempest-secgroup-smoke-1689280590 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:19.417026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4803449-e862-470f-a7c6-6698cbdde3c6 None None] Pushing event updated for resources: {'Port': ['ID=d3569980-3835-437c-aba6-4620efe7ee98,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:19.425423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ad3e596-8491-4c1b-9df9-52819f4a3b4d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.446182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 59088ef0-7a68-43c1-86d4-bdbac19ceffd triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:19.446722 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.480578 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:14Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'd3569980-3835-437c-aba6-4620efe7ee98', 'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:78:8e:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1274, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:13Z', 'updated_at': '2022-03-24T02:19:18Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '13b9dd73-653a-474d-904f-24c2031739ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:19.499196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-5dddc3c7-a440-408a-a0e4-4017c04ab67f None None] Provisioning complete for port d3569980-3835-437c-aba6-4620efe7ee98 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:19.499837 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5dddc3c7-a440-408a-a0e4-4017c04ab67f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3569980-3835-437c-aba6-4620efe7ee98), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.523753 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ad3e596-8491-4c1b-9df9-52819f4a3b4d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (8fd6a4ec-1ce1-44d4-81a6-08c71925fa39), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.531568 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9295cdb1-d2c6-48d0-9d3b-e00268099db3 None None] The sync data for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv is: [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:14Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'd3569980-3835-437c-aba6-4620efe7ee98', 'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:78:8e:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1274, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:13Z', 'updated_at': '2022-03-24T02:19:18Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '13b9dd73-653a-474d-904f-24c2031739ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:19.532597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ad3e596-8491-4c1b-9df9-52819f4a3b4d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8fd6a4ec-1ce1-44d4-81a6-08c71925fa39), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.599411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 59088ef0-7a68-43c1-86d4-bdbac19ceffd is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:19.602277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ad3e596-8491-4c1b-9df9-52819f4a3b4d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:19.634352 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ad3e596-8491-4c1b-9df9-52819f4a3b4d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.646834 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4ad3e596-8491-4c1b-9df9-52819f4a3b4d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.2705979 Mar 24 02:19:19.650901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34106) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:19.655710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-641b17c5-ae88-46eb-aa95-d7e145ec875a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '8fd6a4ec-1ce1-44d4-81a6-08c71925fa39', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:19.698457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-5dddc3c7-a440-408a-a0e4-4017c04ab67f None None] Current status of the port d3569980-3835-437c-aba6-4620efe7ee98 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:19.707208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-641b17c5-ae88-46eb-aa95-d7e145ec875a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (148095a2-1267-4cfb-beb4-9c090b191ff8), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.715864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (831c0189-d6f7-4368-adf2-210b0bcf3a84), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.744817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=831c0189-d6f7-4368-adf2-210b0bcf3a84,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:19.771827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-641b17c5-ae88-46eb-aa95-d7e145ec875a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (148095a2-1267-4cfb-beb4-9c090b191ff8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.777504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-641b17c5-ae88-46eb-aa95-d7e145ec875a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (148095a2-1267-4cfb-beb4-9c090b191ff8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.801917 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-641b17c5-ae88-46eb-aa95-d7e145ec875a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=148095a2-1267-4cfb-beb4-9c090b191ff8,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:19.818449 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-641b17c5-ae88-46eb-aa95-d7e145ec875a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:19.825163 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34108) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:19.825854 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-641b17c5-ae88-46eb-aa95-d7e145ec875a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1738117 Mar 24 02:19:19.830949 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-5f1eaba8-d9be-4bc3-a8ea-dfce6c2d5fda tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '8fd6a4ec-1ce1-44d4-81a6-08c71925fa39', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:19.953264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1eaba8-d9be-4bc3-a8ea-dfce6c2d5fda tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (b981fa98-c222-4d8e-b3a2-2d4e8b076072), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.014503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (089a3ef4-d121-4511-bd42-87d878f1416f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.029799 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1eaba8-d9be-4bc3-a8ea-dfce6c2d5fda tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (b981fa98-c222-4d8e-b3a2-2d4e8b076072), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.038221 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1eaba8-d9be-4bc3-a8ea-dfce6c2d5fda tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (b981fa98-c222-4d8e-b3a2-2d4e8b076072), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.140999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1eaba8-d9be-4bc3-a8ea-dfce6c2d5fda tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b981fa98-c222-4d8e-b3a2-2d4e8b076072,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:20.147451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1eaba8-d9be-4bc3-a8ea-dfce6c2d5fda tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.148631 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5f1eaba8-d9be-4bc3-a8ea-dfce6c2d5fda tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3222692 Mar 24 02:19:20.151891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34110) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:20.156596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ac8ffc22-e2ea-4f26-8e32-5cfa43e9cabf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '8fd6a4ec-1ce1-44d4-81a6-08c71925fa39', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:20.195964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac8ffc22-e2ea-4f26-8e32-5cfa43e9cabf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (551113fb-791b-4d9b-9595-9908cf3db010), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.258779 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac8ffc22-e2ea-4f26-8e32-5cfa43e9cabf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (551113fb-791b-4d9b-9595-9908cf3db010), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.263223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac8ffc22-e2ea-4f26-8e32-5cfa43e9cabf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (551113fb-791b-4d9b-9595-9908cf3db010), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.286954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac8ffc22-e2ea-4f26-8e32-5cfa43e9cabf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=551113fb-791b-4d9b-9595-9908cf3db010,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:20.294106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ac8ffc22-e2ea-4f26-8e32-5cfa43e9cabf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.295503 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ac8ffc22-e2ea-4f26-8e32-5cfa43e9cabf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1426065 Mar 24 02:19:20.298322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34112) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:20.302818 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2113835a-e0bf-456f-ab20-93cdeacf61de tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '8fd6a4ec-1ce1-44d4-81a6-08c71925fa39', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:20.309590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Router 089a3ef4-d121-4511-bd42-87d878f1416f has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:20.333997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2113835a-e0bf-456f-ab20-93cdeacf61de tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (34df1d64-4edb-4924-89ff-a7acf34214ef), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.399203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2113835a-e0bf-456f-ab20-93cdeacf61de tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (34df1d64-4edb-4924-89ff-a7acf34214ef), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.405008 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2113835a-e0bf-456f-ab20-93cdeacf61de tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (34df1d64-4edb-4924-89ff-a7acf34214ef), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.424700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2113835a-e0bf-456f-ab20-93cdeacf61de tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=34df1d64-4edb-4924-89ff-a7acf34214ef,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:20.438212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2113835a-e0bf-456f-ab20-93cdeacf61de tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.439706 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2113835a-e0bf-456f-ab20-93cdeacf61de tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1401484 Mar 24 02:19:20.442426 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34116) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:20.449095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4a2bc8f0-f2f9-436b-8151-41971fe3e3e8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '8fd6a4ec-1ce1-44d4-81a6-08c71925fa39', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:20.455380 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:20.463465 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7e6e061b-df50-401a-8204-1be3bbd3c5bc tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "PUT /v2.0/routers/089a3ef4-d121-4511-bd42-87d878f1416f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5272307 Mar 24 02:19:20.464744 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34118) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:20.464960 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e99c40fc-6ffc-4b51-a0d3-16c4eaae70c9 None None] Sync routers for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:20.476329 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e99c40fc-6ffc-4b51-a0d3-16c4eaae70c9 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:20.477474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e99c40fc-6ffc-4b51-a0d3-16c4eaae70c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:20.483070 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-4a2bc8f0-f2f9-436b-8151-41971fe3e3e8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:19:20.501042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4a2bc8f0-f2f9-436b-8151-41971fe3e3e8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (144ab494-708b-4f9e-9311-4bcbbdb8a97a), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.519227 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e99c40fc-6ffc-4b51-a0d3-16c4eaae70c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:20.540645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e99c40fc-6ffc-4b51-a0d3-16c4eaae70c9 None None] Routers {'089a3ef4-d121-4511-bd42-87d878f1416f'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:20.541375 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e99c40fc-6ffc-4b51-a0d3-16c4eaae70c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['089a3ef4-d121-4511-bd42-87d878f1416f'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:20.586317 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e99c40fc-6ffc-4b51-a0d3-16c4eaae70c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:20.587122 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e99c40fc-6ffc-4b51-a0d3-16c4eaae70c9 None None] The sync data for ids ['089a3ef4-d121-4511-bd42-87d878f1416f'] in dv-neutron-834874-3-hyperv is: [] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:20.590788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4a2bc8f0-f2f9-436b-8151-41971fe3e3e8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (144ab494-708b-4f9e-9311-4bcbbdb8a97a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.597960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4a2bc8f0-f2f9-436b-8151-41971fe3e3e8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (144ab494-708b-4f9e-9311-4bcbbdb8a97a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.630879 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a2bc8f0-f2f9-436b-8151-41971fe3e3e8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=144ab494-708b-4f9e-9311-4bcbbdb8a97a,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:20.636289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4a2bc8f0-f2f9-436b-8151-41971fe3e3e8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.640869 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4a2bc8f0-f2f9-436b-8151-41971fe3e3e8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1968257 Mar 24 02:19:20.641985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34120) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:20.649193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4d3aec94-b2bf-44e5-8f19-9f969e863898 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '8fd6a4ec-1ce1-44d4-81a6-08c71925fa39', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:20.670046 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3569980-3835-437c-aba6-4620efe7ee98 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:20.688498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router (089a3ef4-d121-4511-bd42-87d878f1416f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.692795 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-4d3aec94-b2bf-44e5-8f19-9f969e863898 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:19:20.736403 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d3569980-3835-437c-aba6-4620efe7ee98 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:20.737047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d3569980-3835-437c-aba6-4620efe7ee98), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.758356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4d3aec94-b2bf-44e5-8f19-9f969e863898 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (2623029b-8560-4cc6-9907-afd93d5e0809), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.834790 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4d3aec94-b2bf-44e5-8f19-9f969e863898 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (2623029b-8560-4cc6-9907-afd93d5e0809), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.841851 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d3569980-3835-437c-aba6-4620efe7ee98 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:20.843490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4d3aec94-b2bf-44e5-8f19-9f969e863898 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (2623029b-8560-4cc6-9907-afd93d5e0809), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.876120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3aec94-b2bf-44e5-8f19-9f969e863898 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2623029b-8560-4cc6-9907-afd93d5e0809,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:20.881960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_gateway (089a3ef4-d121-4511-bd42-87d878f1416f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.888032 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4d3aec94-b2bf-44e5-8f19-9f969e863898 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:20.894643 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4d3aec94-b2bf-44e5-8f19-9f969e863898 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2445171 Mar 24 02:19:20.966376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting port 443ae422-1387-4a4d-8be1-2b56c4de4e8d {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:20.967045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (443ae422-1387-4a4d-8be1-2b56c4de4e8d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:21.067596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (443ae422-1387-4a4d-8be1-2b56c4de4e8d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:21.085873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Calling delete_port for 443ae422-1387-4a4d-8be1-2b56c4de4e8d owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:21.192164 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-3cecabe6-52f5-4ac1-8484-7897ae29dd5a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1689280590&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.0922396 Mar 24 02:19:21.384810 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-6eff92c1-0880-4644-a1ac-4f85df141692 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:21.386301 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-6eff92c1-0880-4644-a1ac-4f85df141692 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/networks?id=8ee3ba97-1980-4303-b77a-6f5ad4d46166 HTTP/1.1" status: 200 len: 796 time: 0.1770928 Mar 24 02:19:21.439258 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-b580044e-c5dd-42a1-a23f-26d63e5b9d47 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/quotas/6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 375 time: 0.0247540 Mar 24 02:19:21.499784 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (443ae422-1387-4a4d-8be1-2b56c4de4e8d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:21.538692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Port': ['ID=443ae422-1387-4a4d-8be1-2b56c4de4e8d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:21.592650 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-eb25e072-183f-4fd0-9080-ff467c2910b3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1521702 Mar 24 02:19:21.652913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (089a3ef4-d121-4511-bd42-87d878f1416f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:21.757430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (089a3ef4-d121-4511-bd42-87d878f1416f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:21.764890 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router_controller (089a3ef4-d121-4511-bd42-87d878f1416f), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:21.822605 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-be00094f-4fa7-41f0-9d47-a4cfa668e5b0 service neutron] 10.222.0.20 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2172191 Mar 24 02:19:21.823567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (089a3ef4-d121-4511-bd42-87d878f1416f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:21.824083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Fanout notify agent at l3_agent the message router_deleted on router 089a3ef4-d121-4511-bd42-87d878f1416f {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:19:21.831666 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:21.835152 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f8e56b16-09a9-4f58-9cce-82a681382ad1 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/routers/089a3ef4-d121-4511-bd42-87d878f1416f HTTP/1.1" status: 204 len: 168 time: 1.3680820 Mar 24 02:19:21.835303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34136) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:21.902470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-1fcf04ec-587d-4caf-b549-dfbc1497bbcb tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Deleting subnet 35936600-4794-4c7a-9459-34f9b2293644 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:19:21.908117 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1fcf04ec-587d-4caf-b549-dfbc1497bbcb tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for subnet (35936600-4794-4c7a-9459-34f9b2293644), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:21.929082 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cdea3702-5ab8-4160-97a4-c23bcc487d04 service neutron] 10.222.0.20 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928137 Mar 24 02:19:21.952149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1fcf04ec-587d-4caf-b549-dfbc1497bbcb tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (35936600-4794-4c7a-9459-34f9b2293644), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.001796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1fcf04ec-587d-4caf-b549-dfbc1497bbcb tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (35936600-4794-4c7a-9459-34f9b2293644), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.099385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1fcf04ec-587d-4caf-b549-dfbc1497bbcb tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (35936600-4794-4c7a-9459-34f9b2293644), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.126212 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1fcf04ec-587d-4caf-b549-dfbc1497bbcb tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.128761 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-39e58844-2be7-4d42-89a1-3270d07e4ca3 req-2aee9e83-b8c9-49b3-8174-2bb2884f2e20 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 210 time: 0.0452449 Mar 24 02:19:22.129577 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1fcf04ec-587d-4caf-b549-dfbc1497bbcb tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/subnets/35936600-4794-4c7a-9459-34f9b2293644 HTTP/1.1" status: 204 len: 168 time: 0.2932305 Mar 24 02:19:22.132752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34142) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:22.153865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fcf04ec-587d-4caf-b549-dfbc1497bbcb tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Subnet': ['ID=35936600-4794-4c7a-9459-34f9b2293644,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:22.233971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (383df69d-c9d6-4f76-a384-f1c5ebdd10fe), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.337328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (383df69d-c9d6-4f76-a384-f1c5ebdd10fe), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.361886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['383df69d-c9d6-4f76-a384-f1c5ebdd10fe']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:22.374095 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c982c793-584e-47e2-b9d8-70812f2a84ad') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:22.374417 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c982c793-584e-47e2-b9d8-70812f2a84ad') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:22.385086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (c982c793-584e-47e2-b9d8-70812f2a84ad), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.402865 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (c982c793-584e-47e2-b9d8-70812f2a84ad), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.411149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Releasing vlan 135 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:22.411645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (c982c793-584e-47e2-b9d8-70812f2a84ad), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:22.416175 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:22.485609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (383df69d-c9d6-4f76-a384-f1c5ebdd10fe), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.490504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:22.496939 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] 10.222.0.20 "DELETE /v2.0/networks/383df69d-c9d6-4f76-a384-f1c5ebdd10fe HTTP/1.1" status: 204 len: 168 time: 0.3605828 Mar 24 02:19:22.518326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9107acc1-cb4c-488e-bb16-34064824cd12 tempest-FloatingIPTestJSON-1264428142 tempest-FloatingIPTestJSON-1264428142-project] Pushing event deleted for resources: {'Network': ['ID=383df69d-c9d6-4f76-a384-f1c5ebdd10fe,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:22.783735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34156) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:22.929135 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5e9f5e0f-8723-447b-8a7a-72eed89daa53 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=4f11674605a349f28f6886bf409a1207&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1439781 Mar 24 02:19:22.931679 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34160) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:22.979502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eeb2cb74-d4af-4ebf-96ea-bae0af78ea1b admin admin] Publish callbacks [] for security_group (d39136af-d648-403d-809b-53a1a8bcdd1b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:23.001270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eeb2cb74-d4af-4ebf-96ea-bae0af78ea1b admin admin] Publish callbacks [] for security_group (d39136af-d648-403d-809b-53a1a8bcdd1b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:23.051689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eeb2cb74-d4af-4ebf-96ea-bae0af78ea1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d39136af-d648-403d-809b-53a1a8bcdd1b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:23.056104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eeb2cb74-d4af-4ebf-96ea-bae0af78ea1b admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:23.056104 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eeb2cb74-d4af-4ebf-96ea-bae0af78ea1b admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/d39136af-d648-403d-809b-53a1a8bcdd1b HTTP/1.1" status: 204 len: 168 time: 0.1233616 Mar 24 02:19:23.064701 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb2cb74-d4af-4ebf-96ea-bae0af78ea1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d39136af-d648-403d-809b-53a1a8bcdd1b,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:23.263221 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e89b2de2-dfd1-4ec8-ba29-dde5d3205081 req-66e7b9a9-15bf-41a5-812b-fdb571713b9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 210 time: 0.0463841 Mar 24 02:19:23.286941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-028918a2-f492-425f-a3dc-a0018463497f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:23.288800 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-028918a2-f492-425f-a3dc-a0018463497f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=8ee3ba97-1980-4303-b77a-6f5ad4d46166 HTTP/1.1" status: 200 len: 796 time: 0.1841235 Mar 24 02:19:23.361358 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-690e8a45-4fbb-4906-9b78-6bab2528319b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 380 time: 0.0630963 Mar 24 02:19:23.371523 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'device_id': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'admin_state_up': True, 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'security_groups': ['8fd6a4ec-1ce1-44d4-81a6-08c71925fa39']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:23.493391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:23.496952 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:23.645084 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.3 (8ee3ba97-1980-4303-b77a-6f5ad4d46166/13b9dd73-653a-474d-904f-24c2031739ff/8c01fb2d-b016-4fc0-9ec9-85135306e3cf) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:23.830351 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:23.868335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:23.892980 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34190) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:23.914168 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:23.917326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:23.923341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:23.951552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:23.982372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:23.984815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.010576 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-cd096818-efad-4986-af18-cd5c9cb04629 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6438992 Mar 24 02:19:24.021838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Request body: {'port': {'device_id': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:24.022595 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1071649623'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:24.050140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:24.054144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.065222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.171789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for security_group (577901d5-44c3-4861-9567-0f0305668923), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.177108 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (577901d5-44c3-4861-9567-0f0305668923), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.209532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 148} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:24.216134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'SecurityGroup': ['ID=577901d5-44c3-4861-9567-0f0305668923,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:24.224179 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (9d9f601d-87a0-44ff-91d0-561665693fb3), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.224521 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment 9d9f601d-87a0-44ff-91d0-561665693fb3 of type vlan for network 0ccf211a-6709-496e-b50e-8d61163b6816 Mar 24 02:19:24.266936 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-572555b2-6e3b-41b8-8b8c-5506ce153150 None None] Provisioning complete for port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:24.267584 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-572555b2-6e3b-41b8-8b8c-5506ce153150 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.287092 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (0ccf211a-6709-496e-b50e-8d61163b6816), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.322092 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (0ccf211a-6709-496e-b50e-8d61163b6816), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.332447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:24.336875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.339509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-572555b2-6e3b-41b8-8b8c-5506ce153150 None None] Port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:24.411023 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.5161264 Mar 24 02:19:24.421749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d33b78-2b6e-4bd0-be8e-7976e7c88568 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=0ccf211a-6709-496e-b50e-8d61163b6816,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:24.449307 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 0ccf211a-6709-496e-b50e-8d61163b6816 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:24.467870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.489309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3f8423-c41d-4874-bf7c-98b25937d020 req-70bfd544-848a-46b4-9186-ea49677a3661 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:24.489309 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4f3f8423-c41d-4874-bf7c-98b25937d020 req-70bfd544-848a-46b4-9186-ea49677a3661 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 931 time: 0.0899515 Mar 24 02:19:24.639372 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4f3f8423-c41d-4874-bf7c-98b25937d020 req-8411b876-7040-42b0-875a-12df389b0080 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1383405 Mar 24 02:19:24.841418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8c01fb2d-b016-4fc0-9ec9-85135306e3cf {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:19:24.849478 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Publish callbacks [] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.863225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Transition to ACTIVE for port object 8c01fb2d-b016-4fc0-9ec9-85135306e3cf will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:19:24.866575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:24.909251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Pushing event updated for resources: {'Port': ['ID=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:25.004538 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Attempting to bind port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:25.004880 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Attempting to bind port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:25.005363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Attempting to bind port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf on network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:25.009870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf on network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:19:25.010320 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Attempting to bind port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf on network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:25.028945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:25.029304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Checking segment: {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:25.029681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Bound using segment: {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:25.030145 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Bound port: 8c01fb2d-b016-4fc0-9ec9-85135306e3cf, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:25.030494 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:25.111335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] For port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:25.114395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] For port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:25.129687 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:25.186316 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Pushing event updated for resources: {'Port': ['ID=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:25.199938 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:25.200710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:25.202174 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-dfd18ff7-f5e3-4d9b-a0cb-a3a88277e05f service neutron] 10.222.0.30 "PUT /v2.0/ports/8c01fb2d-b016-4fc0-9ec9-85135306e3cf HTTP/1.1" status: 200 len: 1093 time: 1.1849527 Mar 24 02:19:25.203177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:19:25.205555 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81" -d '{"events": [{"name": "network-changed", "server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:19:25.280047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:19:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ceb43f3f-e6d1-44d3-9608-97acc16b677c x-openstack-request-id: req-ceb43f3f-e6d1-44d3-9608-97acc16b677c {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:19:25.280047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:19:25.280047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-ceb43f3f-e6d1-44d3-9608-97acc16b677c {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:19:25.281564 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ceb43f3f-e6d1-44d3-9608-97acc16b677c'] response: {'name': 'network-changed', 'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'status': 'completed', 'code': 200} Mar 24 02:19:25.303247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-bd3b9cf8-c573-46af-8c2d-49a9082e0a9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:25.304880 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-bd3b9cf8-c573-46af-8c2d-49a9082e0a9d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 1127 time: 0.0605075 Mar 24 02:19:25.365117 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-0297a2d4-5a77-4458-9e24-cff56a1e6a46 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf HTTP/1.1" status: 200 len: 217 time: 0.0537841 Mar 24 02:19:25.427713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-15daba27-2ad4-430c-8205-a568b9f8b369 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:25.429212 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-15daba27-2ad4-430c-8205-a568b9f8b369 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=13b9dd73-653a-474d-904f-24c2031739ff HTTP/1.1" status: 200 len: 834 time: 0.0579755 Mar 24 02:19:25.491117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-4d413efd-27f8-4bae-81f9-1a9920f2f122 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:25.492809 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-4d413efd-27f8-4bae-81f9-1a9920f2f122 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=8ee3ba97-1980-4303-b77a-6f5ad4d46166&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0574150 Mar 24 02:19:25.600375 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-b39701a8-a935-474e-b315-d42b30f31d22 service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1012778 Mar 24 02:19:25.743320 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53ba7b61-ab09-4896-ab95-d0913b641517 req-347f51e7-5cda-4f32-9c00-915ecdbfb851 service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1364808 Mar 24 02:19:25.858187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c95579-74a9-4dd8-b97f-0f50ee9dce0b req-464280ed-adbc-490d-a600-4d537154fd3a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:25.860250 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-88c95579-74a9-4dd8-b97f-0f50ee9dce0b req-464280ed-adbc-490d-a600-4d537154fd3a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 943 time: 0.1384120 Mar 24 02:19:25.888876 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-8a6b595b-28b0-496b-a711-b59cbf51e01e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:25.891261 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-8a6b595b-28b0-496b-a711-b59cbf51e01e service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 1127 time: 0.0923891 Mar 24 02:19:25.980061 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-88c95579-74a9-4dd8-b97f-0f50ee9dce0b req-815bc484-28e3-4c98-9e13-57776f4a934b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1115663 Mar 24 02:19:26.029581 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-38906c16-1aa3-4d13-bd9c-bd27931e2ea4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:26.031723 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-38906c16-1aa3-4d13-bd9c-bd27931e2ea4 service neutron] 10.222.0.30 "GET /v2.0/networks?id=8ee3ba97-1980-4303-b77a-6f5ad4d46166 HTTP/1.1" status: 200 len: 897 time: 0.1351130 Mar 24 02:19:26.078746 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-a54f76f8-989c-413e-b582-b058095b11a7 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf HTTP/1.1" status: 200 len: 217 time: 0.0410767 Mar 24 02:19:26.129041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-3e0687a1-dd26-4163-9b57-06e17c69d43a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:26.130812 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-3e0687a1-dd26-4163-9b57-06e17c69d43a service neutron] 10.222.0.30 "GET /v2.0/subnets?id=13b9dd73-653a-474d-904f-24c2031739ff HTTP/1.1" status: 200 len: 834 time: 0.0469065 Mar 24 02:19:26.183741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-f2dd231f-f3dc-47b4-801c-a4aff7bcb8a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:26.185381 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-f2dd231f-f3dc-47b4-801c-a4aff7bcb8a9 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=8ee3ba97-1980-4303-b77a-6f5ad4d46166&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0492616 Mar 24 02:19:26.279921 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-cedc7aa4-2f5d-448c-a1c4-380cbaf622be service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881503 Mar 24 02:19:26.378367 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7f87cd82-c46d-4fdf-bc0a-b3b74e5ece81 req-6cea4f85-91e0-4045-8c71-98118b5d582b service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928581 Mar 24 02:19:27.121910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491215c8-64cc-4287-a1f1-c9477d418c4e req-5a64276d-327a-473c-9a3d-388b60a40dc8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:27.123471 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-491215c8-64cc-4287-a1f1-c9477d418c4e req-5a64276d-327a-473c-9a3d-388b60a40dc8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 943 time: 0.0560014 Mar 24 02:19:27.188060 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-491215c8-64cc-4287-a1f1-c9477d418c4e req-679a8035-c9db-4129-8e1b-03d33cdbeb6b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0547023 Mar 24 02:19:27.371774 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9213201a-a4a8-459f-aca5-368cebad5645 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:27.596688 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34208) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:27.601741 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': '0ccf211a-6709-496e-b50e-8d61163b6816', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:27.691708 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:27.695185 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:27.883323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (29791c30-6dd7-4de5-bd24-ba31758c1a17), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:27.951447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=29791c30-6dd7-4de5-bd24-ba31758c1a17,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:27.960700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking segment: {'id': '9d9f601d-87a0-44ff-91d0-561665693fb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '0ccf211a-6709-496e-b50e-8d61163b6816'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:27.961060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network hostable DHCP agents. Network: 0ccf211a-6709-496e-b50e-8d61163b6816, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:27.978252 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network 0ccf211a-6709-496e-b50e-8d61163b6816 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:27.989544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 0ccf211a-6709-496e-b50e-8d61163b6816) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:27.993998 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:19:27.994568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:27.994691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.004739 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-679f97a3-09a4-461a-a685-18d3feb1103c None None] Network 0ccf211a-6709-496e-b50e-8d61163b6816 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:28.014814 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9cf78672-bf0e-4b43-892b-6aff1d8dc8a7 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4158359 Mar 24 02:19:28.018186 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34212) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:28.023687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1197909783'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:28.047888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:28.051273 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.083262 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 146} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:28.095227 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (6c859922-cd8a-4c93-b570-ad836597870f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.095587 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment 6c859922-cd8a-4c93-b570-ad836597870f of type vlan for network 74dc4710-4a35-4b92-a96c-4c174bd358fa Mar 24 02:19:28.137525 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-0ccf211a-6709-496e-b50e-8d61163b6816', 'network_id': '0ccf211a-6709-496e-b50e-8d61163b6816', 'project_id': 'b58415804b1b4553b1533717490a0447', 'fixed_ips': [{'subnet_id': '29791c30-6dd7-4de5-bd24-ba31758c1a17'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:28.138396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.151660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (74dc4710-4a35-4b92-a96c-4c174bd358fa), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.180557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (74dc4710-4a35-4b92-a96c-4c174bd358fa), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.185520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:28.186095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.282294 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2606657 Mar 24 02:19:28.284853 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34216) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:28.296923 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': '74dc4710-4a35-4b92-a96c-4c174bd358fa', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:28.300359 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Allocated IP 2001:db8:0:ffff::2 (0ccf211a-6709-496e-b50e-8d61163b6816/29791c30-6dd7-4de5-bd24-ba31758c1a17/ea05e3d3-1117-4d55-8f08-80d687967c45) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:28.315463 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4fb309-ceb4-4f7e-a196-290d51a2256f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=74dc4710-4a35-4b92-a96c-4c174bd358fa,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:28.329928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ad2f05-09e2-41e4-a622-cb5db37c7979 req-66f1cf10-16e3-49af-bf1b-e61e987edc94 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:28.331607 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d7ad2f05-09e2-41e4-a622-cb5db37c7979 req-66f1cf10-16e3-49af-bf1b-e61e987edc94 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 943 time: 0.0628026 Mar 24 02:19:28.373456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 74dc4710-4a35-4b92-a96c-4c174bd358fa details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:28.417625 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d7ad2f05-09e2-41e4-a622-cb5db37c7979 req-405808f5-33ed-4eca-be02-0ba56f4ff062 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0686336 Mar 24 02:19:28.429616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:28.433357 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.695865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Publish callbacks [] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.703184 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.740508 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Network 0ccf211a-6709-496e-b50e-8d61163b6816 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:28.745885 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:28.753224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:28.763950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Pushing event updated for resources: {'Port': ['ID=ea05e3d3-1117-4d55-8f08-80d687967c45,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:28.821928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Attempting to bind port ea05e3d3-1117-4d55-8f08-80d687967c45 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:28.822913 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Attempting to bind port ea05e3d3-1117-4d55-8f08-80d687967c45 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '9d9f601d-87a0-44ff-91d0-561665693fb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '0ccf211a-6709-496e-b50e-8d61163b6816'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:28.824294 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Attempting to bind port ea05e3d3-1117-4d55-8f08-80d687967c45 on network 0ccf211a-6709-496e-b50e-8d61163b6816 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:28.831073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:28.831448 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Checking segment: {'id': '9d9f601d-87a0-44ff-91d0-561665693fb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '0ccf211a-6709-496e-b50e-8d61163b6816'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:28.831853 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.832350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Bound using segment: {'id': '9d9f601d-87a0-44ff-91d0-561665693fb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '0ccf211a-6709-496e-b50e-8d61163b6816'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:28.832834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Bound port: ea05e3d3-1117-4d55-8f08-80d687967c45, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9d9f601d-87a0-44ff-91d0-561665693fb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '0ccf211a-6709-496e-b50e-8d61163b6816'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:28.833208 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.903471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] For port ea05e3d3-1117-4d55-8f08-80d687967c45, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:28.907108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] For port ea05e3d3-1117-4d55-8f08-80d687967c45, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ea05e3d3-1117-4d55-8f08-80d687967c45,segment=NetworkSegment(9d9f601d-87a0-44ff-91d0-561665693fb3),segment_id=9d9f601d-87a0-44ff-91d0-561665693fb3)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:28.914147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.953233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (0341fe4d-7368-4f4f-ad0f-81736ac09eaa), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:28.989209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e69d82-d3e1-420f-80a4-95947a24d66c None None] Pushing event updated for resources: {'Port': ['ID=ea05e3d3-1117-4d55-8f08-80d687967c45,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:29.037833 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=0341fe4d-7368-4f4f-ad0f-81736ac09eaa,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:29.057405 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking segment: {'id': '6c859922-cd8a-4c93-b570-ad836597870f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '74dc4710-4a35-4b92-a96c-4c174bd358fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:29.057778 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network hostable DHCP agents. Network: 74dc4710-4a35-4b92-a96c-4c174bd358fa, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:29.077351 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network 74dc4710-4a35-4b92-a96c-4c174bd358fa is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:29.087380 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 74dc4710-4a35-4b92-a96c-4c174bd358fa) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:29.091853 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:29.092462 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.101594 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-137c2389-1624-4da3-903c-0aa2af664d3a None None] Network 74dc4710-4a35-4b92-a96c-4c174bd358fa requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:29.119615 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-84df1bf8-c3a8-4fbd-990c-999a29dca8f6 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 0.8310874 Mar 24 02:19:29.121107 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34220) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:29.264076 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-74dc4710-4a35-4b92-a96c-4c174bd358fa', 'network_id': '74dc4710-4a35-4b92-a96c-4c174bd358fa', 'project_id': 'b58415804b1b4553b1533717490a0447', 'fixed_ips': [{'subnet_id': '0341fe4d-7368-4f4f-ad0f-81736ac09eaa'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:29.267132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (74dc4710-4a35-4b92-a96c-4c174bd358fa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.267299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.364880 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (0341fe4d-7368-4f4f-ad0f-81736ac09eaa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.438547 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Allocated IP 2001:db8::1 (74dc4710-4a35-4b92-a96c-4c174bd358fa/0341fe4d-7368-4f4f-ad0f-81736ac09eaa/002b01bb-e7d7-45ae-ba18-5e6adb96552f) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:29.531768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988ec64b-19e9-477f-a492-47479a87ef5b req-41498a4a-b0bd-4868-8909-e718d580b6d3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:29.534979 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-988ec64b-19e9-477f-a492-47479a87ef5b req-41498a4a-b0bd-4868-8909-e718d580b6d3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 943 time: 0.0667479 Mar 24 02:19:29.595243 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-988ec64b-19e9-477f-a492-47479a87ef5b req-c18ac506-c05b-4d76-aa23-9f94cd3e8037 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554030 Mar 24 02:19:29.617363 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Publish callbacks [] for port (002b01bb-e7d7-45ae-ba18-5e6adb96552f), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.663204 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (002b01bb-e7d7-45ae-ba18-5e6adb96552f), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.708823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (0341fe4d-7368-4f4f-ad0f-81736ac09eaa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.726556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Network 74dc4710-4a35-4b92-a96c-4c174bd358fa is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:29.730233 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:29.736679 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:29.757858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Pushing event updated for resources: {'Port': ['ID=002b01bb-e7d7-45ae-ba18-5e6adb96552f,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:29.810111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=0341fe4d-7368-4f4f-ad0f-81736ac09eaa,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:29.816198 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (74dc4710-4a35-4b92-a96c-4c174bd358fa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.822761 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Attempting to bind port 002b01bb-e7d7-45ae-ba18-5e6adb96552f on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:29.823262 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Attempting to bind port 002b01bb-e7d7-45ae-ba18-5e6adb96552f by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '6c859922-cd8a-4c93-b570-ad836597870f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '74dc4710-4a35-4b92-a96c-4c174bd358fa'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:29.824288 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Attempting to bind port 002b01bb-e7d7-45ae-ba18-5e6adb96552f on network 74dc4710-4a35-4b92-a96c-4c174bd358fa {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:29.833352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:29.833829 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Checking segment: {'id': '6c859922-cd8a-4c93-b570-ad836597870f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '74dc4710-4a35-4b92-a96c-4c174bd358fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:29.834310 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.834804 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Bound using segment: {'id': '6c859922-cd8a-4c93-b570-ad836597870f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '74dc4710-4a35-4b92-a96c-4c174bd358fa'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:29.837073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Bound port: 002b01bb-e7d7-45ae-ba18-5e6adb96552f, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6c859922-cd8a-4c93-b570-ad836597870f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '74dc4710-4a35-4b92-a96c-4c174bd358fa'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:29.837683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (002b01bb-e7d7-45ae-ba18-5e6adb96552f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.840573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74dc4710-4a35-4b92-a96c-4c174bd358fa']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:29.851944 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6c859922-cd8a-4c93-b570-ad836597870f') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:29.852160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6c859922-cd8a-4c93-b570-ad836597870f') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:29.862059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (6c859922-cd8a-4c93-b570-ad836597870f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.876833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (6c859922-cd8a-4c93-b570-ad836597870f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.884091 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:29.884590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (6c859922-cd8a-4c93-b570-ad836597870f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:29.889345 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:29.917379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] For port 002b01bb-e7d7-45ae-ba18-5e6adb96552f, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:29.947232 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] For port 002b01bb-e7d7-45ae-ba18-5e6adb96552f, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=002b01bb-e7d7-45ae-ba18-5e6adb96552f,segment=NetworkSegment(6c859922-cd8a-4c93-b570-ad836597870f),segment_id=6c859922-cd8a-4c93-b570-ad836597870f)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:29.948341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.db.api [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Mar 24 02:19:29.948341 dv-neutron-834874-3-hyperv neutron-server[104037]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Mar 24 02:19:29.948341 dv-neutron-834874-3-hyperv neutron-server[104037]: [parameters: {'id': '74dc4710-4a35-4b92-a96c-4c174bd358fa'}] Mar 24 02:19:29.948341 dv-neutron-834874-3-hyperv neutron-server[104037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104037) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:19:29.949089 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG oslo_db.api [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:19:29.957051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (002b01bb-e7d7-45ae-ba18-5e6adb96552f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.068995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83b9429d-6ba0-4259-b022-9591619f5858 None None] Pushing event updated for resources: {'Port': ['ID=002b01bb-e7d7-45ae-ba18-5e6adb96552f,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:30.100332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-419c82b8-8795-4108-b9a6-12176eab3757 None None] Network 74dc4710-4a35-4b92-a96c-4c174bd358fa requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:30.103807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66ba7515-0b55-4a27-a0b6-c3eb9116c064 None None] Network 0ccf211a-6709-496e-b50e-8d61163b6816 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:30.235129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-cbb3be7e-8fb8-4ba5-84ea-57f9f4957c51 None None] Provisioning complete for port ea05e3d3-1117-4d55-8f08-80d687967c45 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:30.235410 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cbb3be7e-8fb8-4ba5-84ea-57f9f4957c51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.362992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-cbb3be7e-8fb8-4ba5-84ea-57f9f4957c51 None None] Current status of the port ea05e3d3-1117-4d55-8f08-80d687967c45 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:30.363377 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cbb3be7e-8fb8-4ba5-84ea-57f9f4957c51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.397981 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-cbb3be7e-8fb8-4ba5-84ea-57f9f4957c51 None None] For port ea05e3d3-1117-4d55-8f08-80d687967c45, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ea05e3d3-1117-4d55-8f08-80d687967c45,segment=NetworkSegment(9d9f601d-87a0-44ff-91d0-561665693fb3),segment_id=9d9f601d-87a0-44ff-91d0-561665693fb3)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:30.403319 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cbb3be7e-8fb8-4ba5-84ea-57f9f4957c51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.450495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (74dc4710-4a35-4b92-a96c-4c174bd358fa), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.459527 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb3be7e-8fb8-4ba5-84ea-57f9f4957c51 None None] Pushing event updated for resources: {'Port': ['ID=ea05e3d3-1117-4d55-8f08-80d687967c45,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:30.497961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68b4229b-3e17-44b6-b3c7-4cafbc6d5127 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.532737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting port 002b01bb-e7d7-45ae-ba18-5e6adb96552f {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:30.533201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (002b01bb-e7d7-45ae-ba18-5e6adb96552f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.597884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e49fc2e-9e14-421f-b95c-1ca646b52fe7 None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:19:30.650818 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ea05e3d3-1117-4d55-8f08-80d687967c45 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:30.659618 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] For port 002b01bb-e7d7-45ae-ba18-5e6adb96552f, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=002b01bb-e7d7-45ae-ba18-5e6adb96552f,segment=NetworkSegment(6c859922-cd8a-4c93-b570-ad836597870f),segment_id=6c859922-cd8a-4c93-b570-ad836597870f)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:30.660250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (002b01bb-e7d7-45ae-ba18-5e6adb96552f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.679061 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Calling delete_port for 002b01bb-e7d7-45ae-ba18-5e6adb96552f owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:30.691441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-9f640b10-1efa-4225-aca8-c91c23d317c4 None None] Provisioning complete for port ea05e3d3-1117-4d55-8f08-80d687967c45 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:30.691809 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9f640b10-1efa-4225-aca8-c91c23d317c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.752160 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 8c01fb2d-b016-4fc0-9ec9-85135306e3cf details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:19:30.804656 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e49fc2e-9e14-421f-b95c-1ca646b52fe7 None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:19:30.809035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-182092d7-57fe-4dc3-889b-5dff545ceef4 req-ec020272-618e-4a3c-b5f6-cf1720c99145 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:30.810741 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-182092d7-57fe-4dc3-889b-5dff545ceef4 req-ec020272-618e-4a3c-b5f6-cf1720c99145 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 943 time: 0.1167574 Mar 24 02:19:30.836806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (002b01bb-e7d7-45ae-ba18-5e6adb96552f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.873556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Port': ['ID=002b01bb-e7d7-45ae-ba18-5e6adb96552f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:30.874034 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port ea05e3d3-1117-4d55-8f08-80d687967c45 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:30.874325 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.882465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No DVR routers for this DVR port 002b01bb-e7d7-45ae-ba18-5e6adb96552f on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:30.927054 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-182092d7-57fe-4dc3-889b-5dff545ceef4 req-02608bae-cf97-4575-8341-ffc251396789 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1085262 Mar 24 02:19:30.968791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:30.986029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (74dc4710-4a35-4b92-a96c-4c174bd358fa), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.007641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74dc4710-4a35-4b92-a96c-4c174bd358fa']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:31.007875 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-9f640b10-1efa-4225-aca8-c91c23d317c4 None None] Current status of the port ea05e3d3-1117-4d55-8f08-80d687967c45 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:31.017123 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6c859922-cd8a-4c93-b570-ad836597870f') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:31.017425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6c859922-cd8a-4c93-b570-ad836597870f') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:31.026357 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:31.027279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (6c859922-cd8a-4c93-b570-ad836597870f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.042160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (6c859922-cd8a-4c93-b570-ad836597870f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.053702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:31.054321 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (6c859922-cd8a-4c93-b570-ad836597870f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:31.059804 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:31.062282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'port_id': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'mac_address': 'fa:16:3e:1e:a6:58', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:19:31.160724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:31.161117 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.169845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (74dc4710-4a35-4b92-a96c-4c174bd358fa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.174217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.179017 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/74dc4710-4a35-4b92-a96c-4c174bd358fa HTTP/1.1" status: 204 len: 168 time: 2.0568573 Mar 24 02:19:31.182765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34242) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:31.186173 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port ea05e3d3-1117-4d55-8f08-80d687967c45 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:31.190495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8c01fb2d-b016-4fc0-9ec9-85135306e3cf {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:19:31.196843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-533082950'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:31.199273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8315060-b09c-4a04-a356-43890a096cc8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=74dc4710-4a35-4b92-a96c-4c174bd358fa,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:31.232834 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:31.237498 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.267934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 130} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:31.279097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (ec6e3ee9-0d86-4f58-bb90-596f5d81de68), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.279435 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment ec6e3ee9-0d86-4f58-bb90-596f5d81de68 of type vlan for network f7ce0e3f-7b42-4596-9171-4f56591d24cf Mar 24 02:19:31.321602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (f7ce0e3f-7b42-4596-9171-4f56591d24cf), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.349557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (f7ce0e3f-7b42-4596-9171-4f56591d24cf), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.354544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:31.355139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.375466 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:31.392586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.424263 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2366855 Mar 24 02:19:31.425327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34248) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:31.431186 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cbb238f-f54d-4657-9c3b-4b7ad59450a3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=f7ce0e3f-7b42-4596-9171-4f56591d24cf,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:31.443263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': 'f7ce0e3f-7b42-4596-9171-4f56591d24cf', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:31.447901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:31.451491 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network f7ce0e3f-7b42-4596-9171-4f56591d24cf details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:31.547651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:31.551036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.692654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['8c01fb2d-b016-4fc0-9ec9-85135306e3cf'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:19:31.739195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (8478d3b9-c1cf-4064-867f-cbb6c25a8d4d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.793325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=8478d3b9-c1cf-4064-867f-cbb6c25a8d4d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:31.810080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking segment: {'id': 'ec6e3ee9-0d86-4f58-bb90-596f5d81de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'f7ce0e3f-7b42-4596-9171-4f56591d24cf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:31.810438 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network hostable DHCP agents. Network: f7ce0e3f-7b42-4596-9171-4f56591d24cf, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:31.829407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network f7ce0e3f-7b42-4596-9171-4f56591d24cf is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:31.838984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, f7ce0e3f-7b42-4596-9171-4f56591d24cf) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:31.843365 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:31.844097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.854174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a0d4929-940b-4fb4-8d91-8185303f80fd None None] Network f7ce0e3f-7b42-4596-9171-4f56591d24cf requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:31.864872 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-da8c287d-c3a1-4f9b-b85b-03382abc82ab tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 0.4339685 Mar 24 02:19:31.865365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34250) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:31.872507 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1432047893'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:31.897907 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:31.902255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.929924 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 114} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:31.944404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (99028715-e7bb-4f83-adae-1cdfb53f87c6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:31.944794 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment 99028715-e7bb-4f83-adae-1cdfb53f87c6 of type vlan for network cacf996c-2a0d-4da4-9104-2787ada6302f Mar 24 02:19:32.007446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-f7ce0e3f-7b42-4596-9171-4f56591d24cf', 'network_id': 'f7ce0e3f-7b42-4596-9171-4f56591d24cf', 'project_id': 'b58415804b1b4553b1533717490a0447', 'fixed_ips': [{'subnet_id': '8478d3b9-c1cf-4064-867f-cbb6c25a8d4d'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:32.008625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.019235 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (cacf996c-2a0d-4da4-9104-2787ada6302f), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.051528 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (cacf996c-2a0d-4da4-9104-2787ada6302f), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.058386 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:32.059535 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.070641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ffebeb-43b1-43a5-a28b-2195843e0820 req-c549a63d-1e6a-48b7-9a4d-94f234aa05fc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:32.073364 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f8ffebeb-43b1-43a5-a28b-2195843e0820 req-c549a63d-1e6a-48b7-9a4d-94f234aa05fc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 944 time: 0.0608671 Mar 24 02:19:32.132338 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2655368 Mar 24 02:19:32.134467 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f8ffebeb-43b1-43a5-a28b-2195843e0820 req-f9ced217-fbca-4dd6-aa53-b2b8cb2152cb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549598 Mar 24 02:19:32.135075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34254) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:32.141498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': 'cacf996c-2a0d-4da4-9104-2787ada6302f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:32.163299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58ec2724-7dfa-4e79-b84c-f4aa2df1febd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=cacf996c-2a0d-4da4-9104-2787ada6302f,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:32.177396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network cacf996c-2a0d-4da4-9104-2787ada6302f details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:32.244374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:32.248105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.298549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Allocated IP 2001:db8::1 (f7ce0e3f-7b42-4596-9171-4f56591d24cf/8478d3b9-c1cf-4064-867f-cbb6c25a8d4d/19a6849a-410b-4fd9-88d6-09f55d1d33ef) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:32.318252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.ipam_backend_mixin [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Performing IP validity checks on allocation pools {{(pid=104037) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:322}} Mar 24 02:19:32.319013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.ipam_backend_mixin [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking for overlaps among allocation pools and gateway ip {{(pid=104037) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:343}} Mar 24 02:19:32.425337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.448118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (4df2e93d-ff98-4f2a-bde0-5f3ca95324a8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.473696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Publish callbacks [] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.481097 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.510240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=4df2e93d-ff98-4f2a-bde0-5f3ca95324a8,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:32.518665 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking segment: {'id': '99028715-e7bb-4f83-adae-1cdfb53f87c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'cacf996c-2a0d-4da4-9104-2787ada6302f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:32.519102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network hostable DHCP agents. Network: cacf996c-2a0d-4da4-9104-2787ada6302f, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:32.519977 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Network f7ce0e3f-7b42-4596-9171-4f56591d24cf is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:32.522956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:32.529168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:32.536007 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Pushing event updated for resources: {'Port': ['ID=19a6849a-410b-4fd9-88d6-09f55d1d33ef,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:32.539654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network cacf996c-2a0d-4da4-9104-2787ada6302f is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:32.552530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, cacf996c-2a0d-4da4-9104-2787ada6302f) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:32.558083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:32.559391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.571421 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8804cb30-0385-465f-8e70-6e35f3cda39c None None] Network cacf996c-2a0d-4da4-9104-2787ada6302f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:32.579847 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-45ce4dd5-bb6f-4ccb-89b2-55bc814bc599 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 803 time: 0.4411256 Mar 24 02:19:32.580175 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34258) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:32.652044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Attempting to bind port 19a6849a-410b-4fd9-88d6-09f55d1d33ef on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:32.652417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Attempting to bind port 19a6849a-410b-4fd9-88d6-09f55d1d33ef by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'ec6e3ee9-0d86-4f58-bb90-596f5d81de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'f7ce0e3f-7b42-4596-9171-4f56591d24cf'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:32.652779 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Attempting to bind port 19a6849a-410b-4fd9-88d6-09f55d1d33ef on network f7ce0e3f-7b42-4596-9171-4f56591d24cf {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:32.662729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:32.663111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Checking segment: {'id': 'ec6e3ee9-0d86-4f58-bb90-596f5d81de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'f7ce0e3f-7b42-4596-9171-4f56591d24cf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:32.663517 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.663915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Bound using segment: {'id': 'ec6e3ee9-0d86-4f58-bb90-596f5d81de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'f7ce0e3f-7b42-4596-9171-4f56591d24cf'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:32.664393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Bound port: 19a6849a-410b-4fd9-88d6-09f55d1d33ef, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ec6e3ee9-0d86-4f58-bb90-596f5d81de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'f7ce0e3f-7b42-4596-9171-4f56591d24cf'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:32.664768 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.683146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (cacf996c-2a0d-4da4-9104-2787ada6302f), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.750740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 8c01fb2d-b016-4fc0-9ec9-85135306e3cf up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:32.762675 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (4df2e93d-ff98-4f2a-bde0-5f3ca95324a8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.783623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83ec97d6-77f1-4709-a6b1-f9dde9a6969c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-cacf996c-2a0d-4da4-9104-2787ada6302f', 'network_id': 'cacf996c-2a0d-4da4-9104-2787ada6302f', 'project_id': 'b58415804b1b4553b1533717490a0447', 'fixed_ips': [{'subnet_id': '4df2e93d-ff98-4f2a-bde0-5f3ca95324a8'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:32.784609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-83ec97d6-77f1-4709-a6b1-f9dde9a6969c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.815380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] For port 19a6849a-410b-4fd9-88d6-09f55d1d33ef, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:32.825617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (4df2e93d-ff98-4f2a-bde0-5f3ca95324a8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.847428 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] For port 19a6849a-410b-4fd9-88d6-09f55d1d33ef, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=19a6849a-410b-4fd9-88d6-09f55d1d33ef,segment=NetworkSegment(ec6e3ee9-0d86-4f58-bb90-596f5d81de68),segment_id=ec6e3ee9-0d86-4f58-bb90-596f5d81de68)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:32.856969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=4df2e93d-ff98-4f2a-bde0-5f3ca95324a8,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:32.899417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.917108 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (cacf996c-2a0d-4da4-9104-2787ada6302f), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.937699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cacf996c-2a0d-4da4-9104-2787ada6302f']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:32.947032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '99028715-e7bb-4f83-adae-1cdfb53f87c6') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:32.947325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '99028715-e7bb-4f83-adae-1cdfb53f87c6') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:32.956937 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (99028715-e7bb-4f83-adae-1cdfb53f87c6), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.960176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73895a35-bf70-409b-b95b-9d8f12485fb7 None None] Pushing event updated for resources: {'Port': ['ID=19a6849a-410b-4fd9-88d6-09f55d1d33ef,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:32.964035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c99587e-e39e-40af-a6e2-42b19e267ef3 None None] Network cacf996c-2a0d-4da4-9104-2787ada6302f requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:32.973440 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (99028715-e7bb-4f83-adae-1cdfb53f87c6), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.982822 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:19:32.986974 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 114 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:32.987806 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (99028715-e7bb-4f83-adae-1cdfb53f87c6), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:32.992527 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:33.026456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:33.027216 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.063909 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (cacf996c-2a0d-4da4-9104-2787ada6302f), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.073968 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.078841 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/cacf996c-2a0d-4da4-9104-2787ada6302f HTTP/1.1" status: 204 len: 168 time: 0.4976363 Mar 24 02:19:33.083134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34260) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:33.088171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-553971635'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:33.093936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-625547b2-5176-4c48-8ab2-5c454fcb0992 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=cacf996c-2a0d-4da4-9104-2787ada6302f,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:33.119771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:33.123215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.156721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 147} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:33.163158 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:33.163158 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.171162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (165de8f8-c474-43a7-806d-d963c193fd84), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.171585 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment 165de8f8-c474-43a7-806d-d963c193fd84 of type vlan for network a069d32e-efb3-45f9-a47d-e177ae57330d Mar 24 02:19:33.217995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:33.219143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:19:33.222643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48783f8f-1684-42ac-8399-71746d02a174" -d '{"events": [{"server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "name": "network-vif-plugged", "status": "completed", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:19:33.227090 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.316154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (a069d32e-efb3-45f9-a47d-e177ae57330d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.325612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:33.329766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:19:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fbecb185-57b9-4b4c-a86b-0fc9be7d0972 x-openstack-request-id: req-fbecb185-57b9-4b4c-a86b-0fc9be7d0972 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:19:33.330066 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "name": "network-vif-plugged", "status": "completed", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:19:33.330318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-fbecb185-57b9-4b4c-a86b-0fc9be7d0972 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:19:33.336328 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fbecb185-57b9-4b4c-a86b-0fc9be7d0972'] response: {'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'code': 200} Mar 24 02:19:33.420681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (a069d32e-efb3-45f9-a47d-e177ae57330d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.427070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:33.427897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.469882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d462c6f-294b-46b3-a22f-8369b3410a27 req-01188200-344a-4b39-97ee-f245d19a0381 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:33.476831 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8d462c6f-294b-46b3-a22f-8369b3410a27 req-01188200-344a-4b39-97ee-f245d19a0381 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 945 time: 0.1574812 Mar 24 02:19:33.524625 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.4402158 Mar 24 02:19:33.528227 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34268) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:33.534254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': 'a069d32e-efb3-45f9-a47d-e177ae57330d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:33.573442 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e48e97-f09d-4666-8b14-1355291f8153 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=a069d32e-efb3-45f9-a47d-e177ae57330d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:33.585057 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network a069d32e-efb3-45f9-a47d-e177ae57330d details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:33.605072 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8d462c6f-294b-46b3-a22f-8369b3410a27 req-c86fb9dd-028d-4f00-a3b2-b2b53b10f8ca tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1267579 Mar 24 02:19:33.615056 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deec8e71-6741-49b9-b5db-46043465e96e req-c11ac3ff-1647-4d59-a7ec-df383280131d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:33.616557 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-deec8e71-6741-49b9-b5db-46043465e96e req-c11ac3ff-1647-4d59-a7ec-df383280131d service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 1129 time: 0.1020644 Mar 24 02:19:33.636142 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:33.642871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.684225 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-deec8e71-6741-49b9-b5db-46043465e96e req-2d305e88-e7f0-4fa5-b309-0a13aab129f8 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0607898 Mar 24 02:19:33.698715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.850177 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (3de095fc-0ef1-4dd0-9dd7-015a79118e23), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:33.916090 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=3de095fc-0ef1-4dd0-9dd7-015a79118e23,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:33.943806 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking segment: {'id': '165de8f8-c474-43a7-806d-d963c193fd84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'a069d32e-efb3-45f9-a47d-e177ae57330d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:33.944167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network hostable DHCP agents. Network: a069d32e-efb3-45f9-a47d-e177ae57330d, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:33.972683 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network a069d32e-efb3-45f9-a47d-e177ae57330d is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:33.984691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, a069d32e-efb3-45f9-a47d-e177ae57330d) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:33.998036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e760d228-8d35-4ca3-9d61-0c63bdc1e7f8 None None] Network a069d32e-efb3-45f9-a47d-e177ae57330d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:34.000371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:34.000976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.036789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34270) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:34.050254 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a6b2a022-e103-4534-ba31-78cc52d2c5ea tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 904 time: 0.5207844 Mar 24 02:19:34.118564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-a069d32e-efb3-45f9-a47d-e177ae57330d', 'network_id': 'a069d32e-efb3-45f9-a47d-e177ae57330d', 'project_id': 'b58415804b1b4553b1533717490a0447', 'fixed_ips': [{'subnet_id': '3de095fc-0ef1-4dd0-9dd7-015a79118e23'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:34.118564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.170220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (a069d32e-efb3-45f9-a47d-e177ae57330d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.245306 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (3de095fc-0ef1-4dd0-9dd7-015a79118e23), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.267993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Allocated IP 2001:db8::1 (a069d32e-efb3-45f9-a47d-e177ae57330d/3de095fc-0ef1-4dd0-9dd7-015a79118e23/da952762-d14f-41c1-a4be-d7d9df6c8f49) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:34.330808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68ac96db-1f7d-45f6-9137-36116211041d None None] Network f7ce0e3f-7b42-4596-9171-4f56591d24cf requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:34.425650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c5b5464c-a374-4707-92f3-60db5ebf29ff None None] Provisioning complete for port 19a6849a-410b-4fd9-88d6-09f55d1d33ef triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:34.425931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5b5464c-a374-4707-92f3-60db5ebf29ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.572675 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Publish callbacks [] for port (da952762-d14f-41c1-a4be-d7d9df6c8f49), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.602227 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (da952762-d14f-41c1-a4be-d7d9df6c8f49), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.628296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (3de095fc-0ef1-4dd0-9dd7-015a79118e23), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.656762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 19a6849a-410b-4fd9-88d6-09f55d1d33ef up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:34.679305 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Network a069d32e-efb3-45f9-a47d-e177ae57330d is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:34.683351 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=3de095fc-0ef1-4dd0-9dd7-015a79118e23,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:34.712963 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c5b5464c-a374-4707-92f3-60db5ebf29ff None None] Current status of the port 19a6849a-410b-4fd9-88d6-09f55d1d33ef is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:34.713447 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5b5464c-a374-4707-92f3-60db5ebf29ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.729593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Pushing event updated for resources: {'Port': ['ID=da952762-d14f-41c1-a4be-d7d9df6c8f49,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:34.733013 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:34.735618 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:34.789629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (a069d32e-efb3-45f9-a47d-e177ae57330d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.817910 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a069d32e-efb3-45f9-a47d-e177ae57330d']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:34.831235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '165de8f8-c474-43a7-806d-d963c193fd84') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:34.831552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '165de8f8-c474-43a7-806d-d963c193fd84') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:34.842049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Attempting to bind port da952762-d14f-41c1-a4be-d7d9df6c8f49 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:34.842511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Attempting to bind port da952762-d14f-41c1-a4be-d7d9df6c8f49 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '165de8f8-c474-43a7-806d-d963c193fd84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'a069d32e-efb3-45f9-a47d-e177ae57330d'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:34.843026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Attempting to bind port da952762-d14f-41c1-a4be-d7d9df6c8f49 on network a069d32e-efb3-45f9-a47d-e177ae57330d {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:34.843824 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (165de8f8-c474-43a7-806d-d963c193fd84), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.849367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c5b5464c-a374-4707-92f3-60db5ebf29ff None None] For port 19a6849a-410b-4fd9-88d6-09f55d1d33ef, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=19a6849a-410b-4fd9-88d6-09f55d1d33ef,segment=NetworkSegment(ec6e3ee9-0d86-4f58-bb90-596f5d81de68),segment_id=ec6e3ee9-0d86-4f58-bb90-596f5d81de68)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:34.851624 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:34.852111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Checking segment: {'id': '165de8f8-c474-43a7-806d-d963c193fd84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'a069d32e-efb3-45f9-a47d-e177ae57330d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:34.852844 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.853132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Bound using segment: {'id': '165de8f8-c474-43a7-806d-d963c193fd84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'a069d32e-efb3-45f9-a47d-e177ae57330d'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:34.854444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Bound port: da952762-d14f-41c1-a4be-d7d9df6c8f49, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '165de8f8-c474-43a7-806d-d963c193fd84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'a069d32e-efb3-45f9-a47d-e177ae57330d'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:34.855419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (da952762-d14f-41c1-a4be-d7d9df6c8f49), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.869163 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5b5464c-a374-4707-92f3-60db5ebf29ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.893736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (165de8f8-c474-43a7-806d-d963c193fd84), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.900099 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:34.900502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (165de8f8-c474-43a7-806d-d963c193fd84), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.908570 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 19a6849a-410b-4fd9-88d6-09f55d1d33ef triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:34.908953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:34.952413 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:34.989658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.db.api [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Mar 24 02:19:34.989658 dv-neutron-834874-3-hyperv neutron-server[104037]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Mar 24 02:19:34.989658 dv-neutron-834874-3-hyperv neutron-server[104037]: [parameters: {'id': 'a069d32e-efb3-45f9-a47d-e177ae57330d'}] Mar 24 02:19:34.989658 dv-neutron-834874-3-hyperv neutron-server[104037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104037) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:19:34.990535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG oslo_db.api [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:19:34.999797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beb2a960-c4bf-4d2c-b50c-3aa90cd107b9 req-f46a41ca-6b47-4b0c-b87c-6538b08571fa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:35.002196 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-beb2a960-c4bf-4d2c-b50c-3aa90cd107b9 req-f46a41ca-6b47-4b0c-b87c-6538b08571fa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 945 time: 0.2980576 Mar 24 02:19:35.016287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b5464c-a374-4707-92f3-60db5ebf29ff None None] Pushing event updated for resources: {'Port': ['ID=19a6849a-410b-4fd9-88d6-09f55d1d33ef,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:35.037736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] For port da952762-d14f-41c1-a4be-d7d9df6c8f49, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:35.039915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a5100c24-c59f-4a79-9bb3-c470ff4ca3f2 None None] Provisioning complete for port 19a6849a-410b-4fd9-88d6-09f55d1d33ef triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:35.040359 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a5100c24-c59f-4a79-9bb3-c470ff4ca3f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.045621 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] For port da952762-d14f-41c1-a4be-d7d9df6c8f49, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=da952762-d14f-41c1-a4be-d7d9df6c8f49,segment=NetworkSegment(165de8f8-c474-43a7-806d-d963c193fd84),segment_id=165de8f8-c474-43a7-806d-d963c193fd84)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:35.069188 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-beb2a960-c4bf-4d2c-b50c-3aa90cd107b9 req-83df2260-436e-4318-9155-e09bafb0bb12 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510161 Mar 24 02:19:35.097330 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (da952762-d14f-41c1-a4be-d7d9df6c8f49), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.186119 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 19a6849a-410b-4fd9-88d6-09f55d1d33ef is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:35.208888 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef763603-339a-4c07-9155-b333161ef7fa None None] Pushing event updated for resources: {'Port': ['ID=da952762-d14f-41c1-a4be-d7d9df6c8f49,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:35.234942 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83c347dc-1022-4eeb-aaf8-9351fd6af0ab None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:19:35.428451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a5100c24-c59f-4a79-9bb3-c470ff4ca3f2 None None] Current status of the port 19a6849a-410b-4fd9-88d6-09f55d1d33ef is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:35.491756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83c347dc-1022-4eeb-aaf8-9351fd6af0ab None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:19:35.492192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (a069d32e-efb3-45f9-a47d-e177ae57330d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.545469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting port da952762-d14f-41c1-a4be-d7d9df6c8f49 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:35.545824 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (da952762-d14f-41c1-a4be-d7d9df6c8f49), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.608249 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] For port da952762-d14f-41c1-a4be-d7d9df6c8f49, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=da952762-d14f-41c1-a4be-d7d9df6c8f49,segment=NetworkSegment(165de8f8-c474-43a7-806d-d963c193fd84),segment_id=165de8f8-c474-43a7-806d-d963c193fd84)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:35.609318 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (da952762-d14f-41c1-a4be-d7d9df6c8f49), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.629270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Calling delete_port for da952762-d14f-41c1-a4be-d7d9df6c8f49 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:35.675414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58a2310a-8fda-4d4a-a06b-0696a605dbb9 None None] Network a069d32e-efb3-45f9-a47d-e177ae57330d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:35.714629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (da952762-d14f-41c1-a4be-d7d9df6c8f49), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.742456 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No DVR routers for this DVR port da952762-d14f-41c1-a4be-d7d9df6c8f49 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:35.744416 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Port': ['ID=da952762-d14f-41c1-a4be-d7d9df6c8f49,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:35.829824 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (a069d32e-efb3-45f9-a47d-e177ae57330d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.851764 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a069d32e-efb3-45f9-a47d-e177ae57330d']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:35.861728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '165de8f8-c474-43a7-806d-d963c193fd84') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:35.862028 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '165de8f8-c474-43a7-806d-d963c193fd84') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:35.871274 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (165de8f8-c474-43a7-806d-d963c193fd84), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.885424 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (165de8f8-c474-43a7-806d-d963c193fd84), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.892951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:35.893367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (165de8f8-c474-43a7-806d-d963c193fd84), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:35.896608 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:35.955131 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (a069d32e-efb3-45f9-a47d-e177ae57330d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.959400 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:35.962641 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/a069d32e-efb3-45f9-a47d-e177ae57330d HTTP/1.1" status: 204 len: 168 time: 1.9247761 Mar 24 02:19:35.966392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34286) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:35.972869 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-915072373'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:35.981072 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4fd90b9-b9b5-4686-b93e-16f235bdb871 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=a069d32e-efb3-45f9-a47d-e177ae57330d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:35.993455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:35.996881 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.021269 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 140} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:36.031423 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (36b3a8e1-b7ac-41af-b21c-0b1730142126), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.031760 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment 36b3a8e1-b7ac-41af-b21c-0b1730142126 of type vlan for network b22aa60c-8118-428a-9aa9-aecdb81775ad Mar 24 02:19:36.071352 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (b22aa60c-8118-428a-9aa9-aecdb81775ad), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.097289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (b22aa60c-8118-428a-9aa9-aecdb81775ad), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.103142 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:36.103781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.170590 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2023382 Mar 24 02:19:36.173360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34290) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:36.180027 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': 'b22aa60c-8118-428a-9aa9-aecdb81775ad', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:36.184608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8e68afd-ed68-4555-b455-030a88d2f565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=b22aa60c-8118-428a-9aa9-aecdb81775ad,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:36.197858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network b22aa60c-8118-428a-9aa9-aecdb81775ad details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:36.218844 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b02ad84-91e8-49dc-9106-93c8db938f49 req-4f2d4e7b-ce41-4f28-a0ee-c2c465ba3bf9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:36.221429 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5b02ad84-91e8-49dc-9106-93c8db938f49 req-4f2d4e7b-ce41-4f28-a0ee-c2c465ba3bf9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 945 time: 0.0748839 Mar 24 02:19:36.284054 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5b02ad84-91e8-49dc-9106-93c8db938f49 req-d7f262bf-406e-453e-bad8-2f4f5822a3aa tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567627 Mar 24 02:19:36.286026 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:36.290667 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.409189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b4b00ea-a806-44d0-bfd0-26a951f6cd7d req-5915e7fe-eb10-4f0c-8de1-f801aad50aa6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:36.410843 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0b4b00ea-a806-44d0-bfd0-26a951f6cd7d req-5915e7fe-eb10-4f0c-8de1-f801aad50aa6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 945 time: 0.0572631 Mar 24 02:19:36.468530 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0b4b00ea-a806-44d0-bfd0-26a951f6cd7d req-6cd0b72c-1227-49ce-beb5-d2137ee14615 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501959 Mar 24 02:19:36.490217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (6894714e-a21a-4adb-a930-3f062652c697), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.490781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34296) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:36.538086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc9982d4-487e-414a-8e8c-d43aeb106881 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:36.542316 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cc9982d4-487e-414a-8e8c-d43aeb106881 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 1124 time: 0.0479021 Mar 24 02:19:36.542556 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34298) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:36.547731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address': '172.20.0.3'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:36.557454 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking segment: {'id': '36b3a8e1-b7ac-41af-b21c-0b1730142126', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b22aa60c-8118-428a-9aa9-aecdb81775ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:36.557830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network hostable DHCP agents. Network: b22aa60c-8118-428a-9aa9-aecdb81775ad, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:36.566806 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=6894714e-a21a-4adb-a930-3f062652c697,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:36.574160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.602037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network b22aa60c-8118-428a-9aa9-aecdb81775ad is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:36.616064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, b22aa60c-8118-428a-9aa9-aecdb81775ad) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:36.626241 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a5ca153-924e-4c70-b832-b1ef44d6f765 None None] Network b22aa60c-8118-428a-9aa9-aecdb81775ad requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:36.642699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:36.645918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.668746 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-12bedf6c-af0a-48a8-ab55-e1aaafbd6f56 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 0.4940891 Mar 24 02:19:36.671566 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34300) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:36.674408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 19a6849a-410b-4fd9-88d6-09f55d1d33ef up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:36.689422 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.747122 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 19a6849a-410b-4fd9-88d6-09f55d1d33ef triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:36.747760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.779247 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (b22aa60c-8118-428a-9aa9-aecdb81775ad), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.818419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-010d63f0-4f72-4284-b5c2-0f4f38229c77 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-b22aa60c-8118-428a-9aa9-aecdb81775ad', 'network_id': 'b22aa60c-8118-428a-9aa9-aecdb81775ad', 'project_id': 'b58415804b1b4553b1533717490a0447', 'fixed_ips': [{'subnet_id': '6894714e-a21a-4adb-a930-3f062652c697'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:36.819585 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-010d63f0-4f72-4284-b5c2-0f4f38229c77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.836047 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (6894714e-a21a-4adb-a930-3f062652c697), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.866200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.199 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/af16cdb4-e86c-4775-aec1-d31e79a69067) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:36.921341 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (6894714e-a21a-4adb-a930-3f062652c697), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server [None req-010d63f0-4f72-4284-b5c2-0f4f38229c77 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 6894714e-a21a-4adb-a930-3f062652c697: This subnet is being modified by another concurrent operation. Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 278, in create_dhcp_port Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.force_reraise() Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise self.value Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1504, in create_port Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1469, in _create_port_db Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1467, in create_port_db Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 219, in allocate_ips_for_port_and_store Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server ips = self.allocate_ips_for_port(context, port_copy) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 226, in allocate_ips_for_port Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server return self._allocate_ips_for_port(context, port) Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 258, in _allocate_ips_for_port Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 691, in _ipam_get_subnets Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server subnet.lock_register( Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server raise exception Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 6894714e-a21a-4adb-a930-3f062652c697: This subnet is being modified by another concurrent operation. Mar 24 02:19:36.961661 dv-neutron-834874-3-hyperv neutron-server[104038]: ERROR oslo_messaging.rpc.server Mar 24 02:19:36.972908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 19a6849a-410b-4fd9-88d6-09f55d1d33ef is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:36.989396 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-407cf7b7-2458-48a8-96d4-42b3136d003e None None] get_active_networks_info from dv-neutron-834874-3-hyperv {{(pid=104038) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Mar 24 02:19:37.019885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (af16cdb4-e86c-4775-aec1-d31e79a69067), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.057428 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (af16cdb4-e86c-4775-aec1-d31e79a69067), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.076109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (b22aa60c-8118-428a-9aa9-aecdb81775ad), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.101022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b22aa60c-8118-428a-9aa9-aecdb81775ad']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:37.103717 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=6894714e-a21a-4adb-a930-3f062652c697,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:37.108162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:37.113190 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '36b3a8e1-b7ac-41af-b21c-0b1730142126') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:37.113419 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:37.114070 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '36b3a8e1-b7ac-41af-b21c-0b1730142126') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:37.117975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:37.128755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-407cf7b7-2458-48a8-96d4-42b3136d003e None None] Resources bound (agent type, host, resource id): {{(pid=104038) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Mar 24 02:19:37.130873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (36b3a8e1-b7ac-41af-b21c-0b1730142126), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.147448 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (36b3a8e1-b7ac-41af-b21c-0b1730142126), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.155933 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 140 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:37.156712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (36b3a8e1-b7ac-41af-b21c-0b1730142126), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:37.160395 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:37.183113 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=af16cdb4-e86c-4775-aec1-d31e79a69067,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:37.230967 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (b22aa60c-8118-428a-9aa9-aecdb81775ad), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.243249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.251298 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/b22aa60c-8118-428a-9aa9-aecdb81775ad HTTP/1.1" status: 204 len: 168 time: 0.5787072 Mar 24 02:19:37.254820 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34302) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:37.260198 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-286283370'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:37.275256 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d95db579-a618-4e18-84ad-03a1cae9221e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=b22aa60c-8118-428a-9aa9-aecdb81775ad,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:37.337003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:37.340409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.346292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8bbec252-0670-48c6-b8de-43a0d9880fa1 None None] Network b22aa60c-8118-428a-9aa9-aecdb81775ad requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:37.358766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8bbec252-0670-48c6-b8de-43a0d9880fa1 None None] Network b22aa60c-8118-428a-9aa9-aecdb81775ad could not be found, it might have been deleted concurrently. {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:196}} Mar 24 02:19:37.403903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 132} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:37.419112 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (c7c235c7-0cd9-451e-b152-f58653a10809), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.419446 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment c7c235c7-0cd9-451e-b152-f58653a10809 of type vlan for network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e Mar 24 02:19:37.811161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (e0c5ab35-74e4-4cca-9a8f-f5ef414be87e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.909754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (e0c5ab35-74e4-4cca-9a8f-f5ef414be87e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.914660 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:37.915229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:37.992223 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.7360337 Mar 24 02:19:37.995357 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34306) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:38.001011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': 'e0c5ab35-74e4-4cca-9a8f-f5ef414be87e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:38.011038 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (c4a0d2fa-9431-42a6-9938-4b9cd6db0aec), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.012336 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eeb4b20-c3ef-40a7-a9d3-f25f1b926a40 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=e0c5ab35-74e4-4cca-9a8f-f5ef414be87e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:38.028002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:38.103357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (af16cdb4-e86c-4775-aec1-d31e79a69067), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.111478 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:38.114889 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.272013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (af16cdb4-e86c-4775-aec1-d31e79a69067), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.277639 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (af16cdb4-e86c-4775-aec1-d31e79a69067), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.308296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (969b0484-8540-441b-9dd0-ee709539a549), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.349545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=af16cdb4-e86c-4775-aec1-d31e79a69067,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:38.360139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (c4a0d2fa-9431-42a6-9938-4b9cd6db0aec), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.360329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=969b0484-8540-441b-9dd0-ee709539a549,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:38.391204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking segment: {'id': 'c7c235c7-0cd9-451e-b152-f58653a10809', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e0c5ab35-74e4-4cca-9a8f-f5ef414be87e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:38.391694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network hostable DHCP agents. Network: e0c5ab35-74e4-4cca-9a8f-f5ef414be87e, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:38.410616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:38.419850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, e0c5ab35-74e4-4cca-9a8f-f5ef414be87e) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:38.429016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc620c8a-b589-45de-a33e-34dfbbf7de4f None None] Network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:38.433652 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:38.434239 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.455986 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d29bee6a-4362-4e8d-bacc-7149317f202e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4593894 Mar 24 02:19:38.459241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34308) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:38.465930 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': 'e0c5ab35-74e4-4cca-9a8f-f5ef414be87e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:38.476012 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP c4a0d2fa-9431-42a6-9938-4b9cd6db0aec associated. External IP: 172.26.2.199, port: 8c01fb2d-b016-4fc0-9ec9-85135306e3cf. Mar 24 02:19:38.586849 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-e0c5ab35-74e4-4cca-9a8f-f5ef414be87e', 'network_id': 'e0c5ab35-74e4-4cca-9a8f-f5ef414be87e', 'project_id': 'b58415804b1b4553b1533717490a0447', 'fixed_ips': [{'subnet_id': '969b0484-8540-441b-9dd0-ee709539a549'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:38.588067 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.621475 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:38.627369 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.755665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Allocated IP 2001:db8::2 (e0c5ab35-74e4-4cca-9a8f-f5ef414be87e/969b0484-8540-441b-9dd0-ee709539a549/8aec541a-0157-44fc-861a-fb475e46fe60) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:38.778734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router f1e1a820-21ac-4c51-979d-f4b8742581f3 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:19:38.900823 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (fba602d0-b8da-4151-91c7-47feba104545), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.909403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:19:38.919919 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] Sync routers for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:19:38.930860 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.934030 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:38.934691 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:38.953976 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:38.960522 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:38.965807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:38.966910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.971432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Publish callbacks [] for port (8aec541a-0157-44fc-861a-fb475e46fe60), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.981776 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=fba602d0-b8da-4151-91c7-47feba104545,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:38.984372 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:38.997689 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ad3f1495-e47c-44a5-9915-ce68b0ab2fb6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.4540033 Mar 24 02:19:39.001074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34312) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:39.002270 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-28244627-6e39-4578-bbfa-df7ef99e4933 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 0.5418801 Mar 24 02:19:39.003586 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:19:39.005220 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34314) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:39.008026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd" -d '{"events": [{"name": "network-changed", "server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:19:39.068403 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:39.070076 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Pushing event updated for resources: {'Port': ['ID=8aec541a-0157-44fc-861a-fb475e46fe60,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:39.081249 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:39.084419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:39.110881 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2387a55-ef86-4ceb-9f20-c28d7201fa18 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.132502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2387a55-ef86-4ceb-9f20-c28d7201fa18 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.135009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2387a55-ef86-4ceb-9f20-c28d7201fa18 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.139923 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2387a55-ef86-4ceb-9f20-c28d7201fa18 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.141501 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2387a55-ef86-4ceb-9f20-c28d7201fa18 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.148814 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b2387a55-ef86-4ceb-9f20-c28d7201fa18 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.1424675 Mar 24 02:19:39.149685 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2e858aaf-2ce2-4f5a-a42e-8068925e0d8e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/c4a0d2fa-9431-42a6-9938-4b9cd6db0aec HTTP/1.1" status: 200 len: 991 time: 0.1340723 Mar 24 02:19:39.152468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34318) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:39.160482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1619217253'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:39.167132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Attempting to bind port 8aec541a-0157-44fc-861a-fb475e46fe60 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:39.167927 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Attempting to bind port 8aec541a-0157-44fc-861a-fb475e46fe60 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'c7c235c7-0cd9-451e-b152-f58653a10809', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e0c5ab35-74e4-4cca-9a8f-f5ef414be87e'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:39.168485 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Attempting to bind port 8aec541a-0157-44fc-861a-fb475e46fe60 on network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:39.184284 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:39.184995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Checking segment: {'id': 'c7c235c7-0cd9-451e-b152-f58653a10809', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e0c5ab35-74e4-4cca-9a8f-f5ef414be87e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:39.185580 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.188130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Bound using segment: {'id': 'c7c235c7-0cd9-451e-b152-f58653a10809', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e0c5ab35-74e4-4cca-9a8f-f5ef414be87e'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:39.188696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Bound port: 8aec541a-0157-44fc-861a-fb475e46fe60, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c7c235c7-0cd9-451e-b152-f58653a10809', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e0c5ab35-74e4-4cca-9a8f-f5ef414be87e'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:39.189172 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.193063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:19:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1290ab66-445e-4d9a-91b8-59f1e9f428d4 x-openstack-request-id: req-1290ab66-445e-4d9a-91b8-59f1e9f428d4 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:19:39.193303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:19:39.193637 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-1290ab66-445e-4d9a-91b8-59f1e9f428d4 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:19:39.194125 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1290ab66-445e-4d9a-91b8-59f1e9f428d4'] response: {'name': 'network-changed', 'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'status': 'completed', 'code': 200} Mar 24 02:19:39.205430 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:39.219006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:39.224644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.276480 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 105} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:39.283707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] For port 8aec541a-0157-44fc-861a-fb475e46fe60, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:39.290969 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] For port 8aec541a-0157-44fc-861a-fb475e46fe60, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8aec541a-0157-44fc-861a-fb475e46fe60,segment=NetworkSegment(c7c235c7-0cd9-451e-b152-f58653a10809),segment_id=c7c235c7-0cd9-451e-b152-f58653a10809)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:39.291291 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3bfb06a4-0ca4-4408-9599-5dcd84732d08), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.291632 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment 3bfb06a4-0ca4-4408-9599-5dcd84732d08 of type vlan for network bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe Mar 24 02:19:39.302832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.326196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-0cb3af9e-d944-4dfd-8ef2-c87b3b712872 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.329483 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-0cb3af9e-d944-4dfd-8ef2-c87b3b712872 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 1129 time: 0.1099255 Mar 24 02:19:39.383677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.417405 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd485941-451c-4f9f-8ea0-8dee9dfe44f8 None None] Pushing event updated for resources: {'Port': ['ID=8aec541a-0157-44fc-861a-fb475e46fe60,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:39.441767 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.449217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.450105 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.501068 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-7e36c5cb-86b5-4d7b-9375-82a2917511a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.503297 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-7e36c5cb-86b5-4d7b-9375-82a2917511a7 service neutron] 10.222.0.30 "GET /v2.0/networks?id=8ee3ba97-1980-4303-b77a-6f5ad4d46166 HTTP/1.1" status: 200 len: 897 time: 0.1683152 Mar 24 02:19:39.532335 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.3783751 Mar 24 02:19:39.532968 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34320) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:39.543207 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-cb19d6ec-c6a4-4702-af70-9dfa39234f4b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'New_network'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:39.621574 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d9ee106-a103-46b5-9117-eed1226026ce tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:39.623452 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-70670d00-c963-4aa3-8f06-6988d739a2b2 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf HTTP/1.1" status: 200 len: 999 time: 0.1146960 Mar 24 02:19:39.628973 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:14Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'c4a0d2fa-9431-42a6-9938-4b9cd6db0aec', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.199', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'port_id': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1320, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'mac_address': 'fa:16:3e:1e:a6:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:19:37Z', 'updated_at': '2022-03-24T02:19:37Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd3569980-3835-437c-aba6-4620efe7ee98', 'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:78:8e:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1274, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:13Z', 'updated_at': '2022-03-24T02:19:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '13b9dd73-653a-474d-904f-24c2031739ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:39.637148 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:39.693949 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] Checking router: f1e1a820-21ac-4c51-979d-f4b8742581f3 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:19:39.718891 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:19:39.721458 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:19:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:39.755815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-1c28906b-9110-4378-a519-c2135b47babb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.758791 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-1c28906b-9110-4378-a519-c2135b47babb service neutron] 10.222.0.30 "GET /v2.0/subnets?id=13b9dd73-653a-474d-904f-24c2031739ff HTTP/1.1" status: 200 len: 834 time: 0.1227672 Mar 24 02:19:39.833996 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb19d6ec-c6a4-4702-af70-9dfa39234f4b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.862589 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-99f5fa25-e970-458d-b9d7-d524432ec2e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.865510 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-99f5fa25-e970-458d-b9d7-d524432ec2e5 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=8ee3ba97-1980-4303-b77a-6f5ad4d46166&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0999868 Mar 24 02:19:39.873005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb19d6ec-c6a4-4702-af70-9dfa39234f4b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.930734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-cb19d6ec-c6a4-4702-af70-9dfa39234f4b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe is not hosted by any dhcp agent {{(pid=104036) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Mar 24 02:19:39.944064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb19d6ec-c6a4-4702-af70-9dfa39234f4b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:39.945871 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb19d6ec-c6a4-4702-af70-9dfa39234f4b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:39.948823 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cb19d6ec-c6a4-4702-af70-9dfa39234f4b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "PUT /v2.0/networks/bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe HTTP/1.1" status: 200 len: 723 time: 0.4104674 Mar 24 02:19:39.953114 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:19:39.967225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34324) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:39.977888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': 'bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:40.028805 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb19d6ec-c6a4-4702-af70-9dfa39234f4b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:40.042438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:40.130795 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34326) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:40.160869 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-298b2abe-8c0e-4b40-915a-c4b6156a1473 service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2894309 Mar 24 02:19:40.170562 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:40.174597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:40.219864 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-005c9cad-015d-49a4-b1a4-aef5036c7cbc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/c4a0d2fa-9431-42a6-9938-4b9cd6db0aec HTTP/1.1" status: 200 len: 991 time: 0.0865836 Mar 24 02:19:40.273421 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:14Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'c4a0d2fa-9431-42a6-9938-4b9cd6db0aec', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.199', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'port_id': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1320, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'mac_address': 'fa:16:3e:1e:a6:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:19:37Z', 'updated_at': '2022-03-24T02:19:37Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd3569980-3835-437c-aba6-4620efe7ee98', 'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:78:8e:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1274, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:13Z', 'updated_at': '2022-03-24T02:19:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '13b9dd73-653a-474d-904f-24c2031739ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:40.308325 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97c4895c-70fb-4e7b-b777-a3017d385d2f None None] The sync data for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv is: [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:14Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'c4a0d2fa-9431-42a6-9938-4b9cd6db0aec', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.199', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'port_id': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1320, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'mac_address': 'fa:16:3e:1e:a6:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:19:37Z', 'updated_at': '2022-03-24T02:19:37Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd3569980-3835-437c-aba6-4620efe7ee98', 'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:78:8e:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1274, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:13Z', 'updated_at': '2022-03-24T02:19:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '13b9dd73-653a-474d-904f-24c2031739ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:19:40.348340 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bb6d7da1-8bcd-4ad6-9f4c-bd8fa4cd45dd req-e2bf8b20-0e53-44ab-969a-d2f9d3bdc41a service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1788976 Mar 24 02:19:40.472335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (af39d41e-1799-4ca5-a74e-debf3010edfe), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:40.533843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=af39d41e-1799-4ca5-a74e-debf3010edfe,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:40.582597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking segment: {'id': '3bfb06a4-0ca4-4408-9599-5dcd84732d08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:40.582972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network hostable DHCP agents. Network: bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:40.610339 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:40.620653 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8419320f-bf63-4afa-8a1e-070a99293554 None None] New status for floating IP c4a0d2fa-9431-42a6-9938-4b9cd6db0aec: ACTIVE {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:19:40.633359 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:40.639772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:40.641063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:40.665788 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c415f99a-f9d5-4a73-856d-5c1c888bc29b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6961482 Mar 24 02:19:40.668523 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34328) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:40.675446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-44ed75a3-8d29-4020-bec3-3fb629ebd79c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:40.691865 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a13e5e4-aca0-477e-a030-9329933c005d None None] Network bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:40.741222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 8aec541a-0157-44fc-861a-fb475e46fe60 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:40.797650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-345a3417-822c-48b3-badd-cd1641d1ff50 None None] Network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:40.812666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-44ed75a3-8d29-4020-bec3-3fb629ebd79c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-3298615'] for subnet (af39d41e-1799-4ca5-a74e-debf3010edfe), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:40.926000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 8aec541a-0157-44fc-861a-fb475e46fe60 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:40.926373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:40.959536 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-44ed75a3-8d29-4020-bec3-3fb629ebd79c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8790618889355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-8966603'] for subnet (af39d41e-1799-4ca5-a74e-debf3010edfe), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:40.994987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44ed75a3-8d29-4020-bec3-3fb629ebd79c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:40.995827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-44ed75a3-8d29-4020-bec3-3fb629ebd79c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:40.999524 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-44ed75a3-8d29-4020-bec3-3fb629ebd79c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "PUT /v2.0/subnets/af39d41e-1799-4ca5-a74e-debf3010edfe HTTP/1.1" status: 200 len: 826 time: 0.3273857 Mar 24 02:19:40.999781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34332) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:41.012642 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-f28689b9-18e9-456f-a15a-a540fce4f270 None None] Provisioning complete for port 8aec541a-0157-44fc-861a-fb475e46fe60 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:41.013834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f28689b9-18e9-456f-a15a-a540fce4f270 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.053117 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44ed75a3-8d29-4020-bec3-3fb629ebd79c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=af39d41e-1799-4ca5-a74e-debf3010edfe,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:41.113415 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.180934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (af39d41e-1799-4ca5-a74e-debf3010edfe), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.222768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34334) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:41.258830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (af39d41e-1799-4ca5-a74e-debf3010edfe), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.267577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d13ff63-5aef-4fa8-bcb7-b18c2e161102 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe', 'network_id': 'bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe', 'project_id': 'b58415804b1b4553b1533717490a0447', 'fixed_ips': [{'subnet_id': 'af39d41e-1799-4ca5-a74e-debf3010edfe'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:41.268743 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8d13ff63-5aef-4fa8-bcb7-b18c2e161102 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.315670 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=af39d41e-1799-4ca5-a74e-debf3010edfe,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:41.390996 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d63b818d-881e-4d0c-9038-e1aa810e1b6a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/c4a0d2fa-9431-42a6-9938-4b9cd6db0aec HTTP/1.1" status: 200 len: 993 time: 0.1647892 Mar 24 02:19:41.396502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.417691 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 8aec541a-0157-44fc-861a-fb475e46fe60 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:41.418368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.420073 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:41.433038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3bfb06a4-0ca4-4408-9599-5dcd84732d08') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:41.433461 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3bfb06a4-0ca4-4408-9599-5dcd84732d08') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:41.453323 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (3bfb06a4-0ca4-4408-9599-5dcd84732d08), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.474298 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3bfb06a4-0ca4-4408-9599-5dcd84732d08), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.488567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:41.488967 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (3bfb06a4-0ca4-4408-9599-5dcd84732d08), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.492252 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f6b6d46-03af-4d8e-883c-271e76a5b6a7 None None] Network bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:41.498246 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 8aec541a-0157-44fc-861a-fb475e46fe60, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8aec541a-0157-44fc-861a-fb475e46fe60,segment=NetworkSegment(c7c235c7-0cd9-451e-b152-f58653a10809),segment_id=c7c235c7-0cd9-451e-b152-f58653a10809)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:41.500207 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f28689b9-18e9-456f-a15a-a540fce4f270 None None] Current status of the port 8aec541a-0157-44fc-861a-fb475e46fe60 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:41.500575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f28689b9-18e9-456f-a15a-a540fce4f270 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.549833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:41.550666 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:41.557852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.566193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.571873 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe HTTP/1.1" status: 204 len: 168 time: 0.5687737 Mar 24 02:19:41.572375 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34336) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:41.593028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3d0045-51a9-462e-b8d9-cd5233e5a69d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:41.607921 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-ab075921-688b-44ed-91a9-1cc6d75ba8ef tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:41.608503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ab075921-688b-44ed-91a9-1cc6d75ba8ef tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:41.614006 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ab075921-688b-44ed-91a9-1cc6d75ba8ef tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe HTTP/1.1" status: 404 len: 339 time: 0.0287049 Mar 24 02:19:41.616509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34338) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:41.622427 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-845153561', 'description': 'd1'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:41.646928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:41.650799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.677398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 115} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:41.691632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e0d9c17f-30e1-490c-aae2-c1319fb3035a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.692367 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment e0d9c17f-30e1-490c-aae2-c1319fb3035a of type vlan for network c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66 Mar 24 02:19:41.695741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-429824b6-4092-4fad-9793-b9136c14eade None None] Update dhcp port {'port': {'network_id': 'e0c5ab35-74e4-4cca-9a8f-f5ef414be87e', 'fixed_ips': [{'subnet_id': '969b0484-8540-441b-9dd0-ee709539a549', 'ip_address': '2001:db8::2'}, {'subnet_id': 'fba602d0-b8da-4151-91c7-47feba104545'}], 'binding:host_id': 'dv-neutron-834874-3-hyperv'}, 'id': '8aec541a-0157-44fc-861a-fb475e46fe60'} from dv-neutron-834874-3-hyperv. {{(pid=104038) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:311}} Mar 24 02:19:41.701106 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=8aec541a-0157-44fc-861a-fb475e46fe60,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:41.726350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4dd1a240-c4df-4808-93a4-17a25fc97588 None None] Network bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:41.741146 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-f28689b9-18e9-456f-a15a-a540fce4f270 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:19:41.741432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-f28689b9-18e9-456f-a15a-a540fce4f270 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:19:41.744219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4dd1a240-c4df-4808-93a4-17a25fc97588 None None] Network bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe could not be found, it might have been deleted concurrently. {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:196}} Mar 24 02:19:41.746169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.747850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-429824b6-4092-4fad-9793-b9136c14eade None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.774664 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.779639 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:41.780252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:41.808036 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.1882648 Mar 24 02:19:41.808985 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34344) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:41.857190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b722499-126c-4a15-ae84-53eb7bc1d85f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:41.876004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:41.947926 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-735877a4-1776-4746-bfaa-58b910c137c9 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:41.952331 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34348) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:41.954609 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-735877a4-1776-4746-bfaa-58b910c137c9 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/networks?id=c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66 HTTP/1.1" status: 200 len: 764 time: 0.1409533 Mar 24 02:19:41.958059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c7816e18-e7c3-4134-b333-966e834ad60a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'description': 'd2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:41.989745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-429824b6-4092-4fad-9793-b9136c14eade None None] Allocated IP 172.20.0.1 (e0c5ab35-74e4-4cca-9a8f-f5ef414be87e/fba602d0-b8da-4151-91c7-47feba104545/8aec541a-0157-44fc-861a-fb475e46fe60) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:42.091394 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-429824b6-4092-4fad-9793-b9136c14eade None None] For port 8aec541a-0157-44fc-861a-fb475e46fe60, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8aec541a-0157-44fc-861a-fb475e46fe60,segment=NetworkSegment(c7c235c7-0cd9-451e-b152-f58653a10809),segment_id=c7c235c7-0cd9-451e-b152-f58653a10809)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:42.122356 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-429824b6-4092-4fad-9793-b9136c14eade None None] Publish callbacks [] for port (8aec541a-0157-44fc-861a-fb475e46fe60), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:42.127042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-429824b6-4092-4fad-9793-b9136c14eade None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:42.156920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7816e18-e7c3-4134-b333-966e834ad60a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:42.175731 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-c416af5b-ff4a-41ad-95da-a651f8456782 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-425833467&fields=id&tenant_id=534ec00707834d9cbfb4f670cfeda590 HTTP/1.1" status: 200 len: 267 time: 0.0877473 Mar 24 02:19:42.176870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7816e18-e7c3-4134-b333-966e834ad60a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:42.220628 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429824b6-4092-4fad-9793-b9136c14eade None None] Pushing event updated for resources: {'Port': ['ID=8aec541a-0157-44fc-861a-fb475e46fe60,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:42.229731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-c7816e18-e7c3-4134-b333-966e834ad60a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66 is not hosted by any dhcp agent {{(pid=104037) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Mar 24 02:19:42.235446 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7816e18-e7c3-4134-b333-966e834ad60a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.236057 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c7816e18-e7c3-4134-b333-966e834ad60a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:42.237417 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c7816e18-e7c3-4134-b333-966e834ad60a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "PUT /v2.0/networks/c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66 HTTP/1.1" status: 200 len: 761 time: 0.2838745 Mar 24 02:19:42.240195 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34354) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:42.281721 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-f28689b9-18e9-456f-a15a-a540fce4f270 None None] Current status of the port 8aec541a-0157-44fc-861a-fb475e46fe60 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:42.303640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7816e18-e7c3-4134-b333-966e834ad60a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:42.315640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:42.330697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1287fe65-3212-46d6-ae58-04871dfee5df tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.335913 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1287fe65-3212-46d6-ae58-04871dfee5df tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/networks?id=c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66 HTTP/1.1" status: 200 len: 764 time: 0.0911951 Mar 24 02:19:42.338607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34356) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:42.460645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-d8e0c1ee-0593-4538-8465-cbb6d64274fc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.462143 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-d8e0c1ee-0593-4538-8465-cbb6d64274fc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 810 time: 0.2785506 Mar 24 02:19:42.502713 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-4896e8df-6890-43ab-96f3-57fd19d4c7cf tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/quotas/534ec00707834d9cbfb4f670cfeda590 HTTP/1.1" status: 200 len: 375 time: 0.0331583 Mar 24 02:19:42.600477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-005435d0-a61d-4231-a536-cb3f86f1570d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.601970 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-005435d0-a61d-4231-a536-cb3f86f1570d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.2620058 Mar 24 02:19:42.605069 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34358) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:42.612730 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 8aec541a-0157-44fc-861a-fb475e46fe60 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:42.618734 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-15128bc4-df3b-4576-b8d4-be277852c2bc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1085997 Mar 24 02:19:42.653878 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dd93ed17-d21b-4b1a-ba9c-0bf147fc733d tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 207 time: 0.0456638 Mar 24 02:19:42.659801 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34360) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:42.664622 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 8aec541a-0157-44fc-861a-fb475e46fe60 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:42.665002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:42.735003 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-3534af8f-6e87-4b24-9609-f9e89d794ffa service neutron] 10.222.0.20 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1047285 Mar 24 02:19:42.758964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 8aec541a-0157-44fc-861a-fb475e46fe60 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:42.823399 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3fe53d4-7e3a-4d68-acb3-fb078c984630 None None] Network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:42.832713 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-cdfa00f1-8249-4c07-ab1a-5cb618d39fc4 service neutron] 10.222.0.20 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916770 Mar 24 02:19:42.863148 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c161e47-b97c-4afd-bdc7-854b037e079b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.868447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c161e47-b97c-4afd-bdc7-854b037e079b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.873705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c161e47-b97c-4afd-bdc7-854b037e079b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.879304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c161e47-b97c-4afd-bdc7-854b037e079b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.884286 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c161e47-b97c-4afd-bdc7-854b037e079b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.889419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c161e47-b97c-4afd-bdc7-854b037e079b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:42.892278 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4c161e47-b97c-4afd-bdc7-854b037e079b tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3729 time: 0.2311857 Mar 24 02:19:42.896106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34364) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:42.934266 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-e2fe5429-a256-4bd2-8af2-1ea86b6be090 None None] Provisioning complete for port 8aec541a-0157-44fc-861a-fb475e46fe60 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:42.934671 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e2fe5429-a256-4bd2-8af2-1ea86b6be090 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:43.040689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e2fe5429-a256-4bd2-8af2-1ea86b6be090 None None] Current status of the port 8aec541a-0157-44fc-861a-fb475e46fe60 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:43.127069 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-becf63c4-b741-42d3-9100-3f15c5f437c2 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 811 time: 0.2294369 Mar 24 02:19:43.132006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34372) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:43.191749 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fc959165-05f1-4af5-930a-fd62f0ebb758 req-62497b68-3e0a-4aea-9e42-6021bccc3291 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0339422 Mar 24 02:19:43.212645 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8e3f1db-d316-443b-b093-250b4332b5a1 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.214204 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8e3f1db-d316-443b-b093-250b4332b5a1 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.215689 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8e3f1db-d316-443b-b093-250b4332b5a1 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.217785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8e3f1db-d316-443b-b093-250b4332b5a1 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.219261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8e3f1db-d316-443b-b093-250b4332b5a1 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.221000 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d8e3f1db-d316-443b-b093-250b4332b5a1 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.0879307 Mar 24 02:19:43.225244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34376) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:43.263087 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-24730d3a-e2df-45c9-ad91-efd8cf532b0c None None] Provisioning complete for port 8aec541a-0157-44fc-861a-fb475e46fe60 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:43.263469 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-24730d3a-e2df-45c9-ad91-efd8cf532b0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:43.351373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-24730d3a-e2df-45c9-ad91-efd8cf532b0c None None] Current status of the port 8aec541a-0157-44fc-861a-fb475e46fe60 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:19:43.620916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-145210b3-36f5-4175-9fbb-a5955c7af408 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.622170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-145210b3-36f5-4175-9fbb-a5955c7af408 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.623479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-145210b3-36f5-4175-9fbb-a5955c7af408 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.624659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-145210b3-36f5-4175-9fbb-a5955c7af408 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.625866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-145210b3-36f5-4175-9fbb-a5955c7af408 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.627792 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-145210b3-36f5-4175-9fbb-a5955c7af408 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 697 time: 0.4011693 Mar 24 02:19:43.631194 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34384) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:43.730612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a23779d-dfd1-4fc0-8ee8-9c3cf1a37422 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.731951 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1a23779d-dfd1-4fc0-8ee8-9c3cf1a37422 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/networks/0ccf211a-6709-496e-b50e-8d61163b6816 HTTP/1.1" status: 200 len: 804 time: 0.0997667 Mar 24 02:19:43.736210 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34386) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:43.833749 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5c46e050-76c7-4a94-b44d-aec9d2d715e3 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/networks/0ccf211a-6709-496e-b50e-8d61163b6816?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 320 time: 0.0963571 Mar 24 02:19:43.837066 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34388) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:43.891279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2cf7b916-554f-43ea-8c65-79a625576022 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.892537 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2cf7b916-554f-43ea-8c65-79a625576022 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/subnets/29791c30-6dd7-4de5-bd24-ba31758c1a17 HTTP/1.1" status: 200 len: 843 time: 0.0545495 Mar 24 02:19:43.896081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34390) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:43.946185 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa3768a1-68f9-4374-9fa2-4ad0927ffdb5 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['shared'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:43.947524 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fa3768a1-68f9-4374-9fa2-4ad0927ffdb5 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "GET /v2.0/subnets/29791c30-6dd7-4de5-bd24-ba31758c1a17?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.0505633 Mar 24 02:19:43.950902 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34392) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:43.956035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2022264626'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:43.975396 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:43.979673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.005776 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 123} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:19:44.020812 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (67a81783-3ff5-4ad3-b87f-41ac4a6969b3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.021178 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Added segment 67a81783-3ff5-4ad3-b87f-41ac4a6969b3 of type vlan for network 38885ff6-33ad-4c2d-abd1-0488a154842b Mar 24 02:19:44.109602 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (38885ff6-33ad-4c2d-abd1-0488a154842b), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.164506 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (38885ff6-33ad-4c2d-abd1-0488a154842b), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.165360 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:44.165947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.236885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-bbf3c1ae-ce39-4c63-920d-cd80a123b5ec tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:44.238387 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-bbf3c1ae-ce39-4c63-920d-cd80a123b5ec tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 810 time: 0.1835332 Mar 24 02:19:44.247940 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2960896 Mar 24 02:19:44.251077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34396) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:44.256006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'network_id': '38885ff6-33ad-4c2d-abd1-0488a154842b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888'], 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:44.275007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83230cc9-6b2c-4216-b1fb-f89cbee62436 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Network': ['ID=38885ff6-33ad-4c2d-abd1-0488a154842b,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:44.285843 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 38885ff6-33ad-4c2d-abd1-0488a154842b details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:19:44.295931 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f4b778f2-40c0-41b0-949a-feca1b3c5dd5 req-c2b79ddb-4393-47d4-b487-7622036afff0 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0327637 Mar 24 02:19:44.346086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Made reservation on behalf of b58415804b1b4553b1533717490a0447 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:44.351263 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.387624 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-723603be-ad15-486b-b4dd-91a8a6562512 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=534ec00707834d9cbfb4f670cfeda590 HTTP/1.1" status: 200 len: 379 time: 0.0562961 Mar 24 02:19:44.402122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'port': {'device_id': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'admin_state_up': True, 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'security_groups': ['8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:44.413510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Performing IP validity checks on allocation pools {{(pid=104036) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:322}} Mar 24 02:19:44.414023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.ipam_backend_mixin [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking for overlaps among allocation pools and gateway ip {{(pid=104036) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:343}} Mar 24 02:19:44.522306 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Made reservation on behalf of 534ec00707834d9cbfb4f670cfeda590 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:19:44.525887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.558950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (dd783281-d76b-4ead-9e02-1c7c1fc08384), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.623778 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=dd783281-d76b-4ead-9e02-1c7c1fc08384,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:44.634760 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Checking segment: {'id': '67a81783-3ff5-4ad3-b87f-41ac4a6969b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '38885ff6-33ad-4c2d-abd1-0488a154842b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:44.635447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network hostable DHCP agents. Network: 38885ff6-33ad-4c2d-abd1-0488a154842b, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:19:44.654284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Network 38885ff6-33ad-4c2d-abd1-0488a154842b is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:19:44.663635 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 38885ff6-33ad-4c2d-abd1-0488a154842b) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:44.664490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Allocated IP 172.20.0.3 (1c7b4ca8-c501-4e72-9eba-3ca17999702e/7098e0b3-a3e5-4826-921e-69dc9ba94ef6/5b3ca245-4a38-4e2a-9165-fea0f427a048) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:44.668540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:44.669798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.672441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3a29116-ff07-4766-9a56-d56cd414631f None None] Network 38885ff6-33ad-4c2d-abd1-0488a154842b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:44.689119 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b000adb4-212d-4d3c-aec0-e1c04248542e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 895 time: 0.4369271 Mar 24 02:19:44.693355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34402) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:44.700440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-889ca559-a128-4623-9ad0-f1cad96ec565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2005::1'}], 'dns_nameservers': ['2001:4860:4860::7744', '2001:4860:4860::7888'], 'gateway_ip': '2001:db8::2', 'enable_dhcp': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:44.785676 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-38885ff6-33ad-4c2d-abd1-0488a154842b', 'network_id': '38885ff6-33ad-4c2d-abd1-0488a154842b', 'project_id': 'b58415804b1b4553b1533717490a0447', 'fixed_ips': [{'subnet_id': 'dd783281-d76b-4ead-9e02-1c7c1fc08384'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:19:44.786628 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.876734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-889ca559-a128-4623-9ad0-f1cad96ec565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-9331132'] for subnet (dd783281-d76b-4ead-9e02-1c7c1fc08384), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.913323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:44.931854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Allocated IP 2001:db8::3 (38885ff6-33ad-4c2d-abd1-0488a154842b/dd783281-d76b-4ead-9e02-1c7c1fc08384/1082331e-7bca-4330-81cc-b1f202322f5b) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:19:44.951448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.002908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'Port': ['ID=5b3ca245-4a38-4e2a-9165-fea0f427a048,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:45.015361 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:45.017075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:45.019740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:45.074886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:45.075550 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.094280 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Publish callbacks [] for port (1082331e-7bca-4330-81cc-b1f202322f5b), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.096707 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-9cf330d4-416c-46b6-aae5-327b839ba9e8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6985059 Mar 24 02:19:45.097966 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.102941 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (1082331e-7bca-4330-81cc-b1f202322f5b), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.116762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Request body: {'port': {'device_id': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:45.157999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Network 38885ff6-33ad-4c2d-abd1-0488a154842b is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:19:45.163748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:19:45.169159 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:19:45.172619 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Pushing event updated for resources: {'Port': ['ID=1082331e-7bca-4330-81cc-b1f202322f5b,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:45.239140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.241518 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Attempting to bind port 1082331e-7bca-4330-81cc-b1f202322f5b on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:45.241910 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Attempting to bind port 1082331e-7bca-4330-81cc-b1f202322f5b by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '67a81783-3ff5-4ad3-b87f-41ac4a6969b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '38885ff6-33ad-4c2d-abd1-0488a154842b'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:45.242269 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Attempting to bind port 1082331e-7bca-4330-81cc-b1f202322f5b on network 38885ff6-33ad-4c2d-abd1-0488a154842b {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:45.249733 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:45.250384 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Checking segment: {'id': '67a81783-3ff5-4ad3-b87f-41ac4a6969b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '38885ff6-33ad-4c2d-abd1-0488a154842b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:45.251056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.251769 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Bound using segment: {'id': '67a81783-3ff5-4ad3-b87f-41ac4a6969b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '38885ff6-33ad-4c2d-abd1-0488a154842b'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:45.252409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Bound port: 1082331e-7bca-4330-81cc-b1f202322f5b, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '67a81783-3ff5-4ad3-b87f-41ac4a6969b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '38885ff6-33ad-4c2d-abd1-0488a154842b'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:45.252964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (1082331e-7bca-4330-81cc-b1f202322f5b), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.326742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] For port 1082331e-7bca-4330-81cc-b1f202322f5b, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:45.330542 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] For port 1082331e-7bca-4330-81cc-b1f202322f5b, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=1082331e-7bca-4330-81cc-b1f202322f5b,segment=NetworkSegment(67a81783-3ff5-4ad3-b87f-41ac4a6969b3),segment_id=67a81783-3ff5-4ad3-b87f-41ac4a6969b3)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:45.340791 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (1082331e-7bca-4330-81cc-b1f202322f5b), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.428331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-19d1ade6-1239-447e-84ef-2bceef5b7d93 None None] Provisioning complete for port 5b3ca245-4a38-4e2a-9165-fea0f427a048 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:19:45.428718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-19d1ade6-1239-447e-84ef-2bceef5b7d93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.431413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128909d0-a7ac-43a8-83d8-82b6d4207f7e None None] Pushing event updated for resources: {'Port': ['ID=1082331e-7bca-4330-81cc-b1f202322f5b,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:45.466883 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-19d1ade6-1239-447e-84ef-2bceef5b7d93 None None] Port 5b3ca245-4a38-4e2a-9165-fea0f427a048 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:19:45.506482 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-889ca559-a128-4623-9ad0-f1cad96ec565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8790618889355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-3241109'] for subnet (dd783281-d76b-4ead-9e02-1c7c1fc08384), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.632162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-889ca559-a128-4623-9ad0-f1cad96ec565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:45.632787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-889ca559-a128-4623-9ad0-f1cad96ec565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.635435 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-889ca559-a128-4623-9ad0-f1cad96ec565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "PUT /v2.0/subnets/dd783281-d76b-4ead-9e02-1c7c1fc08384 HTTP/1.1" status: 200 len: 900 time: 0.9398773 Mar 24 02:19:45.639235 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34406) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:45.654148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-889ca559-a128-4623-9ad0-f1cad96ec565 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event updated for resources: {'Subnet': ['ID=dd783281-d76b-4ead-9e02-1c7c1fc08384,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:45.666840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b58ff9-54de-4ae7-9f7b-1a21effa7f87 req-3aa9eac0-b7c3-44a7-8a03-2becf6c93f80 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:45.668456 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-11b58ff9-54de-4ae7-9f7b-1a21effa7f87 req-3aa9eac0-b7c3-44a7-8a03-2becf6c93f80 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 931 time: 0.2837896 Mar 24 02:19:45.786665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (38885ff6-33ad-4c2d-abd1-0488a154842b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.794103 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-11b58ff9-54de-4ae7-9f7b-1a21effa7f87 req-b48b4e09-5534-4d2b-9f5e-36b038369a0b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1156576 Mar 24 02:19:45.858964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5b3ca245-4a38-4e2a-9165-fea0f427a048 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:19:45.868734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Publish callbacks [] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.872901 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting port 1082331e-7bca-4330-81cc-b1f202322f5b {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:45.873244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (1082331e-7bca-4330-81cc-b1f202322f5b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.882144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Transition to ACTIVE for port object 5b3ca245-4a38-4e2a-9165-fea0f427a048 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:19:45.887948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.963568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] For port 1082331e-7bca-4330-81cc-b1f202322f5b, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=1082331e-7bca-4330-81cc-b1f202322f5b,segment=NetworkSegment(67a81783-3ff5-4ad3-b87f-41ac4a6969b3),segment_id=67a81783-3ff5-4ad3-b87f-41ac4a6969b3)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:45.963928 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (1082331e-7bca-4330-81cc-b1f202322f5b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:45.978353 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Calling delete_port for 1082331e-7bca-4330-81cc-b1f202322f5b owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:46.009979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Pushing event updated for resources: {'Port': ['ID=5b3ca245-4a38-4e2a-9165-fea0f427a048,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:46.040920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Attempting to bind port 5b3ca245-4a38-4e2a-9165-fea0f427a048 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:19:46.041719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Attempting to bind port 5b3ca245-4a38-4e2a-9165-fea0f427a048 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:19:46.041719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Attempting to bind port 5b3ca245-4a38-4e2a-9165-fea0f427a048 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:46.048450 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Port 5b3ca245-4a38-4e2a-9165-fea0f427a048 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:19:46.052051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Attempting to bind port 5b3ca245-4a38-4e2a-9165-fea0f427a048 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:19:46.058026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 19, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:19:46.058355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Checking segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:19:46.058956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Bound using segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:19:46.059834 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Bound port: 5b3ca245-4a38-4e2a-9165-fea0f427a048, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:19:46.059971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:46.137443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] For port 5b3ca245-4a38-4e2a-9165-fea0f427a048, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:19:46.143563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] For port 5b3ca245-4a38-4e2a-9165-fea0f427a048, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=5b3ca245-4a38-4e2a-9165-fea0f427a048,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:19:46.150909 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:46.157879 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (1082331e-7bca-4330-81cc-b1f202322f5b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:46.199144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:46.199787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:46.201238 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] 10.222.0.30 "PUT /v2.0/ports/5b3ca245-4a38-4e2a-9165-fea0f427a048 HTTP/1.1" status: 200 len: 1093 time: 1.0967500 Mar 24 02:19:46.201693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'tag': '5b3ca245-4a38-4e2a-9165-fea0f427a048'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:19:46.204595 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c013ff1-9b84-4cc7-bbed-d46fac78b367" -d '{"events": [{"name": "network-changed", "server_uuid": "74e34fdf-6340-4649-ace4-f8648b8309b9", "tag": "5b3ca245-4a38-4e2a-9165-fea0f427a048"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:19:46.233848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e29188-b1a6-4d50-ba36-330278c9d4bb service neutron] Pushing event updated for resources: {'Port': ['ID=5b3ca245-4a38-4e2a-9165-fea0f427a048,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:46.270048 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:19:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-80f54b12-a086-4152-8800-6b3c6d24ab45 x-openstack-request-id: req-80f54b12-a086-4152-8800-6b3c6d24ab45 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:19:46.271714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "74e34fdf-6340-4649-ace4-f8648b8309b9", "tag": "5b3ca245-4a38-4e2a-9165-fea0f427a048", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:19:46.272176 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-80f54b12-a086-4152-8800-6b3c6d24ab45 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:19:46.274401 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-80f54b12-a086-4152-8800-6b3c6d24ab45'] response: {'name': 'network-changed', 'server_uuid': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'tag': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'status': 'completed', 'code': 200} Mar 24 02:19:46.342259 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-b2434111-fe7b-49d9-a1b9-629d914d1de2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:46.344986 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-b2434111-fe7b-49d9-a1b9-629d914d1de2 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 1127 time: 0.0693393 Mar 24 02:19:46.414191 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-d9c2997e-5751-470a-a597-dc12dae243ed service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5b3ca245-4a38-4e2a-9165-fea0f427a048 HTTP/1.1" status: 200 len: 217 time: 0.0620508 Mar 24 02:19:46.492313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-4ec5e69f-9186-40fa-93bd-7793760905b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:46.493791 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-4ec5e69f-9186-40fa-93bd-7793760905b0 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0677791 Mar 24 02:19:46.572127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-7c51ec8c-bd26-494f-9c60-7bd40af49102 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:46.573774 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-7c51ec8c-bd26-494f-9c60-7bd40af49102 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0718522 Mar 24 02:19:46.636576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Port': ['ID=1082331e-7bca-4330-81cc-b1f202322f5b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:46.680114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 1082331e-7bca-4330-81cc-b1f202322f5b up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:19:46.685438 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No DVR routers for this DVR port 1082331e-7bca-4330-81cc-b1f202322f5b on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:46.719675 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 1082331e-7bca-4330-81cc-b1f202322f5b {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:19:46.721798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 1082331e-7bca-4330-81cc-b1f202322f5b not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Mar 24 02:19:46.735316 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (dd783281-d76b-4ead-9e02-1c7c1fc08384), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:46.749347 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Port 1082331e-7bca-4330-81cc-b1f202322f5b not found, will not notify nova. {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Mar 24 02:19:46.762756 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-e2ede2c2-afde-471d-b0fa-11338a50d2d9 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1805418 Mar 24 02:19:46.810444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (dd783281-d76b-4ead-9e02-1c7c1fc08384), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:46.851653 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=dd783281-d76b-4ead-9e02-1c7c1fc08384,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:46.881467 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f8d1f09-95d0-4b5c-86b9-b98d366ee86a req-4c6e89bf-b27f-4035-840a-6eb6b1940a2b service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1133831 Mar 24 02:19:46.916770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05ff95a5-78e5-4d8c-9085-65b251ce34ef None None] Network 38885ff6-33ad-4c2d-abd1-0488a154842b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:46.931161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (38885ff6-33ad-4c2d-abd1-0488a154842b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:46.959520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['38885ff6-33ad-4c2d-abd1-0488a154842b']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:46.973015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '67a81783-3ff5-4ad3-b87f-41ac4a6969b3') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:46.973313 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '67a81783-3ff5-4ad3-b87f-41ac4a6969b3') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:46.983021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (67a81783-3ff5-4ad3-b87f-41ac4a6969b3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:46.996664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (67a81783-3ff5-4ad3-b87f-41ac4a6969b3), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:46.997199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-49f589c9-b85b-4dd3-a8f8-53ff41afade6 None None] Could not find standard attr ID for object 1082331e-7bca-4330-81cc-b1f202322f5b. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:19:47.004187 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 123 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:47.004603 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (67a81783-3ff5-4ad3-b87f-41ac4a6969b3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.008223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7beade6-abfd-429c-a544-6d9802b391e3 req-3d4e93b9-0ca2-40f6-baa6-4dfc339093ee tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:47.016862 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d7beade6-abfd-429c-a544-6d9802b391e3 req-3d4e93b9-0ca2-40f6-baa6-4dfc339093ee tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.1223581 Mar 24 02:19:47.052041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-55658232-2fea-4b01-ba87-66f42337abfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:47.054124 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-55658232-2fea-4b01-ba87-66f42337abfb service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 1127 time: 0.0951633 Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:47.067457 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:47.083011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (38885ff6-33ad-4c2d-abd1-0488a154842b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.093168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.097377 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/38885ff6-33ad-4c2d-abd1-0488a154842b HTTP/1.1" status: 204 len: 168 time: 1.4563053 Mar 24 02:19:47.110889 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34412) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:47.119261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17e7976-bd95-4733-bfa0-d3f764f4d2aa tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=38885ff6-33ad-4c2d-abd1-0488a154842b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:47.139316 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c88998f-0e3b-4fcd-b322-dfbe5044dc4c None None] DHCP port deletion for 38885ff6-33ad-4c2d-abd1-0488a154842b request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:19:47.156534 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-9358b75f-0e78-48ef-8883-5e1cc74c29ed tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:47.159639 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00d4b429-3569-4663-a2f4-52fdd387927f None None] Network 38885ff6-33ad-4c2d-abd1-0488a154842b requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:47.166109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9358b75f-0e78-48ef-8883-5e1cc74c29ed tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:47.174799 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d7beade6-abfd-429c-a544-6d9802b391e3 req-7e82d051-f7f6-47b6-9a20-d9041014a2a3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1567552 Mar 24 02:19:47.176120 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9358b75f-0e78-48ef-8883-5e1cc74c29ed tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/dd783281-d76b-4ead-9e02-1c7c1fc08384 HTTP/1.1" status: 404 len: 337 time: 0.0641794 Mar 24 02:19:47.178100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00d4b429-3569-4663-a2f4-52fdd387927f None None] Network 38885ff6-33ad-4c2d-abd1-0488a154842b could not be found, it might have been deleted concurrently. {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:196}} Mar 24 02:19:47.178750 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34414) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:47.201652 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-8c33b180-1944-4f69-b7e9-705d118aadb0 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:47.203863 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8c33b180-1944-4f69-b7e9-705d118aadb0 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:47.207104 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8c33b180-1944-4f69-b7e9-705d118aadb0 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/38885ff6-33ad-4c2d-abd1-0488a154842b HTTP/1.1" status: 404 len: 339 time: 0.0272346 Mar 24 02:19:47.209514 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34416) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:47.220398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-af72dcf9-80af-47a3-9031-55f3d2e16851 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:47.221878 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-af72dcf9-80af-47a3-9031-55f3d2e16851 service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.1550658 Mar 24 02:19:47.265967 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-fe2cbded-0341-41b8-8e73-5b68ca97ee2b service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5b3ca245-4a38-4e2a-9165-fea0f427a048 HTTP/1.1" status: 200 len: 217 time: 0.0370436 Mar 24 02:19:47.290768 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.338741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-fc8485db-f5e7-4692-9ace-9d9dd0b2101e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:47.340756 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-fc8485db-f5e7-4692-9ace-9d9dd0b2101e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0699058 Mar 24 02:19:47.387051 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.397158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-b43ad5c5-c625-43f6-a92f-9a0476110af1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:47.399147 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-b43ad5c5-c625-43f6-a92f-9a0476110af1 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0512319 Mar 24 02:19:47.415540 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:47.427852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e0d9c17f-30e1-490c-aae2-c1319fb3035a') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:47.428591 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e0d9c17f-30e1-490c-aae2-c1319fb3035a') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:47.445879 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (e0d9c17f-30e1-490c-aae2-c1319fb3035a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.461418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (e0d9c17f-30e1-490c-aae2-c1319fb3035a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.467761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:47.468372 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (e0d9c17f-30e1-490c-aae2-c1319fb3035a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:47.471596 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:47.503734 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-a754bddc-24cf-4553-a2e4-50f4b2f863f5 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0935614 Mar 24 02:19:47.534813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.543955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.547663 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66 HTTP/1.1" status: 204 len: 168 time: 0.3371243 Mar 24 02:19:47.550344 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34418) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:47.587484 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9fc2f9e-e587-4911-972c-44c97fde76b4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=c0ad7bf0-d402-4a30-a84f-74f9ef4c9a66,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:47.589615 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-42853660-7b77-4469-900d-7028bad0d574 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:47.590001 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-42853660-7b77-4469-900d-7028bad0d574 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:47.593237 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-42853660-7b77-4469-900d-7028bad0d574 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/af39d41e-1799-4ca5-a74e-debf3010edfe HTTP/1.1" status: 404 len: 337 time: 0.0411875 Mar 24 02:19:47.596033 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34420) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:47.603029 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8c013ff1-9b84-4cc7-bbed-d46fac78b367 req-3079862d-087e-4710-8a64-755541bd9d1a service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924277 Mar 24 02:19:47.618277 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-6cb3ea9b-1c0b-45bc-8083-b079b249bec5 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:47.618824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6cb3ea9b-1c0b-45bc-8083-b079b249bec5 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:47.622263 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6cb3ea9b-1c0b-45bc-8083-b079b249bec5 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/bbdc5e4a-a574-4976-a7f5-7cd6dc9421fe HTTP/1.1" status: 404 len: 339 time: 0.0246890 Mar 24 02:19:47.625176 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34422) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:47.679724 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-243a336c-ea6e-4f53-a360-f1e4ee27f45f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting subnet fba602d0-b8da-4151-91c7-47feba104545 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:19:47.682751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-243a336c-ea6e-4f53-a360-f1e4ee27f45f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (fba602d0-b8da-4151-91c7-47feba104545), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.722788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-243a336c-ea6e-4f53-a360-f1e4ee27f45f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (fba602d0-b8da-4151-91c7-47feba104545), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.804809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-243a336c-ea6e-4f53-a360-f1e4ee27f45f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (fba602d0-b8da-4151-91c7-47feba104545), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.868372 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-243a336c-ea6e-4f53-a360-f1e4ee27f45f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (fba602d0-b8da-4151-91c7-47feba104545), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.897202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-243a336c-ea6e-4f53-a360-f1e4ee27f45f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=fba602d0-b8da-4151-91c7-47feba104545,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:47.900927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-243a336c-ea6e-4f53-a360-f1e4ee27f45f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:47.906297 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-243a336c-ea6e-4f53-a360-f1e4ee27f45f tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/fba602d0-b8da-4151-91c7-47feba104545 HTTP/1.1" status: 204 len: 168 time: 0.2779696 Mar 24 02:19:47.906804 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34424) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:47.911574 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbd1b24d-39a1-4822-b4a4-abbd51a52877 None None] Network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:47.966229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-447b3eb8-346a-475e-bae8-181c0a2d5392 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting subnet 969b0484-8540-441b-9dd0-ee709539a549 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:19:47.969936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-447b3eb8-346a-475e-bae8-181c0a2d5392 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (969b0484-8540-441b-9dd0-ee709539a549), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.012554 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-447b3eb8-346a-475e-bae8-181c0a2d5392 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (969b0484-8540-441b-9dd0-ee709539a549), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.115789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-447b3eb8-346a-475e-bae8-181c0a2d5392 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (969b0484-8540-441b-9dd0-ee709539a549), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.185234 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-447b3eb8-346a-475e-bae8-181c0a2d5392 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (969b0484-8540-441b-9dd0-ee709539a549), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.213723 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-447b3eb8-346a-475e-bae8-181c0a2d5392 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=969b0484-8540-441b-9dd0-ee709539a549,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:48.218748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-447b3eb8-346a-475e-bae8-181c0a2d5392 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.222104 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-447b3eb8-346a-475e-bae8-181c0a2d5392 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/969b0484-8540-441b-9dd0-ee709539a549 HTTP/1.1" status: 204 len: 168 time: 0.3141704 Mar 24 02:19:48.224734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34428) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:48.345629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (e0c5ab35-74e4-4cca-9a8f-f5ef414be87e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.373413 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762e50fc-8196-4573-bc81-b367a5d8531b req-00b6a194-b6a1-4c22-b82e-e87bf759c4d2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:48.375012 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-762e50fc-8196-4573-bc81-b367a5d8531b req-00b6a194-b6a1-4c22-b82e-e87bf759c4d2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0897856 Mar 24 02:19:48.451064 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-762e50fc-8196-4573-bc81-b367a5d8531b req-c22b4277-1b87-4588-be4b-e9a58f1a57d6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0584610 Mar 24 02:19:48.461231 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting port 8aec541a-0157-44fc-861a-fb475e46fe60 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:48.461570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.531680 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] For port 8aec541a-0157-44fc-861a-fb475e46fe60, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=8aec541a-0157-44fc-861a-fb475e46fe60,segment=NetworkSegment(c7c235c7-0cd9-451e-b152-f58653a10809),segment_id=c7c235c7-0cd9-451e-b152-f58653a10809)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:48.532148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.548521 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Calling delete_port for 8aec541a-0157-44fc-861a-fb475e46fe60 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:48.606213 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 1082331e-7bca-4330-81cc-b1f202322f5b no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:19:48.626850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 1082331e-7bca-4330-81cc-b1f202322f5b {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:19:48.627198 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 1082331e-7bca-4330-81cc-b1f202322f5b not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:19:48.644924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (8aec541a-0157-44fc-861a-fb475e46fe60), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.648240 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e3a4a7d-8358-44ae-b19b-aff2c62df395 None None] Network e0c5ab35-74e4-4cca-9a8f-f5ef414be87e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:48.673175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Port': ['ID=8aec541a-0157-44fc-861a-fb475e46fe60,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:48.677163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No DVR routers for this DVR port 8aec541a-0157-44fc-861a-fb475e46fe60 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:48.765276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (e0c5ab35-74e4-4cca-9a8f-f5ef414be87e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.792631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e0c5ab35-74e4-4cca-9a8f-f5ef414be87e']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:48.802909 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c7c235c7-0cd9-451e-b152-f58653a10809') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:48.803260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c7c235c7-0cd9-451e-b152-f58653a10809') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:48.813576 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (c7c235c7-0cd9-451e-b152-f58653a10809), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.830802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (c7c235c7-0cd9-451e-b152-f58653a10809), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.838301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 132 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:48.838956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (c7c235c7-0cd9-451e-b152-f58653a10809), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:48.852027 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:48.854681 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-52744559-035e-4fc2-aebb-0b371a15226a None None] Could not find standard attr ID for object 8aec541a-0157-44fc-861a-fb475e46fe60. {{(pid=104038) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:176}} Mar 24 02:19:48.903202 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (e0c5ab35-74e4-4cca-9a8f-f5ef414be87e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.910874 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:48.916177 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/e0c5ab35-74e4-4cca-9a8f-f5ef414be87e HTTP/1.1" status: 204 len: 168 time: 0.6882613 Mar 24 02:19:48.917046 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34430) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:48.935641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39fbb197-cc6c-4de6-ace9-c9a9852490c8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=e0c5ab35-74e4-4cca-9a8f-f5ef414be87e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:48.944606 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-416c3817-19d7-4bf5-b929-2c32719b567a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:48.945071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-416c3817-19d7-4bf5-b929-2c32719b567a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:48.950484 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-416c3817-19d7-4bf5-b929-2c32719b567a tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/6894714e-a21a-4adb-a930-3f062652c697 HTTP/1.1" status: 404 len: 337 time: 0.0300760 Mar 24 02:19:48.950777 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9a36ad6-fbfc-4271-b344-83e2402f0aa2 None None] DHCP port deletion for e0c5ab35-74e4-4cca-9a8f-f5ef414be87e request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:19:48.951244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34432) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:48.971376 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-11c81175-70e2-4e94-b7d2-8f4a4909606c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:48.971879 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-11c81175-70e2-4e94-b7d2-8f4a4909606c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:48.974930 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-11c81175-70e2-4e94-b7d2-8f4a4909606c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/b22aa60c-8118-428a-9aa9-aecdb81775ad HTTP/1.1" status: 404 len: 339 time: 0.0227334 Mar 24 02:19:48.977468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34434) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:49.008575 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-54803dd1-cde1-4385-bf8a-70f9c6ef0bcc tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:49.009029 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-54803dd1-cde1-4385-bf8a-70f9c6ef0bcc tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:49.012090 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-54803dd1-cde1-4385-bf8a-70f9c6ef0bcc tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/3de095fc-0ef1-4dd0-9dd7-015a79118e23 HTTP/1.1" status: 404 len: 337 time: 0.0337110 Mar 24 02:19:49.015360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34436) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:49.032975 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-8ccd8dd3-b226-4bb2-958f-2f72d02ae827 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:49.033449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8ccd8dd3-b226-4bb2-958f-2f72d02ae827 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:49.036404 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8ccd8dd3-b226-4bb2-958f-2f72d02ae827 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/a069d32e-efb3-45f9-a47d-e177ae57330d HTTP/1.1" status: 404 len: 339 time: 0.0201163 Mar 24 02:19:49.038982 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34438) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:49.065034 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-e1d95b50-5c5e-4abc-a4a7-733a43a3b498 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:49.065571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e1d95b50-5c5e-4abc-a4a7-733a43a3b498 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:49.069106 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e1d95b50-5c5e-4abc-a4a7-733a43a3b498 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/4df2e93d-ff98-4f2a-bde0-5f3ca95324a8 HTTP/1.1" status: 404 len: 337 time: 0.0289323 Mar 24 02:19:49.071488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34440) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:49.089384 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.pecan_wsgi.hooks.translation [None req-9aee1891-1338-41d3-8179-4133e103f04c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:49.089862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9aee1891-1338-41d3-8179-4133e103f04c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104037) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:49.094559 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9aee1891-1338-41d3-8179-4133e103f04c tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/cacf996c-2a0d-4da4-9104-2787ada6302f HTTP/1.1" status: 404 len: 339 time: 0.0204701 Mar 24 02:19:49.095729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34442) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:49.146546 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-2d2c9215-0c1a-4671-a1a1-de4dc6cc256e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting subnet 8478d3b9-c1cf-4064-867f-cbb6c25a8d4d {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:19:49.149904 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2d2c9215-0c1a-4671-a1a1-de4dc6cc256e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (8478d3b9-c1cf-4064-867f-cbb6c25a8d4d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.191465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2d2c9215-0c1a-4671-a1a1-de4dc6cc256e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (8478d3b9-c1cf-4064-867f-cbb6c25a8d4d), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.276769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2d2c9215-0c1a-4671-a1a1-de4dc6cc256e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (8478d3b9-c1cf-4064-867f-cbb6c25a8d4d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.335299 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2d2c9215-0c1a-4671-a1a1-de4dc6cc256e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (8478d3b9-c1cf-4064-867f-cbb6c25a8d4d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.362284 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2c9215-0c1a-4671-a1a1-de4dc6cc256e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=8478d3b9-c1cf-4064-867f-cbb6c25a8d4d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:49.366008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2d2c9215-0c1a-4671-a1a1-de4dc6cc256e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.369190 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2d2c9215-0c1a-4671-a1a1-de4dc6cc256e tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/8478d3b9-c1cf-4064-867f-cbb6c25a8d4d HTTP/1.1" status: 204 len: 168 time: 0.2723124 Mar 24 02:19:49.371596 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34444) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:49.375454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-151cfbdb-dd9e-4078-86ba-b458b5ed1ad2 None None] Network f7ce0e3f-7b42-4596-9171-4f56591d24cf requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:49.450588 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (f7ce0e3f-7b42-4596-9171-4f56591d24cf), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.514775 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting port 19a6849a-410b-4fd9-88d6-09f55d1d33ef {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:49.515258 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.571312 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb57efdc-eff1-4898-a0f2-d24d531496e2 None None] DHCP port deletion for f7ce0e3f-7b42-4596-9171-4f56591d24cf request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:19:49.590754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62639b0d-38b0-4a85-a292-5e0b330152b0 req-1c8422a6-f101-49e5-8667-790b882280d6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:49.595360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] For port 19a6849a-410b-4fd9-88d6-09f55d1d33ef, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=19a6849a-410b-4fd9-88d6-09f55d1d33ef,segment=NetworkSegment(ec6e3ee9-0d86-4f58-bb90-596f5d81de68),segment_id=ec6e3ee9-0d86-4f58-bb90-596f5d81de68)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:49.595830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.598363 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-62639b0d-38b0-4a85-a292-5e0b330152b0 req-1c8422a6-f101-49e5-8667-790b882280d6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0743577 Mar 24 02:19:49.612697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Calling delete_port for 19a6849a-410b-4fd9-88d6-09f55d1d33ef owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:49.637402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-eb57efdc-eff1-4898-a0f2-d24d531496e2 None None] Deleting port 19a6849a-410b-4fd9-88d6-09f55d1d33ef {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:49.638054 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-eb57efdc-eff1-4898-a0f2-d24d531496e2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.654823 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-62639b0d-38b0-4a85-a292-5e0b330152b0 req-33aad904-d280-4202-b0bc-7c1af64b6681 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518532 Mar 24 02:19:49.707936 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-eb57efdc-eff1-4898-a0f2-d24d531496e2 None None] For port 19a6849a-410b-4fd9-88d6-09f55d1d33ef, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=19a6849a-410b-4fd9-88d6-09f55d1d33ef,segment=NetworkSegment(ec6e3ee9-0d86-4f58-bb90-596f5d81de68),segment_id=ec6e3ee9-0d86-4f58-bb90-596f5d81de68)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:49.708594 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-eb57efdc-eff1-4898-a0f2-d24d531496e2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.714467 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.723253 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-eb57efdc-eff1-4898-a0f2-d24d531496e2 None None] Calling delete_port for 19a6849a-410b-4fd9-88d6-09f55d1d33ef owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:49.743206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Port': ['ID=19a6849a-410b-4fd9-88d6-09f55d1d33ef,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:49.753416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No DVR routers for this DVR port 19a6849a-410b-4fd9-88d6-09f55d1d33ef on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: from cryptography.utils import int_from_bytes Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: from cryptography.utils import int_from_bytes Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Mar 24 02:19:49.798729 dv-neutron-834874-3-hyperv neutron-server[104038]: self.session.flush() Mar 24 02:19:49.809044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-eb57efdc-eff1-4898-a0f2-d24d531496e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (19a6849a-410b-4fd9-88d6-09f55d1d33ef), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.835944 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb57efdc-eff1-4898-a0f2-d24d531496e2 None None] Pushing event deleted for resources: {'Port': ['ID=19a6849a-410b-4fd9-88d6-09f55d1d33ef,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:49.838936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (f7ce0e3f-7b42-4596-9171-4f56591d24cf), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.839783 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb57efdc-eff1-4898-a0f2-d24d531496e2 None None] No DVR routers for this DVR port 19a6849a-410b-4fd9-88d6-09f55d1d33ef on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:49.878762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f7ce0e3f-7b42-4596-9171-4f56591d24cf']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:49.891206 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ec6e3ee9-0d86-4f58-bb90-596f5d81de68') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:49.891508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ec6e3ee9-0d86-4f58-bb90-596f5d81de68') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:49.901951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (ec6e3ee9-0d86-4f58-bb90-596f5d81de68), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.915683 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (ec6e3ee9-0d86-4f58-bb90-596f5d81de68), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.922374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:49.923053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (ec6e3ee9-0d86-4f58-bb90-596f5d81de68), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:49.926340 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:49.984838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (f7ce0e3f-7b42-4596-9171-4f56591d24cf), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.991498 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:49.997732 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/f7ce0e3f-7b42-4596-9171-4f56591d24cf HTTP/1.1" status: 204 len: 168 time: 0.6224198 Mar 24 02:19:49.997732 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34448) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:50.015432 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b31169-18de-47ce-8d32-46fb09b9fa41 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=f7ce0e3f-7b42-4596-9171-4f56591d24cf,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:50.033350 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-488e3b3d-b3c5-4cc7-96e1-4e6f7b9aff24 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:50.033802 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-488e3b3d-b3c5-4cc7-96e1-4e6f7b9aff24 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:50.037013 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-488e3b3d-b3c5-4cc7-96e1-4e6f7b9aff24 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/0341fe4d-7368-4f4f-ad0f-81736ac09eaa HTTP/1.1" status: 404 len: 337 time: 0.0385494 Mar 24 02:19:50.039543 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34450) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:50.057409 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.pecan_wsgi.hooks.translation [None req-cc9e6def-1c6f-4b36-aa0f-cce1338a26cd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] DELETE failed (client error): The resource could not be found. Mar 24 02:19:50.057903 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cc9e6def-1c6f-4b36-aa0f-cce1338a26cd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=104036) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Mar 24 02:19:50.060899 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cc9e6def-1c6f-4b36-aa0f-cce1338a26cd tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/74dc4710-4a35-4b92-a96c-4c174bd358fa HTTP/1.1" status: 404 len: 339 time: 0.0204668 Mar 24 02:19:50.063866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34452) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:50.118713 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-b40b2f9f-acea-4f7e-bd95-e8a552537bb8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting subnet 29791c30-6dd7-4de5-bd24-ba31758c1a17 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:19:50.121854 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b40b2f9f-acea-4f7e-bd95-e8a552537bb8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (29791c30-6dd7-4de5-bd24-ba31758c1a17), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.161781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b40b2f9f-acea-4f7e-bd95-e8a552537bb8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (29791c30-6dd7-4de5-bd24-ba31758c1a17), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.243063 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b40b2f9f-acea-4f7e-bd95-e8a552537bb8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (29791c30-6dd7-4de5-bd24-ba31758c1a17), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.303664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b40b2f9f-acea-4f7e-bd95-e8a552537bb8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (29791c30-6dd7-4de5-bd24-ba31758c1a17), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.329569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40b2f9f-acea-4f7e-bd95-e8a552537bb8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Subnet': ['ID=29791c30-6dd7-4de5-bd24-ba31758c1a17,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:50.333188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b40b2f9f-acea-4f7e-bd95-e8a552537bb8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.336384 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b40b2f9f-acea-4f7e-bd95-e8a552537bb8 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/subnets/29791c30-6dd7-4de5-bd24-ba31758c1a17 HTTP/1.1" status: 204 len: 168 time: 0.2716284 Mar 24 02:19:50.338818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34454) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:50.343025 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c7e0f92-a3b2-4050-b5ce-f6bacf35e37a None None] Network 0ccf211a-6709-496e-b50e-8d61163b6816 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:19:50.417875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (0ccf211a-6709-496e-b50e-8d61163b6816), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.474858 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Deleting port ea05e3d3-1117-4d55-8f08-80d687967c45 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:50.475260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.507694 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89a96460-5f89-437b-a1a9-a761b80df67c None None] DHCP port deletion for 0ccf211a-6709-496e-b50e-8d61163b6816 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:19:50.545047 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] For port ea05e3d3-1117-4d55-8f08-80d687967c45, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ea05e3d3-1117-4d55-8f08-80d687967c45,segment=NetworkSegment(9d9f601d-87a0-44ff-91d0-561665693fb3),segment_id=9d9f601d-87a0-44ff-91d0-561665693fb3)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:50.545481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.561331 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Calling delete_port for ea05e3d3-1117-4d55-8f08-80d687967c45 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:50.567709 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-89a96460-5f89-437b-a1a9-a761b80df67c None None] Deleting port ea05e3d3-1117-4d55-8f08-80d687967c45 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:19:50.568085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-89a96460-5f89-437b-a1a9-a761b80df67c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.628480 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ea05e3d3-1117-4d55-8f08-80d687967c45 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:19:50.665127 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.672837 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-89a96460-5f89-437b-a1a9-a761b80df67c None None] For port ea05e3d3-1117-4d55-8f08-80d687967c45, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=ea05e3d3-1117-4d55-8f08-80d687967c45,segment=NetworkSegment(9d9f601d-87a0-44ff-91d0-561665693fb3),segment_id=9d9f601d-87a0-44ff-91d0-561665693fb3)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:19:50.673265 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-89a96460-5f89-437b-a1a9-a761b80df67c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.693614 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-89a96460-5f89-437b-a1a9-a761b80df67c None None] Calling delete_port for ea05e3d3-1117-4d55-8f08-80d687967c45 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:19:50.702780 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No active binding found for port ea05e3d3-1117-4d55-8f08-80d687967c45 {{(pid=104038) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Mar 24 02:19:50.703155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] The host dv-neutron-834874-3-hyperv is not matching for port ea05e3d3-1117-4d55-8f08-80d687967c45 host None! {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2354}} Mar 24 02:19:50.704174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device ea05e3d3-1117-4d55-8f08-80d687967c45 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:19:50.704602 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 8aec541a-0157-44fc-861a-fb475e46fe60 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:19:50.704728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Port': ['ID=ea05e3d3-1117-4d55-8f08-80d687967c45,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:50.724034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] No DVR routers for this DVR port ea05e3d3-1117-4d55-8f08-80d687967c45 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:50.735923 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 8aec541a-0157-44fc-861a-fb475e46fe60 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:19:50.736266 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 8aec541a-0157-44fc-861a-fb475e46fe60 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:19:50.736601 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 19a6849a-410b-4fd9-88d6-09f55d1d33ef no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:19:50.761132 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 19a6849a-410b-4fd9-88d6-09f55d1d33ef {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:19:50.761362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 19a6849a-410b-4fd9-88d6-09f55d1d33ef not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:19:50.795736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f43301-4344-4d80-b2c8-bd397620c4ef req-ca9f0ec8-f881-49f6-8842-2028f9ab4e80 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:50.805536 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f5f43301-4344-4d80-b2c8-bd397620c4ef req-ca9f0ec8-f881-49f6-8842-2028f9ab4e80 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0786471 Mar 24 02:19:50.837084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-89a96460-5f89-437b-a1a9-a761b80df67c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (ea05e3d3-1117-4d55-8f08-80d687967c45), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.861793 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (0ccf211a-6709-496e-b50e-8d61163b6816), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.863446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a96460-5f89-437b-a1a9-a761b80df67c None None] Pushing event deleted for resources: {'Port': ['ID=ea05e3d3-1117-4d55-8f08-80d687967c45,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:50.868124 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f5f43301-4344-4d80-b2c8-bd397620c4ef req-de589b23-3fc7-4ed7-8910-106f7a3178aa tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0613947 Mar 24 02:19:50.868716 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89a96460-5f89-437b-a1a9-a761b80df67c None None] No DVR routers for this DVR port ea05e3d3-1117-4d55-8f08-80d687967c45 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:19:50.902387 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0ccf211a-6709-496e-b50e-8d61163b6816']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:50.912602 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9d9f601d-87a0-44ff-91d0-561665693fb3') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:50.912896 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9d9f601d-87a0-44ff-91d0-561665693fb3') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:19:50.922072 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (9d9f601d-87a0-44ff-91d0-561665693fb3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.934816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (9d9f601d-87a0-44ff-91d0-561665693fb3), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.940582 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:19:50.940957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (9d9f601d-87a0-44ff-91d0-561665693fb3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:19:50.944240 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:19:51.006396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (0ccf211a-6709-496e-b50e-8d61163b6816), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:51.013751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:51.017002 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] 10.222.0.20 "DELETE /v2.0/networks/0ccf211a-6709-496e-b50e-8d61163b6816 HTTP/1.1" status: 204 len: 168 time: 0.6771185 Mar 24 02:19:51.030396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e7326d-a480-470a-927c-b7c1978b21f4 tempest-NetworksIpV6Test-325179355 tempest-NetworksIpV6Test-325179355-project] Pushing event deleted for resources: {'Network': ['ID=0ccf211a-6709-496e-b50e-8d61163b6816,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:51.260476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34462) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:51.395787 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4bdeb6b8-c86b-477f-8d59-6d086a9dd53c admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=b58415804b1b4553b1533717490a0447&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1339016 Mar 24 02:19:51.400524 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34466) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:51.454585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e11c221a-d7e8-4612-ba05-1cec05b2830a admin admin] Publish callbacks [] for security_group (577901d5-44c3-4861-9567-0f0305668923), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:51.476283 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e11c221a-d7e8-4612-ba05-1cec05b2830a admin admin] Publish callbacks [] for security_group (577901d5-44c3-4861-9567-0f0305668923), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:51.527278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e11c221a-d7e8-4612-ba05-1cec05b2830a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (577901d5-44c3-4861-9567-0f0305668923), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:51.529724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e11c221a-d7e8-4612-ba05-1cec05b2830a admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:51.531091 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e11c221a-d7e8-4612-ba05-1cec05b2830a admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/577901d5-44c3-4861-9567-0f0305668923 HTTP/1.1" status: 204 len: 168 time: 0.1294124 Mar 24 02:19:51.539288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e11c221a-d7e8-4612-ba05-1cec05b2830a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=577901d5-44c3-4861-9567-0f0305668923,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:51.985848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d193f757-c6df-4e11-b4a4-b5c53ca3728a req-c00d8eda-72ec-4d15-82fa-d781207753c6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:51.987365 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d193f757-c6df-4e11-b4a4-b5c53ca3728a req-c00d8eda-72ec-4d15-82fa-d781207753c6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0567839 Mar 24 02:19:52.042238 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d193f757-c6df-4e11-b4a4-b5c53ca3728a req-26813ef2-7b83-4db6-a1e4-a7ca79dfeba0 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0487444 Mar 24 02:19:52.198283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34490) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:52.289460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-secgroup--135858201'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:52.309936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.319435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.395597 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (bc82e172-86be-4003-a139-af17e46d522d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.399672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (bc82e172-86be-4003-a139-af17e46d522d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.433103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bc82e172-86be-4003-a139-af17e46d522d,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:52.479449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (2d483959-fcdf-454d-a119-8ab9d442e6b8), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.483742 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2d483959-fcdf-454d-a119-8ab9d442e6b8), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.513786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.515112 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3157964 Mar 24 02:19:52.516983 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd796107-004d-47f2-90ce-7045fe2b874a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2d483959-fcdf-454d-a119-8ab9d442e6b8,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:52.518003 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34494) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:52.575511 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-efa9d422-a069-4486-9f1c-7858cdb24757 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4544 time: 0.0554135 Mar 24 02:19:52.578166 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34496) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:52.582967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-526f64c9-9b12-4173-b8c5-b8a33634b313 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-security--251523952', 'description': 'tempest-security-description-1523223030'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:52.616134 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-526f64c9-9b12-4173-b8c5-b8a33634b313 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (2d483959-fcdf-454d-a119-8ab9d442e6b8), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.663190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-526f64c9-9b12-4173-b8c5-b8a33634b313 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (2d483959-fcdf-454d-a119-8ab9d442e6b8), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.667696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-526f64c9-9b12-4173-b8c5-b8a33634b313 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2d483959-fcdf-454d-a119-8ab9d442e6b8), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.670327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-526f64c9-9b12-4173-b8c5-b8a33634b313 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.672316 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-526f64c9-9b12-4173-b8c5-b8a33634b313 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "PUT /v2.0/security-groups/2d483959-fcdf-454d-a119-8ab9d442e6b8 HTTP/1.1" status: 200 len: 1796 time: 0.0930068 Mar 24 02:19:52.675251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34498) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:52.695198 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-526f64c9-9b12-4173-b8c5-b8a33634b313 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2d483959-fcdf-454d-a119-8ab9d442e6b8,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:52.721848 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-399e5b73-3b0e-4e9b-a0b5-c401f40e690f tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups/2d483959-fcdf-454d-a119-8ab9d442e6b8 HTTP/1.1" status: 200 len: 1796 time: 0.0429101 Mar 24 02:19:52.722176 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34500) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:52.772570 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c01ed842-68a1-401c-aeb5-e69c84584fe3 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (2d483959-fcdf-454d-a119-8ab9d442e6b8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.795040 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c01ed842-68a1-401c-aeb5-e69c84584fe3 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (2d483959-fcdf-454d-a119-8ab9d442e6b8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.836165 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c01ed842-68a1-401c-aeb5-e69c84584fe3 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2d483959-fcdf-454d-a119-8ab9d442e6b8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.838749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c01ed842-68a1-401c-aeb5-e69c84584fe3 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:52.839888 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c01ed842-68a1-401c-aeb5-e69c84584fe3 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/2d483959-fcdf-454d-a119-8ab9d442e6b8 HTTP/1.1" status: 204 len: 168 time: 0.1167715 Mar 24 02:19:52.843317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34502) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:52.849582 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c01ed842-68a1-401c-aeb5-e69c84584fe3 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d483959-fcdf-454d-a119-8ab9d442e6b8,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:52.890699 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-85227081-d7f6-4c8b-854b-ee48d51e52d2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0462332 Mar 24 02:19:52.893322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34504) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:52.906404 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-c429902f-eed1-4182-81c0-c9c1a80e806f tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] delete failed (client error): The resource could not be found. Mar 24 02:19:52.907497 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c429902f-eed1-4182-81c0-c9c1a80e806f tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/2d483959-fcdf-454d-a119-8ab9d442e6b8 HTTP/1.1" status: 404 len: 347 time: 0.0132284 Mar 24 02:19:52.911104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34506) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:52.915837 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6f04aa2f-861b-4cd4-8fc7-58e068fc61b1 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-secgroup--131322800'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:52.936607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f04aa2f-861b-4cd4-8fc7-58e068fc61b1 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.000326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f04aa2f-861b-4cd4-8fc7-58e068fc61b1 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (114de2aa-9e62-486e-ab30-364a71b2c186), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.004435 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f04aa2f-861b-4cd4-8fc7-58e068fc61b1 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (114de2aa-9e62-486e-ab30-364a71b2c186), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.031632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f04aa2f-861b-4cd4-8fc7-58e068fc61b1 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.032829 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6f04aa2f-861b-4cd4-8fc7-58e068fc61b1 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1208510 Mar 24 02:19:53.035856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34508) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:53.036909 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f04aa2f-861b-4cd4-8fc7-58e068fc61b1 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=114de2aa-9e62-486e-ab30-364a71b2c186,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:53.041080 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2a6f9a67-6470-4b54-b4ea-5d13df461d07 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '114de2aa-9e62-486e-ab30-364a71b2c186', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:53.068532 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a6f9a67-6470-4b54-b4ea-5d13df461d07 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (feda8996-21d4-4e4a-80d6-fb8040303bde), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.122932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a6f9a67-6470-4b54-b4ea-5d13df461d07 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (feda8996-21d4-4e4a-80d6-fb8040303bde), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.127586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a6f9a67-6470-4b54-b4ea-5d13df461d07 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (feda8996-21d4-4e4a-80d6-fb8040303bde), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.146814 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a6f9a67-6470-4b54-b4ea-5d13df461d07 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=feda8996-21d4-4e4a-80d6-fb8040303bde,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:53.159109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a6f9a67-6470-4b54-b4ea-5d13df461d07 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.162957 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2a6f9a67-6470-4b54-b4ea-5d13df461d07 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1258876 Mar 24 02:19:53.163663 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34512) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:53.190915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ecc253-bb13-4df7-b938-ac7e13013479 req-4c6723fe-c656-46c1-a3c2-2a26a3ffc9a6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:53.192655 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b3ecc253-bb13-4df7-b938-ac7e13013479 req-4c6723fe-c656-46c1-a3c2-2a26a3ffc9a6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0759206 Mar 24 02:19:53.216884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0597bb-e990-4c40-ace7-8e4c8735740c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (feda8996-21d4-4e4a-80d6-fb8040303bde), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.227477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0597bb-e990-4c40-ace7-8e4c8735740c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (feda8996-21d4-4e4a-80d6-fb8040303bde), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.268944 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b3ecc253-bb13-4df7-b938-ac7e13013479 req-ce2f0b62-dbc4-408f-82a0-50ea528f78fd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0704095 Mar 24 02:19:53.276561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0597bb-e990-4c40-ace7-8e4c8735740c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (feda8996-21d4-4e4a-80d6-fb8040303bde), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.290220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dc0597bb-e990-4c40-ace7-8e4c8735740c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.290220 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dc0597bb-e990-4c40-ace7-8e4c8735740c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/feda8996-21d4-4e4a-80d6-fb8040303bde HTTP/1.1" status: 204 len: 168 time: 0.1195309 Mar 24 02:19:53.290220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34514) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:53.303073 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc0597bb-e990-4c40-ace7-8e4c8735740c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=feda8996-21d4-4e4a-80d6-fb8040303bde,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:53.338795 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-98e9463e-7b67-4c6a-b7f7-aa26ad9dfb0c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0505106 Mar 24 02:19:53.341614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34516) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:53.397556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ca6ac2b-b9c7-4d40-94d6-d58cfddc141e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (114de2aa-9e62-486e-ab30-364a71b2c186), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.424831 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ca6ac2b-b9c7-4d40-94d6-d58cfddc141e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (114de2aa-9e62-486e-ab30-364a71b2c186), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.474895 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ca6ac2b-b9c7-4d40-94d6-d58cfddc141e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (114de2aa-9e62-486e-ab30-364a71b2c186), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.477508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ca6ac2b-b9c7-4d40-94d6-d58cfddc141e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.478710 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0ca6ac2b-b9c7-4d40-94d6-d58cfddc141e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/114de2aa-9e62-486e-ab30-364a71b2c186 HTTP/1.1" status: 204 len: 168 time: 0.1360726 Mar 24 02:19:53.481427 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34518) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:53.488385 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ca6ac2b-b9c7-4d40-94d6-d58cfddc141e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=114de2aa-9e62-486e-ab30-364a71b2c186,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:53.542172 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8d03cde5-a6f0-46eb-8aea-320c3cfa46b4 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0589516 Mar 24 02:19:53.546194 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34520) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:53.550713 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-2dcde137-f09e-4296-b064-7d029d408fd9 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-secgroup--1607295397'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:53.572089 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2dcde137-f09e-4296-b064-7d029d408fd9 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.636624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2dcde137-f09e-4296-b064-7d029d408fd9 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (797669dc-71ce-4db7-9247-58096379aea2), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.640841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2dcde137-f09e-4296-b064-7d029d408fd9 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (797669dc-71ce-4db7-9247-58096379aea2), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.670787 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2dcde137-f09e-4296-b064-7d029d408fd9 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.672030 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2dcde137-f09e-4296-b064-7d029d408fd9 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1247931 Mar 24 02:19:53.673920 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dcde137-f09e-4296-b064-7d029d408fd9 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=797669dc-71ce-4db7-9247-58096379aea2,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:53.675022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34522) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:53.679692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c25b10bd-2383-4eda-9d4d-34dd3d758689 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '797669dc-71ce-4db7-9247-58096379aea2', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:53.704934 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c25b10bd-2383-4eda-9d4d-34dd3d758689 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (1d7b908d-66e5-49a7-b73d-f8fc3d9b9e57), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.757223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c25b10bd-2383-4eda-9d4d-34dd3d758689 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (1d7b908d-66e5-49a7-b73d-f8fc3d9b9e57), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.760714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c25b10bd-2383-4eda-9d4d-34dd3d758689 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (1d7b908d-66e5-49a7-b73d-f8fc3d9b9e57), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.781951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25b10bd-2383-4eda-9d4d-34dd3d758689 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d7b908d-66e5-49a7-b73d-f8fc3d9b9e57,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:53.790037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c25b10bd-2383-4eda-9d4d-34dd3d758689 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.791323 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c25b10bd-2383-4eda-9d4d-34dd3d758689 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1151814 Mar 24 02:19:53.794023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34524) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:53.798973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1dc9a817-9370-4d9d-a9ad-22a3816cc899 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '797669dc-71ce-4db7-9247-58096379aea2', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:53.823785 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1dc9a817-9370-4d9d-a9ad-22a3816cc899 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (46ad42d3-cfaa-4a03-8164-c875ba1bf54f), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.877650 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1dc9a817-9370-4d9d-a9ad-22a3816cc899 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (46ad42d3-cfaa-4a03-8164-c875ba1bf54f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.880862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1dc9a817-9370-4d9d-a9ad-22a3816cc899 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (46ad42d3-cfaa-4a03-8164-c875ba1bf54f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.897471 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc9a817-9370-4d9d-a9ad-22a3816cc899 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=46ad42d3-cfaa-4a03-8164-c875ba1bf54f,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:53.905612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1dc9a817-9370-4d9d-a9ad-22a3816cc899 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.906818 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1dc9a817-9370-4d9d-a9ad-22a3816cc899 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1117716 Mar 24 02:19:53.909492 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34526) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:53.913699 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a120b175-5c8f-48c6-99d1-7d360cf589ff tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '797669dc-71ce-4db7-9247-58096379aea2', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:53.937671 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a120b175-5c8f-48c6-99d1-7d360cf589ff tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (98dbcdb6-e982-4c9c-8959-ea187025422d), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.992794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a120b175-5c8f-48c6-99d1-7d360cf589ff tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (98dbcdb6-e982-4c9c-8959-ea187025422d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:53.996409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a120b175-5c8f-48c6-99d1-7d360cf589ff tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (98dbcdb6-e982-4c9c-8959-ea187025422d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.014705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a120b175-5c8f-48c6-99d1-7d360cf589ff tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98dbcdb6-e982-4c9c-8959-ea187025422d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:54.020458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a120b175-5c8f-48c6-99d1-7d360cf589ff tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.021778 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a120b175-5c8f-48c6-99d1-7d360cf589ff tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1113751 Mar 24 02:19:54.024467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34528) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.028769 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f0e6b3dd-6ddb-44eb-93b5-35093f62096d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '797669dc-71ce-4db7-9247-58096379aea2', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:54.064053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f0e6b3dd-6ddb-44eb-93b5-35093f62096d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (e520a3e1-17b7-4179-927d-4ed020e50283), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.122177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f0e6b3dd-6ddb-44eb-93b5-35093f62096d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (e520a3e1-17b7-4179-927d-4ed020e50283), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.125872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f0e6b3dd-6ddb-44eb-93b5-35093f62096d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (e520a3e1-17b7-4179-927d-4ed020e50283), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.144807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0e6b3dd-6ddb-44eb-93b5-35093f62096d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e520a3e1-17b7-4179-927d-4ed020e50283,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:54.152831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f0e6b3dd-6ddb-44eb-93b5-35093f62096d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.154021 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f0e6b3dd-6ddb-44eb-93b5-35093f62096d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1286242 Mar 24 02:19:54.157504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34530) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.164996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-375c8b2a-8971-4a5a-878c-32bc3f51ccb0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '797669dc-71ce-4db7-9247-58096379aea2', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:54.186026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-375c8b2a-8971-4a5a-878c-32bc3f51ccb0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (0c4fff1d-cd23-4e5b-86e6-c41318648910), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.242616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-375c8b2a-8971-4a5a-878c-32bc3f51ccb0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (0c4fff1d-cd23-4e5b-86e6-c41318648910), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.246337 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-375c8b2a-8971-4a5a-878c-32bc3f51ccb0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (0c4fff1d-cd23-4e5b-86e6-c41318648910), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.266690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-375c8b2a-8971-4a5a-878c-32bc3f51ccb0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c4fff1d-cd23-4e5b-86e6-c41318648910,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:54.272518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-375c8b2a-8971-4a5a-878c-32bc3f51ccb0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.276945 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34532) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.277129 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-375c8b2a-8971-4a5a-878c-32bc3f51ccb0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 772 time: 0.1184678 Mar 24 02:19:54.315590 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a5325bbb-bf5e-4e0b-b73a-3918ecac3179 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (0c4fff1d-cd23-4e5b-86e6-c41318648910), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.324257 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a5325bbb-bf5e-4e0b-b73a-3918ecac3179 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (0c4fff1d-cd23-4e5b-86e6-c41318648910), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.354162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a5325bbb-bf5e-4e0b-b73a-3918ecac3179 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (0c4fff1d-cd23-4e5b-86e6-c41318648910), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.360537 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a5325bbb-bf5e-4e0b-b73a-3918ecac3179 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.361612 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a5325bbb-bf5e-4e0b-b73a-3918ecac3179 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/0c4fff1d-cd23-4e5b-86e6-c41318648910 HTTP/1.1" status: 204 len: 168 time: 0.0836635 Mar 24 02:19:54.364320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34536) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.376568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5325bbb-bf5e-4e0b-b73a-3918ecac3179 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=0c4fff1d-cd23-4e5b-86e6-c41318648910,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:54.394834 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f76cc20b-9aa7-4258-9f4e-8aa4983a9bcb req-a382ffed-f701-431c-920c-da698ac16e84 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:54.399005 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f76cc20b-9aa7-4258-9f4e-8aa4983a9bcb req-a382ffed-f701-431c-920c-da698ac16e84 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0592363 Mar 24 02:19:54.420352 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bf2a8885-d6fb-496b-98d6-8f8f3e64e13d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5751 time: 0.0547805 Mar 24 02:19:54.423805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34538) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.463551 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f76cc20b-9aa7-4258-9f4e-8aa4983a9bcb req-734e51f5-5027-41e2-ac12-28c7f58e8440 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0614324 Mar 24 02:19:54.466029 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c42b47f1-cba2-438b-8df1-4463b933a14e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (e520a3e1-17b7-4179-927d-4ed020e50283), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.473806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c42b47f1-cba2-438b-8df1-4463b933a14e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (e520a3e1-17b7-4179-927d-4ed020e50283), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.500658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c42b47f1-cba2-438b-8df1-4463b933a14e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (e520a3e1-17b7-4179-927d-4ed020e50283), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.506461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c42b47f1-cba2-438b-8df1-4463b933a14e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.507589 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c42b47f1-cba2-438b-8df1-4463b933a14e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/e520a3e1-17b7-4179-927d-4ed020e50283 HTTP/1.1" status: 204 len: 168 time: 0.0828738 Mar 24 02:19:54.510328 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34540) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.512935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42b47f1-cba2-438b-8df1-4463b933a14e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e520a3e1-17b7-4179-927d-4ed020e50283,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:54.551367 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f329be85-ee43-479b-b91f-b0dbbb0357f2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5205 time: 0.0397518 Mar 24 02:19:54.553962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34542) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.577015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3f15c73-0292-4e4b-8e26-1dc12e4a1a74 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (98dbcdb6-e982-4c9c-8959-ea187025422d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.584302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3f15c73-0292-4e4b-8e26-1dc12e4a1a74 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (98dbcdb6-e982-4c9c-8959-ea187025422d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.614677 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3f15c73-0292-4e4b-8e26-1dc12e4a1a74 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (98dbcdb6-e982-4c9c-8959-ea187025422d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.620580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e3f15c73-0292-4e4b-8e26-1dc12e4a1a74 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.621681 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e3f15c73-0292-4e4b-8e26-1dc12e4a1a74 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/98dbcdb6-e982-4c9c-8959-ea187025422d HTTP/1.1" status: 204 len: 168 time: 0.0667920 Mar 24 02:19:54.625128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34544) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.627435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3f15c73-0292-4e4b-8e26-1dc12e4a1a74 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=98dbcdb6-e982-4c9c-8959-ea187025422d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:54.667584 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2a59e4ec-63de-4ec0-8ab6-14d2ab92667e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0412483 Mar 24 02:19:54.670211 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34546) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.693745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d135111-92a1-4e1c-8c7f-deb6f231bee2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (46ad42d3-cfaa-4a03-8164-c875ba1bf54f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.700930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d135111-92a1-4e1c-8c7f-deb6f231bee2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (46ad42d3-cfaa-4a03-8164-c875ba1bf54f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.726841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d135111-92a1-4e1c-8c7f-deb6f231bee2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (46ad42d3-cfaa-4a03-8164-c875ba1bf54f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.732599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8d135111-92a1-4e1c-8c7f-deb6f231bee2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.734194 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8d135111-92a1-4e1c-8c7f-deb6f231bee2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/46ad42d3-cfaa-4a03-8164-c875ba1bf54f HTTP/1.1" status: 204 len: 168 time: 0.0624981 Mar 24 02:19:54.736774 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34548) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.746247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d135111-92a1-4e1c-8c7f-deb6f231bee2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=46ad42d3-cfaa-4a03-8164-c875ba1bf54f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:54.777661 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-534afbba-cfe9-470c-8f29-221d8cfaf0a6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0398877 Mar 24 02:19:54.780957 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34550) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.804289 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bd7dccda-c434-4666-8d4a-23bd27c02fea tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (1d7b908d-66e5-49a7-b73d-f8fc3d9b9e57), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.811989 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bd7dccda-c434-4666-8d4a-23bd27c02fea tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (1d7b908d-66e5-49a7-b73d-f8fc3d9b9e57), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.837697 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bd7dccda-c434-4666-8d4a-23bd27c02fea tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (1d7b908d-66e5-49a7-b73d-f8fc3d9b9e57), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.844965 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bd7dccda-c434-4666-8d4a-23bd27c02fea tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.848811 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bd7dccda-c434-4666-8d4a-23bd27c02fea tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/1d7b908d-66e5-49a7-b73d-f8fc3d9b9e57 HTTP/1.1" status: 204 len: 168 time: 0.0642633 Mar 24 02:19:54.849174 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34552) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.857808 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd7dccda-c434-4666-8d4a-23bd27c02fea tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=1d7b908d-66e5-49a7-b73d-f8fc3d9b9e57,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:54.889789 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9439c931-94ad-4dc2-bae2-70be775420f6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0392969 Mar 24 02:19:54.892301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34554) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:54.943793 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a66b095-e5b6-472f-9487-a4048368a896 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (797669dc-71ce-4db7-9247-58096379aea2), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:54.965257 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a66b095-e5b6-472f-9487-a4048368a896 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (797669dc-71ce-4db7-9247-58096379aea2), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.006510 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a66b095-e5b6-472f-9487-a4048368a896 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (797669dc-71ce-4db7-9247-58096379aea2), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.009066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-2a66b095-e5b6-472f-9487-a4048368a896 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.010199 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2a66b095-e5b6-472f-9487-a4048368a896 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/797669dc-71ce-4db7-9247-58096379aea2 HTTP/1.1" status: 204 len: 168 time: 0.1169434 Mar 24 02:19:55.013164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34556) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:55.019690 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a66b095-e5b6-472f-9487-a4048368a896 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=797669dc-71ce-4db7-9247-58096379aea2,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:55.062142 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d8e92041-0bb3-4970-b98c-3b087042bd11 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0476952 Mar 24 02:19:55.066745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34558) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:55.071881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6ecac680-613d-4084-83df-dc03a9dc3763 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-secgroup--1823888120'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:55.091628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ecac680-613d-4084-83df-dc03a9dc3763 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.163355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ecac680-613d-4084-83df-dc03a9dc3763 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (a88eb9e8-92d4-48d5-a7a4-ad6363ad9442), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.169236 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ecac680-613d-4084-83df-dc03a9dc3763 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a88eb9e8-92d4-48d5-a7a4-ad6363ad9442), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.208053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6ecac680-613d-4084-83df-dc03a9dc3763 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.209309 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6ecac680-613d-4084-83df-dc03a9dc3763 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1417055 Mar 24 02:19:55.212074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34560) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:55.216403 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6f521baa-5bfa-45e2-8cf9-ccd50751bdf0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': 'a88eb9e8-92d4-48d5-a7a4-ad6363ad9442', 'direction': 'ingress', 'protocol': 17}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:55.223277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ecac680-613d-4084-83df-dc03a9dc3763 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a88eb9e8-92d4-48d5-a7a4-ad6363ad9442,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:55.248520 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f521baa-5bfa-45e2-8cf9-ccd50751bdf0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (3fd565b9-ff72-4e0a-9514-51cdcf60164a), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.306666 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f521baa-5bfa-45e2-8cf9-ccd50751bdf0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (3fd565b9-ff72-4e0a-9514-51cdcf60164a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.310954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f521baa-5bfa-45e2-8cf9-ccd50751bdf0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (3fd565b9-ff72-4e0a-9514-51cdcf60164a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.329504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f521baa-5bfa-45e2-8cf9-ccd50751bdf0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3fd565b9-ff72-4e0a-9514-51cdcf60164a,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:55.338767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6f521baa-5bfa-45e2-8cf9-ccd50751bdf0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.343255 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6f521baa-5bfa-45e2-8cf9-ccd50751bdf0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.1270254 Mar 24 02:19:55.343465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34562) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:55.400043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb392a06-22e9-41b9-9217-0952b6e2c012 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (a88eb9e8-92d4-48d5-a7a4-ad6363ad9442), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.425538 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb392a06-22e9-41b9-9217-0952b6e2c012 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (a88eb9e8-92d4-48d5-a7a4-ad6363ad9442), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.475668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb392a06-22e9-41b9-9217-0952b6e2c012 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (a88eb9e8-92d4-48d5-a7a4-ad6363ad9442), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.479221 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb392a06-22e9-41b9-9217-0952b6e2c012 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.480391 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eb392a06-22e9-41b9-9217-0952b6e2c012 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/a88eb9e8-92d4-48d5-a7a4-ad6363ad9442 HTTP/1.1" status: 204 len: 168 time: 0.1359427 Mar 24 02:19:55.483241 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34564) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:55.490942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb392a06-22e9-41b9-9217-0952b6e2c012 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a88eb9e8-92d4-48d5-a7a4-ad6363ad9442,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:55.555962 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e12c6b55-ec55-414e-abd5-bbc4a50430a2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0715079 Mar 24 02:19:55.559576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34568) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:55.564592 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8c215a43-0f07-4578-8c0e-ecc706bcf231 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-secgroup--1692370772'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:55.585402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c215a43-0f07-4578-8c0e-ecc706bcf231 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.593856 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-663ca3bc-61f7-4bb7-8b9d-4ab35d281ebd req-841578eb-c81c-4395-bb79-6c9731d52c2e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:55.595382 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-663ca3bc-61f7-4bb7-8b9d-4ab35d281ebd req-841578eb-c81c-4395-bb79-6c9731d52c2e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0564201 Mar 24 02:19:55.647036 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-663ca3bc-61f7-4bb7-8b9d-4ab35d281ebd req-7eb168eb-94d2-4589-b16a-d12fe5a04bbc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459247 Mar 24 02:19:55.651253 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c215a43-0f07-4578-8c0e-ecc706bcf231 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (77fe5f4b-2419-4497-bb41-0f0e94de8bbb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.655873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c215a43-0f07-4578-8c0e-ecc706bcf231 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (77fe5f4b-2419-4497-bb41-0f0e94de8bbb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.687673 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8c215a43-0f07-4578-8c0e-ecc706bcf231 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.688807 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8c215a43-0f07-4578-8c0e-ecc706bcf231 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1281285 Mar 24 02:19:55.689494 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c215a43-0f07-4578-8c0e-ecc706bcf231 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=77fe5f4b-2419-4497-bb41-0f0e94de8bbb,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:55.692175 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34570) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:55.696781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ddebc4fd-0f07-4f38-822e-dd160197e065 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-secgroup--541250172'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:55.716163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddebc4fd-0f07-4f38-822e-dd160197e065 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.782811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddebc4fd-0f07-4f38-822e-dd160197e065 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (89097792-74b0-43c5-95eb-b11d66ae3d52), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.786164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddebc4fd-0f07-4f38-822e-dd160197e065 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (89097792-74b0-43c5-95eb-b11d66ae3d52), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.814247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddebc4fd-0f07-4f38-822e-dd160197e065 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.815481 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ddebc4fd-0f07-4f38-822e-dd160197e065 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1222920 Mar 24 02:19:55.817542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddebc4fd-0f07-4f38-822e-dd160197e065 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=89097792-74b0-43c5-95eb-b11d66ae3d52,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:55.818788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34572) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:55.824198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-104580e6-1f6d-4c72-988b-0083d645be0e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '77fe5f4b-2419-4497-bb41-0f0e94de8bbb', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '89097792-74b0-43c5-95eb-b11d66ae3d52', 'remote_ip_prefix': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:55.852726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-104580e6-1f6d-4c72-988b-0083d645be0e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (731f0ebe-9feb-45df-90cf-3c51853f2091), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.923948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-104580e6-1f6d-4c72-988b-0083d645be0e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (731f0ebe-9feb-45df-90cf-3c51853f2091), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.927506 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-104580e6-1f6d-4c72-988b-0083d645be0e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (731f0ebe-9feb-45df-90cf-3c51853f2091), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.945022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-104580e6-1f6d-4c72-988b-0083d645be0e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=731f0ebe-9feb-45df-90cf-3c51853f2091,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:55.952991 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-104580e6-1f6d-4c72-988b-0083d645be0e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.954176 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-104580e6-1f6d-4c72-988b-0083d645be0e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.1337512 Mar 24 02:19:55.957037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34574) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:55.979476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-09c40c90-187d-4ecd-b3e1-26b059f93f0d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (731f0ebe-9feb-45df-90cf-3c51853f2091), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:55.987213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-09c40c90-187d-4ecd-b3e1-26b059f93f0d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (731f0ebe-9feb-45df-90cf-3c51853f2091), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.013129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-09c40c90-187d-4ecd-b3e1-26b059f93f0d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (731f0ebe-9feb-45df-90cf-3c51853f2091), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.017741 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-09c40c90-187d-4ecd-b3e1-26b059f93f0d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.018866 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-09c40c90-187d-4ecd-b3e1-26b059f93f0d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/731f0ebe-9feb-45df-90cf-3c51853f2091 HTTP/1.1" status: 204 len: 168 time: 0.0608573 Mar 24 02:19:56.021391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34576) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.037567 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c40c90-187d-4ecd-b3e1-26b059f93f0d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=731f0ebe-9feb-45df-90cf-3c51853f2091,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:56.067517 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e1ca3c69-41d8-48a3-9ada-4fd26fac9db4 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0451174 Mar 24 02:19:56.070144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34578) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.118685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (89097792-74b0-43c5-95eb-b11d66ae3d52), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.140870 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (89097792-74b0-43c5-95eb-b11d66ae3d52), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.183961 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (89097792-74b0-43c5-95eb-b11d66ae3d52), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.187188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.188334 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/89097792-74b0-43c5-95eb-b11d66ae3d52 HTTP/1.1" status: 204 len: 168 time: 0.1172690 Mar 24 02:19:56.191022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34580) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.197356 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=89097792-74b0-43c5-95eb-b11d66ae3d52,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:56.204287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.204641 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.204987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.205330 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.205669 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.206005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.206335 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.206691 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.207022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.207350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.207678 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.208005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.208330 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.208654 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.208977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403bd4b1-72ed-4202-9fc9-26f2fe6c06c6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:56.241789 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0d9ba95e-4232-4124-9b5a-639793813e3e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.0493028 Mar 24 02:19:56.244407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34582) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.294746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4a0393-e047-4836-86ec-1b90834160f2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (77fe5f4b-2419-4497-bb41-0f0e94de8bbb), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.317703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4a0393-e047-4836-86ec-1b90834160f2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (77fe5f4b-2419-4497-bb41-0f0e94de8bbb), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.356727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4a0393-e047-4836-86ec-1b90834160f2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (77fe5f4b-2419-4497-bb41-0f0e94de8bbb), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.359985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4a0393-e047-4836-86ec-1b90834160f2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.361387 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fd4a0393-e047-4836-86ec-1b90834160f2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/77fe5f4b-2419-4497-bb41-0f0e94de8bbb HTTP/1.1" status: 204 len: 168 time: 0.1157191 Mar 24 02:19:56.363995 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34584) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.369759 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4a0393-e047-4836-86ec-1b90834160f2 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=77fe5f4b-2419-4497-bb41-0f0e94de8bbb,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:56.406044 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-25b9403a-35f4-4856-8946-d1fbe900c4fd tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0409029 Mar 24 02:19:56.409852 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34586) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.413948 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c98f13a5-df47-4748-aea3-3abcde07e755 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-secgroup--92260821'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:56.434230 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c98f13a5-df47-4748-aea3-3abcde07e755 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.498918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c98f13a5-df47-4748-aea3-3abcde07e755 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (f2626aba-ade3-4717-b62b-6d1cc97ac381), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.502248 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c98f13a5-df47-4748-aea3-3abcde07e755 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f2626aba-ade3-4717-b62b-6d1cc97ac381), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.533173 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c98f13a5-df47-4748-aea3-3abcde07e755 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f2626aba-ade3-4717-b62b-6d1cc97ac381,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:56.538158 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c98f13a5-df47-4748-aea3-3abcde07e755 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.542705 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c98f13a5-df47-4748-aea3-3abcde07e755 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.1286504 Mar 24 02:19:56.542705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34588) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.547039 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-20944ac5-bcfb-4dd8-b34c-5e75d01c8d7b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': 'f2626aba-ade3-4717-b62b-6d1cc97ac381', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:56.571696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-20944ac5-bcfb-4dd8-b34c-5e75d01c8d7b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (f4785ae9-82f5-41ae-bac5-529cbc3a4e0d), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.625302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-20944ac5-bcfb-4dd8-b34c-5e75d01c8d7b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (f4785ae9-82f5-41ae-bac5-529cbc3a4e0d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.628857 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-20944ac5-bcfb-4dd8-b34c-5e75d01c8d7b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (f4785ae9-82f5-41ae-bac5-529cbc3a4e0d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.648962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20944ac5-bcfb-4dd8-b34c-5e75d01c8d7b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4785ae9-82f5-41ae-bac5-529cbc3a4e0d,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:56.655765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-20944ac5-bcfb-4dd8-b34c-5e75d01c8d7b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.656838 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-20944ac5-bcfb-4dd8-b34c-5e75d01c8d7b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.1137877 Mar 24 02:19:56.659811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34590) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.683684 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eccc796a-4eae-43c1-b7d1-c0580343db94 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (f4785ae9-82f5-41ae-bac5-529cbc3a4e0d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.692676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eccc796a-4eae-43c1-b7d1-c0580343db94 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (f4785ae9-82f5-41ae-bac5-529cbc3a4e0d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.743196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eccc796a-4eae-43c1-b7d1-c0580343db94 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (f4785ae9-82f5-41ae-bac5-529cbc3a4e0d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.751016 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eccc796a-4eae-43c1-b7d1-c0580343db94 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.752024 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eccc796a-4eae-43c1-b7d1-c0580343db94 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/f4785ae9-82f5-41ae-bac5-529cbc3a4e0d HTTP/1.1" status: 204 len: 168 time: 0.0911500 Mar 24 02:19:56.754762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34594) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.759697 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eccc796a-4eae-43c1-b7d1-c0580343db94 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=f4785ae9-82f5-41ae-bac5-529cbc3a4e0d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:56.781378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb23d2a-41df-4125-b978-fd7ee9d7bc18 req-654a9bed-a3ae-4d8e-bfa4-9a1580a27692 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:56.782890 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fcb23d2a-41df-4125-b978-fd7ee9d7bc18 req-654a9bed-a3ae-4d8e-bfa4-9a1580a27692 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0686002 Mar 24 02:19:56.792303 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a1f43dd7-9d61-447b-9ecb-ed5a23056949 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0364208 Mar 24 02:19:56.795127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34596) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.856223 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fcb23d2a-41df-4125-b978-fd7ee9d7bc18 req-bd3578fc-fe78-493d-96af-68290732737c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0676925 Mar 24 02:19:56.872887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b682a022-c055-4028-b31f-9afdf9426a0b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (f2626aba-ade3-4717-b62b-6d1cc97ac381), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.895356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b682a022-c055-4028-b31f-9afdf9426a0b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (f2626aba-ade3-4717-b62b-6d1cc97ac381), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.934487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b682a022-c055-4028-b31f-9afdf9426a0b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f2626aba-ade3-4717-b62b-6d1cc97ac381), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.937084 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b682a022-c055-4028-b31f-9afdf9426a0b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:56.938184 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b682a022-c055-4028-b31f-9afdf9426a0b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/f2626aba-ade3-4717-b62b-6d1cc97ac381 HTTP/1.1" status: 204 len: 168 time: 0.1421816 Mar 24 02:19:56.940970 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34598) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.946823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b682a022-c055-4028-b31f-9afdf9426a0b tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2626aba-ade3-4717-b62b-6d1cc97ac381,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:56.987599 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2b09b44a-9646-432f-858b-a3a5fa0e5eb6 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0447075 Mar 24 02:19:56.990787 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34600) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:56.994784 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-49bd8ae3-f428-42bf-8794-6ab15f8fcb20 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-secgroup--2007315050'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:57.013740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-49bd8ae3-f428-42bf-8794-6ab15f8fcb20 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.076651 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-49bd8ae3-f428-42bf-8794-6ab15f8fcb20 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (71038dcf-f79b-4b74-bebb-10c61e36682d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.080795 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-49bd8ae3-f428-42bf-8794-6ab15f8fcb20 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (71038dcf-f79b-4b74-bebb-10c61e36682d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.109194 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-49bd8ae3-f428-42bf-8794-6ab15f8fcb20 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.110387 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-49bd8ae3-f428-42bf-8794-6ab15f8fcb20 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1187150 Mar 24 02:19:57.112325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49bd8ae3-f428-42bf-8794-6ab15f8fcb20 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=71038dcf-f79b-4b74-bebb-10c61e36682d,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:57.113396 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34602) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.118673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2fd7bcfa-dc09-4adc-a1fc-5c0939514702 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '71038dcf-f79b-4b74-bebb-10c61e36682d', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:57.143812 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2fd7bcfa-dc09-4adc-a1fc-5c0939514702 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (22185e14-005b-4716-975c-b7299376ff6d), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.192955 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2fd7bcfa-dc09-4adc-a1fc-5c0939514702 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (22185e14-005b-4716-975c-b7299376ff6d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.196617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2fd7bcfa-dc09-4adc-a1fc-5c0939514702 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (22185e14-005b-4716-975c-b7299376ff6d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.213888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd7bcfa-dc09-4adc-a1fc-5c0939514702 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=22185e14-005b-4716-975c-b7299376ff6d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:57.222124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2fd7bcfa-dc09-4adc-a1fc-5c0939514702 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.223323 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2fd7bcfa-dc09-4adc-a1fc-5c0939514702 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1083128 Mar 24 02:19:57.226020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34604) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.241220 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-aa3e9890-6b4a-4f16-b545-c4cb41a4acee tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules/22185e14-005b-4716-975c-b7299376ff6d HTTP/1.1" status: 200 len: 763 time: 0.0140913 Mar 24 02:19:57.243429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34606) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.280293 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a9000803-2a30-4590-af4b-a0da359f9955 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0357330 Mar 24 02:19:57.282590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34608) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.303821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-777345d1-e407-4182-8d6f-2a3fa579ef3c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (22185e14-005b-4716-975c-b7299376ff6d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.311797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-777345d1-e407-4182-8d6f-2a3fa579ef3c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (22185e14-005b-4716-975c-b7299376ff6d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.336952 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-777345d1-e407-4182-8d6f-2a3fa579ef3c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (22185e14-005b-4716-975c-b7299376ff6d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.342811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-777345d1-e407-4182-8d6f-2a3fa579ef3c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.343893 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-777345d1-e407-4182-8d6f-2a3fa579ef3c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/22185e14-005b-4716-975c-b7299376ff6d HTTP/1.1" status: 204 len: 168 time: 0.0604293 Mar 24 02:19:57.346425 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34610) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.349281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-777345d1-e407-4182-8d6f-2a3fa579ef3c tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=22185e14-005b-4716-975c-b7299376ff6d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:57.374437 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c5c1a386-fc1f-49e5-9dcd-aac9f8b22300 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.386350 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7d64583d-b240-46df-8778-d4c6ad327434 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0387669 Mar 24 02:19:57.388849 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34612) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.393534 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-730e7e14-bd18-4c12-bc18-8d0576a20600 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '71038dcf-f79b-4b74-bebb-10c61e36682d', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:57.416798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-730e7e14-bd18-4c12-bc18-8d0576a20600 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (03961dff-529f-4476-b439-9a88253a1e56), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.471792 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-730e7e14-bd18-4c12-bc18-8d0576a20600 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (03961dff-529f-4476-b439-9a88253a1e56), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.475223 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-730e7e14-bd18-4c12-bc18-8d0576a20600 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (03961dff-529f-4476-b439-9a88253a1e56), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.492687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730e7e14-bd18-4c12-bc18-8d0576a20600 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=03961dff-529f-4476-b439-9a88253a1e56,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:57.500851 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-730e7e14-bd18-4c12-bc18-8d0576a20600 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.502058 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-730e7e14-bd18-4c12-bc18-8d0576a20600 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1122227 Mar 24 02:19:57.504665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34614) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.519933 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ce53bce0-31fd-430c-95c9-ec442e10b558 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules/03961dff-529f-4476-b439-9a88253a1e56 HTTP/1.1" status: 200 len: 763 time: 0.0142791 Mar 24 02:19:57.522165 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34616) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.557827 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9dd75a75-ae7d-4764-a5f6-9175e4e8ba5e tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0346575 Mar 24 02:19:57.560367 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34618) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.583770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd9a6572-e1b8-4d5b-9b19-f4ba747cdd96 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (03961dff-529f-4476-b439-9a88253a1e56), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.590876 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd9a6572-e1b8-4d5b-9b19-f4ba747cdd96 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (03961dff-529f-4476-b439-9a88253a1e56), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.618875 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd9a6572-e1b8-4d5b-9b19-f4ba747cdd96 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (03961dff-529f-4476-b439-9a88253a1e56), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.625153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd9a6572-e1b8-4d5b-9b19-f4ba747cdd96 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.626218 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bd9a6572-e1b8-4d5b-9b19-f4ba747cdd96 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/03961dff-529f-4476-b439-9a88253a1e56 HTTP/1.1" status: 204 len: 168 time: 0.0649424 Mar 24 02:19:57.628874 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34620) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.631281 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9a6572-e1b8-4d5b-9b19-f4ba747cdd96 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=03961dff-529f-4476-b439-9a88253a1e56,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:57.665628 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-76b9b740-a996-44f4-a2f2-d52a31a8aac4 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0356066 Mar 24 02:19:57.668164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34622) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.672693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '71038dcf-f79b-4b74-bebb-10c61e36682d', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:57.692857 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Project 3073bdcf8d4e476d9b774243264d4c03 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:19:57.697364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (2139547f-b6c1-402e-a58a-0382172a6c0f), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.756676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (2139547f-b6c1-402e-a58a-0382172a6c0f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.760245 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (2139547f-b6c1-402e-a58a-0382172a6c0f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.776364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2139547f-b6c1-402e-a58a-0382172a6c0f,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:57.785071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.785420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.785758 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.786095 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.786428 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.786898 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.787225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.787552 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.787876 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.788197 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.788516 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.788835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.789149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.789468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.789781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:19:57.794226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.798206 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1c4e2e03-6652-4b31-8d36-4f97b12aeb51 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1263859 Mar 24 02:19:57.798721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34624) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.813825 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fdf31469-6b58-4ed9-8400-812b99602b95 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules/2139547f-b6c1-402e-a58a-0382172a6c0f HTTP/1.1" status: 200 len: 769 time: 0.0140581 Mar 24 02:19:57.816007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34626) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.851725 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-037d77fc-d910-4307-952b-5e35c007b342 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4119 time: 0.0344753 Mar 24 02:19:57.854079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34628) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.879022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f28e560-b96b-4d9a-890d-f401db6f8009 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (2139547f-b6c1-402e-a58a-0382172a6c0f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.888393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f28e560-b96b-4d9a-890d-f401db6f8009 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (2139547f-b6c1-402e-a58a-0382172a6c0f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.914178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f28e560-b96b-4d9a-890d-f401db6f8009 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (2139547f-b6c1-402e-a58a-0382172a6c0f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.918726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9f28e560-b96b-4d9a-890d-f401db6f8009 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:57.919836 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9f28e560-b96b-4d9a-890d-f401db6f8009 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-group-rules/2139547f-b6c1-402e-a58a-0382172a6c0f HTTP/1.1" status: 204 len: 168 time: 0.0648770 Mar 24 02:19:57.923105 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34632) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.935503 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f28e560-b96b-4d9a-890d-f401db6f8009 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=2139547f-b6c1-402e-a58a-0382172a6c0f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:57.960649 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1a701bd1-9f99-46a7-9a54-6e9ef8ef9822 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0359840 Mar 24 02:19:57.963414 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34634) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:57.982301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7717febc-d19e-4f14-8b13-c63f29b9cc9c req-4075697e-1589-4fc2-939b-f7159c1218ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:57.984388 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7717febc-d19e-4f14-8b13-c63f29b9cc9c req-4075697e-1589-4fc2-939b-f7159c1218ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0569553 Mar 24 02:19:58.014052 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb6878c5-4b1c-4950-8be2-2db6b7e46e14 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (71038dcf-f79b-4b74-bebb-10c61e36682d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.033760 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7717febc-d19e-4f14-8b13-c63f29b9cc9c req-ae8837f9-42ac-46e2-a9a7-c0fad2654042 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437384 Mar 24 02:19:58.036388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb6878c5-4b1c-4950-8be2-2db6b7e46e14 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (71038dcf-f79b-4b74-bebb-10c61e36682d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.079060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb6878c5-4b1c-4950-8be2-2db6b7e46e14 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (71038dcf-f79b-4b74-bebb-10c61e36682d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.081566 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb6878c5-4b1c-4950-8be2-2db6b7e46e14 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.082756 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cb6878c5-4b1c-4950-8be2-2db6b7e46e14 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/71038dcf-f79b-4b74-bebb-10c61e36682d HTTP/1.1" status: 204 len: 168 time: 0.1184070 Mar 24 02:19:58.085648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34636) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:58.091450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb6878c5-4b1c-4950-8be2-2db6b7e46e14 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=71038dcf-f79b-4b74-bebb-10c61e36682d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:58.130450 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cdc4b25b-6071-470c-ac0d-95fc0899723d tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0421667 Mar 24 02:19:58.133317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34638) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:58.137488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-80a2a06d-d92f-47f9-a07f-7396b3b5bcfc tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group': {'name': 'tempest-secgroup--1264909609'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:58.159208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80a2a06d-d92f-47f9-a07f-7396b3b5bcfc tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.223958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80a2a06d-d92f-47f9-a07f-7396b3b5bcfc tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (2306c982-27b2-4bef-8339-1c187d71426d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.227749 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80a2a06d-d92f-47f9-a07f-7396b3b5bcfc tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2306c982-27b2-4bef-8339-1c187d71426d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.250370 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-80a2a06d-d92f-47f9-a07f-7396b3b5bcfc tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.251591 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-80a2a06d-d92f-47f9-a07f-7396b3b5bcfc tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1173096 Mar 24 02:19:58.254449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34640) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:58.259060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-663b9a4e-490d-4893-9844-2cbdfaef4cd5 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Request body: {'security_group_rule': {'security_group_id': '2306c982-27b2-4bef-8339-1c187d71426d', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:19:58.259269 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a2a06d-d92f-47f9-a07f-7396b3b5bcfc tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2306c982-27b2-4bef-8339-1c187d71426d,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:58.284785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-663b9a4e-490d-4893-9844-2cbdfaef4cd5 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (6e343128-6601-4ddd-8bba-68a6dc47f4e9), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.328710 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-663b9a4e-490d-4893-9844-2cbdfaef4cd5 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (6e343128-6601-4ddd-8bba-68a6dc47f4e9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.332114 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-663b9a4e-490d-4893-9844-2cbdfaef4cd5 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (6e343128-6601-4ddd-8bba-68a6dc47f4e9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.347397 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663b9a4e-490d-4893-9844-2cbdfaef4cd5 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6e343128-6601-4ddd-8bba-68a6dc47f4e9,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:58.357312 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-663b9a4e-490d-4893-9844-2cbdfaef4cd5 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.358597 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-663b9a4e-490d-4893-9844-2cbdfaef4cd5 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1030793 Mar 24 02:19:58.361188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34642) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:58.412218 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14a5feeb-649f-4c69-a700-187cd9415ea0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (2306c982-27b2-4bef-8339-1c187d71426d), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.437053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14a5feeb-649f-4c69-a700-187cd9415ea0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (2306c982-27b2-4bef-8339-1c187d71426d), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.481050 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14a5feeb-649f-4c69-a700-187cd9415ea0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (2306c982-27b2-4bef-8339-1c187d71426d), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.483822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-14a5feeb-649f-4c69-a700-187cd9415ea0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:58.484952 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-14a5feeb-649f-4c69-a700-187cd9415ea0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/2306c982-27b2-4bef-8339-1c187d71426d HTTP/1.1" status: 204 len: 168 time: 0.1228769 Mar 24 02:19:58.487672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34644) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:58.493767 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a5feeb-649f-4c69-a700-187cd9415ea0 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2306c982-27b2-4bef-8339-1c187d71426d,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:58.534144 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-db3bf2a2-f438-4619-a612-0e75185b5c15 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0453091 Mar 24 02:19:58.536603 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34646) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:58.571183 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-923f11c0-3920-4085-b091-b33dd3f6dd3a tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.0333536 Mar 24 02:19:58.573745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34648) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:58.586858 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.api.v2.resource [None req-0e3a7352-4747-4216-9302-d19da7c10671 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] delete failed (client error): The resource could not be found. Mar 24 02:19:58.587745 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0e3a7352-4747-4216-9302-d19da7c10671 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "DELETE /v2.0/security-groups/2306c982-27b2-4bef-8339-1c187d71426d HTTP/1.1" status: 404 len: 347 time: 0.0130961 Mar 24 02:19:58.590914 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34650) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:58.629578 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-33d22b0c-38c3-45dd-bcc5-2c85957caaf8 tempest-SecGroupIPv6Test-492947975 tempest-SecGroupIPv6Test-492947975-project] 10.222.0.20 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0377059 Mar 24 02:19:58.864916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34656) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:58.992939 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9608ebff-71a9-4194-8c8d-48a51a801a0f admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=3073bdcf8d4e476d9b774243264d4c03&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1268296 Mar 24 02:19:58.995455 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34660) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:19:59.040136 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b005767-bc62-4057-9395-dd9a4790b6d6 admin admin] Publish callbacks [] for security_group (bc82e172-86be-4003-a139-af17e46d522d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:59.060737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b005767-bc62-4057-9395-dd9a4790b6d6 admin admin] Publish callbacks [] for security_group (bc82e172-86be-4003-a139-af17e46d522d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:59.131002 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b005767-bc62-4057-9395-dd9a4790b6d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (bc82e172-86be-4003-a139-af17e46d522d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:59.133474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-9b005767-bc62-4057-9395-dd9a4790b6d6 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:19:59.134620 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9b005767-bc62-4057-9395-dd9a4790b6d6 admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/bc82e172-86be-4003-a139-af17e46d522d HTTP/1.1" status: 204 len: 168 time: 0.1382430 Mar 24 02:19:59.145793 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b005767-bc62-4057-9395-dd9a4790b6d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc82e172-86be-4003-a139-af17e46d522d,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:19:59.172000 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3058ff07-a386-4525-b9e2-ddd650e69a62 req-81fd64e3-e0a7-4ae7-90cc-14d11e0efb96 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:19:59.173507 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3058ff07-a386-4525-b9e2-ddd650e69a62 req-81fd64e3-e0a7-4ae7-90cc-14d11e0efb96 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0734358 Mar 24 02:19:59.225396 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3058ff07-a386-4525-b9e2-ddd650e69a62 req-128fda6c-7df0-4740-9ec4-67383c7d2fb2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455925 Mar 24 02:20:00.340486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1257ead-4fa3-4a32-a65b-4da5fffd6d7c req-ac30a53b-2e1f-493c-8a05-a89968376c5d tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:00.341952 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f1257ead-4fa3-4a32-a65b-4da5fffd6d7c req-ac30a53b-2e1f-493c-8a05-a89968376c5d tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0511198 Mar 24 02:20:00.389858 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f1257ead-4fa3-4a32-a65b-4da5fffd6d7c req-651d65ba-8a32-4b67-8088-48a816754d6b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413816 Mar 24 02:20:00.490979 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ce71ee9b-9e74-4814-85ba-c11fa076b008 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:00.851111 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:01.512717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abbcfc6e-7ea9-40be-8bd9-6eed415a69bf req-22d7117b-6eee-432c-8c21-dc1a177df552 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:01.514151 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-abbcfc6e-7ea9-40be-8bd9-6eed415a69bf req-22d7117b-6eee-432c-8c21-dc1a177df552 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0544965 Mar 24 02:20:01.561967 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-abbcfc6e-7ea9-40be-8bd9-6eed415a69bf req-a55f0e63-a2e9-4bd6-b89b-35028f3f3923 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413797 Mar 24 02:20:02.411633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:02.674859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79f83db-8b13-461f-b2c7-fdcfa673f080 req-a4b3132a-e3c3-4ea9-a9cb-cd37bef6dc21 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:02.676318 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a79f83db-8b13-461f-b2c7-fdcfa673f080 req-a4b3132a-e3c3-4ea9-a9cb-cd37bef6dc21 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0512128 Mar 24 02:20:02.730011 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a79f83db-8b13-461f-b2c7-fdcfa673f080 req-1d73682e-038c-4828-9c48-7b279699221f tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482023 Mar 24 02:20:03.690864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:03.845879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14dc75cf-e869-4f87-b304-abd57675d11d req-82db2e6c-cf0a-4175-9bc4-91ada8c73bf7 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:03.847357 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-14dc75cf-e869-4f87-b304-abd57675d11d req-82db2e6c-cf0a-4175-9bc4-91ada8c73bf7 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0513794 Mar 24 02:20:03.898171 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-14dc75cf-e869-4f87-b304-abd57675d11d req-45d91dc9-905d-44fd-af04-4a66d5a83f75 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453668 Mar 24 02:20:04.908962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 5b3ca245-4a38-4e2a-9165-fea0f427a048 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:20:04.993858 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:20:05.008230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 5b3ca245-4a38-4e2a-9165-fea0f427a048, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=5b3ca245-4a38-4e2a-9165-fea0f427a048,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:20:05.013043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-022d49e2-ab3b-4df9-ba2d-7ed937e3d665 req-98a67054-4407-4f63-9e02-065c419070fe tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:05.015041 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-022d49e2-ab3b-4df9-ba2d-7ed937e3d665 req-98a67054-4407-4f63-9e02-065c419070fe tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 943 time: 0.0527706 Mar 24 02:20:05.020200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'port_id': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'mac_address': 'fa:16:3e:66:5d:6e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:20:05.056603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 5b3ca245-4a38-4e2a-9165-fea0f427a048 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:20:05.056995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:05.062825 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-022d49e2-ab3b-4df9-ba2d-7ed937e3d665 req-6f6bb9b9-29fe-4017-b229-c0c604ff8535 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423498 Mar 24 02:20:05.069972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5b3ca245-4a38-4e2a-9165-fea0f427a048 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:20:05.090177 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 5b3ca245-4a38-4e2a-9165-fea0f427a048, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=5b3ca245-4a38-4e2a-9165-fea0f427a048,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:20:05.094431 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:05.144229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=5b3ca245-4a38-4e2a-9165-fea0f427a048,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:05.151176 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.151534 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.151884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.152227 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.152566 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.152908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.153238 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.153570 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.153903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.154283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.154665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.155057 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.155389 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.156223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.156549 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:05.396291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['5b3ca245-4a38-4e2a-9165-fea0f427a048'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:20:06.180163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592db429-b78e-4bfe-b8ac-2ef2b8fb397c req-56e12073-3819-40e9-ac5e-2db4569d723b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:06.181629 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-592db429-b78e-4bfe-b8ac-2ef2b8fb397c req-56e12073-3819-40e9-ac5e-2db4569d723b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 944 time: 0.0513513 Mar 24 02:20:06.228654 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-592db429-b78e-4bfe-b8ac-2ef2b8fb397c req-96dfb875-c557-4494-b42c-0101c5ccecda tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410631 Mar 24 02:20:06.920258 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 5b3ca245-4a38-4e2a-9165-fea0f427a048 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:20:06.969223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 5b3ca245-4a38-4e2a-9165-fea0f427a048 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:20:06.973683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 5b3ca245-4a38-4e2a-9165-fea0f427a048 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:20:06.974060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:07.047852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 5b3ca245-4a38-4e2a-9165-fea0f427a048 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:20:07.048237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:07.073810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5b3ca245-4a38-4e2a-9165-fea0f427a048'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:20:07.076069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0b85edf5-d25c-402a-8de9-06f88b4eeee5" -d '{"events": [{"server_uuid": "74e34fdf-6340-4649-ace4-f8648b8309b9", "name": "network-vif-plugged", "status": "completed", "tag": "5b3ca245-4a38-4e2a-9165-fea0f427a048"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:20:07.088649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 5b3ca245-4a38-4e2a-9165-fea0f427a048, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=5b3ca245-4a38-4e2a-9165-fea0f427a048,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:20:07.093338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:07.118147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:20:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7ed1176-d97d-4272-88d5-477d7aaa72e8 x-openstack-request-id: req-a7ed1176-d97d-4272-88d5-477d7aaa72e8 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:20:07.118444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "74e34fdf-6340-4649-ace4-f8648b8309b9", "name": "network-vif-plugged", "status": "completed", "tag": "5b3ca245-4a38-4e2a-9165-fea0f427a048", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:20:07.118733 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-a7ed1176-d97d-4272-88d5-477d7aaa72e8 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:20:07.119134 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a7ed1176-d97d-4272-88d5-477d7aaa72e8'] response: {'server_uuid': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'code': 200} Mar 24 02:20:07.145656 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=5b3ca245-4a38-4e2a-9165-fea0f427a048,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:07.307360 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d17abc22-35b1-4938-97dc-406645e9f69d req-4903d5ff-ab10-4227-9e39-b98f0ea52df5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:07.308792 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d17abc22-35b1-4938-97dc-406645e9f69d req-4903d5ff-ab10-4227-9e39-b98f0ea52df5 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 1129 time: 0.0559833 Mar 24 02:20:07.376412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5127bb31-54ad-4424-9d86-cf41ac8c8ca9 req-c73d05d8-acb6-4d10-9416-08cf285a8832 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:07.377872 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5127bb31-54ad-4424-9d86-cf41ac8c8ca9 req-c73d05d8-acb6-4d10-9416-08cf285a8832 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 945 time: 0.0830226 Mar 24 02:20:07.380731 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d17abc22-35b1-4938-97dc-406645e9f69d req-32a0773b-a52d-44ad-92f4-835284b5348e service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0584042 Mar 24 02:20:07.425174 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5127bb31-54ad-4424-9d86-cf41ac8c8ca9 req-bc3bd1fc-42c5-4256-ac72-79ad79485106 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418484 Mar 24 02:20:08.544909 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be9debd-5a5e-4247-979c-4ddb4bdbacf4 req-25b080f2-34e3-4762-bde0-b4cd53c10dba tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:08.547020 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5be9debd-5a5e-4247-979c-4ddb4bdbacf4 req-25b080f2-34e3-4762-bde0-b4cd53c10dba tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 945 time: 0.0550287 Mar 24 02:20:08.596780 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5be9debd-5a5e-4247-979c-4ddb4bdbacf4 req-4ee87deb-8607-47ba-b6a7-dbe657ca7092 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442364 Mar 24 02:20:09.711594 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9613c04-3ff1-44d0-8103-a6b5e60ce4e1 req-59023c62-e00f-4868-be60-c9db420812dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:09.713062 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c9613c04-3ff1-44d0-8103-a6b5e60ce4e1 req-59023c62-e00f-4868-be60-c9db420812dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 945 time: 0.0511596 Mar 24 02:20:09.761622 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c9613c04-3ff1-44d0-8103-a6b5e60ce4e1 req-0ea8a757-b623-4c9a-9177-ec707441fecd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431252 Mar 24 02:20:09.876301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c86ff96c-2880-4a65-befb-89a982a4bff8 req-2409429e-5f35-4687-b847-b1b907d5cd1c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:09.877707 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c86ff96c-2880-4a65-befb-89a982a4bff8 req-2409429e-5f35-4687-b847-b1b907d5cd1c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 945 time: 0.0511827 Mar 24 02:20:09.929491 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c86ff96c-2880-4a65-befb-89a982a4bff8 req-f7b96879-9ad7-40b9-b235-50f1777137b0 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460322 Mar 24 02:20:09.951548 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34688) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:10.133644 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edeb2cf1-d603-4168-bb51-17d5785388fb tempest-TestVolumeBootPattern-513780323 tempest-TestVolumeBootPattern-513780323-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:10.135196 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-edeb2cf1-d603-4168-bb51-17d5785388fb tempest-TestVolumeBootPattern-513780323 tempest-TestVolumeBootPattern-513780323-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 1124 time: 0.1826396 Mar 24 02:20:10.138069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34692) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:10.142893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address': '172.20.0.3'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:20:10.163707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:10.260598 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:10.360770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Allocated IP 172.26.2.201 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/5caea9a0-6078-47ba-9a6c-ed3adfb0390f) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:20:10.462324 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for port (5caea9a0-6078-47ba-9a6c-ed3adfb0390f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:10.495174 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5caea9a0-6078-47ba-9a6c-ed3adfb0390f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:10.527997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:20:10.532789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:20:10.536950 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:20:10.562452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'Port': ['ID=5caea9a0-6078-47ba-9a6c-ed3adfb0390f,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:11.224387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (b84362c7-d8e0-4ed8-b907-8d4838657519), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:11.290663 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (5caea9a0-6078-47ba-9a6c-ed3adfb0390f), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:11.440104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for port (5caea9a0-6078-47ba-9a6c-ed3adfb0390f), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:11.444920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (5caea9a0-6078-47ba-9a6c-ed3adfb0390f), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:11.512514 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'Port': ['ID=5caea9a0-6078-47ba-9a6c-ed3adfb0390f,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:11.522426 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (b84362c7-d8e0-4ed8-b907-8d4838657519), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:11.625977 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Floating IP b84362c7-d8e0-4ed8-b907-8d4838657519 associated. External IP: 172.26.2.201, port: 5b3ca245-4a38-4e2a-9165-fea0f427a048. Mar 24 02:20:11.840904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Router d9d90a22-1adf-4945-a625-094e279f17a1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:20:11.952587 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:20:11.962745 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] Sync routers for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:20:11.969770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:11.972452 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:20:11.973071 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:20:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:11.998095 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-87917fd8-1b83-451a-9e34-92a74fcfa089 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8589616 Mar 24 02:20:11.998750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'tag': '5b3ca245-4a38-4e2a-9165-fea0f427a048'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:20:12.000988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9259c053-11f3-4463-9d01-db0c479e866f" -d '{"events": [{"name": "network-changed", "server_uuid": "74e34fdf-6340-4649-ace4-f8648b8309b9", "tag": "5b3ca245-4a38-4e2a-9165-fea0f427a048"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:20:12.038575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:20:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0868d042-6fe1-4fc8-bbcf-12c0db3f00d0 x-openstack-request-id: req-0868d042-6fe1-4fc8-bbcf-12c0db3f00d0 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:20:12.038853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "74e34fdf-6340-4649-ace4-f8648b8309b9", "tag": "5b3ca245-4a38-4e2a-9165-fea0f427a048", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:20:12.039111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-0868d042-6fe1-4fc8-bbcf-12c0db3f00d0 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:20:12.039532 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0868d042-6fe1-4fc8-bbcf-12c0db3f00d0'] response: {'name': 'network-changed', 'server_uuid': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'tag': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'status': 'completed', 'code': 200} Mar 24 02:20:12.081256 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:20:12.105260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9259c053-11f3-4463-9d01-db0c479e866f req-ce70fb39-ad68-413a-9dbb-f2196e4a21db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:12.106732 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9259c053-11f3-4463-9d01-db0c479e866f req-ce70fb39-ad68-413a-9dbb-f2196e4a21db service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 1129 time: 0.0463133 Mar 24 02:20:12.199739 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9259c053-11f3-4463-9d01-db0c479e866f req-cb979090-1923-47ff-b340-6d0072eab258 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:12.201231 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9259c053-11f3-4463-9d01-db0c479e866f req-cb979090-1923-47ff-b340-6d0072eab258 service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.0882292 Mar 24 02:20:12.265012 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9259c053-11f3-4463-9d01-db0c479e866f req-8a109627-cdc0-443c-b2a8-10d935a4bf6d service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5b3ca245-4a38-4e2a-9165-fea0f427a048 HTTP/1.1" status: 200 len: 999 time: 0.0569208 Mar 24 02:20:12.301466 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'b84362c7-d8e0-4ed8-b907-8d4838657519', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.201', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1381, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:66:5d:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:20:10Z', 'updated_at': '2022-03-24T02:20:10Z', 'revision_number': 0, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:12.314638 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9259c053-11f3-4463-9d01-db0c479e866f req-51f00b6b-1998-4d2c-8047-7b18ed13ed58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:12.316075 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9259c053-11f3-4463-9d01-db0c479e866f req-51f00b6b-1998-4d2c-8047-7b18ed13ed58 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0463588 Mar 24 02:20:12.328120 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] Checking router: d9d90a22-1adf-4945-a625-094e279f17a1 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:20:12.336362 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:20:12.336969 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:20:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:12.363342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9259c053-11f3-4463-9d01-db0c479e866f req-ecc86de3-d8be-42ed-8cd4-1025dc96fe69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:12.364740 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9259c053-11f3-4463-9d01-db0c479e866f req-ecc86de3-d8be-42ed-8cd4-1025dc96fe69 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0428376 Mar 24 02:20:12.443055 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:20:12.451934 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9259c053-11f3-4463-9d01-db0c479e866f req-ecc60805-87e0-49ae-8b0d-317fa29d356b service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0804918 Mar 24 02:20:12.542405 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9259c053-11f3-4463-9d01-db0c479e866f req-e5c5ef84-8be1-49a0-be3c-a2a2206c2618 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849929 Mar 24 02:20:12.660121 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'b84362c7-d8e0-4ed8-b907-8d4838657519', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.201', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1381, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:66:5d:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:20:10Z', 'updated_at': '2022-03-24T02:20:10Z', 'revision_number': 0, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:12.766376 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e92224c-ff42-420d-8857-f4b868c04272 None None] The sync data for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv is: [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'b84362c7-d8e0-4ed8-b907-8d4838657519', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.201', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1381, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:66:5d:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:20:10Z', 'updated_at': '2022-03-24T02:20:10Z', 'revision_number': 0, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:20:12.944085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff046780-dc80-4930-80c1-f2e493d8c31d None None] New status for floating IP b84362c7-d8e0-4ed8-b907-8d4838657519: ACTIVE {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:20:14.995601 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:25.045229 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-07748d0f-5033-4e21-af8d-33dfd4254080 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0422943 Mar 24 02:20:25.131554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-68f9924d-53a1-4e7f-af74-0fd047de66b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:25.133039 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-68f9924d-53a1-4e7f-af74-0fd047de66b5 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 1129 time: 0.0451672 Mar 24 02:20:25.236871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-7e83f115-0202-4f3e-a7fe-670836ebe6d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:25.238308 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-7e83f115-0202-4f3e-a7fe-670836ebe6d4 service neutron] 10.222.0.30 "GET /v2.0/networks?id=8ee3ba97-1980-4303-b77a-6f5ad4d46166 HTTP/1.1" status: 200 len: 897 time: 0.0864627 Mar 24 02:20:25.307361 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-33bdeb33-4afc-47e6-8c12-670cef525aa6 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf HTTP/1.1" status: 200 len: 1001 time: 0.0610251 Mar 24 02:20:25.363770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-3ee61602-8202-404c-a18d-da77bb95fc5c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:25.365325 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-3ee61602-8202-404c-a18d-da77bb95fc5c service neutron] 10.222.0.30 "GET /v2.0/subnets?id=13b9dd73-653a-474d-904f-24c2031739ff HTTP/1.1" status: 200 len: 834 time: 0.0502303 Mar 24 02:20:25.417291 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-5df84625-17c8-4069-9082-7ee31262e928 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:25.418890 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-5df84625-17c8-4069-9082-7ee31262e928 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=8ee3ba97-1980-4303-b77a-6f5ad4d46166&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0474181 Mar 24 02:20:25.506803 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-7b3da7c2-25ef-47e1-84ef-2bb5cb598edf service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813041 Mar 24 02:20:25.600121 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8a840600-2726-4e24-a654-4703d7b5fc30 req-0e7c4b5f-fc7a-40c5-9ad6-85c0da56ec6e service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865507 Mar 24 02:20:27.376015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-65e50648-1340-4b00-b326-1073865a1764 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:30.492952 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-070c815b-1fb4-4a65-8aac-cad2a25ec945 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:30.854203 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:32.414868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:33.693107 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:41.994105 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:20:45.000742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:50.506565 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34730) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:50.657138 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1814f873-d7ff-4652-b76e-caf8017853b8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/c4a0d2fa-9431-42a6-9938-4b9cd6db0aec HTTP/1.1" status: 200 len: 993 time: 0.1494823 Mar 24 02:20:50.922399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34738) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:51.077453 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port af16cdb4-e86c-4775-aec1-d31e79a69067 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:20:51.077792 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (af16cdb4-e86c-4775-aec1-d31e79a69067), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:51.150384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (af16cdb4-e86c-4775-aec1-d31e79a69067), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:51.150732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (af16cdb4-e86c-4775-aec1-d31e79a69067), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:51.163030 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for af16cdb4-e86c-4775-aec1-d31e79a69067 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:20:51.307001 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (af16cdb4-e86c-4775-aec1-d31e79a69067), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:51.336276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=af16cdb4-e86c-4775-aec1-d31e79a69067,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:51.395032 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (c4a0d2fa-9431-42a6-9938-4b9cd6db0aec), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:51.395404 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP c4a0d2fa-9431-42a6-9938-4b9cd6db0aec disassociated (deleted). External IP: 172.26.2.199, port: 8c01fb2d-b016-4fc0-9ec9-85135306e3cf. Mar 24 02:20:51.602472 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router f1e1a820-21ac-4c51-979d-f4b8742581f3 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:20:51.708763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:20:51.714124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:51.719146 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] Sync routers for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:20:51.728066 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:20:51.728668 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:20:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:51.743021 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-48dbe4ec-f943-4e3e-899b-3cfdddb90ae6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/floatingips/c4a0d2fa-9431-42a6-9938-4b9cd6db0aec HTTP/1.1" status: 204 len: 168 time: 0.8194923 Mar 24 02:20:51.743611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:20:51.745851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1fcf1083-b7fb-471a-91a5-23be06e23aea" -d '{"events": [{"name": "network-changed", "server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:20:51.783601 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:20:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43c22de6-7b09-4b8b-a8e5-dd48ad2648c4 x-openstack-request-id: req-43c22de6-7b09-4b8b-a8e5-dd48ad2648c4 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:20:51.783908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:20:51.784171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-43c22de6-7b09-4b8b-a8e5-dd48ad2648c4 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:20:51.784590 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-43c22de6-7b09-4b8b-a8e5-dd48ad2648c4'] response: {'name': 'network-changed', 'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'status': 'completed', 'code': 200} Mar 24 02:20:51.844066 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:20:51.863713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-e04d7e3b-004c-4e2d-b612-916258a9b9bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:51.865501 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-e04d7e3b-004c-4e2d-b612-916258a9b9bd service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 1129 time: 0.0538764 Mar 24 02:20:51.989094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-49a709cf-54be-4165-b03a-5493b82cf3a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:51.991232 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-49a709cf-54be-4165-b03a-5493b82cf3a1 service neutron] 10.222.0.30 "GET /v2.0/networks?id=8ee3ba97-1980-4303-b77a-6f5ad4d46166 HTTP/1.1" status: 200 len: 897 time: 0.1203001 Mar 24 02:20:52.002222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9a8c05-cd53-49e2-bf4f-cade2d22c001 req-8a51c92d-dba2-4949-a40e-a03a0b553b8c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:52.003678 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f9a8c05-cd53-49e2-bf4f-cade2d22c001 req-8a51c92d-dba2-4949-a40e-a03a0b553b8c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 945 time: 0.0788288 Mar 24 02:20:52.044400 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:14Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'd3569980-3835-437c-aba6-4620efe7ee98', 'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:78:8e:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1274, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:13Z', 'updated_at': '2022-03-24T02:19:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '13b9dd73-653a-474d-904f-24c2031739ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:52.052408 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-8ab2c28a-1b55-4439-ad78-2ccf12afe9c8 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf HTTP/1.1" status: 200 len: 217 time: 0.0478044 Mar 24 02:20:52.074975 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] Checking router: f1e1a820-21ac-4c51-979d-f4b8742581f3 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:20:52.083089 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:20:52.083684 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:20:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:52.119196 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f9a8c05-cd53-49e2-bf4f-cade2d22c001 req-7d7d8130-681a-4e21-b85b-2ffd8c02b5e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1082180 Mar 24 02:20:52.122973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-8fed3011-ac68-493e-a0d0-5f22f099d9e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:52.124299 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-8fed3011-ac68-493e-a0d0-5f22f099d9e8 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=13b9dd73-653a-474d-904f-24c2031739ff HTTP/1.1" status: 200 len: 834 time: 0.0655329 Mar 24 02:20:52.177315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-434c79a8-ad25-4781-9117-1f96cd12dc02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:52.178871 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-434c79a8-ad25-4781-9117-1f96cd12dc02 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=8ee3ba97-1980-4303-b77a-6f5ad4d46166&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0482516 Mar 24 02:20:52.190620 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:20:52.269557 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-8ef1c8b8-1fb9-4c70-ab5c-3f90cbb5ee1b service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844557 Mar 24 02:20:52.357747 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1fcf1083-b7fb-471a-91a5-23be06e23aea req-57ffa404-2743-4314-82d8-8450fe8a1b5e service neutron] 10.222.0.30 "GET /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821695 Mar 24 02:20:52.380494 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:14Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'd3569980-3835-437c-aba6-4620efe7ee98', 'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:78:8e:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1274, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:13Z', 'updated_at': '2022-03-24T02:19:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '13b9dd73-653a-474d-904f-24c2031739ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:52.406368 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a19be427-7059-43d1-aed3-565eadfd05ea None None] The sync data for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv is: [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:19:14Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'd3569980-3835-437c-aba6-4620efe7ee98', 'name': '', 'network_id': '8ee3ba97-1980-4303-b77a-6f5ad4d46166', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:78:8e:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1274, 'fixed_ips': [{'subnet_id': '13b9dd73-653a-474d-904f-24c2031739ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:13Z', 'updated_at': '2022-03-24T02:19:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '13b9dd73-653a-474d-904f-24c2031739ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:20:52.620960 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82dd21b2-86ab-49b7-aa31-c37fc2148488 None None] New status for floating IP c4a0d2fa-9431-42a6-9938-4b9cd6db0aec: DOWN {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:20:53.245839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c670ee8a-8121-436c-b515-972e3c8a67ae req-be1d317d-769a-4ae4-ac36-584001e642fb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:53.247347 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c670ee8a-8121-436c-b515-972e3c8a67ae req-be1d317d-769a-4ae4-ac36-584001e642fb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 945 time: 0.0586681 Mar 24 02:20:53.295518 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c670ee8a-8121-436c-b515-972e3c8a67ae req-988766ee-4f69-44e4-ba42-8f04478f310f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424244 Mar 24 02:20:53.617786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b4d74d-f31f-4330-923c-0608c616e566 req-2c3c3712-e91e-444b-82bb-a576c005d97d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:53.619273 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-55b4d74d-f31f-4330-923c-0608c616e566 req-2c3c3712-e91e-444b-82bb-a576c005d97d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 945 time: 0.0513370 Mar 24 02:20:53.712165 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-55b4d74d-f31f-4330-923c-0608c616e566 req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:20:53.712508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-55b4d74d-f31f-4330-923c-0608c616e566 req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:53.798871 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-55b4d74d-f31f-4330-923c-0608c616e566 req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:20:53.799227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-55b4d74d-f31f-4330-923c-0608c616e566 req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:53.812222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-55b4d74d-f31f-4330-923c-0608c616e566 req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 8c01fb2d-b016-4fc0-9ec9-85135306e3cf owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:20:53.939440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-55b4d74d-f31f-4330-923c-0608c616e566 req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (8c01fb2d-b016-4fc0-9ec9-85135306e3cf), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:53.966506 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=8c01fb2d-b016-4fc0-9ec9-85135306e3cf,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:54.008208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-55b4d74d-f31f-4330-923c-0608c616e566 req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] No DVR routers for this DVR port 8c01fb2d-b016-4fc0-9ec9-85135306e3cf on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:20:54.010813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-55b4d74d-f31f-4330-923c-0608c616e566 req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:54.014147 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-55b4d74d-f31f-4330-923c-0608c616e566 req-e33d8474-42de-4931-97ac-a25c050a8f2f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "DELETE /v2.0/ports/8c01fb2d-b016-4fc0-9ec9-85135306e3cf HTTP/1.1" status: 204 len: 173 time: 0.3894424 Mar 24 02:20:54.014600 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'name': 'network-vif-deleted', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:20:54.018498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c424fb4d-2a17-4143-8a2c-ff0d481e6233" -d '{"events": [{"server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "name": "network-vif-deleted", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:20:54.054080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:20:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdac10a1-b1e2-4b09-a513-3d6e492d8f10 x-openstack-request-id: req-cdac10a1-b1e2-4b09-a513-3d6e492d8f10 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:20:54.054371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2a5c6d2a-5378-452d-9141-0cebd6963927", "name": "network-vif-deleted", "tag": "8c01fb2d-b016-4fc0-9ec9-85135306e3cf", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:20:54.054667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-cdac10a1-b1e2-4b09-a513-3d6e492d8f10 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:20:54.055096 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-cdac10a1-b1e2-4b09-a513-3d6e492d8f10'] response: {'server_uuid': '2a5c6d2a-5378-452d-9141-0cebd6963927', 'name': 'network-vif-deleted', 'tag': '8c01fb2d-b016-4fc0-9ec9-85135306e3cf', 'status': 'completed', 'code': 200} Mar 24 02:20:54.408543 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a6d54ee5-fcbe-40c4-a089-41eeb3b54a51 req-2daa099b-0a19-4e03-aea5-c1815d807ab8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2a5c6d2a-5378-452d-9141-0cebd6963927 HTTP/1.1" status: 200 len: 210 time: 0.0315959 Mar 24 02:20:55.464317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34758) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:55.519845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c2c6ad4-8d65-4f7a-a96f-0e3696ef233d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (8fd6a4ec-1ce1-44d4-81a6-08c71925fa39), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:55.544848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c2c6ad4-8d65-4f7a-a96f-0e3696ef233d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (8fd6a4ec-1ce1-44d4-81a6-08c71925fa39), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:55.604463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c2c6ad4-8d65-4f7a-a96f-0e3696ef233d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8fd6a4ec-1ce1-44d4-81a6-08c71925fa39), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:55.607274 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c2c6ad4-8d65-4f7a-a96f-0e3696ef233d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:55.608422 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2c2c6ad4-8d65-4f7a-a96f-0e3696ef233d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/security-groups/8fd6a4ec-1ce1-44d4-81a6-08c71925fa39 HTTP/1.1" status: 204 len: 168 time: 0.1431279 Mar 24 02:20:55.622250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c2c6ad4-8d65-4f7a-a96f-0e3696ef233d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fd6a4ec-1ce1-44d4-81a6-08c71925fa39,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:55.640646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34762) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:55.997109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (f1e1a820-21ac-4c51-979d-f4b8742581f3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:56.251086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port d3569980-3835-437c-aba6-4620efe7ee98 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:20:56.251343 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d3569980-3835-437c-aba6-4620efe7ee98), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:56.340545 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port d3569980-3835-437c-aba6-4620efe7ee98, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d3569980-3835-437c-aba6-4620efe7ee98,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:20:56.340902 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d3569980-3835-437c-aba6-4620efe7ee98), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:56.353369 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for d3569980-3835-437c-aba6-4620efe7ee98 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:20:56.533309 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d3569980-3835-437c-aba6-4620efe7ee98), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:56.559525 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=d3569980-3835-437c-aba6-4620efe7ee98,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:56.584124 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.584469 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.584804 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.585139 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.585468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.585789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.586111 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.586428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.586773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.587092 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.587410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.587726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.588041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.588353 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.588666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:56.742964 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (f1e1a820-21ac-4c51-979d-f4b8742581f3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:56.951198 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router f1e1a820-21ac-4c51-979d-f4b8742581f3 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:20:57.055804 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:20:57.061182 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d0d3c528-2f60-40e8-883c-3098ce34bffc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/f1e1a820-21ac-4c51-979d-f4b8742581f3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4190447 Mar 24 02:20:57.063581 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34764) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:57.067013 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] Sync routers for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:20:57.076387 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:20:57.076968 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:20:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:57.112798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b747494-0218-428a-ae34-53e92692864c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting subnet 13b9dd73-653a-474d-904f-24c2031739ff {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:20:57.116568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b747494-0218-428a-ae34-53e92692864c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (13b9dd73-653a-474d-904f-24c2031739ff), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.159409 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b747494-0218-428a-ae34-53e92692864c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (13b9dd73-653a-474d-904f-24c2031739ff), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.183075 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:20:57.240240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b747494-0218-428a-ae34-53e92692864c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (13b9dd73-653a-474d-904f-24c2031739ff), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.243749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 8c01fb2d-b016-4fc0-9ec9-85135306e3cf no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:20:57.264223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 8c01fb2d-b016-4fc0-9ec9-85135306e3cf {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:20:57.265085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 8c01fb2d-b016-4fc0-9ec9-85135306e3cf not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:20:57.297172 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b747494-0218-428a-ae34-53e92692864c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (13b9dd73-653a-474d-904f-24c2031739ff), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.328544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b747494-0218-428a-ae34-53e92692864c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Subnet': ['ID=13b9dd73-653a-474d-904f-24c2031739ff,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:57.330488 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b747494-0218-428a-ae34-53e92692864c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.333791 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4b747494-0218-428a-ae34-53e92692864c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/subnets/13b9dd73-653a-474d-904f-24c2031739ff HTTP/1.1" status: 204 len: 168 time: 0.2692835 Mar 24 02:20:57.336950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34766) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:57.339353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-471515d7-b57c-47e1-ac05-5ae4d2ed81e9 None None] Network 8ee3ba97-1980-4303-b77a-6f5ad4d46166 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:20:57.367695 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:20:56Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:57.393862 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] Checking router: f1e1a820-21ac-4c51-979d-f4b8742581f3 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:20:57.402643 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] Routers {'f1e1a820-21ac-4c51-979d-f4b8742581f3'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:20:57.405905 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:20:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['f1e1a820-21ac-4c51-979d-f4b8742581f3'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:57.443066 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6455a345-b149-454d-929c-17ac23b3e067 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.449599 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (f1e1a820-21ac-4c51-979d-f4b8742581f3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.520647 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b0e6de1-f3c0-43ba-ac7f-b1928f67f54e None None] DHCP port deletion for 8ee3ba97-1980-4303-b77a-6f5ad4d46166 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:20:57.571292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8b0e6de1-f3c0-43ba-ac7f-b1928f67f54e None None] Deleting port 59088ef0-7a68-43c1-86d4-bdbac19ceffd {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:20:57.571764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8b0e6de1-f3c0-43ba-ac7f-b1928f67f54e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.572190 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (f1e1a820-21ac-4c51-979d-f4b8742581f3), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.614663 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] Set router f1e1a820-21ac-4c51-979d-f4b8742581f3 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:20:57.632829 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port d14f8276-0a69-42c3-b78f-f19b41ffbc7b {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:20:57.633215 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.636501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8b0e6de1-f3c0-43ba-ac7f-b1928f67f54e None None] For port 59088ef0-7a68-43c1-86d4-bdbac19ceffd, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=59088ef0-7a68-43c1-86d4-bdbac19ceffd,segment=NetworkSegment(0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30),segment_id=0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:20:57.636892 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8b0e6de1-f3c0-43ba-ac7f-b1928f67f54e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.653513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8b0e6de1-f3c0-43ba-ac7f-b1928f67f54e None None] Calling delete_port for 59088ef0-7a68-43c1-86d4-bdbac19ceffd owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:20:57.716549 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port d14f8276-0a69-42c3-b78f-f19b41ffbc7b, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d14f8276-0a69-42c3-b78f-f19b41ffbc7b,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:20:57.717235 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.730060 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for d14f8276-0a69-42c3-b78f-f19b41ffbc7b owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:20:57.732522 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8b0e6de1-f3c0-43ba-ac7f-b1928f67f54e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (59088ef0-7a68-43c1-86d4-bdbac19ceffd), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:57.758695 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b0e6de1-f3c0-43ba-ac7f-b1928f67f54e None None] Pushing event deleted for resources: {'Port': ['ID=59088ef0-7a68-43c1-86d4-bdbac19ceffd,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:57.764411 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b0e6de1-f3c0-43ba-ac7f-b1928f67f54e None None] No DVR routers for this DVR port 59088ef0-7a68-43c1-86d4-bdbac19ceffd on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:20:57.800226 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:20:56Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:57.830497 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f6e14b2-3fb4-44bf-9dbc-da5773710064 None None] The sync data for ids ['f1e1a820-21ac-4c51-979d-f4b8742581f3'] in dv-neutron-834874-3-hyperv is: [{'id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'name': 'tempest-TestNetworkBasicOps-router-1424413556', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75'}], 'enable_snat': True}, 'gw_port_id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:08Z', 'updated_at': '2022-03-24T02:20:56Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd14f8276-0a69-42c3-b78f-f19b41ffbc7b', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:38:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e1a820-21ac-4c51-979d-f4b8742581f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1265, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:09Z', 'updated_at': '2022-03-24T02:19:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:20:58.208179 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d14f8276-0a69-42c3-b78f-f19b41ffbc7b), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.237333 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=d14f8276-0a69-42c3-b78f-f19b41ffbc7b,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:58.298536 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (f1e1a820-21ac-4c51-979d-f4b8742581f3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.389996 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (f1e1a820-21ac-4c51-979d-f4b8742581f3), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.392111 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (f1e1a820-21ac-4c51-979d-f4b8742581f3), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.433359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (f1e1a820-21ac-4c51-979d-f4b8742581f3), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.434090 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Fanout notify agent at l3_agent the message router_deleted on router f1e1a820-21ac-4c51-979d-f4b8742581f3 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:20:58.440494 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.441592 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ef092cd0-abb6-434c-996e-0d698614c828 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/routers/f1e1a820-21ac-4c51-979d-f4b8742581f3 HTTP/1.1" status: 204 len: 168 time: 1.1035326 Mar 24 02:20:58.445055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34768) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:58.527070 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (8ee3ba97-1980-4303-b77a-6f5ad4d46166), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.610066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (8ee3ba97-1980-4303-b77a-6f5ad4d46166), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.633657 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8ee3ba97-1980-4303-b77a-6f5ad4d46166']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:58.642572 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:58.642864 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:20:58.652427 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.665245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.671260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Releasing vlan 106 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:20:58.671705 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (0aa07e2b-ffd3-4c78-9dd9-31d81bae8a30), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:20:58.674497 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:20:58.730107 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (8ee3ba97-1980-4303-b77a-6f5ad4d46166), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.736656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.739765 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/networks/8ee3ba97-1980-4303-b77a-6f5ad4d46166 HTTP/1.1" status: 204 len: 168 time: 0.2937632 Mar 24 02:20:58.750815 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34770) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:58.755548 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'network': {'name': 'tempest-network-smoke--1937139351', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'port_security_enabled': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:20:58.760363 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ad5f91-09d6-4417-a012-5947d40e05cc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Network': ['ID=8ee3ba97-1980-4303-b77a-6f5ad4d46166,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:58.777155 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:20:58.780508 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.803466 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 134} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:20:58.812550 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (098f9bd1-066a-47cf-bed4-2b3bea91de3b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.812929 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Added segment 098f9bd1-066a-47cf-bed4-2b3bea91de3b of type vlan for network ba0c6650-a1cc-4c46-b400-5645003e471e Mar 24 02:20:58.852288 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (ba0c6650-a1cc-4c46-b400-5645003e471e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.881544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (ba0c6650-a1cc-4c46-b400-5645003e471e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.886855 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:20:58.887593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.910819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34772) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:20:58.911295 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1593015 Mar 24 02:20:58.916108 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'admin_state_up': True, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:20:58.934778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 59088ef0-7a68-43c1-86d4-bdbac19ceffd no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:20:58.944728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (85f24485-6395-4873-a689-4b065205351e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.945905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (85f24485-6395-4873-a689-4b065205351e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:58.959295 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 59088ef0-7a68-43c1-86d4-bdbac19ceffd {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:20:58.959635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 59088ef0-7a68-43c1-86d4-bdbac19ceffd not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:20:58.960297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d14f8276-0a69-42c3-b78f-f19b41ffbc7b no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:20:58.972526 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76ebb6be-b4d5-48fb-b3d7-6c5b7cbe0c99 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Network': ['ID=ba0c6650-a1cc-4c46-b400-5645003e471e,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:58.979686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d14f8276-0a69-42c3-b78f-f19b41ffbc7b {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:20:58.980239 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d14f8276-0a69-42c3-b78f-f19b41ffbc7b not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:20:58.980545 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3569980-3835-437c-aba6-4620efe7ee98 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:20:59.000663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network ba0c6650-a1cc-4c46-b400-5645003e471e details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:20:59.002275 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d3569980-3835-437c-aba6-4620efe7ee98 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:20:59.002639 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d3569980-3835-437c-aba6-4620efe7ee98 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:20:59.004609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (85f24485-6395-4873-a689-4b065205351e), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:59.149006 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (85f24485-6395-4873-a689-4b065205351e), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:59.340163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (85f24485-6395-4873-a689-4b065205351e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:59.358248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:59.457498 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.165 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/cb077203-15df-44dd-a433-82ffb1cd58cb) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:20:59.565353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:59.599724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:20:59.634527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:20:59.637214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:20:59.640643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:20:59.666483 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=cb077203-15df-44dd-a433-82ffb1cd58cb,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:20:59.679074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.679420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.679767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.680102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.680431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.680758 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.681080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.681398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.681720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.682037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.682357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.682708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.683027 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.683340 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.683659 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:20:59.902763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (85f24485-6395-4873-a689-4b065205351e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:00.096219 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (85f24485-6395-4873-a689-4b065205351e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:00.223130 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 85f24485-6395-4873-a689-4b065205351e is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:21:00.497987 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2af5e14b-57ce-4602-bd71-98ac1265f2f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:00.654857 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:21:00.663771 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Sync routers for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:21:00.673093 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:21:00.673710 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:21:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:00.674087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:00.678269 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2c06d1cb-fb5a-40a8-82d8-298b577eda00 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 1.7628090 Mar 24 02:21:00.678529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34774) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:00.779925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:21:00.802153 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0ea068e6-7b79-4b9b-b4ea-d7cc96ff8664 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=6c0b7eea99a4423dac22912b1fa60ca2&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1225293 Mar 24 02:21:00.804775 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34778) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:00.978946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3761cabe-1ee3-4914-95d7-874239cc57c8 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:00.980453 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-3761cabe-1ee3-4914-95d7-874239cc57c8 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1747828 Mar 24 02:21:00.983272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34780) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:01.017981 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-75bff7f4-3b12-4686-82cc-b573a3c393eb tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0334778 Mar 24 02:21:01.020309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34782) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:01.025167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-65377600', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:01.032618 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.107660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:20:59Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:20:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:01.118563 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:21:01.120650 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.136663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Checking router: 85f24485-6395-4873-a689-4b065205351e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:21:01.137014 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Updating router 85f24485-6395-4873-a689-4b065205351e port cb077203-15df-44dd-a433-82ffb1cd58cb binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:21:01.169481 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.308961 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (28885c06-3de2-448e-bb1e-bc557d6d6307), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.368998 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Subnet': ['ID=28885c06-3de2-448e-bb1e-bc557d6d6307,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:01.379215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Checking segment: {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:21:01.379596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network hostable DHCP agents. Network: ba0c6650-a1cc-4c46-b400-5645003e471e, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:21:01.400889 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network ba0c6650-a1cc-4c46-b400-5645003e471e is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:21:01.413528 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, ba0c6650-a1cc-4c46-b400-5645003e471e) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:21:01.418354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:01.419737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.422035 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11d8a121-0a11-4e18-ba93-449db05afb58 None None] Network ba0c6650-a1cc-4c46-b400-5645003e471e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:21:01.444718 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1485ad21-1383-47f6-ab4f-1b04afc05791 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.4233577 Mar 24 02:21:01.447526 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34784) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:01.475183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Publish callbacks [] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.484404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.557433 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Attempting to bind port cb077203-15df-44dd-a433-82ffb1cd58cb on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:21:01.558168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Attempting to bind port cb077203-15df-44dd-a433-82ffb1cd58cb by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:21:01.558168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Attempting to bind port cb077203-15df-44dd-a433-82ffb1cd58cb on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:21:01.578660 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e93cc32-a8a1-4257-b8fd-1dcfd25e3a08 None None] Pushing event updated for resources: {'Port': ['ID=cb077203-15df-44dd-a433-82ffb1cd58cb,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:01.581779 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 20, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:21:01.582157 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:21:01.582579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.582969 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:21:01.583449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Bound port: cb077203-15df-44dd-a433-82ffb1cd58cb, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:21:01.583864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.606718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-ba0c6650-a1cc-4c46-b400-5645003e471e', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:21:01.607992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.698332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] For port cb077203-15df-44dd-a433-82ffb1cd58cb, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:21:01.720586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] For port cb077203-15df-44dd-a433-82ffb1cd58cb, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=cb077203-15df-44dd-a433-82ffb1cd58cb,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:21:01.727859 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:01.830083 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Allocated IP 172.20.0.2 (ba0c6650-a1cc-4c46-b400-5645003e471e/28885c06-3de2-448e-bb1e-bc557d6d6307/57c7ac70-c2d9-4bf6-826d-5c828d830eff) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:21:01.836018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:21:01.836657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:21:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:01.839479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e93cc32-a8a1-4257-b8fd-1dcfd25e3a08 None None] Pushing event updated for resources: {'Port': ['ID=cb077203-15df-44dd-a433-82ffb1cd58cb,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:01.923887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.009438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:21:02.170598 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Publish callbacks [] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.178453 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.245631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Network ba0c6650-a1cc-4c46-b400-5645003e471e is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:21:02.253390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.1 (ba0c6650-a1cc-4c46-b400-5645003e471e/28885c06-3de2-448e-bb1e-bc557d6d6307/3e579ff6-609b-489b-a16a-1a3c8734fb9e) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:21:02.254848 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:21:02.257689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Pushing event updated for resources: {'Port': ['ID=57c7ac70-c2d9-4bf6-826d-5c828d830eff,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:02.261049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:21:02.331866 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:20:59Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:02.336360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Attempting to bind port 57c7ac70-c2d9-4bf6-826d-5c828d830eff on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:21:02.336731 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Attempting to bind port 57c7ac70-c2d9-4bf6-826d-5c828d830eff by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:21:02.337127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Attempting to bind port 57c7ac70-c2d9-4bf6-826d-5c828d830eff on network ba0c6650-a1cc-4c46-b400-5645003e471e {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:21:02.364362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0717d85-78c5-4a93-82a5-a8c454f72b2d None None] The sync data for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv is: [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:20:59Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:21:02.366964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 20, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:21:02.367342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Checking segment: {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:21:02.367746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.368131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Bound using segment: {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:21:02.368604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Bound port: 57c7ac70-c2d9-4bf6-826d-5c828d830eff, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:21:02.368985 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.374199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.418281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.435331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.452147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] For port 57c7ac70-c2d9-4bf6-826d-5c828d830eff, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:21:02.455604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] For port 57c7ac70-c2d9-4bf6-826d-5c828d830eff, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=57c7ac70-c2d9-4bf6-826d-5c828d830eff,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:21:02.458734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network ba0c6650-a1cc-4c46-b400-5645003e471e is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:21:02.470696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.471005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:21:02.473736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:21:02.518801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=3e579ff6-609b-489b-a16a-1a3c8734fb9e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:02.530840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ff7e91d-2bb7-4847-a53e-8f3111a60fd0 None None] Pushing event updated for resources: {'Port': ['ID=57c7ac70-c2d9-4bf6-826d-5c828d830eff,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:02.542692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (85f24485-6395-4873-a689-4b065205351e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:02.842268 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:03.153724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:03.158631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:03.241277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (85f24485-6395-4873-a689-4b065205351e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:03.247450 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=3e579ff6-609b-489b-a16a-1a3c8734fb9e,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:03.354032 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network ba0c6650-a1cc-4c46-b400-5645003e471e is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:21:03.355527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:21:03.471712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 85f24485-6395-4873-a689-4b065205351e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:21:03.586705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:21:03.587831 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-310d2ae7-c8d0-4a2a-be07-597cb02d7b93 None None] Network ba0c6650-a1cc-4c46-b400-5645003e471e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:21:03.594634 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34786) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:03.595112 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0315e45e-8b54-49e9-90ff-7025c6d3266a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/85f24485-6395-4873-a689-4b065205351e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1462047 Mar 24 02:21:03.668765 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-039a6c08-044f-4d4e-94f3-331000e9f854 None None] Provisioning complete for port 57c7ac70-c2d9-4bf6-826d-5c828d830eff triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:03.669136 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-039a6c08-044f-4d4e-94f3-331000e9f854 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:03.696844 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bee53e86-0676-4b15-b971-b76a60201926 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.697325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bee53e86-0676-4b15-b971-b76a60201926 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.697798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bee53e86-0676-4b15-b971-b76a60201926 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.698254 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bee53e86-0676-4b15-b971-b76a60201926 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.698747 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bee53e86-0676-4b15-b971-b76a60201926 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.699203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bee53e86-0676-4b15-b971-b76a60201926 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.702806 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bee53e86-0676-4b15-b971-b76a60201926 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4284 time: 0.1063774 Mar 24 02:21:03.703955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34788) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:03.739195 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:03.795168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-039a6c08-044f-4d4e-94f3-331000e9f854 None None] Current status of the port 57c7ac70-c2d9-4bf6-826d-5c828d830eff is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:03.795785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-039a6c08-044f-4d4e-94f3-331000e9f854 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:03.803258 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6e7af6f-7b50-424b-af32-2d579cf9eaf5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.803827 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6e7af6f-7b50-424b-af32-2d579cf9eaf5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.804727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6e7af6f-7b50-424b-af32-2d579cf9eaf5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.805362 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6e7af6f-7b50-424b-af32-2d579cf9eaf5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.806014 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6e7af6f-7b50-424b-af32-2d579cf9eaf5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.806908 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6e7af6f-7b50-424b-af32-2d579cf9eaf5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:03.808588 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f6e7af6f-7b50-424b-af32-2d579cf9eaf5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4002 time: 0.1036863 Mar 24 02:21:03.811616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34790) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:03.838602 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-039a6c08-044f-4d4e-94f3-331000e9f854 None None] For port 57c7ac70-c2d9-4bf6-826d-5c828d830eff, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=57c7ac70-c2d9-4bf6-826d-5c828d830eff,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:21:03.845209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-039a6c08-044f-4d4e-94f3-331000e9f854 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:03.909643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-039a6c08-044f-4d4e-94f3-331000e9f854 None None] Pushing event updated for resources: {'Port': ['ID=57c7ac70-c2d9-4bf6-826d-5c828d830eff,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:04.070223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-faca044b-7933-44ec-b162-9d165e63e07f None None] Provisioning complete for port 3e579ff6-609b-489b-a16a-1a3c8734fb9e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:04.070683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-faca044b-7933-44ec-b162-9d165e63e07f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.085305 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Sync routers for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:21:04.099360 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:21:04.100851 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:21:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:04.105078 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bf417ee9-2ab4-41e0-9bbe-07eea65c69d5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3047 time: 0.2923365 Mar 24 02:21:04.227283 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:21:04.291140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-faca044b-7933-44ec-b162-9d165e63e07f None None] Port 3e579ff6-609b-489b-a16a-1a3c8734fb9e cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:21:04.303371 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-faca044b-7933-44ec-b162-9d165e63e07f None None] Provisioning complete for port 57c7ac70-c2d9-4bf6-826d-5c828d830eff triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:04.304085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-faca044b-7933-44ec-b162-9d165e63e07f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.392747 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-faca044b-7933-44ec-b162-9d165e63e07f None None] Current status of the port 57c7ac70-c2d9-4bf6-826d-5c828d830eff is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:04.416192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34794) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:04.420941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-57197053-d3fa-49b5-9bbf-e05ee4364dad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1003475705', 'description': 'tempest-secgroup-smoke-1003475705 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:04.443070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-57197053-d3fa-49b5-9bbf-e05ee4364dad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.453187 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:03Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:04.479163 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Checking router: 85f24485-6395-4873-a689-4b065205351e for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:21:04.479514 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Updating router 85f24485-6395-4873-a689-4b065205351e port 3e579ff6-609b-489b-a16a-1a3c8734fb9e binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:21:04.506925 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.509590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-57197053-d3fa-49b5-9bbf-e05ee4364dad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (df6fde4a-896e-4702-a547-6b7e0aaa7628), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.513992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-57197053-d3fa-49b5-9bbf-e05ee4364dad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (df6fde4a-896e-4702-a547-6b7e0aaa7628), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.514648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-fddf77b7-3053-41d0-8ff6-ec476aa7a750 None None] Provisioning complete for port 3e579ff6-609b-489b-a16a-1a3c8734fb9e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:04.515045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fddf77b7-3053-41d0-8ff6-ec476aa7a750 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.550757 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-57197053-d3fa-49b5-9bbf-e05ee4364dad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.556054 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-57197053-d3fa-49b5-9bbf-e05ee4364dad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1352069 Mar 24 02:21:04.556243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-fddf77b7-3053-41d0-8ff6-ec476aa7a750 None None] Port 3e579ff6-609b-489b-a16a-1a3c8734fb9e cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:21:04.556873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34796) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:04.561861 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-88ac6f9f-b10b-4297-9fe2-29059106e13d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'df6fde4a-896e-4702-a547-6b7e0aaa7628', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:04.562041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57197053-d3fa-49b5-9bbf-e05ee4364dad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=df6fde4a-896e-4702-a547-6b7e0aaa7628,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:04.593679 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-88ac6f9f-b10b-4297-9fe2-29059106e13d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (86bb5049-9ddb-4d0e-b355-08500e025a3e), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.666915 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-88ac6f9f-b10b-4297-9fe2-29059106e13d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (86bb5049-9ddb-4d0e-b355-08500e025a3e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.672417 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-88ac6f9f-b10b-4297-9fe2-29059106e13d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (86bb5049-9ddb-4d0e-b355-08500e025a3e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.690839 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ac6f9f-b10b-4297-9fe2-29059106e13d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=86bb5049-9ddb-4d0e-b355-08500e025a3e,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:04.699903 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-88ac6f9f-b10b-4297-9fe2-29059106e13d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.704367 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-88ac6f9f-b10b-4297-9fe2-29059106e13d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1439533 Mar 24 02:21:04.705158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34798) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:04.710164 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a04789ce-d99e-41b9-8ec1-bd3d1dddc8eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'df6fde4a-896e-4702-a547-6b7e0aaa7628', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:04.722039 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device cb077203-15df-44dd-a433-82ffb1cd58cb up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:21:04.743658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a04789ce-d99e-41b9-8ec1-bd3d1dddc8eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (08b01a38-1752-4833-9584-82d033a67bd8), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.774784 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port cb077203-15df-44dd-a433-82ffb1cd58cb triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:04.775180 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.801312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a04789ce-d99e-41b9-8ec1-bd3d1dddc8eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (08b01a38-1752-4833-9584-82d033a67bd8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.805423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a04789ce-d99e-41b9-8ec1-bd3d1dddc8eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (08b01a38-1752-4833-9584-82d033a67bd8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.815875 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Publish callbacks [] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.824188 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.824481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a04789ce-d99e-41b9-8ec1-bd3d1dddc8eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=08b01a38-1752-4833-9584-82d033a67bd8,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:04.832357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a04789ce-d99e-41b9-8ec1-bd3d1dddc8eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.836638 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a04789ce-d99e-41b9-8ec1-bd3d1dddc8eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1277635 Mar 24 02:21:04.836967 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34800) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:04.842474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3445c0a9-618a-4724-970f-1ef14ec958c1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'df6fde4a-896e-4702-a547-6b7e0aaa7628', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:04.863092 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port cb077203-15df-44dd-a433-82ffb1cd58cb is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:04.863541 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.868139 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Pushing event updated for resources: {'Port': ['ID=3e579ff6-609b-489b-a16a-1a3c8734fb9e,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:04.872153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3445c0a9-618a-4724-970f-1ef14ec958c1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (03cb8994-665a-428b-9dee-3d05a861f59e), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.875456 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.875805 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.876163 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.876513 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.876839 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.877493 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.877493 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.877794 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.878128 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.878457 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.878828 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.879143 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.879463 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.879782 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.880097 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:04.894070 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port cb077203-15df-44dd-a433-82ffb1cd58cb, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=cb077203-15df-44dd-a433-82ffb1cd58cb,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:21:04.899898 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.900771 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 57c7ac70-c2d9-4bf6-826d-5c828d830eff up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:21:04.955482 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Attempting to bind port 3e579ff6-609b-489b-a16a-1a3c8734fb9e on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:21:04.955847 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Attempting to bind port 3e579ff6-609b-489b-a16a-1a3c8734fb9e by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:21:04.956424 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Attempting to bind port 3e579ff6-609b-489b-a16a-1a3c8734fb9e on network ba0c6650-a1cc-4c46-b400-5645003e471e {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:21:04.961365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3445c0a9-618a-4724-970f-1ef14ec958c1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (03cb8994-665a-428b-9dee-3d05a861f59e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.962399 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 21, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:21:04.962818 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Checking segment: {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:21:04.963205 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.963762 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Bound using segment: {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:21:04.964439 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Bound port: 3e579ff6-609b-489b-a16a-1a3c8734fb9e, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:21:04.964790 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.969845 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3445c0a9-618a-4724-970f-1ef14ec958c1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (03cb8994-665a-428b-9dee-3d05a861f59e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:04.993240 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3445c0a9-618a-4724-970f-1ef14ec958c1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=03cb8994-665a-428b-9dee-3d05a861f59e,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:05.004884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=cb077203-15df-44dd-a433-82ffb1cd58cb,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:05.018877 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 57c7ac70-c2d9-4bf6-826d-5c828d830eff triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:05.019228 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.022899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3445c0a9-618a-4724-970f-1ef14ec958c1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.027612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34802) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:05.028283 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3445c0a9-618a-4724-970f-1ef14ec958c1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1901448 Mar 24 02:21:05.034822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-0851e818-23b4-4b9b-b7e5-639efd603ccd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'df6fde4a-896e-4702-a547-6b7e0aaa7628', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:05.040045 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] For port 3e579ff6-609b-489b-a16a-1a3c8734fb9e, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:21:05.044818 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] For port 3e579ff6-609b-489b-a16a-1a3c8734fb9e, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3e579ff6-609b-489b-a16a-1a3c8734fb9e,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:21:05.053785 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.071713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0851e818-23b4-4b9b-b7e5-639efd603ccd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (8e5f4d88-f29b-419b-96ee-ba8054678e96), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.101663 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:21:05.102289 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:21:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:05.111600 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 57c7ac70-c2d9-4bf6-826d-5c828d830eff is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:05.149366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0851e818-23b4-4b9b-b7e5-639efd603ccd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (8e5f4d88-f29b-419b-96ee-ba8054678e96), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.154123 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0851e818-23b4-4b9b-b7e5-639efd603ccd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (8e5f4d88-f29b-419b-96ee-ba8054678e96), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.176864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0851e818-23b4-4b9b-b7e5-639efd603ccd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e5f4d88-f29b-419b-96ee-ba8054678e96,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:05.189201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0851e818-23b4-4b9b-b7e5-639efd603ccd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.189527 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3df20cd-f364-4645-b968-c211b230b54b None None] Pushing event updated for resources: {'Port': ['ID=3e579ff6-609b-489b-a16a-1a3c8734fb9e,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:05.190389 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0851e818-23b4-4b9b-b7e5-639efd603ccd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1611652 Mar 24 02:21:05.193419 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34804) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:05.198129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Provisioning complete for port 3e579ff6-609b-489b-a16a-1a3c8734fb9e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:05.198529 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.198978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5d9cbf18-16e8-4259-bc7f-ac44c8d6598e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'df6fde4a-896e-4702-a547-6b7e0aaa7628', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:05.224302 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-5d9cbf18-16e8-4259-bc7f-ac44c8d6598e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:21:05.231309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d9cbf18-16e8-4259-bc7f-ac44c8d6598e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (a62a8db8-673c-47ab-b8bd-a78a0e95820e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.236909 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:21:05.296342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Current status of the port 3e579ff6-609b-489b-a16a-1a3c8734fb9e is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:05.297109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.301212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d9cbf18-16e8-4259-bc7f-ac44c8d6598e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (a62a8db8-673c-47ab-b8bd-a78a0e95820e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.306384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d9cbf18-16e8-4259-bc7f-ac44c8d6598e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (a62a8db8-673c-47ab-b8bd-a78a0e95820e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.331767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d9cbf18-16e8-4259-bc7f-ac44c8d6598e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a62a8db8-673c-47ab-b8bd-a78a0e95820e,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:05.341572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d9cbf18-16e8-4259-bc7f-ac44c8d6598e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.345369 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5d9cbf18-16e8-4259-bc7f-ac44c8d6598e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1486053 Mar 24 02:21:05.346037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34806) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:05.351056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-af394b16-7905-4833-b5ce-a1539700153e None None] For port 3e579ff6-609b-489b-a16a-1a3c8734fb9e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3e579ff6-609b-489b-a16a-1a3c8734fb9e,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:21:05.352184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1f3666ec-edf4-428b-b3e6-0efa263a421e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'df6fde4a-896e-4702-a547-6b7e0aaa7628', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:05.358274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.381713 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-1f3666ec-edf4-428b-b3e6-0efa263a421e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:21:05.387330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1f3666ec-edf4-428b-b3e6-0efa263a421e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (e331eac7-3948-457b-b61d-7b9d57d817f3), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.423112 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Pushing event updated for resources: {'Port': ['ID=3e579ff6-609b-489b-a16a-1a3c8734fb9e,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:05.436435 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.436933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.437381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.437833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.438260 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.438754 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.439187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.439617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.440047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.440476 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.440908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.441337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.442006 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.442436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.442897 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af394b16-7905-4833-b5ce-a1539700153e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:21:05.473282 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:05.483938 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-461ce2c3-d24a-47a4-8258-39b20485dca1 None None] Provisioning complete for port 3e579ff6-609b-489b-a16a-1a3c8734fb9e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:05.484579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-461ce2c3-d24a-47a4-8258-39b20485dca1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.491301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1f3666ec-edf4-428b-b3e6-0efa263a421e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (e331eac7-3948-457b-b61d-7b9d57d817f3), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.496487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1f3666ec-edf4-428b-b3e6-0efa263a421e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (e331eac7-3948-457b-b61d-7b9d57d817f3), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.503314 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e74af3f-fb9c-4fd1-be56-fe34d0cdddaa None None] The sync data for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv is: [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:21:05.515560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3666ec-edf4-428b-b3e6-0efa263a421e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e331eac7-3948-457b-b61d-7b9d57d817f3,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:05.524321 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1f3666ec-edf4-428b-b3e6-0efa263a421e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:05.525615 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1f3666ec-edf4-428b-b3e6-0efa263a421e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1785142 Mar 24 02:21:05.600458 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-461ce2c3-d24a-47a4-8258-39b20485dca1 None None] Current status of the port 3e579ff6-609b-489b-a16a-1a3c8734fb9e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:05.716680 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7c4f9203-3558-4073-b11b-a1985f2c4464 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1003475705&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.0561182 Mar 24 02:21:05.832805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-f20752fb-00b7-4da6-99e8-18c1c084ceb8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:05.834356 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-f20752fb-00b7-4da6-99e8-18c1c084ceb8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 797 time: 0.1108589 Mar 24 02:21:05.849134 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-0fb6faa0-064b-4512-bd94-800e8d2032f3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/quotas/6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 375 time: 0.0093184 Mar 24 02:21:05.926928 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-0ca1fedc-5f31-4420-a6b8-54c0ed9d5144 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0719776 Mar 24 02:21:06.028863 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-f0df0773-f822-49d4-998e-ed400f203c5b service neutron] 10.222.0.20 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906527 Mar 24 02:21:06.121012 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-3162ba53-7757-4fe5-8510-15bce47c6f05 service neutron] 10.222.0.20 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860906 Mar 24 02:21:06.285256 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e1d9f294-8bc6-4f3a-8078-a1b34682a101 req-c19984f2-147f-4724-8d75-68325d33f60e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 210 time: 0.0295894 Mar 24 02:21:06.716432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3e579ff6-609b-489b-a16a-1a3c8734fb9e up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:21:06.766064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 3e579ff6-609b-489b-a16a-1a3c8734fb9e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:06.766443 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:06.852113 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 3e579ff6-609b-489b-a16a-1a3c8734fb9e is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:06.853081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device cb077203-15df-44dd-a433-82ffb1cd58cb up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:21:06.907688 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port cb077203-15df-44dd-a433-82ffb1cd58cb triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:06.908065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:06.983361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port cb077203-15df-44dd-a433-82ffb1cd58cb is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:07.552325 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bf9c0f85-609e-41bf-8e58-4955bd14bc23 req-bbfe5fbc-dc3e-4302-92d0-f47601f526f2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 210 time: 0.0308168 Mar 24 02:21:07.597088 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-52839c85-3e59-4415-ba57-49ff97b5a402 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:07.598490 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-52839c85-3e59-4415-ba57-49ff97b5a402 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 797 time: 0.4830401 Mar 24 02:21:07.659912 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-909aadb4-dda4-416b-b7ea-99f9efeb89a3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 380 time: 0.0512235 Mar 24 02:21:07.668279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'device_id': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'admin_state_up': True, 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'security_groups': ['df6fde4a-896e-4702-a547-6b7e0aaa7628']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:07.773367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:21:07.776688 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:07.899457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.4 (ba0c6650-a1cc-4c46-b400-5645003e471e/28885c06-3de2-448e-bb1e-bc557d6d6307/30104b10-829b-4559-afb5-d6df8fca3862) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:21:08.038097 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (30104b10-829b-4559-afb5-d6df8fca3862), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.069886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (30104b10-829b-4559-afb5-d6df8fca3862), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.109126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network ba0c6650-a1cc-4c46-b400-5645003e471e is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:21:08.112129 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:21:08.114609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:21:08.156246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=30104b10-829b-4559-afb5-d6df8fca3862,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:08.178633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:08.179252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.196535 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-949e496b-95e1-4c94-b498-041486bee3a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5316598 Mar 24 02:21:08.208748 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Request body: {'port': {'device_id': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:08.269624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (30104b10-829b-4559-afb5-d6df8fca3862), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.345019 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-009af5f5-eec1-4ae3-bffe-7026a0e61651 None None] Provisioning complete for port 30104b10-829b-4559-afb5-d6df8fca3862 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:08.345648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-009af5f5-eec1-4ae3-bffe-7026a0e61651 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (30104b10-829b-4559-afb5-d6df8fca3862), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.378230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-009af5f5-eec1-4ae3-bffe-7026a0e61651 None None] Port 30104b10-829b-4559-afb5-d6df8fca3862 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:21:08.532626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 30104b10-829b-4559-afb5-d6df8fca3862 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:21:08.540608 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Publish callbacks [] for port (30104b10-829b-4559-afb5-d6df8fca3862), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.552502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Transition to ACTIVE for port object 30104b10-829b-4559-afb5-d6df8fca3862 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:21:08.556065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (30104b10-829b-4559-afb5-d6df8fca3862), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.606883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Pushing event updated for resources: {'Port': ['ID=30104b10-829b-4559-afb5-d6df8fca3862,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:08.712504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Attempting to bind port 30104b10-829b-4559-afb5-d6df8fca3862 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:21:08.712840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Attempting to bind port 30104b10-829b-4559-afb5-d6df8fca3862 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:21:08.713170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Attempting to bind port 30104b10-829b-4559-afb5-d6df8fca3862 on network ba0c6650-a1cc-4c46-b400-5645003e471e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:21:08.720398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Port 30104b10-829b-4559-afb5-d6df8fca3862 on network ba0c6650-a1cc-4c46-b400-5645003e471e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:21:08.720721 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Attempting to bind port 30104b10-829b-4559-afb5-d6df8fca3862 on network ba0c6650-a1cc-4c46-b400-5645003e471e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:21:08.732956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7c6b256-97d8-4939-9e47-847c1adfdef2 req-6954325f-7957-49fd-843e-b604ed9a12e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:08.734480 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d7c6b256-97d8-4939-9e47-847c1adfdef2 req-6954325f-7957-49fd-843e-b604ed9a12e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 943 time: 0.0886292 Mar 24 02:21:08.735737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 20, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:21:08.736078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Checking segment: {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:21:08.736460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Bound using segment: {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:21:08.736901 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Bound port: 30104b10-829b-4559-afb5-d6df8fca3862, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:21:08.737258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (30104b10-829b-4559-afb5-d6df8fca3862), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.826405 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d7c6b256-97d8-4939-9e47-847c1adfdef2 req-4781a2f1-a11d-4edb-ba3f-92e5f9d17b14 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0858214 Mar 24 02:21:08.837128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] For port 30104b10-829b-4559-afb5-d6df8fca3862, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:21:08.840221 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] For port 30104b10-829b-4559-afb5-d6df8fca3862, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=30104b10-829b-4559-afb5-d6df8fca3862,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:21:08.850468 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (30104b10-829b-4559-afb5-d6df8fca3862), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.885367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:08.886049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:08.887546 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] 10.222.0.30 "PUT /v2.0/ports/30104b10-829b-4559-afb5-d6df8fca3862 HTTP/1.1" status: 200 len: 1093 time: 0.6830585 Mar 24 02:21:08.888026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:21:08.890487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46ef0e6b-630c-48a5-98e4-5affba68c412" -d '{"events": [{"name": "network-changed", "server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "tag": "30104b10-829b-4559-afb5-d6df8fca3862"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:21:08.916366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7291d897-b1ed-415a-9c28-8c5931754018 service neutron] Pushing event updated for resources: {'Port': ['ID=30104b10-829b-4559-afb5-d6df8fca3862,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:08.946365 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:21:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34d4ffa9-705c-4019-9f01-00f8927b5226 x-openstack-request-id: req-34d4ffa9-705c-4019-9f01-00f8927b5226 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:21:08.946691 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "tag": "30104b10-829b-4559-afb5-d6df8fca3862", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:21:08.946940 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-34d4ffa9-705c-4019-9f01-00f8927b5226 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:21:08.947352 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-34d4ffa9-705c-4019-9f01-00f8927b5226'] response: {'name': 'network-changed', 'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862', 'status': 'completed', 'code': 200} Mar 24 02:21:08.989292 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7a72b592-fb93-4fb4-a88a-97164367b851 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:08.990964 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-7a72b592-fb93-4fb4-a88a-97164367b851 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 1127 time: 0.0547845 Mar 24 02:21:09.033271 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-f482f6b5-085a-407a-ab2b-6ece08144d5b service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=30104b10-829b-4559-afb5-d6df8fca3862 HTTP/1.1" status: 200 len: 217 time: 0.0359378 Mar 24 02:21:09.084579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-56468c98-6f49-4ac0-bade-545efda011c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:09.086062 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-56468c98-6f49-4ac0-bade-545efda011c2 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 200 len: 833 time: 0.0469437 Mar 24 02:21:09.141551 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-ec373d97-25f8-444c-9542-72c46728eda4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:09.143084 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-ec373d97-25f8-444c-9542-72c46728eda4 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=ba0c6650-a1cc-4c46-b400-5645003e471e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0508757 Mar 24 02:21:09.231929 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-8b6331c5-5b5d-4f50-a2d1-6ac123f1d306 service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820689 Mar 24 02:21:09.325040 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-318f369b-41b7-4eb0-8fe9-e4910b5cef5f req-94408413-3fc4-45d1-b75e-66f90eafa99f service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864415 Mar 24 02:21:09.411935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-ec139993-2c58-4aa4-af70-b8312bd85881 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:09.413425 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-ec139993-2c58-4aa4-af70-b8312bd85881 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 1127 time: 0.0450196 Mar 24 02:21:09.503276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-506da4df-d292-43da-b546-a6aef54f20c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:09.504748 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-506da4df-d292-43da-b546-a6aef54f20c1 service neutron] 10.222.0.30 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 898 time: 0.0843704 Mar 24 02:21:09.548052 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-017ffff3-4cac-4f8f-9479-6a7ab5e63f0e service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=30104b10-829b-4559-afb5-d6df8fca3862 HTTP/1.1" status: 200 len: 217 time: 0.0379477 Mar 24 02:21:09.596199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-a80fa7d9-e486-48d7-81a3-15adf65188d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:09.597540 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-a80fa7d9-e486-48d7-81a3-15adf65188d2 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 200 len: 833 time: 0.0431175 Mar 24 02:21:09.645398 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-f83e6599-5d6d-4aad-b145-a2e8e8f055fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:09.647528 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-f83e6599-5d6d-4aad-b145-a2e8e8f055fa service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=ba0c6650-a1cc-4c46-b400-5645003e471e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0439942 Mar 24 02:21:09.736421 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-b9e5beb2-1f72-408e-b4ad-bda1d8b03f3d service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831463 Mar 24 02:21:09.824382 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46ef0e6b-630c-48a5-98e4-5affba68c412 req-419eaa45-c837-4938-b438-6a0e9fb62a38 service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822504 Mar 24 02:21:09.949071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0613e137-3bbb-40e9-b2a1-ff1dec9e833d req-df72a955-41c7-447e-86dd-1f86dcee3878 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:09.950600 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0613e137-3bbb-40e9-b2a1-ff1dec9e833d req-df72a955-41c7-447e-86dd-1f86dcee3878 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 943 time: 0.0564952 Mar 24 02:21:10.003725 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0613e137-3bbb-40e9-b2a1-ff1dec9e833d req-85875671-9aea-4942-8249-3932cb0a6919 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473912 Mar 24 02:21:11.125591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eb29de7-0861-4396-9df5-79e8e644848e req-c27c561a-8c41-464f-8dd7-fa4edd021561 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:11.127126 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5eb29de7-0861-4396-9df5-79e8e644848e req-c27c561a-8c41-464f-8dd7-fa4edd021561 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 943 time: 0.0520163 Mar 24 02:21:11.176057 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5eb29de7-0861-4396-9df5-79e8e644848e req-cb0b6e05-6fd7-46cc-aecd-a906166c1562 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428312 Mar 24 02:21:12.291658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc68c325-452e-4282-8908-241978866f2d req-d14041b2-0800-4879-ab23-ccef72dd1a5c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:12.293110 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cc68c325-452e-4282-8908-241978866f2d req-d14041b2-0800-4879-ab23-ccef72dd1a5c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 943 time: 0.0514755 Mar 24 02:21:12.343546 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cc68c325-452e-4282-8908-241978866f2d req-7587e058-29ac-4d87-8ae5-7c5961ba9cdc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449977 Mar 24 02:21:13.368785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 30104b10-829b-4559-afb5-d6df8fca3862 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:21:13.465162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406d3d4b-d1df-4a2d-8a80-c6c0cf28395f req-94c9c754-a3de-4f49-804b-0d02f1bbc292 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:13.465874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 30104b10-829b-4559-afb5-d6df8fca3862, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=30104b10-829b-4559-afb5-d6df8fca3862,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:21:13.466571 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-406d3d4b-d1df-4a2d-8a80-c6c0cf28395f req-94c9c754-a3de-4f49-804b-0d02f1bbc292 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 943 time: 0.0586910 Mar 24 02:21:13.477737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '30104b10-829b-4559-afb5-d6df8fca3862', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'port_id': '30104b10-829b-4559-afb5-d6df8fca3862', 'mac_address': 'fa:16:3e:93:c1:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 134, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:21:13.514884 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 30104b10-829b-4559-afb5-d6df8fca3862 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:13.515274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (30104b10-829b-4559-afb5-d6df8fca3862), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:13.515530 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-406d3d4b-d1df-4a2d-8a80-c6c0cf28395f req-1b7fba2c-5fa0-406f-9181-2c43b94a9e52 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432498 Mar 24 02:21:13.528125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 30104b10-829b-4559-afb5-d6df8fca3862 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:21:13.547738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 30104b10-829b-4559-afb5-d6df8fca3862, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=30104b10-829b-4559-afb5-d6df8fca3862,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:21:13.551262 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (30104b10-829b-4559-afb5-d6df8fca3862), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:13.600002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=30104b10-829b-4559-afb5-d6df8fca3862,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:13.885579 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['30104b10-829b-4559-afb5-d6df8fca3862'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:21:14.631583 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f857e931-6b58-42e1-b32e-6e6d832ec8f1 req-19a279a6-9bc3-4a60-b914-6fb34805fa7d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:14.633102 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f857e931-6b58-42e1-b32e-6e6d832ec8f1 req-19a279a6-9bc3-4a60-b914-6fb34805fa7d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 944 time: 0.0524361 Mar 24 02:21:14.681925 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f857e931-6b58-42e1-b32e-6e6d832ec8f1 req-4f9111a6-b14d-46e5-99fd-3f24561e8fcf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424242 Mar 24 02:21:15.021715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:15.399460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 30104b10-829b-4559-afb5-d6df8fca3862 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:21:15.454197 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 30104b10-829b-4559-afb5-d6df8fca3862 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:21:15.457998 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 30104b10-829b-4559-afb5-d6df8fca3862 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:21:15.458373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (30104b10-829b-4559-afb5-d6df8fca3862), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:15.541194 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 30104b10-829b-4559-afb5-d6df8fca3862 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:21:15.541577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (30104b10-829b-4559-afb5-d6df8fca3862), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:15.563353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:21:15.565610 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fdb1c19e-211e-4085-b2d3-fdc52f6075bc" -d '{"events": [{"server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "name": "network-vif-plugged", "status": "completed", "tag": "30104b10-829b-4559-afb5-d6df8fca3862"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:21:15.579584 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 30104b10-829b-4559-afb5-d6df8fca3862, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=30104b10-829b-4559-afb5-d6df8fca3862,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:21:15.585320 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (30104b10-829b-4559-afb5-d6df8fca3862), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:15.608250 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:21:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b2cb4f7-abd5-4880-ad27-4b769d209652 x-openstack-request-id: req-8b2cb4f7-abd5-4880-ad27-4b769d209652 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:21:15.608551 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "name": "network-vif-plugged", "status": "completed", "tag": "30104b10-829b-4559-afb5-d6df8fca3862", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:21:15.608811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-8b2cb4f7-abd5-4880-ad27-4b769d209652 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:21:15.609214 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8b2cb4f7-abd5-4880-ad27-4b769d209652'] response: {'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862', 'code': 200} Mar 24 02:21:15.636903 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=30104b10-829b-4559-afb5-d6df8fca3862,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:15.807501 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0f1ff5-c019-4548-b985-639e52c517c6 req-8ee59cce-c781-4397-8f5f-233f6f820c02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:15.808983 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2a0f1ff5-c019-4548-b985-639e52c517c6 req-8ee59cce-c781-4397-8f5f-233f6f820c02 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 1129 time: 0.0782981 Mar 24 02:21:15.821064 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcd5562-ab74-41fd-ad3e-c11fff3274d0 req-8896429f-f43c-4bb2-9985-5c8f6ed289ab tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:15.822421 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-afcd5562-ab74-41fd-ad3e-c11fff3274d0 req-8896429f-f43c-4bb2-9985-5c8f6ed289ab tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 945 time: 0.0673590 Mar 24 02:21:15.894160 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2a0f1ff5-c019-4548-b985-639e52c517c6 req-71726e34-b0b0-4d5a-b734-6d859bedaaee service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0707877 Mar 24 02:21:15.898350 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-afcd5562-ab74-41fd-ad3e-c11fff3274d0 req-d7d704c3-c734-4135-871f-3ce35a4dee65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0700631 Mar 24 02:21:17.015254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da293ae-2a4b-4877-9cd1-073b201a1a53 req-30514df4-87f7-444c-9a7d-75e169736d26 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:17.016746 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9da293ae-2a4b-4877-9cd1-073b201a1a53 req-30514df4-87f7-444c-9a7d-75e169736d26 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 945 time: 0.0529413 Mar 24 02:21:17.071812 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9da293ae-2a4b-4877-9cd1-073b201a1a53 req-f19ab2b4-cf34-475d-bca0-7446a45bb2f9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489318 Mar 24 02:21:18.187407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20436d53-3fee-47a0-becf-f2958bde5780 req-498a952e-1125-4b05-b3ce-51d38afbea34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:18.188868 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-20436d53-3fee-47a0-becf-f2958bde5780 req-498a952e-1125-4b05-b3ce-51d38afbea34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 945 time: 0.0519741 Mar 24 02:21:18.247102 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-20436d53-3fee-47a0-becf-f2958bde5780 req-d1ef4eea-1f2d-43cf-bd96-5040f65cd17b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523896 Mar 24 02:21:18.362963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9088520-3c5d-4dd6-958b-b50d3780dd0a req-d0759397-b2c0-4677-9c44-7b62ab478ff2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:18.364332 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a9088520-3c5d-4dd6-958b-b50d3780dd0a req-d0759397-b2c0-4677-9c44-7b62ab478ff2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 945 time: 0.0525837 Mar 24 02:21:18.411378 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a9088520-3c5d-4dd6-958b-b50d3780dd0a req-10c3d1dd-ae08-4a63-99dd-c0348dae6249 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416088 Mar 24 02:21:18.432669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34864) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:18.479208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-958391d8-4c0c-4f42-b498-c35ad537e47b tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:18.480703 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-958391d8-4c0c-4f42-b498-c35ad537e47b tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 1124 time: 0.0470428 Mar 24 02:21:18.483431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34866) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:18.487580 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '30104b10-829b-4559-afb5-d6df8fca3862', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address': '172.20.0.4'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:21:18.507669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:18.601886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:18.717653 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.107 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:21:18.814170 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:18.847946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:18.886990 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:21:18.890137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:21:18.893750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:21:18.923132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:18.993828 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:21:19.245188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (adce6263-6007-4ae5-bf2b-b28db2bccb16), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:19.322214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:19.482535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:19.486979 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:19.553709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:21:19.563712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (adce6263-6007-4ae5-bf2b-b28db2bccb16), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:19.667701 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP adce6263-6007-4ae5-bf2b-b28db2bccb16 associated. External IP: 172.26.2.107, port: 30104b10-829b-4559-afb5-d6df8fca3862. Mar 24 02:21:19.872527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 85f24485-6395-4873-a689-4b065205351e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:21:20.246572 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:21:20.256197 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] Sync routers for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:21:20.263380 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:20.265700 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:21:20.266293 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:21:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:20.292286 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-544fba32-4be5-49ec-a430-2c209a730f9d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8078651 Mar 24 02:21:20.292890 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:21:20.295071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34868) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:20.295558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b" -d '{"events": [{"name": "network-changed", "server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "tag": "30104b10-829b-4559-afb5-d6df8fca3862"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:21:20.331067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:21:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb7ecc28-5a64-4a7c-8bbd-2f78a8fdd7fb x-openstack-request-id: req-eb7ecc28-5a64-4a7c-8bbd-2f78a8fdd7fb {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:21:20.331067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "tag": "30104b10-829b-4559-afb5-d6df8fca3862", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:21:20.331330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-eb7ecc28-5a64-4a7c-8bbd-2f78a8fdd7fb {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:21:20.331535 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-eb7ecc28-5a64-4a7c-8bbd-2f78a8fdd7fb'] response: {'name': 'network-changed', 'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862', 'status': 'completed', 'code': 200} Mar 24 02:21:20.361088 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bc8305e4-0ce1-4747-936a-c06553d5e325 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 991 time: 0.0641062 Mar 24 02:21:20.377513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:21:20.399900 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-ec25b887-4106-4da6-a338-bb09d6ad8844 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:20.401440 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-ec25b887-4106-4da6-a338-bb09d6ad8844 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 1129 time: 0.0455244 Mar 24 02:21:20.492163 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-847c5c43-fec0-4ec1-af34-e87b7c626fc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:20.493568 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-847c5c43-fec0-4ec1-af34-e87b7c626fc9 service neutron] 10.222.0.30 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 898 time: 0.0865996 Mar 24 02:21:20.557787 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-9804cd93-9dd5-47f4-8d27-19aefda2840b service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=30104b10-829b-4559-afb5-d6df8fca3862 HTTP/1.1" status: 200 len: 999 time: 0.0579009 Mar 24 02:21:20.597430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'adce6263-6007-4ae5-bf2b-b28db2bccb16', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.107', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '85f24485-6395-4873-a689-4b065205351e', 'port_id': '30104b10-829b-4559-afb5-d6df8fca3862', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1400, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'mac_address': 'fa:16:3e:93:c1:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:21:19Z', 'updated_at': '2022-03-24T02:21:19Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:20.606838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-952f3532-e23c-4939-bdcb-12056e4b4d34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:20.608316 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-952f3532-e23c-4939-bdcb-12056e4b4d34 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 200 len: 833 time: 0.0443435 Mar 24 02:21:20.623787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] Checking router: 85f24485-6395-4873-a689-4b065205351e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:21:20.632140 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:21:20.632748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:21:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:20.659724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-54ba9fe5-5c8e-4290-b9f3-86cf2667b0f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:20.661287 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-54ba9fe5-5c8e-4290-b9f3-86cf2667b0f0 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=ba0c6650-a1cc-4c46-b400-5645003e471e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0466173 Mar 24 02:21:20.739207 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:21:20.748707 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-07dc46fc-ec91-4d51-ac9d-4ac091c1f1cb service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809283 Mar 24 02:21:20.840468 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d14acf50-f0f7-46f8-b5c5-5cf2b8358a0b req-b9a53fdf-22dc-4bb7-8e04-6c3c3889508f service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855458 Mar 24 02:21:20.959729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'adce6263-6007-4ae5-bf2b-b28db2bccb16', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.107', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '85f24485-6395-4873-a689-4b065205351e', 'port_id': '30104b10-829b-4559-afb5-d6df8fca3862', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1400, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'mac_address': 'fa:16:3e:93:c1:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:21:19Z', 'updated_at': '2022-03-24T02:21:19Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:21:20.984970 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49f633e2-5f1f-4289-b927-a31156e1a52a None None] The sync data for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv is: [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'adce6263-6007-4ae5-bf2b-b28db2bccb16', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.107', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '85f24485-6395-4873-a689-4b065205351e', 'port_id': '30104b10-829b-4559-afb5-d6df8fca3862', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1400, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'mac_address': 'fa:16:3e:93:c1:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:21:19Z', 'updated_at': '2022-03-24T02:21:19Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:21:21.168533 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84980452-a64d-4fdd-8208-5b285dff0cd8 None None] New status for floating IP adce6263-6007-4ae5-bf2b-b28db2bccb16: ACTIVE {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:21:21.364836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34872) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:21.427329 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-369672cc-2ea9-41d5-8be4-0a0749766f4f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 991 time: 0.0612588 Mar 24 02:21:22.431204 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34874) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:21:22.493621 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-76a8e61c-51b4-4c9f-a778-4a38e1c72079 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 993 time: 0.0612772 Mar 24 02:21:26.598199 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f309952b-9641-4d05-beb7-741268b274d0 req-150d8ffa-c4bd-4fac-83e6-9c7b2aec1424 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0426941 Mar 24 02:21:26.677666 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f309952b-9641-4d05-beb7-741268b274d0 req-3969a15f-1682-4808-8985-f3d386d85fa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:26.679143 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f309952b-9641-4d05-beb7-741268b274d0 req-3969a15f-1682-4808-8985-f3d386d85fa9 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 1129 time: 0.0422547 Mar 24 02:21:26.792196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f309952b-9641-4d05-beb7-741268b274d0 req-4c2b72fa-43e3-4e80-a720-fa8b7040d585 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:26.793644 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f309952b-9641-4d05-beb7-741268b274d0 req-4c2b72fa-43e3-4e80-a720-fa8b7040d585 service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.0967879 Mar 24 02:21:26.858362 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f309952b-9641-4d05-beb7-741268b274d0 req-e83d525a-5312-4329-b753-961abd9213ce service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5b3ca245-4a38-4e2a-9165-fea0f427a048 HTTP/1.1" status: 200 len: 1001 time: 0.0579481 Mar 24 02:21:26.905154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f309952b-9641-4d05-beb7-741268b274d0 req-a0aa45a8-9fe5-403e-9e35-dca71ca956a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:26.906600 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f309952b-9641-4d05-beb7-741268b274d0 req-a0aa45a8-9fe5-403e-9e35-dca71ca956a8 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0427396 Mar 24 02:21:26.958499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f309952b-9641-4d05-beb7-741268b274d0 req-e43b9097-f258-4d24-9b04-75a74a5b37c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:21:26.959983 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f309952b-9641-4d05-beb7-741268b274d0 req-e43b9097-f258-4d24-9b04-75a74a5b37c4 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0471885 Mar 24 02:21:27.045469 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f309952b-9641-4d05-beb7-741268b274d0 req-ad0dfac3-8cd3-46fb-8cc0-be4e09f197c9 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0793185 Mar 24 02:21:27.147287 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f309952b-9641-4d05-beb7-741268b274d0 req-a58512e9-378d-44be-86d8-255a1753397c service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835917 Mar 24 02:21:27.384657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e07835b0-a7c1-410f-95aa-1ce759dbc1a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:30.502880 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dad2db2e-a3f0-41ac-aa97-5a7fafc1074f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:31.004869 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:32.421175 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:33.691535 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:45.051497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:21:55.993357 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:21:57.386161 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-945d7a31-9619-433d-8827-2063ff152104 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:00.503112 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c8d5c3fe-0c39-4f76-a6b1-03851818263d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:00.861641 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:02.422853 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:03.695424 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:07.380440 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d090522a-9901-4ba9-8109-0e71f3b69cf3 req-e94f3b12-9b95-4a52-ad52-6e8bde83d2fe tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:07.381954 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d090522a-9901-4ba9-8109-0e71f3b69cf3 req-e94f3b12-9b95-4a52-ad52-6e8bde83d2fe tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 945 time: 0.0529032 Mar 24 02:22:07.430361 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d090522a-9901-4ba9-8109-0e71f3b69cf3 req-5f815120-13dc-41f0-b3f0-e9f074b59051 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427985 Mar 24 02:22:08.547265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a119c8c1-8790-4f61-a4d9-c55e7210d846 req-b725de0b-52af-4dc1-a5ad-c7ed997b43c6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:08.548739 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a119c8c1-8790-4f61-a4d9-c55e7210d846 req-b725de0b-52af-4dc1-a5ad-c7ed997b43c6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 945 time: 0.0513029 Mar 24 02:22:08.597292 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a119c8c1-8790-4f61-a4d9-c55e7210d846 req-dd32235f-af5e-4e4a-b61d-d2779f6d13f6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425673 Mar 24 02:22:09.000634 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-d45b89df-2f83-430a-bd16-5d755ff4ad7c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:09.002076 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-d45b89df-2f83-430a-bd16-5d755ff4ad7c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 945 time: 0.0556588 Mar 24 02:22:09.090707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Deleting port 5b3ca245-4a38-4e2a-9165-fea0f427a048 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:22:09.091066 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:09.181117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] For port 5b3ca245-4a38-4e2a-9165-fea0f427a048, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=5b3ca245-4a38-4e2a-9165-fea0f427a048,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:22:09.181477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:09.399067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:09.399430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (b84362c7-d8e0-4ed8-b907-8d4838657519), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:09.399769 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Floating IP b84362c7-d8e0-4ed8-b907-8d4838657519 disassociated. External IP: 172.26.2.201, port: 5b3ca245-4a38-4e2a-9165-fea0f427a048. Mar 24 02:22:09.400105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Calling delete_port for 5b3ca245-4a38-4e2a-9165-fea0f427a048 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:22:09.518939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5b3ca245-4a38-4e2a-9165-fea0f427a048), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:09.550483 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event deleted for resources: {'Port': ['ID=5b3ca245-4a38-4e2a-9165-fea0f427a048,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:09.561142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.561490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.561833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.562167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.562496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.562843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.563171 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.563499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.563820 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.564144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.564464 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.564788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.565107 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.565430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.565747 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:09.699045 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fbfda5ba-e827-440d-a152-57a355944425 req-00cd8fc9-6a9f-4a7f-b637-a8c677d942eb tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0335038 Mar 24 02:22:09.700650 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Router d9d90a22-1adf-4945-a625-094e279f17a1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:22:09.807754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:22:09.818437 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] Sync routers for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:22:09.829231 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:22:09.829766 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:22:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:09.848538 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] No DVR routers for this DVR port 5b3ca245-4a38-4e2a-9165-fea0f427a048 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:22:09.851124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:09.854358 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a8b7541c-1c1f-48e8-b488-a6c79940b31e req-b346f73f-a419-453f-9f26-1613a780a602 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "DELETE /v2.0/ports/5b3ca245-4a38-4e2a-9165-fea0f427a048 HTTP/1.1" status: 204 len: 173 time: 0.8471615 Mar 24 02:22:09.854816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'name': 'network-vif-deleted', 'tag': '5b3ca245-4a38-4e2a-9165-fea0f427a048'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:22:09.857027 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25c19e81-b979-4f5d-bfb6-2cc09de2eb00" -d '{"events": [{"server_uuid": "74e34fdf-6340-4649-ace4-f8648b8309b9", "name": "network-vif-deleted", "tag": "5b3ca245-4a38-4e2a-9165-fea0f427a048"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:22:09.918504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:22:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ccfcc3c6-e470-4244-8e76-84bbdfad960b x-openstack-request-id: req-ccfcc3c6-e470-4244-8e76-84bbdfad960b {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:22:09.918806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "74e34fdf-6340-4649-ace4-f8648b8309b9", "name": "network-vif-deleted", "tag": "5b3ca245-4a38-4e2a-9165-fea0f427a048", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:22:09.919074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-ccfcc3c6-e470-4244-8e76-84bbdfad960b {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:22:09.919472 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ccfcc3c6-e470-4244-8e76-84bbdfad960b'] response: {'server_uuid': '74e34fdf-6340-4649-ace4-f8648b8309b9', 'name': 'network-vif-deleted', 'tag': '5b3ca245-4a38-4e2a-9165-fea0f427a048', 'status': 'completed', 'code': 200} Mar 24 02:22:09.962412 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:22:10.197459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:10.222762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] Checking router: d9d90a22-1adf-4945-a625-094e279f17a1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:22:10.230738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:22:10.231341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:22:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:10.336282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:22:10.529379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:10.559560 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d8cafac-c2ac-437f-824e-14e566d4cf77 None None] The sync data for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv is: [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:22:10.805119 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-14bc22a1-f5ef-4948-9871-9b83165c1df9 req-b3cd7b53-e146-4946-a9d1-dec70fb2fbb4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0286644 Mar 24 02:22:10.813514 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-458f87b0-1df5-4911-a8d1-1b43a68e4d1f None None] New status for floating IP b84362c7-d8e0-4ed8-b907-8d4838657519: DOWN {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:22:11.924056 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-822360c7-3d1a-48dc-a94d-606cbff0740d req-1a2aaa0f-0c0c-4edc-bce5-22ed8a2a5274 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0351355 Mar 24 02:22:13.018805 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a1aa48e5-0b53-4a0f-b03a-0f0f6fc595ed req-d59affe4-c0c5-47ac-9be7-09b440a6c56e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0276299 Mar 24 02:22:13.681397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 5b3ca245-4a38-4e2a-9165-fea0f427a048 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:22:13.701612 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 5b3ca245-4a38-4e2a-9165-fea0f427a048 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:22:13.701946 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 5b3ca245-4a38-4e2a-9165-fea0f427a048 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:22:14.110875 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fbd27f9b-db2b-4e2e-bd26-992da6d33285 req-95c9f0f5-82f7-4281-8964-48dce1b6088b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0270066 Mar 24 02:22:15.044995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:15.208682 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-558577f7-c8d2-4fee-ac27-0d7f4759cf95 req-22ae51aa-fdc2-43e7-81bf-9d87abe6b11f tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0285521 Mar 24 02:22:16.302068 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-da78d17b-f090-4ad7-89bf-7e476c42427a req-6fb8816a-8368-4836-a0d7-a302afad2e22 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0261259 Mar 24 02:22:17.393278 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-157269ea-ed14-467e-aa9b-5ff8090a438b req-485ab7cd-3014-45c7-9b29-5ce59ac5d2cb tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0266500 Mar 24 02:22:18.491175 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51c74c17-f2c2-4789-b93f-c8a7c8edc815 req-f3f53158-5fff-4f21-ab62-3f648dbc23f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=74e34fdf-6340-4649-ace4-f8648b8309b9 HTTP/1.1" status: 200 len: 210 time: 0.0313458 Mar 24 02:22:19.769193 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1b50380a-1580-4f2b-a033-e704fb8e9f29 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-425833467&fields=id&tenant_id=534ec00707834d9cbfb4f670cfeda590 HTTP/1.1" status: 200 len: 267 time: 0.0441272 Mar 24 02:22:19.871879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-d165e8f0-99eb-4b45-9353-bd1e42efec8e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:19.873317 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-d165e8f0-99eb-4b45-9353-bd1e42efec8e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 810 time: 0.0972595 Mar 24 02:22:19.887859 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-201e601f-b196-4891-9e99-6b10f3150267 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/quotas/534ec00707834d9cbfb4f670cfeda590 HTTP/1.1" status: 200 len: 375 time: 0.0093172 Mar 24 02:22:19.945804 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-76dbeacf-1502-41b6-aa19-bccbcab9234c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0531414 Mar 24 02:22:19.961242 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-cb7a24d4-a531-46ac-8490-f4265f86c750 service neutron] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:22:19.962176 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-cb7a24d4-a531-46ac-8490-f4265f86c750 service neutron] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053856 Mar 24 02:22:20.047399 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-4add8b59-8cd9-4bab-8eca-df578d41231a service neutron] 10.222.0.20 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800879 Mar 24 02:22:20.140015 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-81ef79ac-bd8c-4712-b891-0eb53bb93a16 service neutron] 10.222.0.20 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870523 Mar 24 02:22:20.420703 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1c719ca5-9b61-4522-b8d9-b56a393fa1b5 req-b213d8b2-1c8c-42e5-8965-f8fb1a7ca35c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0281601 Mar 24 02:22:21.299309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-3ac5076b-d111-47cd-8f35-4c70bc40b552 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:21.301054 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-3ac5076b-d111-47cd-8f35-4c70bc40b552 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 810 time: 0.1045573 Mar 24 02:22:21.368874 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-88380010-327a-4c66-ba35-6d5bce4cca8c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=534ec00707834d9cbfb4f670cfeda590 HTTP/1.1" status: 200 len: 379 time: 0.0595651 Mar 24 02:22:21.379402 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'port': {'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'admin_state_up': True, 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'security_groups': ['8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:21.523637 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e66e16cb-6535-4727-9e0e-64164ad980ae req-7831a1db-d543-4b29-b4ed-f31685351f3d tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0286787 Mar 24 02:22:21.524354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Made reservation on behalf of 534ec00707834d9cbfb4f670cfeda590 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:22:21.527609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:21.922537 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Allocated IP 172.20.0.11 (1c7b4ca8-c501-4e72-9eba-3ca17999702e/7098e0b3-a3e5-4826-921e-69dc9ba94ef6/42b4c550-82ba-45d7-bc38-e7dbcfff4311) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:22:22.071152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:22.107154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:22.148102 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:22:22.149962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:22:22.157577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:22:22.210121 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'Port': ['ID=42b4c550-82ba-45d7-bc38-e7dbcfff4311,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:22.227875 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:22.228695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:22.251546 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1906b4bd-220e-4d8d-873b-ba5859da5d38 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8760433 Mar 24 02:22:22.263054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Request body: {'port': {'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:22.354291 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:22.483428 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d9f19e17-fdc0-4df3-a838-b6a4b62aa146 None None] Provisioning complete for port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:22:22.484026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d9f19e17-fdc0-4df3-a838-b6a4b62aa146 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:22.522959 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d9f19e17-fdc0-4df3-a838-b6a4b62aa146 None None] Port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:22:22.658561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 42b4c550-82ba-45d7-bc38-e7dbcfff4311 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:22:22.668193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Publish callbacks [] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:22.691516 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebdff775-5a5e-473d-9d3f-2244b1c29974 req-23d3412c-faad-45a2-a076-a1cca2a7e1e6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:22.693254 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ebdff775-5a5e-473d-9d3f-2244b1c29974 req-23d3412c-faad-45a2-a076-a1cca2a7e1e6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 932 time: 0.0948324 Mar 24 02:22:22.694192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Transition to ACTIVE for port object 42b4c550-82ba-45d7-bc38-e7dbcfff4311 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:22:22.698296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:22.786115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Pushing event updated for resources: {'Port': ['ID=42b4c550-82ba-45d7-bc38-e7dbcfff4311,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:22.793639 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ebdff775-5a5e-473d-9d3f-2244b1c29974 req-9b05298d-50c7-4843-a7d9-2764cfd854d5 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0929379 Mar 24 02:22:22.872422 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Attempting to bind port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:22:22.872805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Attempting to bind port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:22:22.873094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Attempting to bind port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:22:22.877984 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:22:22.878307 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Attempting to bind port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:22:22.883409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 22, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:22:22.883802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Checking segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:22:22.884192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Bound using segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:22:22.884654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Bound port: 42b4c550-82ba-45d7-bc38-e7dbcfff4311, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:22:22.885014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:22.956709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] For port 42b4c550-82ba-45d7-bc38-e7dbcfff4311, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:22:22.960233 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] For port 42b4c550-82ba-45d7-bc38-e7dbcfff4311, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:22:22.966191 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:23.003143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.003752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:23.005125 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] 10.222.0.30 "PUT /v2.0/ports/42b4c550-82ba-45d7-bc38-e7dbcfff4311 HTTP/1.1" status: 200 len: 1094 time: 0.7462208 Mar 24 02:22:23.005485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:22:23.007750 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3a5a903-f06b-42f6-b71d-8864177d1e36" -d '{"events": [{"name": "network-changed", "server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:22:23.036723 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34aa50d5-8b74-4aba-a5ad-583b566cfc16 service neutron] Pushing event updated for resources: {'Port': ['ID=42b4c550-82ba-45d7-bc38-e7dbcfff4311,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:23.077983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:22:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-626d7c42-aab7-4592-957e-7302f07039fa x-openstack-request-id: req-626d7c42-aab7-4592-957e-7302f07039fa {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:22:23.078313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:22:23.078605 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-626d7c42-aab7-4592-957e-7302f07039fa {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:22:23.079029 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-626d7c42-aab7-4592-957e-7302f07039fa'] response: {'name': 'network-changed', 'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'status': 'completed', 'code': 200} Mar 24 02:22:23.111460 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34964) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:23.168868 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-266084f8-285f-406b-aac4-09db62c5b6ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.170572 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-266084f8-285f-406b-aac4-09db62c5b6ef service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 1128 time: 0.1192515 Mar 24 02:22:23.214382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e50f7935-3abc-4a4a-9bcb-d473e359d265 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.215259 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e50f7935-3abc-4a4a-9bcb-d473e359d265 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.215901 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e50f7935-3abc-4a4a-9bcb-d473e359d265 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.217881 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e50f7935-3abc-4a4a-9bcb-d473e359d265 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?project_id=6c0b7eea99a4423dac22912b1fa60ca2&network_id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 3102 time: 0.1054354 Mar 24 02:22:23.219727 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-926e934a-6cdd-4fa8-9e61-41f07fc33ff5 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311 HTTP/1.1" status: 200 len: 217 time: 0.0411372 Mar 24 02:22:23.280940 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-a6344cc4-297f-451e-a07b-3ab9a0308cec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.282423 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-a6344cc4-297f-451e-a07b-3ab9a0308cec service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0513270 Mar 24 02:22:23.331691 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-ec14261b-3294-4dc5-bd1b-b45292fb43e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.333215 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-ec14261b-3294-4dc5-bd1b-b45292fb43e3 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0437467 Mar 24 02:22:23.343017 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1c53deca-00ae-4944-86ee-00a29930ae01 service neutron] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:22:23.343935 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-1c53deca-00ae-4944-86ee-00a29930ae01 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048892 Mar 24 02:22:23.432439 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-4a099902-a32f-434d-bf5b-20e12ede2cc5 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822499 Mar 24 02:22:23.524737 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb80105b-4fad-4bc4-bddf-9767140e216d req-e5f4523b-75d9-4db7-9d4b-e8d9cb9d9366 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863111 Mar 24 02:22:23.609736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-12d4fb5f-4999-4208-8c0c-b146e362d03b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.611266 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-12d4fb5f-4999-4208-8c0c-b146e362d03b service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 1128 time: 0.0451663 Mar 24 02:22:23.708670 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-9f38c864-3868-4db2-8389-7a1799de57c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.710156 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-9f38c864-3868-4db2-8389-7a1799de57c5 service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.0894432 Mar 24 02:22:23.750923 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-034ebe23-7e5e-4ba6-9992-c0f310cfc41a service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311 HTTP/1.1" status: 200 len: 217 time: 0.0348001 Mar 24 02:22:23.798046 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-9fd5a2d1-95e6-4cfa-9bfa-35f53a7f3ecf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.799512 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-9fd5a2d1-95e6-4cfa-9bfa-35f53a7f3ecf service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0430796 Mar 24 02:22:23.854287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-6820daeb-2f5c-4471-85c3-342c94a57fdf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.855836 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-6820daeb-2f5c-4471-85c3-342c94a57fdf service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0500882 Mar 24 02:22:23.984496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ed6fa4c-48cf-4968-a625-d77096e58194 req-2c4a1eb9-5f29-4e7c-b4b6-e68a6b5ba68a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:23.985894 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2ed6fa4c-48cf-4968-a625-d77096e58194 req-2c4a1eb9-5f29-4e7c-b4b6-e68a6b5ba68a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.1153581 Mar 24 02:22:23.989446 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-3a1d9e94-23cf-47f8-a0e0-25ab1196ae73 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266384 Mar 24 02:22:24.084380 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2ed6fa4c-48cf-4968-a625-d77096e58194 req-e5bfbd09-5b50-429f-8641-45f8789dfb6d tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0921907 Mar 24 02:22:24.111705 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c3a5a903-f06b-42f6-b71d-8864177d1e36 req-3146b3a6-e447-4de1-86b6-cc8fcd9cd6d6 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1137249 Mar 24 02:22:25.206530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb4a4c2-824f-4c89-825a-e2325873a5be req-6ebb8add-53c2-49f2-a373-19a18e82a21a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:25.208025 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3cb4a4c2-824f-4c89-825a-e2325873a5be req-6ebb8add-53c2-49f2-a373-19a18e82a21a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0545201 Mar 24 02:22:25.260703 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3cb4a4c2-824f-4c89-825a-e2325873a5be req-83259c02-b9f3-477d-b7dd-73a1b48a18fd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470750 Mar 24 02:22:26.048195 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-72c8ef3b-7a50-42a0-bd8d-257f94175819 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0447800 Mar 24 02:22:26.132937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-25193bb7-7c7e-4881-bd37-88679ec2291c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:26.134413 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-25193bb7-7c7e-4881-bd37-88679ec2291c service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 1129 time: 0.0438528 Mar 24 02:22:26.239273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-b6aa5ef5-65a8-4beb-a7fe-77dca78c2e41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:26.240729 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-b6aa5ef5-65a8-4beb-a7fe-77dca78c2e41 service neutron] 10.222.0.30 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 898 time: 0.0879526 Mar 24 02:22:26.307686 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-d46181b0-e62b-4349-8e61-14fe8f18d1be service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=30104b10-829b-4559-afb5-d6df8fca3862 HTTP/1.1" status: 200 len: 1001 time: 0.0603614 Mar 24 02:22:26.389731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-169f7674-60bc-4111-9aeb-0b4109f617b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:26.391195 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-169f7674-60bc-4111-9aeb-0b4109f617b8 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 200 len: 833 time: 0.0769532 Mar 24 02:22:26.412996 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71879b91-0a5f-4136-afb5-5fd2d2859d49 req-2bbb4d0a-4d59-46b3-a987-df8f841dd155 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:26.414409 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-71879b91-0a5f-4136-afb5-5fd2d2859d49 req-2bbb4d0a-4d59-46b3-a987-df8f841dd155 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0739985 Mar 24 02:22:26.483119 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-e70d7a5a-05f7-4877-aa0b-f5155788efdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:26.484616 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-e70d7a5a-05f7-4877-aa0b-f5155788efdc service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=ba0c6650-a1cc-4c46-b400-5645003e471e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0867772 Mar 24 02:22:26.489340 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-71879b91-0a5f-4136-afb5-5fd2d2859d49 req-509395d7-cc68-46b1-aee5-ba8f145babc4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0566063 Mar 24 02:22:26.578120 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-4838b152-6130-4c08-8fdd-0fa0aa2957de service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855713 Mar 24 02:22:26.666322 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82ad5adc-2b88-44c7-b054-ad141ecd93de req-9596c69c-bab4-4d47-87ea-daca5c81147c service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813177 Mar 24 02:22:27.088135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34982) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:27.160944 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3afc1a55-4674-480b-84d9-ade16fec88d1 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:27.163653 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3afc1a55-4674-480b-84d9-ade16fec88d1 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260 HTTP/1.1" status: 200 len: 814 time: 0.0745077 Mar 24 02:22:27.386968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-33ffabb5-22d9-4b06-a291-edd8c971b6a3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:27.611961 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51258124-e018-4d0b-b797-a8729cf35d65 req-2e6a2b51-eab6-4f96-bd91-9c788755b0e2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:27.613595 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51258124-e018-4d0b-b797-a8729cf35d65 req-2e6a2b51-eab6-4f96-bd91-9c788755b0e2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0568786 Mar 24 02:22:27.667806 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51258124-e018-4d0b-b797-a8729cf35d65 req-e1db35fb-e3e9-4fdf-af4c-7d4b70ff05b3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480537 Mar 24 02:22:28.345963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 34990) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:28.351188 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ffb6d15b-2605-4229-909d-29d1568e720f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'port_id': None}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:28.407114 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ffb6d15b-2605-4229-909d-29d1568e720f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (adce6263-6007-4ae5-bf2b-b28db2bccb16), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:28.551125 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ffb6d15b-2605-4229-909d-29d1568e720f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:28.556388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ffb6d15b-2605-4229-909d-29d1568e720f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (adce6263-6007-4ae5-bf2b-b28db2bccb16), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:28.556728 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-ffb6d15b-2605-4229-909d-29d1568e720f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP adce6263-6007-4ae5-bf2b-b28db2bccb16 disassociated. External IP: 172.26.2.107, port: 30104b10-829b-4559-afb5-d6df8fca3862. Mar 24 02:22:28.775068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ffb6d15b-2605-4229-909d-29d1568e720f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 85f24485-6395-4873-a689-4b065205351e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:22:28.795133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffca9f24-002e-4919-84af-c9ac95e28793 req-ad93b113-9c1c-4098-a162-aeffe4341214 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:28.796755 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ffca9f24-002e-4919-84af-c9ac95e28793 req-ad93b113-9c1c-4098-a162-aeffe4341214 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0602350 Mar 24 02:22:28.848275 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ffca9f24-002e-4919-84af-c9ac95e28793 req-99d8196b-f71d-4cb0-8dbc-5d298cb5b961 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454497 Mar 24 02:22:28.891016 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffb6d15b-2605-4229-909d-29d1568e720f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:22:28.896217 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ffb6d15b-2605-4229-909d-29d1568e720f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:28.916639 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] Sync routers for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:22:28.926044 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ffb6d15b-2605-4229-909d-29d1568e720f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 690 time: 0.5789125 Mar 24 02:22:28.926668 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862'}] {{(pid=104036) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:22:28.929196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:22:28.929362 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 34994) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:28.930016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:22:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:28.935706 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d6177697792ca3fff01bbfc58b3e16cb8a22905a2f74e66d9151ebb6b50c8f9c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25" -d '{"events": [{"name": "network-changed", "server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "tag": "30104b10-829b-4559-afb5-d6df8fca3862"}]}' {{(pid=104036) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:22:28.975311 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0d5ad1de-c136-44e1-ace7-1a698ebdc003 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 690 time: 0.0444248 Mar 24 02:22:29.053018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:22:29.098441 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:22:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42b67e32-d2e8-416b-ae90-4b805a0efec0 x-openstack-request-id: req-42b67e32-d2e8-416b-ae90-4b805a0efec0 {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:22:29.098720 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "tag": "30104b10-829b-4559-afb5-d6df8fca3862", "status": "completed", "code": 200}]} {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:22:29.098987 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-42b67e32-d2e8-416b-ae90-4b805a0efec0 {{(pid=104036) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:22:29.099407 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.notifiers.nova [-] Nova event matching ['req-42b67e32-d2e8-416b-ae90-4b805a0efec0'] response: {'name': 'network-changed', 'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862', 'status': 'completed', 'code': 200} Mar 24 02:22:29.173372 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-d381e11a-5820-4f40-b819-f290e3c43640 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:29.175076 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-d381e11a-5820-4f40-b819-f290e3c43640 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 1129 time: 0.0557196 Mar 24 02:22:29.265180 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:29.269936 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-e4d5316e-f68f-4ddc-ad86-fe414f555cae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:29.271638 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-e4d5316e-f68f-4ddc-ad86-fe414f555cae service neutron] 10.222.0.30 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 898 time: 0.0905149 Mar 24 02:22:29.292016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] Checking router: 85f24485-6395-4873-a689-4b065205351e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:22:29.300373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:22:29.300986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:22:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:29.316857 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-e4f90e81-caca-42b7-a512-bab4e963f9b3 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=30104b10-829b-4559-afb5-d6df8fca3862 HTTP/1.1" status: 200 len: 217 time: 0.0388463 Mar 24 02:22:29.368962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-7f2999f9-7e70-4eea-9eca-81f677fa5df4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:29.370402 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-7f2999f9-7e70-4eea-9eca-81f677fa5df4 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 200 len: 833 time: 0.0474641 Mar 24 02:22:29.424113 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-9e2d102b-8055-4388-82c7-ee3bf9c23408 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:29.425811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:22:29.425976 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-9e2d102b-8055-4388-82c7-ee3bf9c23408 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=ba0c6650-a1cc-4c46-b400-5645003e471e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0497079 Mar 24 02:22:29.525585 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-74925d18-f68d-44fe-8449-f10f3714a0d2 service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0931976 Mar 24 02:22:29.619122 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-df1b6d9a-0b24-4846-a7cc-192a5b4c3b25 req-95ba6cd0-b30f-4b1b-b8ee-5c2ef29b590a service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877452 Mar 24 02:22:29.627770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:29.657108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3067ced-94b7-4f57-9e9c-80b7929c09e8 None None] The sync data for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv is: [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:22:29.883366 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-511e1019-050a-43a1-bf0b-05a9638e09bf None None] New status for floating IP adce6263-6007-4ae5-bf2b-b28db2bccb16: DOWN {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:22:29.967952 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c52f420-8078-4834-b0ac-6258ad6a4e38 req-d7a50a06-a031-4e1e-a02c-70f41d735a83 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:29.969577 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7c52f420-8078-4834-b0ac-6258ad6a4e38 req-d7a50a06-a031-4e1e-a02c-70f41d735a83 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0538087 Mar 24 02:22:29.978643 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35002) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:30.022359 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7c52f420-8078-4834-b0ac-6258ad6a4e38 req-bb2f5936-b127-4ef7-a818-4995f348b8c2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459442 Mar 24 02:22:30.052043 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d27163d5-bce5-4051-98b1-0c0b06e25c6e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 690 time: 0.0715346 Mar 24 02:22:30.504773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5b4440e7-30a1-49f5-982e-660f52b0ff23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:30.864785 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:31.055921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35006) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:31.110435 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-49bb79ed-53b1-4f28-a933-d81e0839a6e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 688 time: 0.0533612 Mar 24 02:22:31.155893 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee44602-49d8-43f6-816f-63365c7aa566 req-db028d62-e8f4-476f-a0b5-aa8be71c9a85 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:31.157438 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4ee44602-49d8-43f6-816f-63365c7aa566 req-db028d62-e8f4-476f-a0b5-aa8be71c9a85 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0607610 Mar 24 02:22:31.210383 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4ee44602-49d8-43f6-816f-63365c7aa566 req-be75c9a9-d4a2-489b-874e-7e0bdb546375 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470612 Mar 24 02:22:32.320955 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35014) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:32.325384 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-608513229', 'description': 'tempest-secgroup-smoke-608513229 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:32.333715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca5cf86-a491-49fd-88ef-27ea0659c602 req-3bc8ff4f-6f97-43b1-a831-8b8afe7f2843 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:32.335896 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4ca5cf86-a491-49fd-88ef-27ea0659c602 req-3bc8ff4f-6f97-43b1-a831-8b8afe7f2843 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0578177 Mar 24 02:22:32.345339 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.387825 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4ca5cf86-a491-49fd-88ef-27ea0659c602 req-ecb0e504-0277-4b33-9710-64c3f2db0b07 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456722 Mar 24 02:22:32.415715 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (e1c0a66f-ec17-4729-a339-ed292713a426), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.420797 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e1c0a66f-ec17-4729-a339-ed292713a426), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.427974 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.452120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.453321 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1314023 Mar 24 02:22:32.454446 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e1c0a66f-ec17-4729-a339-ed292713a426,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:32.456268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35016) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:32.460422 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4d18c2b4-c362-47cd-92ee-45c05b6c8b65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'e1c0a66f-ec17-4729-a339-ed292713a426', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:32.473556 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.473899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.474237 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.474666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.475001 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.475354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.475673 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.475991 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.476310 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.476629 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.476947 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.477264 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.477578 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.477890 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.478202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72095dc6-db15-4080-acf0-85332f64492f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:32.497041 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d18c2b4-c362-47cd-92ee-45c05b6c8b65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (cfca76d2-d8b7-47d8-ac75-11b8561b08ec), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.541361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d18c2b4-c362-47cd-92ee-45c05b6c8b65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (cfca76d2-d8b7-47d8-ac75-11b8561b08ec), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.544666 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d18c2b4-c362-47cd-92ee-45c05b6c8b65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (cfca76d2-d8b7-47d8-ac75-11b8561b08ec), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.562005 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d18c2b4-c362-47cd-92ee-45c05b6c8b65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cfca76d2-d8b7-47d8-ac75-11b8561b08ec,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:32.571045 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d18c2b4-c362-47cd-92ee-45c05b6c8b65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.572222 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4d18c2b4-c362-47cd-92ee-45c05b6c8b65 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1150770 Mar 24 02:22:32.575036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35018) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:32.579242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-0330b4e9-577a-471f-860e-23ce0911a654 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'e1c0a66f-ec17-4729-a339-ed292713a426', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:32.602172 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0330b4e9-577a-471f-860e-23ce0911a654 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7132e996-2ac5-4e29-9ad5-5fb6bb3abf24), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.660694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0330b4e9-577a-471f-860e-23ce0911a654 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7132e996-2ac5-4e29-9ad5-5fb6bb3abf24), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.664215 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0330b4e9-577a-471f-860e-23ce0911a654 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (7132e996-2ac5-4e29-9ad5-5fb6bb3abf24), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.677796 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0330b4e9-577a-471f-860e-23ce0911a654 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7132e996-2ac5-4e29-9ad5-5fb6bb3abf24,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:32.690989 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0330b4e9-577a-471f-860e-23ce0911a654 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.692160 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0330b4e9-577a-471f-860e-23ce0911a654 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1162295 Mar 24 02:22:32.695697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35020) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:32.699821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3634c79a-f56b-409c-aaa6-b9c99ea50b38 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'e1c0a66f-ec17-4729-a339-ed292713a426', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:32.723551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3634c79a-f56b-409c-aaa6-b9c99ea50b38 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (4887aaee-1e97-4066-88de-3a2aa60b5ef9), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.778289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3634c79a-f56b-409c-aaa6-b9c99ea50b38 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (4887aaee-1e97-4066-88de-3a2aa60b5ef9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.781776 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3634c79a-f56b-409c-aaa6-b9c99ea50b38 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (4887aaee-1e97-4066-88de-3a2aa60b5ef9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.799306 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3634c79a-f56b-409c-aaa6-b9c99ea50b38 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4887aaee-1e97-4066-88de-3a2aa60b5ef9,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:32.804892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3634c79a-f56b-409c-aaa6-b9c99ea50b38 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.806954 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3634c79a-f56b-409c-aaa6-b9c99ea50b38 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1103191 Mar 24 02:22:32.808720 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35022) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:32.813064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-fe146e61-4015-4f36-b1ad-0f9db80e38b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'e1c0a66f-ec17-4729-a339-ed292713a426', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:32.836512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe146e61-4015-4f36-b1ad-0f9db80e38b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (a22eae63-ff54-411d-b2bd-f11151454c80), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.891517 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe146e61-4015-4f36-b1ad-0f9db80e38b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (a22eae63-ff54-411d-b2bd-f11151454c80), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.894891 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe146e61-4015-4f36-b1ad-0f9db80e38b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (a22eae63-ff54-411d-b2bd-f11151454c80), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.911439 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe146e61-4015-4f36-b1ad-0f9db80e38b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a22eae63-ff54-411d-b2bd-f11151454c80,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:32.919684 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-fe146e61-4015-4f36-b1ad-0f9db80e38b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.920849 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-fe146e61-4015-4f36-b1ad-0f9db80e38b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1112394 Mar 24 02:22:32.923559 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35024) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:32.927719 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4d0dfa12-6313-4252-a91d-319cc783903c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'e1c0a66f-ec17-4729-a339-ed292713a426', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:32.946988 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-4d0dfa12-6313-4252-a91d-319cc783903c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:22:32.951593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d0dfa12-6313-4252-a91d-319cc783903c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c386017d-d422-4e85-bd0f-120d0b92d59e), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:32.992289 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:22:33.010650 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d0dfa12-6313-4252-a91d-319cc783903c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c386017d-d422-4e85-bd0f-120d0b92d59e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:33.015009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d0dfa12-6313-4252-a91d-319cc783903c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (c386017d-d422-4e85-bd0f-120d0b92d59e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:33.031495 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d0dfa12-6313-4252-a91d-319cc783903c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c386017d-d422-4e85-bd0f-120d0b92d59e,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:33.040313 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d0dfa12-6313-4252-a91d-319cc783903c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:33.041503 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4d0dfa12-6313-4252-a91d-319cc783903c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1170359 Mar 24 02:22:33.044287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35026) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:33.048474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-78235384-647d-4e3c-a32c-08fa79c83e77 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'e1c0a66f-ec17-4729-a339-ed292713a426', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:33.068040 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-78235384-647d-4e3c-a32c-08fa79c83e77 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:22:33.072769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-78235384-647d-4e3c-a32c-08fa79c83e77 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (63d14bb0-b52a-477e-91b1-607146723a18), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:33.130761 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-78235384-647d-4e3c-a32c-08fa79c83e77 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (63d14bb0-b52a-477e-91b1-607146723a18), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:33.134251 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-78235384-647d-4e3c-a32c-08fa79c83e77 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (63d14bb0-b52a-477e-91b1-607146723a18), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:33.150881 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78235384-647d-4e3c-a32c-08fa79c83e77 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=63d14bb0-b52a-477e-91b1-607146723a18,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:33.158998 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-78235384-647d-4e3c-a32c-08fa79c83e77 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:33.160172 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-78235384-647d-4e3c-a32c-08fa79c83e77 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1149902 Mar 24 02:22:33.305579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e26a8ea1-9dfb-4312-9744-08972748a4dc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-608513229&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.0431604 Mar 24 02:22:33.409969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-8bae1cb2-81a0-4cb2-b3a0-cccd42255f53 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:33.411357 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-8bae1cb2-81a0-4cb2-b3a0-cccd42255f53 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 797 time: 0.0996428 Mar 24 02:22:33.426424 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-9af67856-a7b7-4000-bd84-9bcc1328cd35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/quotas/6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 375 time: 0.0089343 Mar 24 02:22:33.517881 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-491cf2e6-2643-4528-badb-4bf7c110ea96 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0858858 Mar 24 02:22:33.533618 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909c36f9-b1f3-4336-a649-26039e8acf68 req-e286611f-adac-4c26-9818-14757d4057cd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:33.535080 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-909c36f9-b1f3-4336-a649-26039e8acf68 req-e286611f-adac-4c26-9818-14757d4057cd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0757716 Mar 24 02:22:33.540377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-63623d5d-5b7f-4ed2-b2a2-7404b212f9b7 service neutron] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:22:33.541290 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-63623d5d-5b7f-4ed2-b2a2-7404b212f9b7 service neutron] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053720 Mar 24 02:22:33.636652 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-909c36f9-b1f3-4336-a649-26039e8acf68 req-413948e3-75e5-4ee3-b6fc-3160d3925a2c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0944800 Mar 24 02:22:33.657360 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-fd5b2217-8221-4223-9226-30ebfd7689eb service neutron] 10.222.0.20 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1094968 Mar 24 02:22:33.696462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:33.750808 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-b9830295-958a-4e6e-9783-8d4528e79bf3 service neutron] 10.222.0.20 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877395 Mar 24 02:22:33.907144 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-89accfc8-3271-4f0a-ac64-59b8d901246f req-ccb45163-b812-4927-bd58-c33d0746bccd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 210 time: 0.0284100 Mar 24 02:22:34.839624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7af58d-5d15-4cee-b007-ebabbbe3e46e req-ff2875b8-ed4e-4dc5-9b53-204180db80c9 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:34.841105 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0e7af58d-5d15-4cee-b007-ebabbbe3e46e req-ff2875b8-ed4e-4dc5-9b53-204180db80c9 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0996308 Mar 24 02:22:34.847380 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-3d96f3e9-4bd3-4689-b018-2ed582597259 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:34.848772 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-3d96f3e9-4bd3-4689-b018-2ed582597259 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 797 time: 0.1571493 Mar 24 02:22:34.923882 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0e7af58d-5d15-4cee-b007-ebabbbe3e46e req-6e1965c4-a114-46f5-bc4b-fa7b2a494aba tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0740786 Mar 24 02:22:34.957824 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-734a3222-5c48-4723-aca7-d1c4e01e0667 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 472 time: 0.0931063 Mar 24 02:22:34.967141 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'device_id': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'admin_state_up': True, 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'security_groups': ['e1c0a66f-ec17-4729-a339-ed292713a426']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:35.039401 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b8776f64-9b05-4619-9af1-2772c97fd2ba req-1b86c829-ccb4-483b-98d1-d8433605ddd3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 210 time: 0.0577352 Mar 24 02:22:35.099179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:22:35.103071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:35.228394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.13 (ba0c6650-a1cc-4c46-b400-5645003e471e/28885c06-3de2-448e-bb1e-bc557d6d6307/dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:22:35.362883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:35.394261 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:35.447399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network ba0c6650-a1cc-4c46-b400-5645003e471e is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:22:35.450408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:22:35.452969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:22:35.484962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:35.512207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:35.512816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:35.529026 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cbb3571c-b930-4201-adb1-e5ed9f05628b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5654585 Mar 24 02:22:35.541167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Request body: {'port': {'device_id': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:35.608162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:35.680443 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-21ad518f-fc90-48e3-a675-595dd79a01a4 None None] Provisioning complete for port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:22:35.681086 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-21ad518f-fc90-48e3-a675-595dd79a01a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:35.715556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-21ad518f-fc90-48e3-a675-595dd79a01a4 None None] Port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:22:36.095200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ffeb378-6038-465e-9ef5-56ac47f163f4 req-9c571a07-3803-42b4-8bcb-82ebcb07c026 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:36.096720 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ffeb378-6038-465e-9ef5-56ac47f163f4 req-9c571a07-3803-42b4-8bcb-82ebcb07c026 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.1066909 Mar 24 02:22:36.213046 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ffeb378-6038-465e-9ef5-56ac47f163f4 req-f0a911a6-f717-4fa7-9ab1-1a21152ead82 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1094866 Mar 24 02:22:36.243207 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d8fdb4-c245-4318-869d-3c451aef9348 req-f4213ebe-a42d-49f7-a0b6-5b6ea2bb3776 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:36.244828 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f0d8fdb4-c245-4318-869d-3c451aef9348 req-f4213ebe-a42d-49f7-a0b6-5b6ea2bb3776 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 932 time: 0.1351919 Mar 24 02:22:36.263849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:22:36.276395 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Publish callbacks [] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:36.300058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Transition to ACTIVE for port object dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:22:36.308393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:36.326276 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f0d8fdb4-c245-4318-869d-3c451aef9348 req-67307b55-2f90-425e-86db-d82edafeacb0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0733395 Mar 24 02:22:36.370475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Pushing event updated for resources: {'Port': ['ID=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:36.446629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Attempting to bind port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:22:36.446967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Attempting to bind port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:22:36.447297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Attempting to bind port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f on network ba0c6650-a1cc-4c46-b400-5645003e471e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:22:36.451913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f on network ba0c6650-a1cc-4c46-b400-5645003e471e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:22:36.452255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Attempting to bind port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f on network ba0c6650-a1cc-4c46-b400-5645003e471e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:22:36.457281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 22, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:22:36.457703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Checking segment: {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:22:36.458161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Bound using segment: {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:22:36.458688 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Bound port: dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '098f9bd1-066a-47cf-bed4-2b3bea91de3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:22:36.459125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:36.524873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] For port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:22:36.528357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] For port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:22:36.533822 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:36.566025 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:36.566675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:36.568357 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] 10.222.0.30 "PUT /v2.0/ports/dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f HTTP/1.1" status: 200 len: 1094 time: 1.0320120 Mar 24 02:22:36.568816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'tag': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:22:36.571560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-278b7367-7bdd-40b1-9f21-bcef7fa7be88" -d '{"events": [{"name": "network-changed", "server_uuid": "eaaf9096-060c-4657-b936-82ba8dbb18ba", "tag": "dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:22:36.601394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e743d2c2-d5d2-45b3-b69c-a92ce2aa0697 service neutron] Pushing event updated for resources: {'Port': ['ID=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:36.611414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:22:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47ada37e-f814-48b8-96ea-a0bb6e234685 x-openstack-request-id: req-47ada37e-f814-48b8-96ea-a0bb6e234685 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:22:36.611711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eaaf9096-060c-4657-b936-82ba8dbb18ba", "tag": "dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:22:36.611968 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-47ada37e-f814-48b8-96ea-a0bb6e234685 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:22:36.612404 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-47ada37e-f814-48b8-96ea-a0bb6e234685'] response: {'name': 'network-changed', 'server_uuid': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'tag': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f', 'status': 'completed', 'code': 200} Mar 24 02:22:36.665054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-63deeee1-2ae4-4f2c-b87a-e183b798703e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:36.666728 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-63deeee1-2ae4-4f2c-b87a-e183b798703e service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 1128 time: 0.0506270 Mar 24 02:22:36.709649 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-bdd0f0e3-ad17-4e9c-8bee-f99b7831fa1e service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f HTTP/1.1" status: 200 len: 217 time: 0.0353713 Mar 24 02:22:36.758860 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-36e41571-460c-482e-a4d1-046374eacdf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:36.760346 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-36e41571-460c-482e-a4d1-046374eacdf5 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 200 len: 833 time: 0.0447414 Mar 24 02:22:36.811310 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-1b2b3a6a-ac42-4250-8323-f3892bfcd018 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:36.812789 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-1b2b3a6a-ac42-4250-8323-f3892bfcd018 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=ba0c6650-a1cc-4c46-b400-5645003e471e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0468023 Mar 24 02:22:36.899452 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-cda3e118-956f-4bd7-8f1a-c5a3f2e832ba service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808225 Mar 24 02:22:36.988555 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aec8be39-70ce-4cc6-acab-ec81547e66f3 req-e73c8468-b119-4c38-90bd-6d5ce4df9e22 service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0837023 Mar 24 02:22:37.083771 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-d255a3d6-2287-49e1-8552-0a42878c2aa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:37.085236 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-d255a3d6-2287-49e1-8552-0a42878c2aa4 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 1128 time: 0.0456576 Mar 24 02:22:37.170937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-1c0c61a9-9e3c-4657-9f05-bd2ccd8ca5e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:37.172386 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-1c0c61a9-9e3c-4657-9f05-bd2ccd8ca5e0 service neutron] 10.222.0.30 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 898 time: 0.0811341 Mar 24 02:22:37.216831 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-dbf340d4-cd39-4931-8a97-42b42fb4c73b service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f HTTP/1.1" status: 200 len: 217 time: 0.0379431 Mar 24 02:22:37.264282 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-d99db788-b0a3-4c4c-97ec-6208104b9aa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:37.265724 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-d99db788-b0a3-4c4c-97ec-6208104b9aa2 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 200 len: 833 time: 0.0425115 Mar 24 02:22:37.345930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-b182dbbc-aca1-48a8-b421-d869a643d530 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:37.347363 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-b182dbbc-aca1-48a8-b421-d869a643d530 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=ba0c6650-a1cc-4c46-b400-5645003e471e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0735884 Mar 24 02:22:37.357638 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4456943e-f4b1-4316-b9e7-1185db310206 req-f7e14141-be05-47bd-8c79-788278ba569e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:37.359108 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4456943e-f4b1-4316-b9e7-1185db310206 req-f7e14141-be05-47bd-8c79-788278ba569e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0779591 Mar 24 02:22:37.494459 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4456943e-f4b1-4316-b9e7-1185db310206 req-3f9dcfcf-6935-4f71-a6c3-41407cdc7cc8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1263988 Mar 24 02:22:37.520836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f678fee-b25c-4e5e-a197-ffac1af1087e req-ecd2979f-2913-4caf-ab55-b03f8bc0bbd8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:37.522279 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2f678fee-b25c-4e5e-a197-ffac1af1087e req-ecd2979f-2913-4caf-ab55-b03f8bc0bbd8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 944 time: 0.1066136 Mar 24 02:22:37.524070 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-d193b8a5-f71d-4d23-b8d3-8c33cbfee045 service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1641233 Mar 24 02:22:37.622139 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2f678fee-b25c-4e5e-a197-ffac1af1087e req-d7b5a94a-c7d0-4d67-85ea-8353bbb4b234 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0941377 Mar 24 02:22:37.647895 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-278b7367-7bdd-40b1-9f21-bcef7fa7be88 req-8562c2dd-6349-4b73-85f1-5065b42d1855 service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1144569 Mar 24 02:22:38.658869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb77d6f8-c461-4dfb-b4b4-19af4b246dab req-af5681b6-47d8-4c40-af1d-1255d2ede1b5 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:38.660363 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-eb77d6f8-c461-4dfb-b4b4-19af4b246dab req-af5681b6-47d8-4c40-af1d-1255d2ede1b5 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.1013324 Mar 24 02:22:38.737315 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-eb77d6f8-c461-4dfb-b4b4-19af4b246dab req-c71e3535-b546-4e6b-9f47-b3021e6b2142 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0708318 Mar 24 02:22:38.758883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501c65da-b83a-4246-8b2a-ea5b76b6bd10 req-86faca9a-1527-4b4b-a507-6f5907ea7c71 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:38.760334 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-501c65da-b83a-4246-8b2a-ea5b76b6bd10 req-86faca9a-1527-4b4b-a507-6f5907ea7c71 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 944 time: 0.0742431 Mar 24 02:22:38.808258 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-501c65da-b83a-4246-8b2a-ea5b76b6bd10 req-84c11d96-9d0a-4a12-9a67-56c365cd7ff1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424838 Mar 24 02:22:39.788125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 42b4c550-82ba-45d7-bc38-e7dbcfff4311 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:22:39.857317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8318d7b6-f50a-4e07-98e9-632d21240848 req-8c461b0d-8261-4f9a-8148-c620b04e9a14 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:39.858876 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8318d7b6-f50a-4e07-98e9-632d21240848 req-8c461b0d-8261-4f9a-8148-c620b04e9a14 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 944 time: 0.0535407 Mar 24 02:22:39.886398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 42b4c550-82ba-45d7-bc38-e7dbcfff4311, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:22:39.899653 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:22:39.916400 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8318d7b6-f50a-4e07-98e9-632d21240848 req-011ff45f-f09a-4663-a280-cbb81c074d59 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518439 Mar 24 02:22:39.951531 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:22:39.951930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:39.964978 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 42b4c550-82ba-45d7-bc38-e7dbcfff4311 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:22:39.984601 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 42b4c550-82ba-45d7-bc38-e7dbcfff4311, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:22:39.989092 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:39.989748 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b10665d-484a-4c1f-b527-ddfe2d0b2fae req-9dc646de-83a0-494c-8c1b-645de3a62628 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:39.991296 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6b10665d-484a-4c1f-b527-ddfe2d0b2fae req-9dc646de-83a0-494c-8c1b-645de3a62628 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 944 time: 0.1127200 Mar 24 02:22:40.036016 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=42b4c550-82ba-45d7-bc38-e7dbcfff4311,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:40.040504 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6b10665d-484a-4c1f-b527-ddfe2d0b2fae req-aac5b57a-f410-4375-82a8-47c68ba704a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436888 Mar 24 02:22:40.043469 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.043760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.044104 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.044442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.044775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.045102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.045426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.045750 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.046092 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.046398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.046757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.047080 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.047399 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.047716 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.048032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:22:40.314230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['42b4c550-82ba-45d7-bc38-e7dbcfff4311'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:22:41.029649 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5792104-10d1-41dd-87c9-64b079a9c772 req-5c52eddf-75a8-4e96-8a37-60cc55c9d3db tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:41.031145 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d5792104-10d1-41dd-87c9-64b079a9c772 req-5c52eddf-75a8-4e96-8a37-60cc55c9d3db tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 945 time: 0.0511734 Mar 24 02:22:41.078809 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d5792104-10d1-41dd-87c9-64b079a9c772 req-42d18fb1-fef2-4b9b-b3e9-b4e2d075285e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422664 Mar 24 02:22:41.156036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac2d639-2458-4651-b393-f641d39f658a req-ea395ea2-631e-4365-959c-7a0467b714ab tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:41.157481 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2ac2d639-2458-4651-b393-f641d39f658a req-ea395ea2-631e-4365-959c-7a0467b714ab tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 944 time: 0.0512416 Mar 24 02:22:41.209494 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2ac2d639-2458-4651-b393-f641d39f658a req-151abe05-a1ca-4691-b2ce-619574ac25c5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463710 Mar 24 02:22:41.802735 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:22:41.805904 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 42b4c550-82ba-45d7-bc38-e7dbcfff4311 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:22:41.908209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:22:41.919689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:22:41.920063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:41.958090 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:22:41.976008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'port_id': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f', 'mac_address': 'fa:16:3e:61:68:a9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 134, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:22:42.040882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:22:42.041186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:42.056540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:22:42.056915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:42.066034 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:22:42.090073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:22:42.092596 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11af43f9-3e8f-45d5-b783-f86e7f586422" -d '{"events": [{"server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "name": "network-vif-plugged", "status": "completed", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:22:42.108382 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:22:42.112042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 42b4c550-82ba-45d7-bc38-e7dbcfff4311, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:22:42.114810 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:42.139899 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:42.144627 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:22:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-06a6be3f-86ad-43bc-a26b-ac7b54d313c0 x-openstack-request-id: req-06a6be3f-86ad-43bc-a26b-ac7b54d313c0 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:22:42.144918 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "name": "network-vif-plugged", "status": "completed", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:22:42.145171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-06a6be3f-86ad-43bc-a26b-ac7b54d313c0 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:22:42.145567 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-06a6be3f-86ad-43bc-a26b-ac7b54d313c0'] response: {'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'code': 200} Mar 24 02:22:42.176994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:42.202365 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a4c492-bec9-4467-b32b-312c837af469 req-40d54195-e046-4b66-b018-b812b9316b10 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:42.203889 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c6a4c492-bec9-4467-b32b-312c837af469 req-40d54195-e046-4b66-b018-b812b9316b10 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 946 time: 0.0557172 Mar 24 02:22:42.235454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=42b4c550-82ba-45d7-bc38-e7dbcfff4311,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:42.259750 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c6a4c492-bec9-4467-b32b-312c837af469 req-41ae3afe-20cf-4aba-9f48-2823b06d3446 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0499015 Mar 24 02:22:42.365434 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f701a1-b953-4926-8f1f-d5cc24cef22b req-cf7b4256-c354-4214-abfd-a679d37ffbbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:42.366945 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-39f701a1-b953-4926-8f1f-d5cc24cef22b req-cf7b4256-c354-4214-abfd-a679d37ffbbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 945 time: 0.0861855 Mar 24 02:22:42.371358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53951a4e-d104-4fdb-b10a-24505861cf71 req-8ff38f99-d6eb-464a-974b-fae33fb59597 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:42.372711 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53951a4e-d104-4fdb-b10a-24505861cf71 req-8ff38f99-d6eb-464a-974b-fae33fb59597 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 1130 time: 0.0794790 Mar 24 02:22:42.444487 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-39f701a1-b953-4926-8f1f-d5cc24cef22b req-c45aae8c-347e-4e37-8eea-0df166007cbc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0708017 Mar 24 02:22:42.448889 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-53951a4e-d104-4fdb-b10a-24505861cf71 req-ac702b1a-9495-4ed1-9d64-28b3400ae297 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0686617 Mar 24 02:22:42.458996 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:22:43.375727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee5d2b3-98a5-462b-ad10-ddb3877c6e85 req-b8210978-4f1c-452b-8fd8-818eb52ca8ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:43.377174 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3ee5d2b3-98a5-462b-ad10-ddb3877c6e85 req-b8210978-4f1c-452b-8fd8-818eb52ca8ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 946 time: 0.0525081 Mar 24 02:22:43.423992 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3ee5d2b3-98a5-462b-ad10-ddb3877c6e85 req-e037bc13-3054-4d3d-93a0-f7ed621dca18 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412693 Mar 24 02:22:43.564668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09b0bfd4-45fb-4258-8dac-63153442b8d1 req-0107c3c7-dca8-4054-8d49-7abbb7107b7a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:43.566113 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-09b0bfd4-45fb-4258-8dac-63153442b8d1 req-0107c3c7-dca8-4054-8d49-7abbb7107b7a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 945 time: 0.0518923 Mar 24 02:22:43.617831 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-09b0bfd4-45fb-4258-8dac-63153442b8d1 req-12ab3344-6a45-4bb5-b47f-77113fcc1c16 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459445 Mar 24 02:22:43.810430 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:22:43.861071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:22:43.864961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:22:43.865458 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:43.945494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:22:43.945877 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:43.980953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:22:43.984466 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:44.029011 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:44.146591 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:22:44.149480 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1b1bfa8-f0d4-4440-99dd-422b5d8b2ecd" -d '{"events": [{"server_uuid": "eaaf9096-060c-4657-b936-82ba8dbb18ba", "name": "network-vif-plugged", "status": "completed", "tag": "dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:22:44.182927 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:22:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-35207251-5089-4a03-a750-f77e95a5ff09 x-openstack-request-id: req-35207251-5089-4a03-a750-f77e95a5ff09 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:22:44.183229 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eaaf9096-060c-4657-b936-82ba8dbb18ba", "name": "network-vif-plugged", "status": "completed", "tag": "dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:22:44.183493 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-35207251-5089-4a03-a750-f77e95a5ff09 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:22:44.183901 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-35207251-5089-4a03-a750-f77e95a5ff09'] response: {'server_uuid': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f', 'code': 200} Mar 24 02:22:44.344988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1434f6ee-2295-404f-84b8-dbf89c746619 req-6d21f640-dc1e-4faa-84d8-ae8282a4e40d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:44.346555 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1434f6ee-2295-404f-84b8-dbf89c746619 req-6d21f640-dc1e-4faa-84d8-ae8282a4e40d service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 1130 time: 0.0441184 Mar 24 02:22:44.390014 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1434f6ee-2295-404f-84b8-dbf89c746619 req-ec23b549-6f02-4767-8be7-9d92d9815455 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378480 Mar 24 02:22:44.538126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73972070-f086-4e9f-b602-b3834f128c41 req-fe096990-dd46-4e90-a7b9-031f82505717 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:44.539690 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-73972070-f086-4e9f-b602-b3834f128c41 req-fe096990-dd46-4e90-a7b9-031f82505717 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 946 time: 0.0519705 Mar 24 02:22:44.588032 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-73972070-f086-4e9f-b602-b3834f128c41 req-1fbd1cd5-d3cc-4a09-85f9-6e31475fc58c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428257 Mar 24 02:22:44.738882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0ca7c2-425f-462f-a9c4-b3381996f571 req-3122e5fd-3248-46ef-b048-25dbd637710c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:44.740314 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6f0ca7c2-425f-462f-a9c4-b3381996f571 req-3122e5fd-3248-46ef-b048-25dbd637710c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 946 time: 0.0868733 Mar 24 02:22:44.754047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c86e48-007e-4acc-ad73-ec67cd2fb49b req-d8b1115d-0a19-47f2-a054-560c30362ffb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:44.755487 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-97c86e48-007e-4acc-ad73-ec67cd2fb49b req-d8b1115d-0a19-47f2-a054-560c30362ffb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 946 time: 0.0724006 Mar 24 02:22:44.822892 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6f0ca7c2-425f-462f-a9c4-b3381996f571 req-1be1150d-ace2-4462-b5f4-16311bff75ae tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0760174 Mar 24 02:22:44.835647 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-97c86e48-007e-4acc-ad73-ec67cd2fb49b req-1814317a-cbbe-4e20-b884-ade68459c4eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0732033 Mar 24 02:22:44.844536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35110) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:44.894431 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cbcb9c2-b89d-4091-b97f-7ba7bce23f81 tempest-TestVolumeBootPattern-513780323 tempest-TestVolumeBootPattern-513780323-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:44.896120 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1cbcb9c2-b89d-4091-b97f-7ba7bce23f81 tempest-TestVolumeBootPattern-513780323 tempest-TestVolumeBootPattern-513780323-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 1125 time: 0.0506363 Mar 24 02:22:44.899065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35112) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:44.903289 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address': '172.20.0.11'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:44.923031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:45.016936 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:45.036502 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:45.124604 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Allocated IP 172.26.2.143 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/a82cfa68-c1b8-4343-9aa3-696b112fab32) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:22:45.223831 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for port (a82cfa68-c1b8-4343-9aa3-696b112fab32), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:45.256798 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a82cfa68-c1b8-4343-9aa3-696b112fab32), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:45.292533 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:22:45.295279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:22:45.297832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:22:45.327925 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'Port': ['ID=a82cfa68-c1b8-4343-9aa3-696b112fab32,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:45.653888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (6d1e6138-f7e0-473d-bae4-c655f53ad785), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:45.725252 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a82cfa68-c1b8-4343-9aa3-696b112fab32), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:45.870872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for port (a82cfa68-c1b8-4343-9aa3-696b112fab32), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:45.875896 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (a82cfa68-c1b8-4343-9aa3-696b112fab32), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:45.974876 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'Port': ['ID=a82cfa68-c1b8-4343-9aa3-696b112fab32,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:22:45.990392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (6d1e6138-f7e0-473d-bae4-c655f53ad785), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:46.035642 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe3f617-2b0f-4ac3-b210-cc4e79a9f8d3 req-54d7dc31-7a93-4f27-b636-4361faa52c3d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:46.037117 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0fe3f617-2b0f-4ac3-b210-cc4e79a9f8d3 req-54d7dc31-7a93-4f27-b636-4361faa52c3d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 946 time: 0.1311097 Mar 24 02:22:46.125353 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0fe3f617-2b0f-4ac3-b210-cc4e79a9f8d3 req-11dc8250-052c-4abc-b03b-0a619f7cfd22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0635824 Mar 24 02:22:46.135934 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Floating IP 6d1e6138-f7e0-473d-bae4-c655f53ad785 associated. External IP: 172.26.2.143, port: 42b4c550-82ba-45d7-bc38-e7dbcfff4311. Mar 24 02:22:46.278601 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d54be3e-04d6-4e44-99cb-fd30a91c0adc req-4d1cc22e-fbca-4f46-99f4-05c0531b32eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:46.279965 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2d54be3e-04d6-4e44-99cb-fd30a91c0adc req-4d1cc22e-fbca-4f46-99f4-05c0531b32eb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 946 time: 0.0802233 Mar 24 02:22:46.399901 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2d54be3e-04d6-4e44-99cb-fd30a91c0adc req-661676d5-1d8a-4a79-a22e-72fba484489f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1142039 Mar 24 02:22:46.420533 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35118) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:46.423439 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Router d9d90a22-1adf-4945-a625-094e279f17a1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:22:46.792138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eedaa26a-df4b-4f30-b039-ce23b698a754 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:46.793659 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eedaa26a-df4b-4f30-b039-ce23b698a754 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 1125 time: 0.3722155 Mar 24 02:22:46.796627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35120) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:46.801270 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-ff6c31fc-b2c6-4c94-82f4-26138c30198b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'port_id': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:22:46.826381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:22:46.836055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] Sync routers for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:22:46.842314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff6c31fc-b2c6-4c94-82f4-26138c30198b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (adce6263-6007-4ae5-bf2b-b28db2bccb16), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:46.846190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:46.846715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:22:46.847421 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:22:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:46.879705 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-537148b4-baa2-4deb-9031-41eadec5f025 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.9796255 Mar 24 02:22:46.880717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:22:46.884628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-835823bd-2b52-4ad0-acb3-81052e5c7219" -d '{"events": [{"name": "network-changed", "server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:22:46.958936 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:22:46.981363 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:22:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4d2e160-28fc-469b-88da-55f89d2fb13e x-openstack-request-id: req-e4d2e160-28fc-469b-88da-55f89d2fb13e {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:22:46.981734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:22:46.982060 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-e4d2e160-28fc-469b-88da-55f89d2fb13e {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:22:46.982597 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e4d2e160-28fc-469b-88da-55f89d2fb13e'] response: {'name': 'network-changed', 'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'status': 'completed', 'code': 200} Mar 24 02:22:47.050287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-e7b72856-4f7a-4161-a62f-4718d36d97fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:47.051937 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-e7b72856-4f7a-4161-a62f-4718d36d97fe service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 1130 time: 0.0479429 Mar 24 02:22:47.147745 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-7f38475e-224e-4e98-8542-7e4cf56eb4d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:47.149300 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-7f38475e-224e-4e98-8542-7e4cf56eb4d3 service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.0915821 Mar 24 02:22:47.190048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '6d1e6138-f7e0-473d-bae4-c655f53ad785', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.143', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1413, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:22:45Z', 'updated_at': '2022-03-24T02:22:45Z', 'revision_number': 0, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:47.215965 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] Checking router: d9d90a22-1adf-4945-a625-094e279f17a1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:22:47.219577 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-1c5bb697-6bb8-40a4-b8f1-9ef0de18027c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311 HTTP/1.1" status: 200 len: 1000 time: 0.0639410 Mar 24 02:22:47.224832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:22:47.225471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:22:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:47.267426 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-1527fb94-f040-4441-a342-f93c2a9b8812 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:47.268899 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-1527fb94-f040-4441-a342-f93c2a9b8812 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0437417 Mar 24 02:22:47.323561 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-c6de6e39-05d8-475d-8c0e-dd578f824517 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:47.325141 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-c6de6e39-05d8-475d-8c0e-dd578f824517 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0504777 Mar 24 02:22:47.336290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:22:47.416184 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-b2cffded-3213-48e9-9478-f0b43f719eb7 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844016 Mar 24 02:22:47.424387 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff6c31fc-b2c6-4c94-82f4-26138c30198b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:47.428932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff6c31fc-b2c6-4c94-82f4-26138c30198b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (adce6263-6007-4ae5-bf2b-b28db2bccb16), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:47.515411 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-835823bd-2b52-4ad0-acb3-81052e5c7219 req-1ccf2986-1be2-4828-b73d-2c1ad510eb4c service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0938554 Mar 24 02:22:47.570050 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '6d1e6138-f7e0-473d-bae4-c655f53ad785', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.143', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1413, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:22:45Z', 'updated_at': '2022-03-24T02:22:45Z', 'revision_number': 0, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:47.600840 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9923312b-8fdc-4179-91ec-2703df37b706 None None] The sync data for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv is: [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '6d1e6138-f7e0-473d-bae4-c655f53ad785', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.143', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1413, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:22:45Z', 'updated_at': '2022-03-24T02:22:45Z', 'revision_number': 0, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:22:47.798391 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0934788f-7818-42d1-afb1-81437882c6dc None None] New status for floating IP 6d1e6138-f7e0-473d-bae4-c655f53ad785: ACTIVE {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:22:47.853260 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-ff6c31fc-b2c6-4c94-82f4-26138c30198b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP adce6263-6007-4ae5-bf2b-b28db2bccb16 associated. External IP: 172.26.2.107, port: dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f. Mar 24 02:22:48.063274 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff6c31fc-b2c6-4c94-82f4-26138c30198b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 85f24485-6395-4873-a689-4b065205351e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:22:48.171468 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff6c31fc-b2c6-4c94-82f4-26138c30198b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:22:48.176008 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ff6c31fc-b2c6-4c94-82f4-26138c30198b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:22:48.182684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] Sync routers for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:22:48.192883 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:22:48.193423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:22:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:48.206048 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ff6c31fc-b2c6-4c94-82f4-26138c30198b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 992 time: 1.4083388 Mar 24 02:22:48.206649 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'tag': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f'}] {{(pid=104036) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:22:48.208843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35128) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:48.209342 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d6177697792ca3fff01bbfc58b3e16cb8a22905a2f74e66d9151ebb6b50c8f9c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82064cbd-3a19-45c8-99d4-f419e75871f4" -d '{"events": [{"name": "network-changed", "server_uuid": "eaaf9096-060c-4657-b936-82ba8dbb18ba", "tag": "dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f"}]}' {{(pid=104036) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:22:48.242465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:22:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78863988-853b-41d0-bf8a-3027a46eff1c x-openstack-request-id: req-78863988-853b-41d0-bf8a-3027a46eff1c {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:22:48.242809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eaaf9096-060c-4657-b936-82ba8dbb18ba", "tag": "dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f", "status": "completed", "code": 200}]} {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:22:48.243066 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-78863988-853b-41d0-bf8a-3027a46eff1c {{(pid=104036) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:22:48.243482 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.notifiers.nova [-] Nova event matching ['req-78863988-853b-41d0-bf8a-3027a46eff1c'] response: {'name': 'network-changed', 'server_uuid': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'tag': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f', 'status': 'completed', 'code': 200} Mar 24 02:22:48.297386 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5c4f75c3-fdf9-4fbf-9524-85a814df935f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 992 time: 0.0871453 Mar 24 02:22:48.302984 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:22:48.313623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-9bf3d2fb-35b9-4187-9cf2-16fac0dd3df5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:48.315128 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-9bf3d2fb-35b9-4187-9cf2-16fac0dd3df5 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 1130 time: 0.0512249 Mar 24 02:22:48.407536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-c15e5501-5307-41e4-a001-d42ccc690b2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:48.409039 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-c15e5501-5307-41e4-a001-d42ccc690b2c service neutron] 10.222.0.30 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 898 time: 0.0879025 Mar 24 02:22:48.473298 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-2c4dd377-1252-4801-b8a0-64d10f78eeab service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f HTTP/1.1" status: 200 len: 1000 time: 0.0580673 Mar 24 02:22:48.519961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'adce6263-6007-4ae5-bf2b-b28db2bccb16', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.107', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '85f24485-6395-4873-a689-4b065205351e', 'port_id': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1400, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'mac_address': 'fa:16:3e:61:68:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:21:19Z', 'updated_at': '2022-03-24T02:22:47Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:48.524296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-f8e98cfd-6558-4ced-bb8e-d1f598f7c015 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:48.525757 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-f8e98cfd-6558-4ced-bb8e-d1f598f7c015 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 200 len: 833 time: 0.0468428 Mar 24 02:22:48.549846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] Checking router: 85f24485-6395-4873-a689-4b065205351e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:22:48.558370 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:22:48.559100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:22:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:48.574549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-8ef8bd82-a85c-491e-8291-9567d1d19dbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:22:48.576055 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-8ef8bd82-a85c-491e-8291-9567d1d19dbf service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=ba0c6650-a1cc-4c46-b400-5645003e471e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0446069 Mar 24 02:22:48.663045 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-7d5a5a97-a748-4409-b39d-c90f2b8a61e2 service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806444 Mar 24 02:22:48.664328 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:22:48.759453 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-82064cbd-3a19-45c8-99d4-f419e75871f4 req-5c4c6521-2d38-44f6-98f4-00788bda6b6d service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0906994 Mar 24 02:22:49.024703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'adce6263-6007-4ae5-bf2b-b28db2bccb16', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.107', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '85f24485-6395-4873-a689-4b065205351e', 'port_id': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1400, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'mac_address': 'fa:16:3e:61:68:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:21:19Z', 'updated_at': '2022-03-24T02:22:47Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:22:49.053454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95d7e8c1-38fe-42f3-8dec-f4a964b4643f None None] The sync data for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv is: [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'adce6263-6007-4ae5-bf2b-b28db2bccb16', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.107', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '85f24485-6395-4873-a689-4b065205351e', 'port_id': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1400, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'mac_address': 'fa:16:3e:61:68:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:21:19Z', 'updated_at': '2022-03-24T02:22:47Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:22:49.231683 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6eaeb68-f765-4203-b0da-42ec8944b999 None None] New status for floating IP adce6263-6007-4ae5-bf2b-b28db2bccb16: ACTIVE {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:22:49.301215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35132) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:49.361279 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6bedd7a8-e600-44df-a354-ae6a69cf9918 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 992 time: 0.0589099 Mar 24 02:22:50.364734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35134) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:22:50.428393 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1f54088d-4227-4851-9b4b-a6c36b0ca6af tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 200 len: 994 time: 0.0623677 Mar 24 02:22:57.389519 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-57b529e8-804c-4eae-a4e0-ff26d7a3f8a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:00.505846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-94b82a1f-de49-44d8-83ab-b3eeceddd44b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:00.867464 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:02.430510 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:03.702236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:09.990949 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:23:15.042405 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:26.049070 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-15d7463b-463b-434b-b1ac-e694b8029452 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0419405 Mar 24 02:23:26.131597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-37e5a228-cd35-4b72-85d2-d61ec6336bcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:23:26.133073 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-37e5a228-cd35-4b72-85d2-d61ec6336bcc service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 1129 time: 0.0441952 Mar 24 02:23:26.235705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-ea61ac99-c7d8-41e8-9f6c-2953e678d995 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:23:26.237162 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-ea61ac99-c7d8-41e8-9f6c-2953e678d995 service neutron] 10.222.0.30 "GET /v2.0/networks?id=ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 200 len: 898 time: 0.0866065 Mar 24 02:23:26.277060 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-b2570b22-9376-4a20-bf0c-55760d0d930e service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=30104b10-829b-4559-afb5-d6df8fca3862 HTTP/1.1" status: 200 len: 217 time: 0.0339897 Mar 24 02:23:26.327787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-691542aa-5c94-4804-b50c-77193498d586 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:23:26.329113 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-691542aa-5c94-4804-b50c-77193498d586 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 200 len: 833 time: 0.0466948 Mar 24 02:23:26.377178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-ca3f7b29-08e2-47b5-a326-576edaf8aff9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:23:26.378759 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-ca3f7b29-08e2-47b5-a326-576edaf8aff9 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=ba0c6650-a1cc-4c46-b400-5645003e471e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0433755 Mar 24 02:23:26.466470 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-6a1f891a-b987-4a65-8c16-26ddd506d350 service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816052 Mar 24 02:23:26.556643 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6ec4e75-68e4-484b-9782-bf29933e2c67 req-08b0f790-529f-4912-911c-7643d30bd61b service neutron] 10.222.0.30 "GET /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844302 Mar 24 02:23:27.390856 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5768223f-0455-49d8-9243-b54bf16671e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:30.507491 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c02083c-4a02-426c-8862-13c4d9fc93f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:30.870461 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:32.432818 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:33.695420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:45.052236 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:23:46.990366 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:23:57.393517 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a32787b2-8cb8-41f1-9456-df80c5bb4e31 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:00.511090 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-781a0a39-6573-4790-9858-f1d49f576566 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:00.873459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:01.577649 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9659047-6361-4bd8-9d4f-4bd42e523dbb req-4949a2f4-fdbd-436a-a74b-5aed9bad7d41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:01.579127 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a9659047-6361-4bd8-9d4f-4bd42e523dbb req-4949a2f4-fdbd-436a-a74b-5aed9bad7d41 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 946 time: 0.0531027 Mar 24 02:24:01.626509 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a9659047-6361-4bd8-9d4f-4bd42e523dbb req-cf42b619-c2ac-47b9-a394-399da53f1a45 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419805 Mar 24 02:24:02.437449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:02.747951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9cf61e8-98d0-4211-b3b3-c4fe939efeed req-c5f6c0ca-dcc9-47e2-aaf1-e4cecb0d13ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:02.749334 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d9cf61e8-98d0-4211-b3b3-c4fe939efeed req-c5f6c0ca-dcc9-47e2-aaf1-e4cecb0d13ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 946 time: 0.0556369 Mar 24 02:24:02.797244 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d9cf61e8-98d0-4211-b3b3-c4fe939efeed req-3b0bd3ef-ad71-46d6-a0c9-390a9c615062 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=e1c0a66f-ec17-4729-a339-ed292713a426&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424037 Mar 24 02:24:03.243672 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-01a8842e-d76c-4d7a-b5e3-cbef878e5825 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:03.245105 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-01a8842e-d76c-4d7a-b5e3-cbef878e5825 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 946 time: 0.0515208 Mar 24 02:24:03.334495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:24:03.334863 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:03.423558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:03.423833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:03.591661 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:03.592023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (adce6263-6007-4ae5-bf2b-b28db2bccb16), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:03.592337 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP adce6263-6007-4ae5-bf2b-b28db2bccb16 disassociated. External IP: 172.26.2.107, port: dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f. Mar 24 02:24:03.592677 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:24:03.697789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:03.721016 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:03.747364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:03.757457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.758065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.758196 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.758484 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.758851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.759193 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.759527 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.759870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.760624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.760624 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.760842 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.761143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.761470 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.761796 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.762125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:03.897987 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-83c99c6c-606a-49bc-90ac-fab775d52a2e req-4dd0b3e1-8e30-4a3e-82d1-feffcda4dc34 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=eaaf9096-060c-4657-b936-82ba8dbb18ba HTTP/1.1" status: 200 len: 210 time: 0.0337896 Mar 24 02:24:03.902455 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 85f24485-6395-4873-a689-4b065205351e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:24:04.012891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:24:04.022575 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] Sync routers for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:24:04.031896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:04.032737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:04.057480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] No DVR routers for this DVR port dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:24:04.060276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:04.063956 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a13aafe3-b2d5-4114-9f39-e2eef5209ee0 req-d0bcbd82-d7da-465a-aeaf-84f938f2a4d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "DELETE /v2.0/ports/dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f HTTP/1.1" status: 204 len: 173 time: 0.8133674 Mar 24 02:24:04.064420 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'name': 'network-vif-deleted', 'tag': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:24:04.068302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65514b65-849f-4cb1-ac7b-2840414ab83e" -d '{"events": [{"server_uuid": "eaaf9096-060c-4657-b936-82ba8dbb18ba", "name": "network-vif-deleted", "tag": "dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:24:04.110182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:24:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fdd3962d-4d2f-4193-bff0-9d9caa09f2c3 x-openstack-request-id: req-fdd3962d-4d2f-4193-bff0-9d9caa09f2c3 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:24:04.110883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eaaf9096-060c-4657-b936-82ba8dbb18ba", "name": "network-vif-deleted", "tag": "dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:24:04.111217 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-fdd3962d-4d2f-4193-bff0-9d9caa09f2c3 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:24:04.111704 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fdd3962d-4d2f-4193-bff0-9d9caa09f2c3'] response: {'server_uuid': 'eaaf9096-060c-4657-b936-82ba8dbb18ba', 'name': 'network-vif-deleted', 'tag': 'dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f', 'status': 'completed', 'code': 200} Mar 24 02:24:04.163060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:04.366897 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:04.395487 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] Checking router: 85f24485-6395-4873-a689-4b065205351e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:24:04.403480 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:04.404078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:04.512189 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:04.702855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:04.729024 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53baab5b-9e42-49a7-92ef-731e6d0ad3c7 None None] The sync data for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv is: [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:21:02Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '3e579ff6-609b-489b-a16a-1a3c8734fb9e', 'name': '', 'network_id': 'ba0c6650-a1cc-4c46-b400-5645003e471e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:7c:eb:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1388, 'fixed_ips': [{'subnet_id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:21:02Z', 'updated_at': '2022-03-24T02:21:05Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '28885c06-3de2-448e-bb1e-bc557d6d6307', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:24:04.949830 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25b85b9a-09d8-43e9-adc0-7299999739dd None None] New status for floating IP adce6263-6007-4ae5-bf2b-b28db2bccb16: DOWN {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:24:04.955806 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35188) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:05.012725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb53dbea-72ee-4213-bc28-38b2e4697fc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (e1c0a66f-ec17-4729-a339-ed292713a426), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.038401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb53dbea-72ee-4213-bc28-38b2e4697fc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (e1c0a66f-ec17-4729-a339-ed292713a426), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.100948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb53dbea-72ee-4213-bc28-38b2e4697fc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e1c0a66f-ec17-4729-a339-ed292713a426), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.103571 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-eb53dbea-72ee-4213-bc28-38b2e4697fc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.104748 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-eb53dbea-72ee-4213-bc28-38b2e4697fc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/security-groups/e1c0a66f-ec17-4729-a339-ed292713a426 HTTP/1.1" status: 204 len: 168 time: 0.1479678 Mar 24 02:24:05.116708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb53dbea-72ee-4213-bc28-38b2e4697fc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1c0a66f-ec17-4729-a339-ed292713a426,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:05.135373 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35192) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:05.258359 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:24:05.258673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.334656 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.334981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.346762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:24:05.474085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.505772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=b0971562-dfdf-47e5-bca4-7c0fa6f4b5f6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:05.563920 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (adce6263-6007-4ae5-bf2b-b28db2bccb16), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.566496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:05.568499 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-602fbed0-82b5-4421-b730-f27245f2488f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/floatingips/adce6263-6007-4ae5-bf2b-b28db2bccb16 HTTP/1.1" status: 204 len: 168 time: 0.4321005 Mar 24 02:24:05.776749 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d182f10-57c8-48a0-8221-b3900919f6a3 req-5b5cbe99-8353-4c5e-8d5a-49892434ca3c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:05.778135 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d182f10-57c8-48a0-8221-b3900919f6a3 req-5b5cbe99-8353-4c5e-8d5a-49892434ca3c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 945 time: 0.0522513 Mar 24 02:24:05.826122 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0d182f10-57c8-48a0-8221-b3900919f6a3 req-e7655608-e1b9-4b30-8419-aace0d407fcf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424607 Mar 24 02:24:06.237061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:24:06.259948 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:24:06.260292 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device dfdc1068-1c93-4b7a-8eca-d6fb7f4b2a4f not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:24:06.948720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f7780b-6e60-4e8f-8af5-c072aa745dca req-6a409bc8-42d8-4499-8394-d945d9e1199b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:06.950273 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d8f7780b-6e60-4e8f-8af5-c072aa745dca req-6a409bc8-42d8-4499-8394-d945d9e1199b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 945 time: 0.0583694 Mar 24 02:24:06.999147 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d8f7780b-6e60-4e8f-8af5-c072aa745dca req-2fb9a699-0d1b-47a8-bccb-842f3d8b7a26 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=df6fde4a-896e-4702-a547-6b7e0aaa7628&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434279 Mar 24 02:24:07.377251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-5498b085-1382-4740-a621-7dd6f6f4038e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:07.378742 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-5498b085-1382-4740-a621-7dd6f6f4038e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 945 time: 0.0531940 Mar 24 02:24:07.471265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 30104b10-829b-4559-afb5-d6df8fca3862 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:24:07.471604 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (30104b10-829b-4559-afb5-d6df8fca3862), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:07.562528 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 30104b10-829b-4559-afb5-d6df8fca3862, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=30104b10-829b-4559-afb5-d6df8fca3862,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:07.562922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (30104b10-829b-4559-afb5-d6df8fca3862), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:07.576259 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 30104b10-829b-4559-afb5-d6df8fca3862 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:24:07.702543 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (30104b10-829b-4559-afb5-d6df8fca3862), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:07.728768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=30104b10-829b-4559-afb5-d6df8fca3862,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:07.776717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] No DVR routers for this DVR port 30104b10-829b-4559-afb5-d6df8fca3862 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:24:07.779703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:07.783459 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6591e626-0b89-41dd-8c3b-47a61f1f6dfa req-267a4e4f-82c0-45c6-a9a3-db1eab69d669 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "DELETE /v2.0/ports/30104b10-829b-4559-afb5-d6df8fca3862 HTTP/1.1" status: 204 len: 173 time: 0.3998690 Mar 24 02:24:07.783966 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'name': 'network-vif-deleted', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:24:07.787225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e266f843-54d6-43db-932f-38d46921426d" -d '{"events": [{"server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "name": "network-vif-deleted", "tag": "30104b10-829b-4559-afb5-d6df8fca3862"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:24:07.832397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:24:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe30082a-a1eb-48fb-873a-a9f90434274f x-openstack-request-id: req-fe30082a-a1eb-48fb-873a-a9f90434274f {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:24:07.833206 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf362d87-4f7c-4b66-8a89-3152e822f1ad", "name": "network-vif-deleted", "tag": "30104b10-829b-4559-afb5-d6df8fca3862", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:24:07.833559 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-fe30082a-a1eb-48fb-873a-a9f90434274f {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:24:07.834128 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fe30082a-a1eb-48fb-873a-a9f90434274f'] response: {'server_uuid': 'cf362d87-4f7c-4b66-8a89-3152e822f1ad', 'name': 'network-vif-deleted', 'tag': '30104b10-829b-4559-afb5-d6df8fca3862', 'status': 'completed', 'code': 200} Mar 24 02:24:08.112384 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-93b33ef3-de58-4b31-949d-945eaffb1813 req-04a42e45-02c4-41ad-8fd9-3b1277466a49 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=cf362d87-4f7c-4b66-8a89-3152e822f1ad HTTP/1.1" status: 200 len: 210 time: 0.0325699 Mar 24 02:24:09.170007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35206) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:09.225641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-20e65323-75bd-4cb8-9f51-6e69ac3b286b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (df6fde4a-896e-4702-a547-6b7e0aaa7628), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:09.250283 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-20e65323-75bd-4cb8-9f51-6e69ac3b286b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (df6fde4a-896e-4702-a547-6b7e0aaa7628), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:09.309998 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-20e65323-75bd-4cb8-9f51-6e69ac3b286b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (df6fde4a-896e-4702-a547-6b7e0aaa7628), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:09.312658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-20e65323-75bd-4cb8-9f51-6e69ac3b286b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:09.313821 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-20e65323-75bd-4cb8-9f51-6e69ac3b286b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/security-groups/df6fde4a-896e-4702-a547-6b7e0aaa7628 HTTP/1.1" status: 204 len: 168 time: 0.1427660 Mar 24 02:24:09.322971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e65323-75bd-4cb8-9f51-6e69ac3b286b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=df6fde4a-896e-4702-a547-6b7e0aaa7628,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:09.351353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35210) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:09.768189 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (85f24485-6395-4873-a689-4b065205351e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:10.346350 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 3e579ff6-609b-489b-a16a-1a3c8734fb9e {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:24:10.347094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:10.434201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 3e579ff6-609b-489b-a16a-1a3c8734fb9e, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=3e579ff6-609b-489b-a16a-1a3c8734fb9e,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:10.434487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:10.451461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 3e579ff6-609b-489b-a16a-1a3c8734fb9e owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:24:10.639682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (3e579ff6-609b-489b-a16a-1a3c8734fb9e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:10.665963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=3e579ff6-609b-489b-a16a-1a3c8734fb9e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:10.852642 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (85f24485-6395-4873-a689-4b065205351e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.072511 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 85f24485-6395-4873-a689-4b065205351e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:24:11.182840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:24:11.190716 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-962810fa-e177-4bc3-896a-241754fd7c8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/85f24485-6395-4873-a689-4b065205351e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8382494 Mar 24 02:24:11.191281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35212) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:11.193417 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] Sync routers for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:24:11.202869 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:11.203573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:11.243308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-7b777fa4-00c8-4e4c-a3f8-847979b90c05 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting subnet 28885c06-3de2-448e-bb1e-bc557d6d6307 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:24:11.247081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b777fa4-00c8-4e4c-a3f8-847979b90c05 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (28885c06-3de2-448e-bb1e-bc557d6d6307), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.288180 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b777fa4-00c8-4e4c-a3f8-847979b90c05 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (28885c06-3de2-448e-bb1e-bc557d6d6307), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.308028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:11.415762 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b777fa4-00c8-4e4c-a3f8-847979b90c05 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (28885c06-3de2-448e-bb1e-bc557d6d6307), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.488641 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b777fa4-00c8-4e4c-a3f8-847979b90c05 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (28885c06-3de2-448e-bb1e-bc557d6d6307), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.490475 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:24:10Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:11.524953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b777fa4-00c8-4e4c-a3f8-847979b90c05 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Subnet': ['ID=28885c06-3de2-448e-bb1e-bc557d6d6307,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:11.528593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7b777fa4-00c8-4e4c-a3f8-847979b90c05 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.531836 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7b777fa4-00c8-4e4c-a3f8-847979b90c05 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/subnets/28885c06-3de2-448e-bb1e-bc557d6d6307 HTTP/1.1" status: 204 len: 168 time: 0.3396134 Mar 24 02:24:11.534413 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35214) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:11.645927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (85f24485-6395-4873-a689-4b065205351e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.668488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e649eb1-0f7c-41fc-94e1-10a5be1b5914 None None] Network ba0c6650-a1cc-4c46-b400-5645003e471e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:24:11.670744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] Checking router: 85f24485-6395-4873-a689-4b065205351e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:24:11.727041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] Routers {'85f24485-6395-4873-a689-4b065205351e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:11.727812 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['85f24485-6395-4873-a689-4b065205351e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:11.754414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (85f24485-6395-4873-a689-4b065205351e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.811137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port cb077203-15df-44dd-a433-82ffb1cd58cb {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:24:11.811976 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.863243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] Set router 85f24485-6395-4873-a689-4b065205351e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:11.895375 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port cb077203-15df-44dd-a433-82ffb1cd58cb, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=cb077203-15df-44dd-a433-82ffb1cd58cb,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:11.895736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:11.912632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for cb077203-15df-44dd-a433-82ffb1cd58cb owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:24:11.945687 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] DHCP port deletion for ba0c6650-a1cc-4c46-b400-5645003e471e request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:24:12.080017 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Deleting port 57c7ac70-c2d9-4bf6-826d-5c828d830eff {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:24:12.080479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.085709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (cb077203-15df-44dd-a433-82ffb1cd58cb), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.116593 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=cb077203-15df-44dd-a433-82ffb1cd58cb,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:12.155457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] For port 57c7ac70-c2d9-4bf6-826d-5c828d830eff, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=57c7ac70-c2d9-4bf6-826d-5c828d830eff,segment=NetworkSegment(098f9bd1-066a-47cf-bed4-2b3bea91de3b),segment_id=098f9bd1-066a-47cf-bed4-2b3bea91de3b)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:12.155773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.171881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Calling delete_port for 57c7ac70-c2d9-4bf6-826d-5c828d830eff owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:24:12.174307 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:24:10Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:12.180564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (85f24485-6395-4873-a689-4b065205351e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.206935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363bca4d-47da-401d-8ed5-c64df5c97167 None None] The sync data for ids ['85f24485-6395-4873-a689-4b065205351e'] in dv-neutron-834874-3-hyperv is: [{'id': '85f24485-6395-4873-a689-4b065205351e', 'name': 'tempest-TestNetworkBasicOps-router-1590268490', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165'}], 'enable_snat': True}, 'gw_port_id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:20:58Z', 'updated_at': '2022-03-24T02:24:10Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'cb077203-15df-44dd-a433-82ffb1cd58cb', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:61:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85f24485-6395-4873-a689-4b065205351e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1385, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:20:59Z', 'updated_at': '2022-03-24T02:21:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:24:12.276801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 30104b10-829b-4559-afb5-d6df8fca3862 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:24:12.285530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (85f24485-6395-4873-a689-4b065205351e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.288237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (85f24485-6395-4873-a689-4b065205351e), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.300031 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 30104b10-829b-4559-afb5-d6df8fca3862 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:24:12.300391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 30104b10-829b-4559-afb5-d6df8fca3862 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:24:12.303387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (57c7ac70-c2d9-4bf6-826d-5c828d830eff), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.328416 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Pushing event deleted for resources: {'Port': ['ID=57c7ac70-c2d9-4bf6-826d-5c828d830eff,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:12.333147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] No DVR routers for this DVR port 57c7ac70-c2d9-4bf6-826d-5c828d830eff on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:24:12.339307 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.339658 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.340000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.340338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.340669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.340998 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.341323 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.341645 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.341966 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.344486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.344486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.344486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.344486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.344486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.344486 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70cc03da-27ce-4b88-acbb-e70b4d056b79 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.359911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (85f24485-6395-4873-a689-4b065205351e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.360432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Fanout notify agent at l3_agent the message router_deleted on router 85f24485-6395-4873-a689-4b065205351e {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:24:12.367707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.368794 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2e6b2f5c-d584-45c6-b0ed-01204262ccad tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/routers/85f24485-6395-4873-a689-4b065205351e HTTP/1.1" status: 204 len: 168 time: 0.8333936 Mar 24 02:24:12.371539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35216) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:12.445075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (ba0c6650-a1cc-4c46-b400-5645003e471e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.531526 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (ba0c6650-a1cc-4c46-b400-5645003e471e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.552945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ba0c6650-a1cc-4c46-b400-5645003e471e']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:12.563187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '098f9bd1-066a-47cf-bed4-2b3bea91de3b') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:12.563484 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '098f9bd1-066a-47cf-bed4-2b3bea91de3b') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:12.574144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (098f9bd1-066a-47cf-bed4-2b3bea91de3b), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.588597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (098f9bd1-066a-47cf-bed4-2b3bea91de3b), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.594505 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Releasing vlan 134 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:24:12.594912 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (098f9bd1-066a-47cf-bed4-2b3bea91de3b), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:24:12.597815 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:24:12.659247 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (ba0c6650-a1cc-4c46-b400-5645003e471e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.666801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.670512 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/networks/ba0c6650-a1cc-4c46-b400-5645003e471e HTTP/1.1" status: 204 len: 168 time: 0.2980101 Mar 24 02:24:12.686931 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ba17438-34cd-49c3-a301-1805614ff9c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Network': ['ID=ba0c6650-a1cc-4c46-b400-5645003e471e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:12.692695 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35218) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:12.700245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'network': {'name': 'tempest-network-smoke--1991784245', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'port_security_enabled': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:12.722137 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:24:12.725696 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.749428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 131} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:24:12.759822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3cc256d2-b7e0-40c6-80c4-84cfcd7063c5), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.760164 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Added segment 3cc256d2-b7e0-40c6-80c4-84cfcd7063c5 of type vlan for network 200e8971-ae2d-467a-bc91-aa62cbd0d722 Mar 24 02:24:12.801785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (200e8971-ae2d-467a-bc91-aa62cbd0d722), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.808165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3e579ff6-609b-489b-a16a-1a3c8734fb9e no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:24:12.829511 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (200e8971-ae2d-467a-bc91-aa62cbd0d722), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.829931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 3e579ff6-609b-489b-a16a-1a3c8734fb9e {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:24:12.830556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 3e579ff6-609b-489b-a16a-1a3c8734fb9e not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:24:12.830988 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 57c7ac70-c2d9-4bf6-826d-5c828d830eff no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:24:12.835533 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:12.836164 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.851776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 57c7ac70-c2d9-4bf6-826d-5c828d830eff {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:24:12.851776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 57c7ac70-c2d9-4bf6-826d-5c828d830eff not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:24:12.907543 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2134142 Mar 24 02:24:12.910271 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35222) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:12.916582 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-996408681', 'admin_state_up': True, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:12.922729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Network': ['ID=200e8971-ae2d-467a-bc91-aa62cbd0d722,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:12.939149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.939503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.939849 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.940244 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.940660 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.941031 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.941593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.942618 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.943416 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.943751 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.944085 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.944418 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.944746 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.945071 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.945394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-271ad01e-3c3a-4f1b-a0cd-f2e1444861a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:12.956509 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (2f2c61f5-ef2e-4673-95a5-c994cd97d611), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:12.957043 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 200e8971-ae2d-467a-bc91-aa62cbd0d722 details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:24:12.957865 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (2f2c61f5-ef2e-4673-95a5-c994cd97d611), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:13.046504 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (2f2c61f5-ef2e-4673-95a5-c994cd97d611), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:13.186057 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (2f2c61f5-ef2e-4673-95a5-c994cd97d611), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:13.381800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (2f2c61f5-ef2e-4673-95a5-c994cd97d611), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:13.399892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:13.506579 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.205 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:24:13.606909 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:13.638659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:13.679398 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:24:13.682229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:24:13.688338 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:24:13.710074 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:13.932457 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (2f2c61f5-ef2e-4673-95a5-c994cd97d611), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:14.370939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (2f2c61f5-ef2e-4673-95a5-c994cd97d611), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:14.492052 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:24:14.596499 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:24:14.605781 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Sync routers for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:24:14.615470 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:14.616065 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:14.616465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:14.617678 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-9639aea9-c57a-4114-9d95-61ecc7a554b7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.7064412 Mar 24 02:24:14.621110 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35224) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:14.648385 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8cd7b93c-d8ab-4886-908b-1a24653c4d46 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=6c0b7eea99a4423dac22912b1fa60ca2&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0262070 Mar 24 02:24:14.650894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35226) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:14.703461 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device cb077203-15df-44dd-a433-82ffb1cd58cb no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:24:14.723197 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:14.724408 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: cb077203-15df-44dd-a433-82ffb1cd58cb {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:24:14.724958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device cb077203-15df-44dd-a433-82ffb1cd58cb not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:24:14.737782 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fedcd032-ffc2-45ce-9513-c01f42bdd590 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:14.739817 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fedcd032-ffc2-45ce-9513-c01f42bdd590 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0880499 Mar 24 02:24:14.742816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35228) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:14.771793 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-58660e11-cb25-475a-a09b-76d7699b1d12 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0277503 Mar 24 02:24:14.774226 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35230) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:14.779436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-148425574', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:14.869168 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:24:14.872798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:14.985829 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:13Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:15.012296 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Checking router: 2f2c61f5-ef2e-4673-95a5-c994cd97d611 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:24:15.012643 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Updating router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:24:15.039382 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.056064 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (ade64610-b570-4413-a67f-09aac2718316), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.063752 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.118134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Subnet': ['ID=ade64610-b570-4413-a67f-09aac2718316,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:15.126830 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Checking segment: {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:24:15.127186 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network hostable DHCP agents. Network: 200e8971-ae2d-467a-bc91-aa62cbd0d722, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:24:15.143557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 200e8971-ae2d-467a-bc91-aa62cbd0d722 is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:24:15.152024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 200e8971-ae2d-467a-bc91-aa62cbd0d722) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:24:15.157187 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:15.158650 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.166915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68dcea94-dbd1-4b41-817a-ce45db39fc06 None None] Network 200e8971-ae2d-467a-bc91-aa62cbd0d722 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:24:15.187018 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-70040c88-c029-4df2-b5fe-33db10227a8a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.4087942 Mar 24 02:24:15.187805 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35232) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:15.267720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-200e8971-ae2d-467a-bc91-aa62cbd0d722', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:24:15.268572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.299752 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Publish callbacks [] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.308817 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.359081 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Attempting to bind port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:24:15.359444 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Attempting to bind port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:24:15.360382 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Attempting to bind port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:24:15.370555 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Pushing event updated for resources: {'Port': ['ID=f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:15.372808 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 24, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:24:15.373175 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:24:15.373566 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.374148 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:24:15.374877 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Bound port: f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:24:15.375195 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.382094 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.382285 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.382581 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.382925 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.383236 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.383824 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.383958 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.384176 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.384509 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.384829 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.385548 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.385548 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.385782 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.386069 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.386377 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:24:15.414855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Allocated IP 172.20.0.2 (200e8971-ae2d-467a-bc91-aa62cbd0d722/ade64610-b570-4413-a67f-09aac2718316/fcc59f9f-3574-46c4-aad5-7070e2a1eebe) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:24:15.438144 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] For port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:24:15.441340 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] For port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:24:15.448885 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.500395 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:15.501025 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:15.576657 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b86a6293-656d-4aec-a8a4-7882b6e7fe61 None None] Pushing event updated for resources: {'Port': ['ID=f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:15.595850 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Publish callbacks [] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.602337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.621360 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:15.649699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Network 200e8971-ae2d-467a-bc91-aa62cbd0d722 is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:24:15.652547 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:24:15.655282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:24:15.668924 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Pushing event updated for resources: {'Port': ['ID=fcc59f9f-3574-46c4-aad5-7070e2a1eebe,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:15.723185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Attempting to bind port fcc59f9f-3574-46c4-aad5-7070e2a1eebe on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:24:15.723185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Attempting to bind port fcc59f9f-3574-46c4-aad5-7070e2a1eebe by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:24:15.724078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Attempting to bind port fcc59f9f-3574-46c4-aad5-7070e2a1eebe on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:24:15.724222 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.728558 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 24, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:24:15.728928 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Checking segment: {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:24:15.729332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.729720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Bound using segment: {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:24:15.730185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Bound port: fcc59f9f-3574-46c4-aad5-7070e2a1eebe, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:24:15.730586 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.800583 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] For port fcc59f9f-3574-46c4-aad5-7070e2a1eebe, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:24:15.802995 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:13Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:15.804023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] For port fcc59f9f-3574-46c4-aad5-7070e2a1eebe, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fcc59f9f-3574-46c4-aad5-7070e2a1eebe,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:24:15.812202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:15.830748 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67db0281-90d6-4276-8f81-a4626ba6f739 None None] The sync data for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv is: [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:13Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:24:15.875434 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd5c3e67-5843-4364-b816-170239aaab73 None None] Pushing event updated for resources: {'Port': ['ID=fcc59f9f-3574-46c4-aad5-7070e2a1eebe,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:16.175542 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.1 (200e8971-ae2d-467a-bc91-aa62cbd0d722/ade64610-b570-4413-a67f-09aac2718316/76199a90-4847-47b8-95e8-af175875dd39) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:24:16.311255 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (76199a90-4847-47b8-95e8-af175875dd39), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:16.345892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (76199a90-4847-47b8-95e8-af175875dd39), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:16.404990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 200e8971-ae2d-467a-bc91-aa62cbd0d722 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:24:16.412687 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:24:16.421340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:24:16.445860 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=76199a90-4847-47b8-95e8-af175875dd39,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:16.468826 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (2f2c61f5-ef2e-4673-95a5-c994cd97d611), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:16.612006 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (76199a90-4847-47b8-95e8-af175875dd39), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:16.834283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:24:16.889448 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:16.889952 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:16.933374 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (76199a90-4847-47b8-95e8-af175875dd39), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:16.939562 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (76199a90-4847-47b8-95e8-af175875dd39), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:16.967732 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d042988-127b-43e8-885e-346eb38df21d None None] Network 200e8971-ae2d-467a-bc91-aa62cbd0d722 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:24:17.013152 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=76199a90-4847-47b8-95e8-af175875dd39,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:17.018128 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (2f2c61f5-ef2e-4673-95a5-c994cd97d611), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.025333 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:17.025799 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.061985 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:17.071471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.072214 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fcc59f9f-3574-46c4-aad5-7070e2a1eebe up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:24:17.114608 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 200e8971-ae2d-467a-bc91-aa62cbd0d722 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:24:17.118600 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:24:17.146168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-c9f2205f-036b-42b8-9c79-ed608b6cc658 None None] Provisioning complete for port fcc59f9f-3574-46c4-aad5-7070e2a1eebe triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:17.146625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c9f2205f-036b-42b8-9c79-ed608b6cc658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.210157 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:17.237825 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:24:17.238825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fcc59f9f-3574-46c4-aad5-7070e2a1eebe triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:17.239895 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.312015 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-c9f2205f-036b-42b8-9c79-ed608b6cc658 None None] Current status of the port fcc59f9f-3574-46c4-aad5-7070e2a1eebe is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:17.312409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c9f2205f-036b-42b8-9c79-ed608b6cc658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.365018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:24:17.375341 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e22556bf-5100-4de7-81c3-9cd2f5d4bbf4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/2f2c61f5-ef2e-4673-95a5-c994cd97d611/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1840069 Mar 24 02:24:17.375711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35234) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:17.390259 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-c9f2205f-036b-42b8-9c79-ed608b6cc658 None None] For port fcc59f9f-3574-46c4-aad5-7070e2a1eebe, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fcc59f9f-3574-46c4-aad5-7070e2a1eebe,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:17.400613 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-c9f2205f-036b-42b8-9c79-ed608b6cc658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.407624 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fcc59f9f-3574-46c4-aad5-7070e2a1eebe is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:17.407624 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.505924 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9f2205f-036b-42b8-9c79-ed608b6cc658 None None] Pushing event updated for resources: {'Port': ['ID=fcc59f9f-3574-46c4-aad5-7070e2a1eebe,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:17.524914 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=104038) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Mar 24 02:24:17.525264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG oslo_db.api [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Mar 24 02:24:17.531135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d1fe88a7-ab82-47c1-81cf-9e4a325416e0 None None] Provisioning complete for port 76199a90-4847-47b8-95e8-af175875dd39 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:17.531508 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1fe88a7-ab82-47c1-81cf-9e4a325416e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (76199a90-4847-47b8-95e8-af175875dd39), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.568562 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d1fe88a7-ab82-47c1-81cf-9e4a325416e0 None None] Port 76199a90-4847-47b8-95e8-af175875dd39 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:24:17.575165 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-425242c0-ec07-4fd6-aab3-70a2fdd17285 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.575637 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-425242c0-ec07-4fd6-aab3-70a2fdd17285 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.576104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-425242c0-ec07-4fd6-aab3-70a2fdd17285 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.576564 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-425242c0-ec07-4fd6-aab3-70a2fdd17285 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.577104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-425242c0-ec07-4fd6-aab3-70a2fdd17285 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.577575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-425242c0-ec07-4fd6-aab3-70a2fdd17285 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.578956 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d1fe88a7-ab82-47c1-81cf-9e4a325416e0 None None] Provisioning complete for port fcc59f9f-3574-46c4-aad5-7070e2a1eebe triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:17.579448 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-425242c0-ec07-4fd6-aab3-70a2fdd17285 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4284 time: 0.2028053 Mar 24 02:24:17.579665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d1fe88a7-ab82-47c1-81cf-9e4a325416e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.582202 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35236) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:17.635537 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Sync routers for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:24:17.679392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:17.680025 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:17.681799 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d1fe88a7-ab82-47c1-81cf-9e4a325416e0 None None] Current status of the port fcc59f9f-3574-46c4-aad5-7070e2a1eebe is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:17.685402 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3592cd9-b7a6-4b45-a8da-59de130f2a8e tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.685943 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3592cd9-b7a6-4b45-a8da-59de130f2a8e tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.686465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3592cd9-b7a6-4b45-a8da-59de130f2a8e tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.687049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3592cd9-b7a6-4b45-a8da-59de130f2a8e tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.687560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3592cd9-b7a6-4b45-a8da-59de130f2a8e tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.688177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3592cd9-b7a6-4b45-a8da-59de130f2a8e tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:17.690042 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a3592cd9-b7a6-4b45-a8da-59de130f2a8e tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4003 time: 0.1067314 Mar 24 02:24:17.693800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35238) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:17.799385 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:17.844009 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d1e86665-e7ee-44cc-92be-99fc6c1041fe tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3046 time: 0.1487050 Mar 24 02:24:17.846818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35240) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:17.853225 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'name': 'tempest-TestNetworkBasicOps-1876447562', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:17.979992 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:24:17.983502 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:17.988081 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7f121635-ad82-46dc-a133-f30d4aaf76c8 None None] Provisioning complete for port 76199a90-4847-47b8-95e8-af175875dd39 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:17.988603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7f121635-ad82-46dc-a133-f30d4aaf76c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (76199a90-4847-47b8-95e8-af175875dd39), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.001512 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] device_id is not set on port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 yet. {{(pid=104036) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:24:18.110835 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.11 (200e8971-ae2d-467a-bc91-aa62cbd0d722/ade64610-b570-4413-a67f-09aac2718316/96f5b3fa-eece-427c-bafe-1e464a84c6b3) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:24:18.121816 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7f121635-ad82-46dc-a133-f30d4aaf76c8 None None] Port 76199a90-4847-47b8-95e8-af175875dd39 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:24:18.133748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fcc59f9f-3574-46c4-aad5-7070e2a1eebe is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:18.219199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '76199a90-4847-47b8-95e8-af175875dd39', 'name': '', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:58:45:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_interface', 'standard_attr_id': 1420, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:15Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'ade64610-b570-4413-a67f-09aac2718316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:18.249404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Checking router: 2f2c61f5-ef2e-4673-95a5-c994cd97d611 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:24:18.249759 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Updating router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 port 76199a90-4847-47b8-95e8-af175875dd39 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:24:18.275219 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.282538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (76199a90-4847-47b8-95e8-af175875dd39), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.285114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-eaabd533-304a-4de6-9333-dcc741369c31 None None] Provisioning complete for port 76199a90-4847-47b8-95e8-af175875dd39 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:18.285474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-eaabd533-304a-4de6-9333-dcc741369c31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (76199a90-4847-47b8-95e8-af175875dd39), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.309558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.351591 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-eaabd533-304a-4de6-9333-dcc741369c31 None None] Port 76199a90-4847-47b8-95e8-af175875dd39 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:24:18.358713 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 200e8971-ae2d-467a-bc91-aa62cbd0d722 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:24:18.361773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:24:18.364643 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:24:18.393393 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:18.420832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:18.421490 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.441179 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c4dd4ade-2e2f-412a-bfba-7d1096aea8c3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.5930910 Mar 24 02:24:18.600855 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Publish callbacks [] for port (76199a90-4847-47b8-95e8-af175875dd39), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.605986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (76199a90-4847-47b8-95e8-af175875dd39), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.655404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e89c7f-fed4-4149-be23-7f2c5df69499 None None] Pushing event updated for resources: {'Port': ['ID=76199a90-4847-47b8-95e8-af175875dd39,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:18.714978 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Attempting to bind port 76199a90-4847-47b8-95e8-af175875dd39 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:24:18.715441 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Attempting to bind port 76199a90-4847-47b8-95e8-af175875dd39 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:24:18.715704 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Attempting to bind port 76199a90-4847-47b8-95e8-af175875dd39 on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:24:18.723789 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7be83502-7bb1-4ab0-8582-50477a6e22da None None] Provisioning complete for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:18.724199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7be83502-7bb1-4ab0-8582-50477a6e22da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.727548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 24, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:24:18.727800 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Checking segment: {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:24:18.728008 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.728387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Bound using segment: {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:24:18.728878 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Bound port: 76199a90-4847-47b8-95e8-af175875dd39, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:24:18.729301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (76199a90-4847-47b8-95e8-af175875dd39), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.763399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35244) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:18.767930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-19f1e8bd-3615-430a-a694-e3ca3bc8fc01 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1585855855', 'description': 'tempest-secgroup-smoke-1585855855 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:18.789537 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-19f1e8bd-3615-430a-a694-e3ca3bc8fc01 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.803621 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:24:18.828597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7be83502-7bb1-4ab0-8582-50477a6e22da None None] Port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:24:18.861537 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-19f1e8bd-3615-430a-a694-e3ca3bc8fc01 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (0faaf22f-02d0-4472-b1bf-94b7305b3761), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.866019 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-19f1e8bd-3615-430a-a694-e3ca3bc8fc01 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0faaf22f-02d0-4472-b1bf-94b7305b3761), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.878503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] For port 76199a90-4847-47b8-95e8-af175875dd39, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:24:18.884373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] For port 76199a90-4847-47b8-95e8-af175875dd39, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=76199a90-4847-47b8-95e8-af175875dd39,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:24:18.893171 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (76199a90-4847-47b8-95e8-af175875dd39), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.896326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-19f1e8bd-3615-430a-a694-e3ca3bc8fc01 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.897563 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-19f1e8bd-3615-430a-a694-e3ca3bc8fc01 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1331723 Mar 24 02:24:18.900544 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35246) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:18.903599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19f1e8bd-3615-430a-a694-e3ca3bc8fc01 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0faaf22f-02d0-4472-b1bf-94b7305b3761,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:18.907289 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:18.907664 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:18.913629 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4a9e0d47-194a-4cde-9abd-c297b2904942 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '0faaf22f-02d0-4472-b1bf-94b7305b3761', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:18.944320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4a9e0d47-194a-4cde-9abd-c297b2904942 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (46592725-df82-4240-a927-482a5d38bfb9), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.015047 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4a9e0d47-194a-4cde-9abd-c297b2904942 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (46592725-df82-4240-a927-482a5d38bfb9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.019667 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4a9e0d47-194a-4cde-9abd-c297b2904942 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (46592725-df82-4240-a927-482a5d38bfb9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.020393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-3ae6f1fb-4f46-4f4a-bd5e-44978bb577d1 None None] Provisioning complete for port 76199a90-4847-47b8-95e8-af175875dd39 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:19.020937 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3ae6f1fb-4f46-4f4a-bd5e-44978bb577d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (76199a90-4847-47b8-95e8-af175875dd39), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.025440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e89c7f-fed4-4149-be23-7f2c5df69499 None None] Pushing event updated for resources: {'Port': ['ID=76199a90-4847-47b8-95e8-af175875dd39,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:19.027664 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:19.028367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:00Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:19.035808 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9e0d47-194a-4cde-9abd-c297b2904942 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=46592725-df82-4240-a927-482a5d38bfb9,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:19.055785 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4a9e0d47-194a-4cde-9abd-c297b2904942 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.058975 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4a9e0d47-194a-4cde-9abd-c297b2904942 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1573021 Mar 24 02:24:19.059993 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35248) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:19.065049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-4447d28b-0a10-443d-8dc1-1447506fe10c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '0faaf22f-02d0-4472-b1bf-94b7305b3761', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:19.094735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4447d28b-0a10-443d-8dc1-1447506fe10c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (202f09ab-9004-4ebf-b0fd-4681b863090c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.160897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4447d28b-0a10-443d-8dc1-1447506fe10c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (202f09ab-9004-4ebf-b0fd-4681b863090c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.165074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4447d28b-0a10-443d-8dc1-1447506fe10c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (202f09ab-9004-4ebf-b0fd-4681b863090c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.180746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:19.181775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fcc59f9f-3574-46c4-aad5-7070e2a1eebe up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:24:19.183348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4447d28b-0a10-443d-8dc1-1447506fe10c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=202f09ab-9004-4ebf-b0fd-4681b863090c,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:19.192615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-4447d28b-0a10-443d-8dc1-1447506fe10c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.194305 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-4447d28b-0a10-443d-8dc1-1447506fe10c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1332440 Mar 24 02:24:19.197069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35250) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:19.201292 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-fd2c341a-237c-44a1-b3fa-472b29d000d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '0faaf22f-02d0-4472-b1bf-94b7305b3761', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:19.225348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd2c341a-237c-44a1-b3fa-472b29d000d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (fcf95a76-8a16-47f3-859d-8b1aa55e3359), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.257868 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:19.281080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd2c341a-237c-44a1-b3fa-472b29d000d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (fcf95a76-8a16-47f3-859d-8b1aa55e3359), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.284648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd2c341a-237c-44a1-b3fa-472b29d000d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (fcf95a76-8a16-47f3-859d-8b1aa55e3359), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.302676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2c341a-237c-44a1-b3fa-472b29d000d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fcf95a76-8a16-47f3-859d-8b1aa55e3359,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:19.310970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd2c341a-237c-44a1-b3fa-472b29d000d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.312177 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fd2c341a-237c-44a1-b3fa-472b29d000d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1142273 Mar 24 02:24:19.315036 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35252) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:19.317771 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-3ae6f1fb-4f46-4f4a-bd5e-44978bb577d1 None None] Current status of the port 76199a90-4847-47b8-95e8-af175875dd39 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:19.318414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3ae6f1fb-4f46-4f4a-bd5e-44978bb577d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (76199a90-4847-47b8-95e8-af175875dd39), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.319657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-12ee812e-df07-452b-9cc5-6758bc237269 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '0faaf22f-02d0-4472-b1bf-94b7305b3761', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:19.344133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12ee812e-df07-452b-9cc5-6758bc237269 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c1470436-cf39-405c-bb55-26cc9ee0c695), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.370274 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fcc59f9f-3574-46c4-aad5-7070e2a1eebe triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:19.370682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.404505 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12ee812e-df07-452b-9cc5-6758bc237269 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c1470436-cf39-405c-bb55-26cc9ee0c695), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.408103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12ee812e-df07-452b-9cc5-6758bc237269 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (c1470436-cf39-405c-bb55-26cc9ee0c695), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.427991 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ee812e-df07-452b-9cc5-6758bc237269 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c1470436-cf39-405c-bb55-26cc9ee0c695,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:19.433538 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-12ee812e-df07-452b-9cc5-6758bc237269 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.434758 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-12ee812e-df07-452b-9cc5-6758bc237269 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1187198 Mar 24 02:24:19.437539 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35254) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:19.442152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-8843b5f4-14bc-490a-ac45-58d8fdf16874 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '0faaf22f-02d0-4472-b1bf-94b7305b3761', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:19.452181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-3ae6f1fb-4f46-4f4a-bd5e-44978bb577d1 None None] For port 76199a90-4847-47b8-95e8-af175875dd39, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=76199a90-4847-47b8-95e8-af175875dd39,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:19.462645 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-8843b5f4-14bc-490a-ac45-58d8fdf16874 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:24:19.463633 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3ae6f1fb-4f46-4f4a-bd5e-44978bb577d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (76199a90-4847-47b8-95e8-af175875dd39), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.467967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8843b5f4-14bc-490a-ac45-58d8fdf16874 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (628b0d94-4c6c-4852-babe-9563c75bcf73), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.526131 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8843b5f4-14bc-490a-ac45-58d8fdf16874 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (628b0d94-4c6c-4852-babe-9563c75bcf73), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.529757 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8843b5f4-14bc-490a-ac45-58d8fdf16874 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (628b0d94-4c6c-4852-babe-9563c75bcf73), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.547743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8843b5f4-14bc-490a-ac45-58d8fdf16874 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=628b0d94-4c6c-4852-babe-9563c75bcf73,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:19.556983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8843b5f4-14bc-490a-ac45-58d8fdf16874 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.560970 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8843b5f4-14bc-490a-ac45-58d8fdf16874 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1196535 Mar 24 02:24:19.561299 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35256) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:19.565632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a438ef4a-8de1-4219-97ee-ed34fab476dc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '0faaf22f-02d0-4472-b1bf-94b7305b3761', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:19.585137 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ae6f1fb-4f46-4f4a-bd5e-44978bb577d1 None None] Pushing event updated for resources: {'Port': ['ID=76199a90-4847-47b8-95e8-af175875dd39,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:19.586559 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-a438ef4a-8de1-4219-97ee-ed34fab476dc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:24:19.592808 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a438ef4a-8de1-4219-97ee-ed34fab476dc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (a5a4a921-4bae-4111-911e-9840d3ec6f0c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.613742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fcc59f9f-3574-46c4-aad5-7070e2a1eebe is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:19.622201 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8b0c787c-c91a-4e31-a468-b1031be8f072 None None] Provisioning complete for port 76199a90-4847-47b8-95e8-af175875dd39 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:19.622594 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8b0c787c-c91a-4e31-a468-b1031be8f072 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (76199a90-4847-47b8-95e8-af175875dd39), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.653258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a438ef4a-8de1-4219-97ee-ed34fab476dc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (a5a4a921-4bae-4111-911e-9840d3ec6f0c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.656943 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a438ef4a-8de1-4219-97ee-ed34fab476dc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (a5a4a921-4bae-4111-911e-9840d3ec6f0c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.659738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '76199a90-4847-47b8-95e8-af175875dd39', 'name': '', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:58:45:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_interface', 'standard_attr_id': 1420, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:15Z', 'updated_at': '2022-03-24T02:24:18Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'ade64610-b570-4413-a67f-09aac2718316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:19.676181 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a438ef4a-8de1-4219-97ee-ed34fab476dc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a5a4a921-4bae-4111-911e-9840d3ec6f0c,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:19.684477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a438ef4a-8de1-4219-97ee-ed34fab476dc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:19.685653 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a438ef4a-8de1-4219-97ee-ed34fab476dc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1234312 Mar 24 02:24:19.689699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4340a793-2c1a-4637-8cc7-ca3b3d6c683f None None] The sync data for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv is: [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '76199a90-4847-47b8-95e8-af175875dd39', 'name': '', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:58:45:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_interface', 'standard_attr_id': 1420, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:15Z', 'updated_at': '2022-03-24T02:24:18Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'ade64610-b570-4413-a67f-09aac2718316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:24:19.876046 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-e1f0e02c-bb01-43dd-9a86-193a9bd60e81 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1585855855&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.0516579 Mar 24 02:24:19.893426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8b0c787c-c91a-4e31-a468-b1031be8f072 None None] Current status of the port 76199a90-4847-47b8-95e8-af175875dd39 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:20.215105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-ecc28481-e8b6-4fee-bde7-f2091bb56a68 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:20.216528 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-ecc28481-e8b6-4fee-bde7-f2091bb56a68 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 931 time: 0.3300169 Mar 24 02:24:20.308374 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-c19e6b18-ad5e-4cb3-83e3-2566997cebbe service neutron] 10.222.0.20 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0795784 Mar 24 02:24:20.403181 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-b96da48e-c7ad-41fd-a3b8-e04afee19c62 service neutron] 10.222.0.20 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0892723 Mar 24 02:24:20.494711 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-707d388b-82e3-4685-b18a-96cf5ca0df78 service neutron] 10.222.0.20 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857918 Mar 24 02:24:20.546976 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-003927c6-ec0e-46ee-b1d2-e81afaad0032 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:20.548330 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-003927c6-ec0e-46ee-b1d2-e81afaad0032 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 931 time: 0.0479033 Mar 24 02:24:20.720583 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-90e98711-4cd0-4d76-a88a-af34ae2defcd req-a970c506-0fb0-4dd4-8b17-6496b6999157 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 210 time: 0.0386624 Mar 24 02:24:20.767417 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35282) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:20.790221 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 76199a90-4847-47b8-95e8-af175875dd39 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:24:20.841432 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 76199a90-4847-47b8-95e8-af175875dd39 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:20.841805 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (76199a90-4847-47b8-95e8-af175875dd39), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:20.865143 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-7a96d396-4524-4982-954f-693095f81e9b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:20.866419 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-7a96d396-4524-4982-954f-693095f81e9b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 931 time: 0.0977869 Mar 24 02:24:20.921993 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 76199a90-4847-47b8-95e8-af175875dd39 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:21.791327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-2846a702-d4fd-448b-a7f0-56502f7dc475 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:21.792752 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-2846a702-d4fd-448b-a7f0-56502f7dc475 service neutron] 10.222.0.30 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 1027 time: 0.0413306 Mar 24 02:24:21.837040 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-70638e38-da01-4158-8e26-d4ed3fe69f2b req-d5212eb8-f750-4c74-be41-f6635f73ae73 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 210 time: 0.0472724 Mar 24 02:24:21.921120 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-25c816f0-5716-41b3-8109-13fc21b8c0e2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:21.922555 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-25c816f0-5716-41b3-8109-13fc21b8c0e2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=200e8971-ae2d-467a-bc91-aa62cbd0d722 HTTP/1.1" status: 200 len: 797 time: 0.1209636 Mar 24 02:24:21.984932 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-3b9eabe0-74d5-4683-9bc4-376babe2498a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 380 time: 0.0526562 Mar 24 02:24:21.995154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Request body: {'port': {'device_id': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:22.050668 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:22.314530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 96f5b3fa-eece-427c-bafe-1e464a84c6b3 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:24:22.322000 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Publish callbacks [] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:22.333287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Transition to ACTIVE for port object 96f5b3fa-eece-427c-bafe-1e464a84c6b3 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:24:22.337090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:22.385126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:22.460645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Attempting to bind port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:24:22.461135 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Attempting to bind port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:24:22.461474 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Attempting to bind port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:24:22.466277 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:24:22.466621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Attempting to bind port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:24:22.471640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 24, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:24:22.471980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Checking segment: {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:24:22.472375 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Bound using segment: {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:24:22.472805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Bound port: 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:24:22.473663 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:22.540310 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:24:22.543381 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:24:22.548377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:22.580851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:22.581497 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:22.582934 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] 10.222.0.30 "PUT /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 1132 time: 0.5916853 Mar 24 02:24:22.583410 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:24:22.585824 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-728c6a7a-097c-451f-9e02-3ab25c3270f0" -d '{"events": [{"name": "network-changed", "server_uuid": "a4adaf24-97ef-434d-bb43-cf1e8e426c9f", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:24:22.617611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48865f5b-e028-4b74-95a6-38e1a375f441 service neutron] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:22.672752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:24:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e80e9b37-8439-4ef3-b479-272ec7456a18 x-openstack-request-id: req-e80e9b37-8439-4ef3-b479-272ec7456a18 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:24:22.673058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a4adaf24-97ef-434d-bb43-cf1e8e426c9f", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:24:22.673304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-e80e9b37-8439-4ef3-b479-272ec7456a18 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:24:22.673715 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e80e9b37-8439-4ef3-b479-272ec7456a18'] response: {'name': 'network-changed', 'server_uuid': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'status': 'completed', 'code': 200} Mar 24 02:24:22.710908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-50329d81-5a2f-480a-8926-6c49a0a079bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:22.712568 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-50329d81-5a2f-480a-8926-6c49a0a079bf service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 1166 time: 0.0731146 Mar 24 02:24:22.760714 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-83adf5ad-bfc5-4cd0-9a31-5d0e55e77418 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 217 time: 0.0406454 Mar 24 02:24:22.813227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-ca1a063c-b305-44c0-ad8b-90a40f003adf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:22.814745 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-ca1a063c-b305-44c0-ad8b-90a40f003adf service neutron] 10.222.0.30 "GET /v2.0/subnets?id=ade64610-b570-4413-a67f-09aac2718316 HTTP/1.1" status: 200 len: 834 time: 0.0484321 Mar 24 02:24:22.867646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-a1ec4aa6-85f9-4642-96e6-917f2fb6f361 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:22.869195 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-a1ec4aa6-85f9-4642-96e6-917f2fb6f361 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=200e8971-ae2d-467a-bc91-aa62cbd0d722&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0490723 Mar 24 02:24:23.002770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca2ebdd-72cc-462e-a267-ac6e8c9e6d35 req-541f6b4b-7f3f-41d0-8a45-cab24ac3106f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:23.004143 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1ca2ebdd-72cc-462e-a267-ac6e8c9e6d35 req-541f6b4b-7f3f-41d0-8a45-cab24ac3106f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 982 time: 0.0808933 Mar 24 02:24:23.006347 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-31db3eb0-5edd-4402-bf44-6a13afa2611b service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1306219 Mar 24 02:24:23.108344 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1ca2ebdd-72cc-462e-a267-ac6e8c9e6d35 req-01e00851-4a0e-42ab-be69-0b015328ef8c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0985689 Mar 24 02:24:23.131274 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0dd95918-4ae4-471a-9de7-e933dfdc1650 req-7d1ecae4-f1c7-4ba1-bab9-9936dbc47158 service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1158824 Mar 24 02:24:23.217966 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-c6da9882-4d8d-4249-b75f-a55a4302b3bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:23.219489 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-c6da9882-4d8d-4249-b75f-a55a4302b3bf service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 1166 time: 0.0466990 Mar 24 02:24:23.309787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-d7457411-41a3-4d90-97e9-47ca4a0805e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:23.311272 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-d7457411-41a3-4d90-97e9-47ca4a0805e2 service neutron] 10.222.0.30 "GET /v2.0/networks?id=200e8971-ae2d-467a-bc91-aa62cbd0d722 HTTP/1.1" status: 200 len: 898 time: 0.0861886 Mar 24 02:24:23.352217 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-a79d6315-819e-435c-ae35-ea707d81bbd6 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 217 time: 0.0344708 Mar 24 02:24:23.398837 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-21def382-7274-446d-ba82-ba875f5bf43b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:23.400240 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-21def382-7274-446d-ba82-ba875f5bf43b service neutron] 10.222.0.30 "GET /v2.0/subnets?id=ade64610-b570-4413-a67f-09aac2718316 HTTP/1.1" status: 200 len: 834 time: 0.0425205 Mar 24 02:24:23.453256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-957d2ba0-f8e7-47c7-85ff-ab5b5fb8cb1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:23.454754 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-957d2ba0-f8e7-47c7-85ff-ab5b5fb8cb1f service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=200e8971-ae2d-467a-bc91-aa62cbd0d722&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0483825 Mar 24 02:24:23.544395 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-ee08a181-be7a-4790-ae48-2a7cb49e58dd service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828595 Mar 24 02:24:23.637854 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-728c6a7a-097c-451f-9e02-3ab25c3270f0 req-f78546df-91bf-4514-9e29-46c2590d316e service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871067 Mar 24 02:24:23.988310 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:24:24.228770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4e5d03-be43-4f6a-943f-34238931e21a req-25e75244-d566-4bd8-a9cd-f187f198a2f6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:24.230291 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5d4e5d03-be43-4f6a-943f-34238931e21a req-25e75244-d566-4bd8-a9cd-f187f198a2f6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 982 time: 0.0531440 Mar 24 02:24:24.276454 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5d4e5d03-be43-4f6a-943f-34238931e21a req-9afff57a-713b-4841-ac64-b41d91c8175b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404918 Mar 24 02:24:25.391517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a44e2e-67b8-406b-9a65-ec8476a4cba9 req-01b6b945-3d98-4169-b2c5-ad268a4917cf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:25.392969 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d3a44e2e-67b8-406b-9a65-ec8476a4cba9 req-01b6b945-3d98-4169-b2c5-ad268a4917cf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 982 time: 0.0521734 Mar 24 02:24:25.438691 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d3a44e2e-67b8-406b-9a65-ec8476a4cba9 req-0f673101-2ff9-4acb-9753-ed158831ac71 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400987 Mar 24 02:24:26.330548 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 96f5b3fa-eece-427c-bafe-1e464a84c6b3 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:24:26.427368 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:26.438797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'port_id': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'mac_address': 'fa:16:3e:70:ca:c8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 131, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:24:26.476893 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:26.477279 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:26.490740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 96f5b3fa-eece-427c-bafe-1e464a84c6b3 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:24:26.510508 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:26.514558 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:26.561457 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6051472-0a43-46bc-867d-8ec3a29df1c5 req-f895fddc-1c75-4b3a-87c3-999658668668 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:26.562951 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6051472-0a43-46bc-867d-8ec3a29df1c5 req-f895fddc-1c75-4b3a-87c3-999658668668 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 983 time: 0.0581086 Mar 24 02:24:26.563186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:26.611249 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6051472-0a43-46bc-867d-8ec3a29df1c5 req-162f550e-88e6-4b72-b8be-d7118380b4a4 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406225 Mar 24 02:24:26.855302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['96f5b3fa-eece-427c-bafe-1e464a84c6b3'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:24:27.047634 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-72187d23-1f3d-4b1f-8c54-58f4809e673a service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0440176 Mar 24 02:24:27.111376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-6f9b2560-2683-4e49-a5f3-8bdbc61ac07d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:27.112838 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-6f9b2560-2683-4e49-a5f3-8bdbc61ac07d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 1130 time: 0.0437012 Mar 24 02:24:27.220578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-fa1a8fa3-252b-4e97-9c91-9d91d16cf39f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:27.222057 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-fa1a8fa3-252b-4e97-9c91-9d91d16cf39f service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.0874877 Mar 24 02:24:27.288067 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-20f1bf4f-0f0d-418c-b9b3-c8f8ba83385c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311 HTTP/1.1" status: 200 len: 1002 time: 0.0592399 Mar 24 02:24:27.340347 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-e33f6ee7-67c3-4966-8641-36cd2b7d9dfd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:27.341761 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-e33f6ee7-67c3-4966-8641-36cd2b7d9dfd service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0468736 Mar 24 02:24:27.390425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-54383727-531d-4441-a32e-806348c6d7bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:27.392013 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-54383727-531d-4441-a32e-806348c6d7bf service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0430644 Mar 24 02:24:27.397124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee92a986-d2d0-4793-b101-27a25f0e6edf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:27.482812 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-d3dbb83f-f1a4-447e-a4ac-cfc61e066d85 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833502 Mar 24 02:24:27.576733 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-33eebc7a-7cb1-40ab-93aa-01befae2e074 req-f755c558-3f68-43ab-8c7f-6e81a7d76d1f service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880198 Mar 24 02:24:27.732517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee57916-a68a-43a7-b985-143ee3113e66 req-26b31df4-06ca-4a07-8b4c-cee91c387022 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:27.734016 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dee57916-a68a-43a7-b985-143ee3113e66 req-26b31df4-06ca-4a07-8b4c-cee91c387022 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 983 time: 0.0545895 Mar 24 02:24:27.780855 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-dee57916-a68a-43a7-b985-143ee3113e66 req-d7c37356-eab8-472e-83de-b755c0a2cf3c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413389 Mar 24 02:24:28.345186 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 96f5b3fa-eece-427c-bafe-1e464a84c6b3 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:24:28.396214 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:24:28.400467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:28.401069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:28.477471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:28.477847 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:28.499929 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:24:28.502118 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58253215-ce16-42ab-afa0-0d7fe2eec65a" -d '{"events": [{"server_uuid": "a4adaf24-97ef-434d-bb43-cf1e8e426c9f", "name": "network-vif-plugged", "status": "completed", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:24:28.514190 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:28.518045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:28.565832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:28.596261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:24:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-21cc3212-b1db-431a-8865-ef7bbef16370 x-openstack-request-id: req-21cc3212-b1db-431a-8865-ef7bbef16370 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:24:28.596560 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a4adaf24-97ef-434d-bb43-cf1e8e426c9f", "name": "network-vif-plugged", "status": "completed", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:24:28.596849 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-21cc3212-b1db-431a-8865-ef7bbef16370 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:24:28.597263 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-21cc3212-b1db-431a-8865-ef7bbef16370'] response: {'server_uuid': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'code': 200} Mar 24 02:24:28.761200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ba5072-cc5b-4f94-86eb-f4326b8a9f9f req-244f4616-69d1-4e77-affa-a0adc5204342 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:28.762740 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-00ba5072-cc5b-4f94-86eb-f4326b8a9f9f req-244f4616-69d1-4e77-affa-a0adc5204342 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 1168 time: 0.0475094 Mar 24 02:24:28.804848 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-00ba5072-cc5b-4f94-86eb-f4326b8a9f9f req-1703411f-692a-437f-b7ef-85cefb74be28 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0363424 Mar 24 02:24:28.894873 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1a9630-aef8-4698-bf65-dc7ba7fcf647 req-93373799-625e-4729-b6a7-cdc78748e89a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:28.896827 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-da1a9630-aef8-4698-bf65-dc7ba7fcf647 req-93373799-625e-4729-b6a7-cdc78748e89a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 984 time: 0.0519254 Mar 24 02:24:28.943200 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-da1a9630-aef8-4698-bf65-dc7ba7fcf647 req-65614e36-307f-49ad-a353-7c397900eabf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405388 Mar 24 02:24:30.065304 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4508c323-4054-4394-8e1d-39e9e3dc5654 req-9d7ec19d-d066-438b-9203-e782e929abe7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:30.067026 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4508c323-4054-4394-8e1d-39e9e3dc5654 req-9d7ec19d-d066-438b-9203-e782e929abe7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 984 time: 0.0546458 Mar 24 02:24:30.129143 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4508c323-4054-4394-8e1d-39e9e3dc5654 req-e87f6005-9ea8-4a35-8de8-ccaf013034ec tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558255 Mar 24 02:24:30.513060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f13c2e20-43aa-43c0-b971-b3b424864054 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:30.877131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:31.251424 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e43fbbf-f791-408e-806d-a0d5a11e431a req-c88d4e89-4b8d-41d7-8173-b582b42d270b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:31.252894 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4e43fbbf-f791-408e-806d-a0d5a11e431a req-c88d4e89-4b8d-41d7-8173-b582b42d270b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 984 time: 0.0522261 Mar 24 02:24:31.299437 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4e43fbbf-f791-408e-806d-a0d5a11e431a req-31286f08-9895-4208-a720-98e9d51e0578 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409436 Mar 24 02:24:31.416071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc53203f-6531-4d7f-bbe2-bfad2baa64cb req-ab61671d-fc81-4fd9-9bf5-f5f59895dc45 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:31.417461 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cc53203f-6531-4d7f-bbe2-bfad2baa64cb req-ab61671d-fc81-4fd9-9bf5-f5f59895dc45 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 984 time: 0.0527036 Mar 24 02:24:31.470795 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cc53203f-6531-4d7f-bbe2-bfad2baa64cb req-760141ca-bfdd-466e-812d-c4647694b09c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477352 Mar 24 02:24:31.497617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35354) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:31.545303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71bf7c80-b2d4-48ab-ad90-265a6ec2880f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:31.546824 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-71bf7c80-b2d4-48ab-ad90-265a6ec2880f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 1163 time: 0.0478268 Mar 24 02:24:31.549667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35356) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:31.554183 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address': '172.20.0.11'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:31.575495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:31.670289 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:31.782408 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.123 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/a0f78e63-e6ad-47dc-bde2-22800401a37a) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:24:31.884048 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (a0f78e63-e6ad-47dc-bde2-22800401a37a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:31.916521 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a0f78e63-e6ad-47dc-bde2-22800401a37a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:31.956369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:24:31.959127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:24:31.961832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:24:31.991335 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=a0f78e63-e6ad-47dc-bde2-22800401a37a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:32.317705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (0bf1a359-a29d-47d7-ab97-610c0c4f8983), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:32.387795 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a0f78e63-e6ad-47dc-bde2-22800401a37a), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:32.439266 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:32.544573 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (a0f78e63-e6ad-47dc-bde2-22800401a37a), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:32.549203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (a0f78e63-e6ad-47dc-bde2-22800401a37a), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:32.619293 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=a0f78e63-e6ad-47dc-bde2-22800401a37a,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:32.631623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (0bf1a359-a29d-47d7-ab97-610c0c4f8983), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:32.737608 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP 0bf1a359-a29d-47d7-ab97-610c0c4f8983 associated. External IP: 172.26.2.123, port: 96f5b3fa-eece-427c-bafe-1e464a84c6b3. Mar 24 02:24:32.952157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:24:33.060923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:24:33.071969 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] Sync routers for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:24:33.080710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:33.082882 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:33.083495 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:33.198364 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:33.415030 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dcd026c8-2278-48b7-9dc2-8668a7d27f4e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 1035 time: 1.8643117 Mar 24 02:24:33.415717 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:24:33.417863 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35360) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:33.418278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a" -d '{"events": [{"name": "network-changed", "server_uuid": "a4adaf24-97ef-434d-bb43-cf1e8e426c9f", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:24:33.434956 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '0bf1a359-a29d-47d7-ab97-610c0c4f8983', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.123', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'port_id': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1432, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1876447562', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'mac_address': 'fa:16:3e:70:ca:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:24:32Z', 'updated_at': '2022-03-24T02:24:32Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '76199a90-4847-47b8-95e8-af175875dd39', 'name': '', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:58:45:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_interface', 'standard_attr_id': 1420, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:15Z', 'updated_at': '2022-03-24T02:24:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'ade64610-b570-4413-a67f-09aac2718316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:33.459633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:24:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8872c116-50e5-4f78-b2a5-5ff837b2c209 x-openstack-request-id: req-8872c116-50e5-4f78-b2a5-5ff837b2c209 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:24:33.459945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a4adaf24-97ef-434d-bb43-cf1e8e426c9f", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:24:33.460204 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-8872c116-50e5-4f78-b2a5-5ff837b2c209 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:24:33.460608 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8872c116-50e5-4f78-b2a5-5ff837b2c209'] response: {'name': 'network-changed', 'server_uuid': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'status': 'completed', 'code': 200} Mar 24 02:24:33.468164 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] Checking router: 2f2c61f5-ef2e-4673-95a5-c994cd97d611 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:24:33.478328 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:24:33.479087 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:33.581488 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-0cad0e5a-38c8-4419-94d1-b12a0e783254 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:33.583827 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-0cad0e5a-38c8-4419-94d1-b12a0e783254 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 1168 time: 0.0869353 Mar 24 02:24:33.639248 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:24:33.712590 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-3bb1c9ab-2d89-4cdb-b6b5-13b90d25d58b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:33.714112 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-3bb1c9ab-2d89-4cdb-b6b5-13b90d25d58b service neutron] 10.222.0.30 "GET /v2.0/networks?id=200e8971-ae2d-467a-bc91-aa62cbd0d722 HTTP/1.1" status: 200 len: 898 time: 0.1234994 Mar 24 02:24:33.719078 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:33.823301 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-c472f7fb-892d-40ba-8867-3aeb98f7d147 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 1038 time: 0.1028106 Mar 24 02:24:33.855035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3515f98-4053-459f-96ac-6ca8179d1521 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:33.859934 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c3515f98-4053-459f-96ac-6ca8179d1521 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f&network_id=200e8971-ae2d-467a-bc91-aa62cbd0d722 HTTP/1.1" status: 200 len: 1163 time: 0.4403315 Mar 24 02:24:33.898432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-464803a4-aa59-4897-85bb-36607c7f2d40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:33.900313 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-464803a4-aa59-4897-85bb-36607c7f2d40 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=ade64610-b570-4413-a67f-09aac2718316 HTTP/1.1" status: 200 len: 834 time: 0.0710950 Mar 24 02:24:33.960794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-68e3363d-f280-46b4-8088-b9cb0a0fe36e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:33.962393 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-68e3363d-f280-46b4-8088-b9cb0a0fe36e service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=200e8971-ae2d-467a-bc91-aa62cbd0d722&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0547669 Mar 24 02:24:34.032558 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '0bf1a359-a29d-47d7-ab97-610c0c4f8983', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.123', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'port_id': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1432, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1876447562', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'mac_address': 'fa:16:3e:70:ca:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:24:32Z', 'updated_at': '2022-03-24T02:24:32Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '76199a90-4847-47b8-95e8-af175875dd39', 'name': '', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:58:45:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_interface', 'standard_attr_id': 1420, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:15Z', 'updated_at': '2022-03-24T02:24:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'ade64610-b570-4413-a67f-09aac2718316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:24:34.061329 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-419f8cc9-0ef9-4ad3-a3e3-35a0c1e32575 None None] The sync data for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv is: [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '0bf1a359-a29d-47d7-ab97-610c0c4f8983', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.123', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'port_id': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1432, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1876447562', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'mac_address': 'fa:16:3e:70:ca:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4adaf24-97ef-434d-bb43-cf1e8e426c9f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:24:32Z', 'updated_at': '2022-03-24T02:24:32Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '76199a90-4847-47b8-95e8-af175875dd39', 'name': '', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:58:45:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_interface', 'standard_attr_id': 1420, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:15Z', 'updated_at': '2022-03-24T02:24:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'ade64610-b570-4413-a67f-09aac2718316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:24:34.104415 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-ad94a247-35fe-4e31-9e24-d3ab7ef8d4f7 service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1363382 Mar 24 02:24:34.172154 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de57cb70-bcde-4846-97ff-55c40187cf83 req-2ccca286-c407-4077-b1fb-6602d3a44460 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:34.173645 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-de57cb70-bcde-4846-97ff-55c40187cf83 req-2ccca286-c407-4077-b1fb-6602d3a44460 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 984 time: 0.1171012 Mar 24 02:24:34.247395 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-de57cb70-bcde-4846-97ff-55c40187cf83 req-32a97f77-b8ef-46ed-aacb-301609e6787d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670693 Mar 24 02:24:34.255667 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0413cbd3-91e8-48bc-b89c-bfee49fc8a7a req-d727ea22-3298-4bb3-886c-2675a49db5a5 service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1437123 Mar 24 02:24:34.298107 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddf17274-de12-4caf-81c5-c71bd903015e None None] New status for floating IP 0bf1a359-a29d-47d7-ab97-610c0c4f8983: ACTIVE {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:24:35.386199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-128c0910-0696-4df9-87ca-df133f62fcb9 req-1557cbeb-35db-4918-9dcc-f9913003c166 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:35.392976 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-128c0910-0696-4df9-87ca-df133f62fcb9 req-1557cbeb-35db-4918-9dcc-f9913003c166 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 984 time: 0.0630488 Mar 24 02:24:35.436202 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-128c0910-0696-4df9-87ca-df133f62fcb9 req-f2237273-54ad-4f3c-a5fe-bfa276c87bd6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423405 Mar 24 02:24:35.539232 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-01c42e7d-a273-45ed-b5ae-5652d4655ff5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:35.540778 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-01c42e7d-a273-45ed-b5ae-5652d4655ff5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 984 time: 0.0759599 Mar 24 02:24:35.596281 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-96669889-dbc0-424a-b8cd-29669108394c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:35.598390 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-96669889-dbc0-424a-b8cd-29669108394c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0521271 Mar 24 02:24:35.737203 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-2ec1cd2d-a36c-40e9-bb2f-78e466af6ef1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.1335337 Mar 24 02:24:35.747255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:35.818719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:35.968414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:36.011764 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:24:36.061349 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] device_id is not set on port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:24:36.071496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] Publish callbacks [] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:36.081113 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:36.232065 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=6']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:36.303020 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] No DVR routers for this DVR port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:24:36.474880 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b742a6c4-37ee-4d67-80d7-fdaa42a9348c None None] Provisioning complete for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:36.476108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b742a6c4-37ee-4d67-80d7-fdaa42a9348c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:36.483761 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] In _notify_port_updated(), no bound segment for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:24:36.486234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:36.486894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:36.489794 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-aa982355-2f1c-443a-b67d-77c30d4eac0b req-e248443d-a4a0-4ac6-8026-5c4adf5324a6 service neutron] 10.222.0.30 "PUT /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 1027 time: 0.7460263 Mar 24 02:24:36.559373 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b742a6c4-37ee-4d67-80d7-fdaa42a9348c None None] Port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:24:36.570946 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2bd82cb5-e5cf-4901-8ed2-8e9236b2f5e3 req-c7ad3ef3-9a81-4670-8c35-8bfc7699543e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=a4adaf24-97ef-434d-bb43-cf1e8e426c9f HTTP/1.1" status: 200 len: 210 time: 0.0475001 Mar 24 02:24:37.649250 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35382) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:37.705824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95567429-3c87-4ded-bd59-a8ef1a7621c0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:37.712805 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-95567429-3c87-4ded-bd59-a8ef1a7621c0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 926 time: 0.0625269 Mar 24 02:24:38.202962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35388) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:38.207683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ae40ffae-a8d7-48c3-be7f-e0ee75efe862 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1442566933', 'description': 'tempest-secgroup-smoke-1442566933 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:38.234923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae40ffae-a8d7-48c3-be7f-e0ee75efe862 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.311719 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae40ffae-a8d7-48c3-be7f-e0ee75efe862 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (d425b97c-0300-4936-a43f-fad9d09d521a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.320227 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae40ffae-a8d7-48c3-be7f-e0ee75efe862 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d425b97c-0300-4936-a43f-fad9d09d521a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.353208 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae40ffae-a8d7-48c3-be7f-e0ee75efe862 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d425b97c-0300-4936-a43f-fad9d09d521a,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:38.366086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ae40ffae-a8d7-48c3-be7f-e0ee75efe862 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.368896 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ae40ffae-a8d7-48c3-be7f-e0ee75efe862 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1634407 Mar 24 02:24:38.370358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35390) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:38.374872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-8105b3a5-b373-4145-9995-f9b6a4ec7737 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd425b97c-0300-4936-a43f-fad9d09d521a', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:38.409694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8105b3a5-b373-4145-9995-f9b6a4ec7737 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (5f3bf38b-9961-44bc-bd29-72d9192da1d1), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.469645 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8105b3a5-b373-4145-9995-f9b6a4ec7737 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (5f3bf38b-9961-44bc-bd29-72d9192da1d1), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.474015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8105b3a5-b373-4145-9995-f9b6a4ec7737 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (5f3bf38b-9961-44bc-bd29-72d9192da1d1), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.492694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8105b3a5-b373-4145-9995-f9b6a4ec7737 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5f3bf38b-9961-44bc-bd29-72d9192da1d1,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:38.498841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-8105b3a5-b373-4145-9995-f9b6a4ec7737 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.500035 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8105b3a5-b373-4145-9995-f9b6a4ec7737 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1286249 Mar 24 02:24:38.502823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35392) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:38.507426 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-a67b4efd-dafd-461e-959a-27f24a61f96d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd425b97c-0300-4936-a43f-fad9d09d521a', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:38.539320 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a67b4efd-dafd-461e-959a-27f24a61f96d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (10739247-6317-49fd-b0cc-d7572bc813fa), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.606814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a67b4efd-dafd-461e-959a-27f24a61f96d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (10739247-6317-49fd-b0cc-d7572bc813fa), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.610566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a67b4efd-dafd-461e-959a-27f24a61f96d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (10739247-6317-49fd-b0cc-d7572bc813fa), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.630742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67b4efd-dafd-461e-959a-27f24a61f96d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=10739247-6317-49fd-b0cc-d7572bc813fa,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:38.637112 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a67b4efd-dafd-461e-959a-27f24a61f96d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.641018 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35394) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:38.641167 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a67b4efd-dafd-461e-959a-27f24a61f96d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1372066 Mar 24 02:24:38.646186 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4b722c38-37c0-4bd3-a2c3-a4e200f3315d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd425b97c-0300-4936-a43f-fad9d09d521a', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:38.671954 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b722c38-37c0-4bd3-a2c3-a4e200f3315d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (f40da68a-2a3e-41ef-a5ff-2ff133ccaf28), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.733067 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b722c38-37c0-4bd3-a2c3-a4e200f3315d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (f40da68a-2a3e-41ef-a5ff-2ff133ccaf28), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.737053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b722c38-37c0-4bd3-a2c3-a4e200f3315d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (f40da68a-2a3e-41ef-a5ff-2ff133ccaf28), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.756290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b722c38-37c0-4bd3-a2c3-a4e200f3315d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f40da68a-2a3e-41ef-a5ff-2ff133ccaf28,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:38.766908 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4b722c38-37c0-4bd3-a2c3-a4e200f3315d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.771464 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4b722c38-37c0-4bd3-a2c3-a4e200f3315d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1293516 Mar 24 02:24:38.772192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35396) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:38.776963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-f7e30e43-2088-49bf-9666-a8aa4bc8f946 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd425b97c-0300-4936-a43f-fad9d09d521a', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:38.807255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7e30e43-2088-49bf-9666-a8aa4bc8f946 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c60cbdf9-5b41-42a5-90e2-0283a4640982), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.870766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7e30e43-2088-49bf-9666-a8aa4bc8f946 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c60cbdf9-5b41-42a5-90e2-0283a4640982), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.876116 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7e30e43-2088-49bf-9666-a8aa4bc8f946 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (c60cbdf9-5b41-42a5-90e2-0283a4640982), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.897476 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7e30e43-2088-49bf-9666-a8aa4bc8f946 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c60cbdf9-5b41-42a5-90e2-0283a4640982,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:38.908254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7e30e43-2088-49bf-9666-a8aa4bc8f946 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:38.913176 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f7e30e43-2088-49bf-9666-a8aa4bc8f946 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1397614 Mar 24 02:24:38.914002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35400) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:38.919444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-dc399ee8-0ccb-4916-ac46-fd6381b2d196 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd425b97c-0300-4936-a43f-fad9d09d521a', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:38.948723 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-dc399ee8-0ccb-4916-ac46-fd6381b2d196 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:24:38.953716 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc399ee8-0ccb-4916-ac46-fd6381b2d196 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (1f71450c-70df-4480-af6a-dfeef2ee949c), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:39.019910 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc399ee8-0ccb-4916-ac46-fd6381b2d196 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (1f71450c-70df-4480-af6a-dfeef2ee949c), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:39.024324 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc399ee8-0ccb-4916-ac46-fd6381b2d196 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (1f71450c-70df-4480-af6a-dfeef2ee949c), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:39.044593 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc399ee8-0ccb-4916-ac46-fd6381b2d196 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1f71450c-70df-4480-af6a-dfeef2ee949c,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:39.053184 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc399ee8-0ccb-4916-ac46-fd6381b2d196 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:39.054422 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dc399ee8-0ccb-4916-ac46-fd6381b2d196 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1392071 Mar 24 02:24:39.057042 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35402) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:39.061360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-bd7021d4-6fce-4a6f-b4ca-31435c4ff382 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd425b97c-0300-4936-a43f-fad9d09d521a', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:39.084786 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-bd7021d4-6fce-4a6f-b4ca-31435c4ff382 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:24:39.090034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd7021d4-6fce-4a6f-b4ca-31435c4ff382 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (029bdf0a-1aaa-4ad7-94d1-3530160dc8a6), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:39.150816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd7021d4-6fce-4a6f-b4ca-31435c4ff382 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (029bdf0a-1aaa-4ad7-94d1-3530160dc8a6), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:39.154934 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd7021d4-6fce-4a6f-b4ca-31435c4ff382 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (029bdf0a-1aaa-4ad7-94d1-3530160dc8a6), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:39.172911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd7021d4-6fce-4a6f-b4ca-31435c4ff382 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=029bdf0a-1aaa-4ad7-94d1-3530160dc8a6,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:39.182210 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd7021d4-6fce-4a6f-b4ca-31435c4ff382 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:39.183452 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bd7021d4-6fce-4a6f-b4ca-31435c4ff382 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1254466 Mar 24 02:24:39.363159 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-fc251615-0f21-40e6-a510-d56bd6bad31c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1442566933&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.0460339 Mar 24 02:24:39.421212 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-da3dad94-c6b3-4430-8e1c-6f335e8aef0d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:39.425717 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-da3dad94-c6b3-4430-8e1c-6f335e8aef0d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 931 time: 0.0558403 Mar 24 02:24:39.557078 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-4e2b7277-1ef6-4736-843a-f129902d883b service neutron] 10.222.0.20 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.1216519 Mar 24 02:24:39.645265 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-75f313d1-be82-4ec1-9e3f-28760d78515f service neutron] 10.222.0.20 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821924 Mar 24 02:24:39.737821 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-4ec19df6-aa1e-496e-af9f-ce780218196a service neutron] 10.222.0.20 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868592 Mar 24 02:24:39.791168 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-4197c811-32f9-4a79-aa18-83d564ec61da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:39.793276 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-4197c811-32f9-4a79-aa18-83d564ec61da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 931 time: 0.0482192 Mar 24 02:24:40.422703 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 96f5b3fa-eece-427c-bafe-1e464a84c6b3 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:24:40.460758 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] The host hv-neutron-8348 is not matching for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 host ! {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2354}} Mar 24 02:24:40.461133 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 96f5b3fa-eece-427c-bafe-1e464a84c6b3 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:24:40.969043 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b99db627-1899-48bb-b2a9-487ba01d6343 req-a19ae594-f4c8-441b-a973-629263d2ba91 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 210 time: 0.0273755 Mar 24 02:24:41.228426 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-88b4b946-aa53-45e4-8028-58117f945313 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-425833467&fields=id&tenant_id=534ec00707834d9cbfb4f670cfeda590 HTTP/1.1" status: 200 len: 267 time: 0.0427501 Mar 24 02:24:41.334111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921615e1-e3a4-4fca-9994-610292105453 req-15d302b6-441f-4d38-b625-b1669022ab3e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:41.335592 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-15d302b6-441f-4d38-b625-b1669022ab3e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 810 time: 0.1012206 Mar 24 02:24:41.349909 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-64a307e8-79e6-4068-be6d-b9437c456683 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/quotas/534ec00707834d9cbfb4f670cfeda590 HTTP/1.1" status: 200 len: 375 time: 0.0092239 Mar 24 02:24:41.405685 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-71f83078-4a33-4345-bcd5-d155bfed29e6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0511642 Mar 24 02:24:41.503888 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-34ab1e23-6057-4c56-b0c0-0b65ad235c02 service neutron] 10.222.0.20 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866385 Mar 24 02:24:41.591016 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-baa3ec12-a60e-4e86-8190-1dd6a07dedf8 service neutron] 10.222.0.20 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815680 Mar 24 02:24:41.870430 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-983810d5-5b60-4f27-94e1-ea4e6d38c38e req-b7377b55-6f55-4ebf-9022-c429dbaf2916 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0273905 Mar 24 02:24:42.000724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-45d489a9-9fff-4e4a-bea7-d762df444206 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:42.002247 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-45d489a9-9fff-4e4a-bea7-d762df444206 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 931 time: 0.0556409 Mar 24 02:24:42.050763 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-88aaa137-abfc-4bf7-a7e5-e5cfd4efb96f req-1015880e-3fbd-4f2d-a555-36250c0726f9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 210 time: 0.0314145 Mar 24 02:24:42.841300 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921615e1-e3a4-4fca-9994-610292105453 req-604345f1-4e0b-4e91-9669-064db6e78ba3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:42.842918 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-604345f1-4e0b-4e91-9669-064db6e78ba3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 810 time: 0.1018977 Mar 24 02:24:42.908312 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-01458e40-192a-4d88-b7bd-82d498b30c0b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=534ec00707834d9cbfb4f670cfeda590 HTTP/1.1" status: 200 len: 379 time: 0.0577362 Mar 24 02:24:42.916309 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'port': {'device_id': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'admin_state_up': True, 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'security_groups': ['8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:42.991193 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6d7ef109-fc25-4ebc-8e72-6c08748ad8ad req-cd962b63-2679-4089-9b51-736543564857 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0336869 Mar 24 02:24:43.052334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Made reservation on behalf of 534ec00707834d9cbfb4f670cfeda590 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:24:43.056424 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:43.153126 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e59cb290-bff5-411a-8e45-dc61e4769ab2 req-10fe84db-f1d6-490e-9d8a-8d3c92ec2b8d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 210 time: 0.0316186 Mar 24 02:24:43.219579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Allocated IP 172.20.0.13 (1c7b4ca8-c501-4e72-9eba-3ca17999702e/7098e0b3-a3e5-4826-921e-69dc9ba94ef6/f7cc65a8-3ed6-4a46-9edf-cc2afead1568) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:24:43.375923 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:43.420887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:43.466058 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:24:43.469353 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:24:43.476615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:24:43.484054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'Port': ['ID=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:43.546510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:43.547301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:43.566447 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-0a581bca-7d2c-4d88-a72b-a2e2e97f9b35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6537988 Mar 24 02:24:43.576808 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Request body: {'port': {'device_id': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:43.651432 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:43.835451 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-60c50524-18ec-4c1d-841a-4cbc9b668d15 None None] Provisioning complete for port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:43.836888 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-60c50524-18ec-4c1d-841a-4cbc9b668d15 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:43.881071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-60c50524-18ec-4c1d-841a-4cbc9b668d15 None None] Port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:24:43.945980 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f7cc65a8-3ed6-4a46-9edf-cc2afead1568 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:24:43.954941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Publish callbacks [] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:43.970700 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Transition to ACTIVE for port object f7cc65a8-3ed6-4a46-9edf-cc2afead1568 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:24:43.975904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:44.070406 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-0dd17fbd-415f-4ff0-adf0-7cc55c150ca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:44.071963 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-0dd17fbd-415f-4ff0-adf0-7cc55c150ca8 service neutron] 10.222.0.30 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 1027 time: 0.0621116 Mar 24 02:24:44.096475 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Pushing event updated for resources: {'Port': ['ID=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:44.364591 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af9d07a0-d793-44f7-bdc8-38bbade0cbc0 req-21f540ff-b40a-45f3-9608-eb69df6185b5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 210 time: 0.0653312 Mar 24 02:24:44.371899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Attempting to bind port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:24:44.372307 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Attempting to bind port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:24:44.372791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Attempting to bind port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:24:44.386913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d0088ca-22aa-43c6-90f4-497c8487d65d req-cb79708f-1d63-434a-ad53-f2d2e89db99b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:44.388401 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8d0088ca-22aa-43c6-90f4-497c8487d65d req-cb79708f-1d63-434a-ad53-f2d2e89db99b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.2464607 Mar 24 02:24:44.392441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:24:44.392852 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Attempting to bind port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 on network 1c7b4ca8-c501-4e72-9eba-3ca17999702e {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:24:44.404161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-5c0b8988-d570-47c9-bda7-b61e10599a3f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:44.405740 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-5c0b8988-d570-47c9-bda7-b61e10599a3f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=200e8971-ae2d-467a-bc91-aa62cbd0d722 HTTP/1.1" status: 200 len: 797 time: 0.3193750 Mar 24 02:24:44.415740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 24, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:24:44.416118 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Checking segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:24:44.416491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Bound using segment: {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:24:44.416959 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Bound port: f7cc65a8-3ed6-4a46-9edf-cc2afead1568, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cd8dc1cb-883d-457f-8089-73af87a1a574', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:24:44.417319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:44.555368 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8d0088ca-22aa-43c6-90f4-497c8487d65d req-df0d7788-dd21-4a16-8cb2-646c9ac93053 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1467390 Mar 24 02:24:44.594389 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] For port f7cc65a8-3ed6-4a46-9edf-cc2afead1568, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:24:44.604408 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-43b96d79-472b-42fa-95d1-34f63c439edf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 473 time: 0.1828477 Mar 24 02:24:44.606278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] For port f7cc65a8-3ed6-4a46-9edf-cc2afead1568, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:24:44.612755 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:44.624246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Request body: {'port': {'device_id': 'd141deed-f253-41b9-b07e-4140f4aec26b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:44.682045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:44.682731 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:44.684540 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] 10.222.0.30 "PUT /v2.0/ports/f7cc65a8-3ed6-4a46-9edf-cc2afead1568 HTTP/1.1" status: 200 len: 1094 time: 1.1120517 Mar 24 02:24:44.689450 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:24:44.692878 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ab8127f-2a89-4813-bdd7-dfd6ee678715" -d '{"events": [{"name": "network-changed", "server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:24:44.760570 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:24:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5f847d9-c561-4010-95d3-344386b94983 x-openstack-request-id: req-b5f847d9-c561-4010-95d3-344386b94983 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:24:44.760869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:24:44.761122 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-b5f847d9-c561-4010-95d3-344386b94983 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:24:44.761530 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b5f847d9-c561-4010-95d3-344386b94983'] response: {'name': 'network-changed', 'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'status': 'completed', 'code': 200} Mar 24 02:24:44.762216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06c7b476-9593-4c04-9019-47dcfad07edd service neutron] Pushing event updated for resources: {'Port': ['ID=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:44.771518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:44.932518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921615e1-e3a4-4fca-9994-610292105453 req-6d3052ee-57bb-43bb-b085-162e5522962a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:44.934089 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-6d3052ee-57bb-43bb-b085-162e5522962a service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 1128 time: 0.1252637 Mar 24 02:24:44.988647 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-93c146b6-751b-4a7f-b2e6-3f23ecd56a67 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7cc65a8-3ed6-4a46-9edf-cc2afead1568 HTTP/1.1" status: 200 len: 217 time: 0.0460138 Mar 24 02:24:45.061379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:45.075948 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921615e1-e3a4-4fca-9994-610292105453 req-e0909bd6-4c9e-499d-9bbf-e780495bdfc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:45.077403 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-e0909bd6-4c9e-499d-9bbf-e780495bdfc1 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0614288 Mar 24 02:24:45.178618 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921615e1-e3a4-4fca-9994-610292105453 req-32073640-2d8a-41ab-98a5-a1dd538ca571 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:45.180133 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-32073640-2d8a-41ab-98a5-a1dd538ca571 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0950973 Mar 24 02:24:45.199263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 96f5b3fa-eece-427c-bafe-1e464a84c6b3 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:24:45.511870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Publish callbacks [] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:45.573783 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7313326c-a986-4993-893d-5c860c914721 req-3e624398-8b33-431e-a932-60d4636ad382 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 210 time: 0.0594196 Mar 24 02:24:45.578783 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Transition to ACTIVE for port object 96f5b3fa-eece-427c-bafe-1e464a84c6b3 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:24:45.590127 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:45.694643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=7']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:45.725987 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-2ff9767d-eaf3-4a79-99ba-a2b87cb62992 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5384617 Mar 24 02:24:45.840864 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4038b4f2-4c9a-480a-b797-2e902318226b req-b99e863a-c5b0-4b50-85f7-ca2665ed5f23 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:45.842462 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4038b4f2-4c9a-480a-b797-2e902318226b req-b99e863a-c5b0-4b50-85f7-ca2665ed5f23 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.2079287 Mar 24 02:24:45.921448 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-921615e1-e3a4-4fca-9994-610292105453 req-4cc51284-b6ee-4356-ad0b-a914503af941 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1888034 Mar 24 02:24:45.971785 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4038b4f2-4c9a-480a-b797-2e902318226b req-be80ddc0-dbd5-4091-a0bb-88a942bb4cf1 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1126249 Mar 24 02:24:45.983188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Attempting to bind port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:24:45.987728 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Attempting to bind port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:24:45.988260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Attempting to bind port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:24:46.003019 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:24:46.003364 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Attempting to bind port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:24:46.027139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 24, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:24:46.027558 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Checking segment: {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:24:46.027891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Bound using segment: {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:24:46.028340 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Bound port: 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:24:46.028681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:46.081365 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-9feff504-4ee3-4ae7-b570-330441cb5bbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:46.083008 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-9feff504-4ee3-4ae7-b570-330441cb5bbf service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 1128 time: 0.0915058 Mar 24 02:24:46.159334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:24:46.174879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:24:46.185358 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:46.237355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:46.238116 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:46.240068 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] 10.222.0.30 "PUT /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 1132 time: 1.6235590 Mar 24 02:24:46.241012 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-c646621a-acc7-42c6-a158-25862fb65d32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:46.242387 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-c646621a-acc7-42c6-a158-25862fb65d32 service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.1523602 Mar 24 02:24:46.311351 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-ecba4b7f-5046-4d15-b114-a196dcbdd4c8 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7cc65a8-3ed6-4a46-9edf-cc2afead1568 HTTP/1.1" status: 200 len: 217 time: 0.0575135 Mar 24 02:24:46.311351 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab5f921-7fbc-444a-afd0-9c86e31b29db service neutron] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=8']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:46.380724 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-d61ce8a3-4e45-4c80-82d9-2de3b265dc35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:46.382199 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-d61ce8a3-4e45-4c80-82d9-2de3b265dc35 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0539312 Mar 24 02:24:46.387391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-29268289-31bd-4160-afcb-11e3bcf4f0ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:46.388827 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-29268289-31bd-4160-afcb-11e3bcf4f0ef service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 1166 time: 0.0889006 Mar 24 02:24:46.481023 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-5e1b1f08-e997-439b-8635-98aad39972f9 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 1038 time: 0.0837731 Mar 24 02:24:46.485600 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-dca34afa-6cb5-42f8-a073-308d377c320c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:46.487061 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-dca34afa-6cb5-42f8-a073-308d377c320c service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0973954 Mar 24 02:24:46.579351 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-9b444fdf-b267-4e9a-bf87-5ad98e81bda2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:46.580817 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-9b444fdf-b267-4e9a-bf87-5ad98e81bda2 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=ade64610-b570-4413-a67f-09aac2718316 HTTP/1.1" status: 200 len: 834 time: 0.0929334 Mar 24 02:24:46.635262 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-ea5e9923-b698-4665-9cc0-58b6d1d8c192 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1398053 Mar 24 02:24:46.713294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-1938f7ea-e405-4e26-aa6c-6b13e878ad68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:46.714807 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-1938f7ea-e405-4e26-aa6c-6b13e878ad68 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=200e8971-ae2d-467a-bc91-aa62cbd0d722&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.1257322 Mar 24 02:24:46.773533 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd141deed-f253-41b9-b07e-4140f4aec26b', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:24:46.775765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2af3d8ac-cae5-46ab-936c-250d2c97ed49" -d '{"events": [{"name": "network-changed", "server_uuid": "d141deed-f253-41b9-b07e-4140f4aec26b", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:24:46.822708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:24:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a09982af-20ce-46a1-99aa-8954e4e74ad3 x-openstack-request-id: req-a09982af-20ce-46a1-99aa-8954e4e74ad3 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:24:46.823018 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d141deed-f253-41b9-b07e-4140f4aec26b", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:24:46.823244 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-a09982af-20ce-46a1-99aa-8954e4e74ad3 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:24:46.823632 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a09982af-20ce-46a1-99aa-8954e4e74ad3'] response: {'name': 'network-changed', 'server_uuid': 'd141deed-f253-41b9-b07e-4140f4aec26b', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'status': 'completed', 'code': 200} Mar 24 02:24:46.836328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10112e2c-cf29-4245-89fa-36660d1aa543 req-e641f4f8-6634-454b-99dc-69969d462444 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:46.837797 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-10112e2c-cf29-4245-89fa-36660d1aa543 req-e641f4f8-6634-454b-99dc-69969d462444 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 982 time: 0.1874349 Mar 24 02:24:46.846626 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ab8127f-2a89-4813-bdd7-dfd6ee678715 req-d1400240-f3f9-44a0-8fde-71d2a17d198c service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2044036 Mar 24 02:24:46.883462 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-bc4d8d9f-3749-4774-9223-990d1876103d service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1609011 Mar 24 02:24:46.942721 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-10112e2c-cf29-4245-89fa-36660d1aa543 req-84894b49-201d-4b4c-be0e-c58775150ec7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981543 Mar 24 02:24:46.986491 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1bab88b1-2724-4c00-9823-8b3d3c8c6c50 req-88ec119f-1068-4dce-876b-16914e952dbe service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0953779 Mar 24 02:24:47.116903 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-ac4786f4-3df9-4ca2-9471-832225dab585 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:47.119237 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-ac4786f4-3df9-4ca2-9471-832225dab585 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 1166 time: 0.0853679 Mar 24 02:24:47.133096 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac864681-c501-4d9b-8e9a-5b70c975bb9c req-fd223366-0341-4e07-94de-88c4ed4b53ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:47.134562 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ac864681-c501-4d9b-8e9a-5b70c975bb9c req-fd223366-0341-4e07-94de-88c4ed4b53ff tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0882061 Mar 24 02:24:47.233495 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ac864681-c501-4d9b-8e9a-5b70c975bb9c req-9d91ed4a-912e-4a3a-b528-db4c40d92825 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0917764 Mar 24 02:24:47.258628 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-491a2f79-c2af-42e4-8199-c1a3cf04ee87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:47.260207 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-491a2f79-c2af-42e4-8199-c1a3cf04ee87 service neutron] 10.222.0.30 "GET /v2.0/networks?id=200e8971-ae2d-467a-bc91-aa62cbd0d722 HTTP/1.1" status: 200 len: 898 time: 0.1351309 Mar 24 02:24:47.329138 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-7d478f3c-a446-4057-8814-d4811b24f068 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 1038 time: 0.0626969 Mar 24 02:24:47.375479 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-58439702-903a-4358-a560-abf791e4db77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:47.376896 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-58439702-903a-4358-a560-abf791e4db77 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=ade64610-b570-4413-a67f-09aac2718316 HTTP/1.1" status: 200 len: 834 time: 0.0418532 Mar 24 02:24:47.424449 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-64adc7b8-b82b-46aa-a4d2-50257bd12b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:47.425932 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-64adc7b8-b82b-46aa-a4d2-50257bd12b4a service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=200e8971-ae2d-467a-bc91-aa62cbd0d722&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0434628 Mar 24 02:24:47.518890 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-b8818839-dbbe-494d-9bb2-ad30df3aeb62 service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847149 Mar 24 02:24:47.606080 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2af3d8ac-cae5-46ab-936c-250d2c97ed49 req-f15c2d9a-3cca-4df9-adee-8c67166cb73b service neutron] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809395 Mar 24 02:24:48.066080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca28c7ec-1225-4769-81a7-36f05c05010e req-e885d033-cc46-465b-97fa-bfe645314bcf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:48.067593 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ca28c7ec-1225-4769-81a7-36f05c05010e req-e885d033-cc46-465b-97fa-bfe645314bcf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 982 time: 0.0576065 Mar 24 02:24:48.113435 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ca28c7ec-1225-4769-81a7-36f05c05010e req-fe260f94-4b10-412c-b468-08bbdb1d0912 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400274 Mar 24 02:24:48.350418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d589a3-3c43-4b39-99fe-01e091aa1373 req-bfa3d5bb-47aa-4d65-9bb3-23e4998dc85c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:48.351958 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-60d589a3-3c43-4b39-99fe-01e091aa1373 req-bfa3d5bb-47aa-4d65-9bb3-23e4998dc85c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0532787 Mar 24 02:24:48.400699 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-60d589a3-3c43-4b39-99fe-01e091aa1373 req-f20e86a4-3056-41c7-aa2c-71ec85df82fe tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428300 Mar 24 02:24:49.234643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf6a0f2-aeed-4cc1-a061-dbf905e06d5d req-59cf6c6f-da9a-4e4b-8a07-0aff9fb86e81 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:49.237317 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-adf6a0f2-aeed-4cc1-a061-dbf905e06d5d req-59cf6c6f-da9a-4e4b-8a07-0aff9fb86e81 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 982 time: 0.0590460 Mar 24 02:24:49.287773 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-adf6a0f2-aeed-4cc1-a061-dbf905e06d5d req-7c299925-878b-4365-8550-48e3c40ce04f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441272 Mar 24 02:24:49.522720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbd0e30-909a-4315-ac56-4b93c004da69 req-21049655-4785-4989-b92e-73ebdc7b18ec tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:49.524304 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5bbd0e30-909a-4315-ac56-4b93c004da69 req-21049655-4785-4989-b92e-73ebdc7b18ec tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0556369 Mar 24 02:24:49.576092 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5bbd0e30-909a-4315-ac56-4b93c004da69 req-ce5b94f5-8f42-43f7-9a43-6904b60276dc tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460472 Mar 24 02:24:50.403351 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f94a1fd7-40b8-4e0f-93c8-bd07be8ac4a6 req-94c19867-9836-463f-be28-2b3ed2182d1a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:50.404823 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f94a1fd7-40b8-4e0f-93c8-bd07be8ac4a6 req-94c19867-9836-463f-be28-2b3ed2182d1a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 982 time: 0.0515068 Mar 24 02:24:50.456940 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f94a1fd7-40b8-4e0f-93c8-bd07be8ac4a6 req-225c6f28-a985-492d-808d-103a027a963d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463455 Mar 24 02:24:50.484839 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 96f5b3fa-eece-427c-bafe-1e464a84c6b3 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:24:50.580449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:50.591995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'port_id': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'mac_address': 'fa:16:3e:70:ca:c8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 131, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:24:50.629080 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:50.630055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:50.643360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 96f5b3fa-eece-427c-bafe-1e464a84c6b3 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:24:50.663224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:50.668257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:50.698997 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb1e8f6-48a6-4324-a933-40d2f113b64b req-af9928ad-d6e9-47d1-a594-f07fda7d060f tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:50.709052 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6eb1e8f6-48a6-4324-a933-40d2f113b64b req-af9928ad-d6e9-47d1-a594-f07fda7d060f tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0651753 Mar 24 02:24:50.716256 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=9']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:50.760361 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6eb1e8f6-48a6-4324-a933-40d2f113b64b req-a249f21d-bef0-48e8-98b3-e8a8f82c706b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452363 Mar 24 02:24:50.993004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['96f5b3fa-eece-427c-bafe-1e464a84c6b3'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:24:51.574121 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb097443-bc59-48ed-896f-e24f087c8dbc req-36cf8902-812c-452f-a29a-11918fa51845 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:51.575598 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb097443-bc59-48ed-896f-e24f087c8dbc req-36cf8902-812c-452f-a29a-11918fa51845 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 983 time: 0.0531864 Mar 24 02:24:51.622245 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cb097443-bc59-48ed-896f-e24f087c8dbc req-15d12cfa-d063-476f-9b1e-6abc83b932cd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410411 Mar 24 02:24:51.879840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979df12e-b8d7-4301-b0b8-75fe3c4643e5 req-c6d8d7c6-75e2-4575-b5f3-eec4728cc637 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:51.881243 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-979df12e-b8d7-4301-b0b8-75fe3c4643e5 req-c6d8d7c6-75e2-4575-b5f3-eec4728cc637 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0558476 Mar 24 02:24:51.929702 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-979df12e-b8d7-4301-b0b8-75fe3c4643e5 req-07cbb1cb-8890-4455-9b98-ac7a3384aa0f tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429411 Mar 24 02:24:52.500174 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 96f5b3fa-eece-427c-bafe-1e464a84c6b3 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:24:52.547589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:24:52.552039 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:52.552412 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:52.630964 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:24:52.631346 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:52.653301 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd141deed-f253-41b9-b07e-4140f4aec26b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:24:52.655488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1fc9391c-c7e8-473d-bd27-cf7e2c62817d" -d '{"events": [{"server_uuid": "d141deed-f253-41b9-b07e-4140f4aec26b", "name": "network-vif-plugged", "status": "completed", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:24:52.669446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:52.674196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:52.716431 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:24:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1db06039-d045-473c-9c92-dbc2b712ba64 x-openstack-request-id: req-1db06039-d045-473c-9c92-dbc2b712ba64 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:24:52.716832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d141deed-f253-41b9-b07e-4140f4aec26b", "name": "network-vif-plugged", "status": "completed", "tag": "96f5b3fa-eece-427c-bafe-1e464a84c6b3", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:24:52.717187 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-1db06039-d045-473c-9c92-dbc2b712ba64 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:24:52.717685 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-1db06039-d045-473c-9c92-dbc2b712ba64'] response: {'server_uuid': 'd141deed-f253-41b9-b07e-4140f4aec26b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '96f5b3fa-eece-427c-bafe-1e464a84c6b3', 'code': 200} Mar 24 02:24:52.734466 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=10']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:52.747897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d860e23-6358-404f-95e9-22291894b176 req-d2cee478-319d-4293-94bf-fc31ca16238d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:52.749025 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8d860e23-6358-404f-95e9-22291894b176 req-d2cee478-319d-4293-94bf-fc31ca16238d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 985 time: 0.0567379 Mar 24 02:24:52.800684 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8d860e23-6358-404f-95e9-22291894b176 req-68a35b68-aae4-475b-b86a-9bbe1f49d35f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455508 Mar 24 02:24:52.894389 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b587cf-2d78-47f8-a4e0-129a4380241d req-d10f92e0-30ad-4509-aa8b-1991013cce3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:52.896576 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d8b587cf-2d78-47f8-a4e0-129a4380241d req-d10f92e0-30ad-4509-aa8b-1991013cce3c service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 1169 time: 0.0435014 Mar 24 02:24:52.947651 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d8b587cf-2d78-47f8-a4e0-129a4380241d req-7d3e1380-2708-40d2-9afa-1c26d0bca017 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445037 Mar 24 02:24:53.053691 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4830cac8-9771-4cab-9925-8460e96ee036 req-bbc32909-ef7e-4c0c-b1de-202249999a35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:53.055158 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4830cac8-9771-4cab-9925-8460e96ee036 req-bbc32909-ef7e-4c0c-b1de-202249999a35 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0547221 Mar 24 02:24:53.105139 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4830cac8-9771-4cab-9925-8460e96ee036 req-807acc91-aeef-42fc-a670-859ad6a0fa36 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444705 Mar 24 02:24:53.930095 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-250e8d7e-fe09-4127-85c2-b6976fe30e1f req-0b5dcb86-39b9-4dec-a365-d8c0644e333a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:53.931597 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-250e8d7e-fe09-4127-85c2-b6976fe30e1f req-0b5dcb86-39b9-4dec-a365-d8c0644e333a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 985 time: 0.0600438 Mar 24 02:24:53.976668 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-250e8d7e-fe09-4127-85c2-b6976fe30e1f req-8181df38-e8fa-48b4-a9c2-0c345380db90 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392566 Mar 24 02:24:54.226317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3737c76-908c-4c1b-b0b8-d3109c269810 req-1d9fa735-9cb7-4721-ac01-d4f32c6449d0 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:54.227818 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f3737c76-908c-4c1b-b0b8-d3109c269810 req-1d9fa735-9cb7-4721-ac01-d4f32c6449d0 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0563626 Mar 24 02:24:54.281165 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f3737c76-908c-4c1b-b0b8-d3109c269810 req-b6b784bf-7270-46ab-a91a-62d145dcc307 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478067 Mar 24 02:24:55.096508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91309ce9-87f4-4df5-bffc-883a3bc22162 req-14672aab-0c16-4a66-8646-5528779d7511 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:55.097973 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-91309ce9-87f4-4df5-bffc-883a3bc22162 req-14672aab-0c16-4a66-8646-5528779d7511 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 985 time: 0.0520580 Mar 24 02:24:55.144223 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-91309ce9-87f4-4df5-bffc-883a3bc22162 req-1bd0edd7-bc78-4ebc-8cef-9df97a905bba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407245 Mar 24 02:24:55.263521 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b9371a8-8ff6-4d63-be4c-3323cf5d079e req-fe1913d3-34a3-49bf-b94e-a10239052656 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:55.264928 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8b9371a8-8ff6-4d63-be4c-3323cf5d079e req-fe1913d3-34a3-49bf-b94e-a10239052656 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 985 time: 0.0558779 Mar 24 02:24:55.310925 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-8b9371a8-8ff6-4d63-be4c-3323cf5d079e req-02c707be-8857-4b5f-82ec-1de34f2d65bb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405056 Mar 24 02:24:55.332176 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35520) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:55.376520 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04659659-773e-41a2-9963-7a47a2172c46 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:55.378118 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-04659659-773e-41a2-9963-7a47a2172c46 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b&network_id=200e8971-ae2d-467a-bc91-aa62cbd0d722 HTTP/1.1" status: 200 len: 1164 time: 0.0449488 Mar 24 02:24:55.399023 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe93d4f5-efbb-468d-8ee0-980b1e3a84c5 req-da41608c-7bce-4ba1-9094-1b9f57ebd0d4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:55.400528 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fe93d4f5-efbb-468d-8ee0-980b1e3a84c5 req-da41608c-7bce-4ba1-9094-1b9f57ebd0d4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0541692 Mar 24 02:24:55.449905 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fe93d4f5-efbb-468d-8ee0-980b1e3a84c5 req-2d378cf5-9334-4b8d-996e-1767a7005e1b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439506 Mar 24 02:24:55.590811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b80126-5852-4cc5-ab98-f713c739a412 req-beeac2b0-bd16-49d4-a29a-03aac6830ca5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:55.592266 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-55b80126-5852-4cc5-ab98-f713c739a412 req-beeac2b0-bd16-49d4-a29a-03aac6830ca5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 985 time: 0.0519366 Mar 24 02:24:55.642440 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-55b80126-5852-4cc5-ab98-f713c739a412 req-402c8086-69bb-4c80-a71f-00a293ccdd13 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445626 Mar 24 02:24:56.568022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41145787-61d2-442f-a7d3-837562c92fe5 req-7fea7e6b-120f-48df-9355-20f83baa4dba tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:56.569735 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41145787-61d2-442f-a7d3-837562c92fe5 req-7fea7e6b-120f-48df-9355-20f83baa4dba tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0522013 Mar 24 02:24:56.616662 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41145787-61d2-442f-a7d3-837562c92fe5 req-3f07d12b-dd32-42fd-b5c3-38fdebe1cf89 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411870 Mar 24 02:24:56.760736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c65d7cef-3289-4273-87bf-d1fd619a8774 req-e04dccac-de94-4fee-adf5-00877018dc98 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:56.762146 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c65d7cef-3289-4273-87bf-d1fd619a8774 req-e04dccac-de94-4fee-adf5-00877018dc98 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 985 time: 0.0523665 Mar 24 02:24:56.808037 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c65d7cef-3289-4273-87bf-d1fd619a8774 req-269fe915-75dc-43c3-86d9-0f02569a3777 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=a7001f9f-979d-46f2-815e-6bc51053ec9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404916 Mar 24 02:24:56.990180 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-bc95cec3-e665-461d-addd-e02352968284 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:56.991640 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-bc95cec3-e665-461d-addd-e02352968284 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 985 time: 0.0553129 Mar 24 02:24:57.037053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-428d9047-dd4c-4cef-8961-e02e2b308783 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:57.038312 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-428d9047-dd4c-4cef-8961-e02e2b308783 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0408499 Mar 24 02:24:57.136390 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-0ab3dcb9-31e0-4c0c-81e3-97ac87298a2e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.0917914 Mar 24 02:24:57.146869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:24:57.206230 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:57.334702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=96f5b3fa-eece-427c-bafe-1e464a84c6b3,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:24:57.366765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] For port 96f5b3fa-eece-427c-bafe-1e464a84c6b3, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:24:57.398483 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] device_id is not set on port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 yet. {{(pid=104037) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:199}} Mar 24 02:24:57.398826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-33bfe514-85d7-4bae-98f8-2bc093dda9df None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:57.407720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] Publish callbacks [] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:57.413414 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:57.492480 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] Pushing event updated for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=11']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:57.533017 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] No DVR routers for this DVR port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:24:57.670591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] In _notify_port_updated(), no bound segment for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 on network 200e8971-ae2d-467a-bc91-aa62cbd0d722 {{(pid=104037) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:896}} Mar 24 02:24:57.671463 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:57.672072 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:57.673469 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ead124e5-0df7-47f0-9149-8be4e4a3c888 req-ab552658-082f-4bcc-afd6-66f17f4eaedd service neutron] 10.222.0.30 "PUT /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 200 len: 1028 time: 0.5309119 Mar 24 02:24:57.714740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-1960411b-6d71-425e-92ef-73cbdfba9572 None None] Provisioning complete for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:24:57.715026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1960411b-6d71-425e-92ef-73cbdfba9572 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:57.735456 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bed60b-dc67-432b-b2a6-aaa43a1ab8fa req-bfbf74d2-cfae-4fbe-ad38-78ef4414e29c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:57.736966 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c3bed60b-dc67-432b-b2a6-aaa43a1ab8fa req-bfbf74d2-cfae-4fbe-ad38-78ef4414e29c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0552096 Mar 24 02:24:57.751515 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-1960411b-6d71-425e-92ef-73cbdfba9572 None None] Port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:24:57.787949 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c3bed60b-dc67-432b-b2a6-aaa43a1ab8fa req-2c284519-ac0c-45a3-9af0-efdbcadce024 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449176 Mar 24 02:24:57.913786 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-14b559ac-f14c-41f2-a289-fe377abf85e7 req-6ba3f017-652e-4ca6-a65b-6ca75b59bbd2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=d141deed-f253-41b9-b07e-4140f4aec26b HTTP/1.1" status: 200 len: 210 time: 0.0300770 Mar 24 02:24:58.902969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c347cf-e8cc-4fcf-ab19-d22fdf04ea8f req-2fd3f776-aedd-472e-b486-cfca259e4e97 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:24:58.904423 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d2c347cf-e8cc-4fcf-ab19-d22fdf04ea8f req-2fd3f776-aedd-472e-b486-cfca259e4e97 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0507076 Mar 24 02:24:58.952832 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d2c347cf-e8cc-4fcf-ab19-d22fdf04ea8f req-4290ac3d-acfe-4f29-91a4-b08ae554c119 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423245 Mar 24 02:24:58.968568 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35538) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:59.027798 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8a8eb4e9-3421-4948-9624-dae8ece43aea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (d425b97c-0300-4936-a43f-fad9d09d521a), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:59.052012 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8a8eb4e9-3421-4948-9624-dae8ece43aea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (d425b97c-0300-4936-a43f-fad9d09d521a), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:59.110772 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8a8eb4e9-3421-4948-9624-dae8ece43aea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d425b97c-0300-4936-a43f-fad9d09d521a), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:59.113437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8a8eb4e9-3421-4948-9624-dae8ece43aea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:59.114602 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8a8eb4e9-3421-4948-9624-dae8ece43aea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/security-groups/d425b97c-0300-4936-a43f-fad9d09d521a HTTP/1.1" status: 204 len: 168 time: 0.1450233 Mar 24 02:24:59.123644 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8eb4e9-3421-4948-9624-dae8ece43aea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d425b97c-0300-4936-a43f-fad9d09d521a,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:59.146714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35542) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:24:59.299293 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port a0f78e63-e6ad-47dc-bde2-22800401a37a {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:24:59.299637 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a0f78e63-e6ad-47dc-bde2-22800401a37a), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:59.374991 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a0f78e63-e6ad-47dc-bde2-22800401a37a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:59.375315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (a0f78e63-e6ad-47dc-bde2-22800401a37a), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:59.387200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for a0f78e63-e6ad-47dc-bde2-22800401a37a owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:24:59.532195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a0f78e63-e6ad-47dc-bde2-22800401a37a), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:59.557387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=a0f78e63-e6ad-47dc-bde2-22800401a37a,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:24:59.616100 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (0bf1a359-a29d-47d7-ab97-610c0c4f8983), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:24:59.616476 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP 0bf1a359-a29d-47d7-ab97-610c0c4f8983 disassociated (deleted). External IP: 172.26.2.123, port: 96f5b3fa-eece-427c-bafe-1e464a84c6b3. Mar 24 02:25:00.145225 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98ad9ab-a3ce-478c-b1ce-f542c343f325 req-e91ffbdb-3eb1-4087-a968-ae47514785d2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:00.146721 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e98ad9ab-a3ce-478c-b1ce-f542c343f325 req-e91ffbdb-3eb1-4087-a968-ae47514785d2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0974357 Mar 24 02:25:00.172213 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:25:00.265887 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e98ad9ab-a3ce-478c-b1ce-f542c343f325 req-2bd61a6e-07d0-45cb-8390-fb2afc203b17 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1122291 Mar 24 02:25:00.304765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:25:00.309970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.314498 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] Sync routers for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:25:00.324296 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:00.324982 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:24:30Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:00.342863 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fd835e80-9ad0-4dd5-9597-3fffc9f010f7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/floatingips/0bf1a359-a29d-47d7-ab97-610c0c4f8983 HTTP/1.1" status: 204 len: 168 time: 1.1950679 Mar 24 02:25:00.411737 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35550) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:00.432512 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:00.467732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7519bc17-c8d9-4e09-977e-17bf14d98051 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (0faaf22f-02d0-4472-b1bf-94b7305b3761), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.493041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7519bc17-c8d9-4e09-977e-17bf14d98051 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (0faaf22f-02d0-4472-b1bf-94b7305b3761), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.515210 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-26ad9575-a849-4a97-a7f2-7ef2eb66c85f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.558666 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7519bc17-c8d9-4e09-977e-17bf14d98051 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0faaf22f-02d0-4472-b1bf-94b7305b3761), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.561338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7519bc17-c8d9-4e09-977e-17bf14d98051 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.564970 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7519bc17-c8d9-4e09-977e-17bf14d98051 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/security-groups/0faaf22f-02d0-4472-b1bf-94b7305b3761 HTTP/1.1" status: 204 len: 168 time: 0.1497936 Mar 24 02:25:00.565145 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 96f5b3fa-eece-427c-bafe-1e464a84c6b3 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:25:00.580851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7519bc17-c8d9-4e09-977e-17bf14d98051 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0faaf22f-02d0-4472-b1bf-94b7305b3761,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:00.597612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35554) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:00.621474 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] The host hv-neutron-8348 is not matching for port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 host ! {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2354}} Mar 24 02:25:00.621961 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 96f5b3fa-eece-427c-bafe-1e464a84c6b3 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:25:00.644603 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '76199a90-4847-47b8-95e8-af175875dd39', 'name': '', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:58:45:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_interface', 'standard_attr_id': 1420, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:15Z', 'updated_at': '2022-03-24T02:24:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'ade64610-b570-4413-a67f-09aac2718316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:00.670923 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] Checking router: 2f2c61f5-ef2e-4673-95a5-c994cd97d611 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:25:00.679405 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:00.680019 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:00.693496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6dab7f1b-4cd0-4124-98d7-ee7cd7c7f0da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 96f5b3fa-eece-427c-bafe-1e464a84c6b3 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:25:00.693834 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6dab7f1b-4cd0-4124-98d7-ee7cd7c7f0da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.778205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6dab7f1b-4cd0-4124-98d7-ee7cd7c7f0da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.786317 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:00.792950 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-6dab7f1b-4cd0-4124-98d7-ee7cd7c7f0da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 96f5b3fa-eece-427c-bafe-1e464a84c6b3 owned by {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:25:00.882598 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.924072 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6dab7f1b-4cd0-4124-98d7-ee7cd7c7f0da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (96f5b3fa-eece-427c-bafe-1e464a84c6b3), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:00.959546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dab7f1b-4cd0-4124-98d7-ee7cd7c7f0da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=96f5b3fa-eece-427c-bafe-1e464a84c6b3,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:00.987617 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:25:00.998281 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '76199a90-4847-47b8-95e8-af175875dd39', 'name': '', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:58:45:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_interface', 'standard_attr_id': 1420, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:15Z', 'updated_at': '2022-03-24T02:24:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'ade64610-b570-4413-a67f-09aac2718316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:01.024822 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e75d262-6f1d-4d33-9739-d157d826f2be None None] The sync data for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv is: [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:24:16Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '76199a90-4847-47b8-95e8-af175875dd39', 'name': '', 'network_id': '200e8971-ae2d-467a-bc91-aa62cbd0d722', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:58:45:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_interface', 'standard_attr_id': 1420, 'fixed_ips': [{'subnet_id': 'ade64610-b570-4413-a67f-09aac2718316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:15Z', 'updated_at': '2022-03-24T02:24:19Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'ade64610-b570-4413-a67f-09aac2718316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:25:01.029866 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6dab7f1b-4cd0-4124-98d7-ee7cd7c7f0da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:01.033607 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6dab7f1b-4cd0-4124-98d7-ee7cd7c7f0da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/ports/96f5b3fa-eece-427c-bafe-1e464a84c6b3 HTTP/1.1" status: 204 len: 168 time: 0.4344561 Mar 24 02:25:01.036354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35556) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:01.316560 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd3b580d-d64e-4c58-8309-ee52b9bb69ab None None] New status for floating IP 0bf1a359-a29d-47d7-ab97-610c0c4f8983: DOWN {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:25:01.436187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a555d2-862e-4135-89ef-a0922f273d6a req-fca40a77-bb65-445e-8bc0-3f819a79d3d7 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:01.437755 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f3a555d2-862e-4135-89ef-a0922f273d6a req-fca40a77-bb65-445e-8bc0-3f819a79d3d7 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0965605 Mar 24 02:25:01.523205 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f3a555d2-862e-4135-89ef-a0922f273d6a req-bdb2ce50-0a64-4637-9f4c-0b993cdee91e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0780790 Mar 24 02:25:01.554853 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (2f2c61f5-ef2e-4673-95a5-c994cd97d611), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:01.812461 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 76199a90-4847-47b8-95e8-af175875dd39 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:25:01.812753 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (76199a90-4847-47b8-95e8-af175875dd39), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:01.903598 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 76199a90-4847-47b8-95e8-af175875dd39, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=76199a90-4847-47b8-95e8-af175875dd39,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:01.904057 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (76199a90-4847-47b8-95e8-af175875dd39), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:01.918047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 76199a90-4847-47b8-95e8-af175875dd39 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:25:02.101384 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (76199a90-4847-47b8-95e8-af175875dd39), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:02.127664 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=76199a90-4847-47b8-95e8-af175875dd39,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:02.309915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (2f2c61f5-ef2e-4673-95a5-c994cd97d611), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:02.439787 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:02.523836 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:25:02.575705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device f7cc65a8-3ed6-4a46-9edf-cc2afead1568 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:25:02.663144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c56963-18ed-4c28-90f5-5169b7ebf41a req-ef15df28-b121-45f9-b33b-30aeb3dcfdc9 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:02.664619 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c7c56963-18ed-4c28-90f5-5169b7ebf41a req-ef15df28-b121-45f9-b33b-30aeb3dcfdc9 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 944 time: 0.0691710 Mar 24 02:25:02.668247 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port f7cc65a8-3ed6-4a46-9edf-cc2afead1568, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:02.680104 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:25:02.680331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'port_id': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'mac_address': 'fa:16:3e:85:a6:dc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:25:02.689871 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ab85537c-ed12-4fce-adc8-7d0e41d1ec66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/2f2c61f5-ef2e-4673-95a5-c994cd97d611/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6524935 Mar 24 02:25:02.692977 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] Sync routers for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:25:02.693733 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35562) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:02.704570 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:02.705466 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:02.717652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:02.718017 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:02.735429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f7cc65a8-3ed6-4a46-9edf-cc2afead1568 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:25:02.758649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port f7cc65a8-3ed6-4a46-9edf-cc2afead1568, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:02.771822 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c7c56963-18ed-4c28-90f5-5169b7ebf41a req-f049418c-19c4-486c-8370-d3542143c7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1006415 Mar 24 02:25:02.776736 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:02.788693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-7c4293b1-b154-49a0-abb3-b1b2bd96d0c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting subnet ade64610-b570-4413-a67f-09aac2718316 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:25:02.793588 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7c4293b1-b154-49a0-abb3-b1b2bd96d0c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (ade64610-b570-4413-a67f-09aac2718316), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:02.838605 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7c4293b1-b154-49a0-abb3-b1b2bd96d0c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (ade64610-b570-4413-a67f-09aac2718316), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:02.841896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:02.844796 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:02.926839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7c4293b1-b154-49a0-abb3-b1b2bd96d0c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (ade64610-b570-4413-a67f-09aac2718316), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:02.984985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7c4293b1-b154-49a0-abb3-b1b2bd96d0c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (ade64610-b570-4413-a67f-09aac2718316), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.009963 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c4293b1-b154-49a0-abb3-b1b2bd96d0c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Subnet': ['ID=ade64610-b570-4413-a67f-09aac2718316,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:03.015585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7c4293b1-b154-49a0-abb3-b1b2bd96d0c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.018777 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7c4293b1-b154-49a0-abb3-b1b2bd96d0c2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/subnets/ade64610-b570-4413-a67f-09aac2718316 HTTP/1.1" status: 204 len: 168 time: 0.3245447 Mar 24 02:25:03.021529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35564) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:03.025000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23c032b1-3c9e-4e41-a382-0ddc04349aa3 None None] Network 200e8971-ae2d-467a-bc91-aa62cbd0d722 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:25:03.031868 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:25:02Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:03.059020 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] Checking router: 2f2c61f5-ef2e-4673-95a5-c994cd97d611 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:25:03.069343 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] Routers {'2f2c61f5-ef2e-4673-95a5-c994cd97d611'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:03.070306 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:03.101936 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['f7cc65a8-3ed6-4a46-9edf-cc2afead1568'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:25:03.143817 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (2f2c61f5-ef2e-4673-95a5-c994cd97d611), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.247753 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce907c21-0369-4222-886f-6a12c32a101c None None] DHCP port deletion for 200e8971-ae2d-467a-bc91-aa62cbd0d722 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:25:03.281107 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] Set router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:03.293456 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (2f2c61f5-ef2e-4673-95a5-c994cd97d611), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.347651 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:25:03.348557 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.359795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ce907c21-0369-4222-886f-6a12c32a101c None None] Deleting port fcc59f9f-3574-46c4-aad5-7070e2a1eebe {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:25:03.360170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ce907c21-0369-4222-886f-6a12c32a101c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.426883 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:03.427276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.440681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 owned by network:router_gateway {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:25:03.448595 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-ce907c21-0369-4222-886f-6a12c32a101c None None] For port fcc59f9f-3574-46c4-aad5-7070e2a1eebe, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fcc59f9f-3574-46c4-aad5-7070e2a1eebe,segment=NetworkSegment(3cc256d2-b7e0-40c6-80c4-84cfcd7063c5),segment_id=3cc256d2-b7e0-40c6-80c4-84cfcd7063c5)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:03.449185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ce907c21-0369-4222-886f-6a12c32a101c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.464302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ce907c21-0369-4222-886f-6a12c32a101c None None] Calling delete_port for fcc59f9f-3574-46c4-aad5-7070e2a1eebe owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:25:03.466277 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:25:02Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:03.496613 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e06646b3-f00a-4624-88cd-1b2b9fdc899f None None] The sync data for ids ['2f2c61f5-ef2e-4673-95a5-c994cd97d611'] in dv-neutron-834874-3-hyperv is: [{'id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'name': 'tempest-TestNetworkBasicOps-router-996408681', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205'}], 'enable_snat': True}, 'gw_port_id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:24:12Z', 'updated_at': '2022-03-24T02:25:02Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:58:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f2c61f5-ef2e-4673-95a5-c994cd97d611', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1417, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:24:13Z', 'updated_at': '2022-03-24T02:24:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:25:03.553235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ce907c21-0369-4222-886f-6a12c32a101c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (fcc59f9f-3574-46c4-aad5-7070e2a1eebe), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.579392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce907c21-0369-4222-886f-6a12c32a101c None None] Pushing event deleted for resources: {'Port': ['ID=fcc59f9f-3574-46c4-aad5-7070e2a1eebe,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:03.584657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce907c21-0369-4222-886f-6a12c32a101c None None] No DVR routers for this DVR port fcc59f9f-3574-46c4-aad5-7070e2a1eebe on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:25:03.621508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.644508 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:03.703114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.707695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (2f2c61f5-ef2e-4673-95a5-c994cd97d611), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.797477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (2f2c61f5-ef2e-4673-95a5-c994cd97d611), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.799623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (2f2c61f5-ef2e-4673-95a5-c994cd97d611), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.857945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (2f2c61f5-ef2e-4673-95a5-c994cd97d611), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.858493 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Fanout notify agent at l3_agent the message router_deleted on router 2f2c61f5-ef2e-4673-95a5-c994cd97d611 {{(pid=104037) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:25:03.865774 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.866980 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a572925b-b7a1-4e08-993e-5066621a8c36 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/routers/2f2c61f5-ef2e-4673-95a5-c994cd97d611 HTTP/1.1" status: 204 len: 168 time: 0.8445785 Mar 24 02:25:03.869755 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35568) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:03.909387 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5109657-9844-49e4-8800-d8317c66f3e8 req-cb390559-b3c2-4981-b4a7-a9e78dceb9ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:03.911237 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f5109657-9844-49e4-8800-d8317c66f3e8 req-cb390559-b3c2-4981-b4a7-a9e78dceb9ef tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 945 time: 0.0641499 Mar 24 02:25:03.961412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (200e8971-ae2d-467a-bc91-aa62cbd0d722), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:03.965508 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f5109657-9844-49e4-8800-d8317c66f3e8 req-fc9ba43d-4a60-481f-939b-f866c6394840 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475714 Mar 24 02:25:04.055656 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (200e8971-ae2d-467a-bc91-aa62cbd0d722), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.076843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['200e8971-ae2d-467a-bc91-aa62cbd0d722']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:04.085970 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:04.086265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3cc256d2-b7e0-40c6-80c4-84cfcd7063c5') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:04.096325 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (3cc256d2-b7e0-40c6-80c4-84cfcd7063c5), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.109716 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (3cc256d2-b7e0-40c6-80c4-84cfcd7063c5), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.116392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Releasing vlan 131 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:25:04.116786 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (3cc256d2-b7e0-40c6-80c4-84cfcd7063c5), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:25:04.119711 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:25:04.179161 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (200e8971-ae2d-467a-bc91-aa62cbd0d722), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.186506 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.191473 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/networks/200e8971-ae2d-467a-bc91-aa62cbd0d722 HTTP/1.1" status: 204 len: 168 time: 0.3183062 Mar 24 02:25:04.204755 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35570) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:04.206542 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee5089f-e895-449a-8923-973e34d75aa7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Network': ['ID=200e8971-ae2d-467a-bc91-aa62cbd0d722,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:04.217943 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0d33655d-1a33-4ce9-92f2-98c6c197383c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/agents?agent_type=L3+agent HTTP/1.1" status: 200 len: 838 time: 0.0123761 Mar 24 02:25:04.220433 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35572) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:04.225376 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'network': {'name': 'tempest-network-smoke--1940680151', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'port_security_enabled': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:04.248066 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:25:04.251676 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.275597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 116} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:25:04.287264 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (333ac000-e3cb-48f8-b8cc-fe888c62fd7d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.287646 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Added segment 333ac000-e3cb-48f8-b8cc-fe888c62fd7d of type vlan for network aeaed783-a093-45d9-8d0b-20f353f1cddb Mar 24 02:25:04.326256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (aeaed783-a093-45d9-8d0b-20f353f1cddb), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.349843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (aeaed783-a093-45d9-8d0b-20f353f1cddb), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.354917 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:04.355494 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.415002 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1933982 Mar 24 02:25:04.417777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35574) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:04.422435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-450946370', 'admin_state_up': True, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:04.426777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Network': ['ID=aeaed783-a093-45d9-8d0b-20f353f1cddb,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:04.433727 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.434081 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.434429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.434815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.435157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.435487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.435820 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.436150 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.436478 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.436985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.437288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.437630 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.437964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.438321 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.438673 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417906a0-98a9-4171-b5aa-dea36a86c33c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:04.444358 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.445482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.450199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network aeaed783-a093-45d9-8d0b-20f353f1cddb details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:25:04.506382 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.578096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device f7cc65a8-3ed6-4a46-9edf-cc2afead1568 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:25:04.632068 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:25:04.638683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:04.639156 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.654449 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.716252 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:04.716710 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.743354 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:25:04.745532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86a1858b-3c83-4357-948e-1c03de021fb7" -d '{"events": [{"server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "name": "network-vif-plugged", "status": "completed", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:25:04.777674 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port f7cc65a8-3ed6-4a46-9edf-cc2afead1568, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:04.786467 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.788361 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:25:04.791130 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:25:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7e62ef6-aae7-4780-8bff-ee5198bdc42a x-openstack-request-id: req-c7e62ef6-aae7-4780-8bff-ee5198bdc42a {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:25:04.791413 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "name": "network-vif-plugged", "status": "completed", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:25:04.791667 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-c7e62ef6-aae7-4780-8bff-ee5198bdc42a {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:25:04.792209 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-c7e62ef6-aae7-4780-8bff-ee5198bdc42a'] response: {'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'code': 200} Mar 24 02:25:04.838740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:25:04.839012 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8b9b9bf-ffb2-4e39-980c-5a1e5725ac37 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:25:04.839431 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 76199a90-4847-47b8-95e8-af175875dd39 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:25:04.868428 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 76199a90-4847-47b8-95e8-af175875dd39 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:25:04.868699 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 76199a90-4847-47b8-95e8-af175875dd39 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:25:04.869128 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fcc59f9f-3574-46c4-aad5-7070e2a1eebe no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:25:04.871997 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.890541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:04.900959 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: fcc59f9f-3574-46c4-aad5-7070e2a1eebe {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:25:04.901322 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fcc59f9f-3574-46c4-aad5-7070e2a1eebe not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:25:04.909746 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:04.979386 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecff150c-568e-4a78-a000-180915d6bfcc req-79d9b98d-05d6-4ede-9bc9-0431f1ede7b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:04.980988 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ecff150c-568e-4a78-a000-180915d6bfcc req-79d9b98d-05d6-4ede-9bc9-0431f1ede7b4 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 1130 time: 0.0453460 Mar 24 02:25:05.010748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.234 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/d64c13ba-68ca-4812-819d-ba2881c9b900) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:25:05.027172 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ecff150c-568e-4a78-a000-180915d6bfcc req-97faf677-b6f7-4bb7-9868-03537b6c1c21 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404885 Mar 24 02:25:05.088966 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ccd1099-057b-49e9-85bb-48ca31f41243 req-95990246-2014-470c-a5d4-9f76bf220bd5 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:05.090351 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3ccd1099-057b-49e9-85bb-48ca31f41243 req-95990246-2014-470c-a5d4-9f76bf220bd5 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 946 time: 0.0567510 Mar 24 02:25:05.117791 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:05.139568 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3ccd1099-057b-49e9-85bb-48ca31f41243 req-6c95315d-f704-4906-8829-07740d77d40e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435860 Mar 24 02:25:05.152436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:05.188009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:25:05.190824 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:25:05.195084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:25:05.224908 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=d64c13ba-68ca-4812-819d-ba2881c9b900,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:05.450395 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:05.649558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:05.772288 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:25:05.880203 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:25:05.890506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Sync routers for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:25:05.899403 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:05.901096 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-1556a8d6-7bf0-4058-adb2-4efb4a02c4ce tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.4821117 Mar 24 02:25:05.902931 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:05.903577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:05.904105 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35580) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:05.933532 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d33e6166-2e7b-4737-8eb8-4c6d289ec1e2 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=6c0b7eea99a4423dac22912b1fa60ca2&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0281613 Mar 24 02:25:05.936055 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35582) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:06.029568 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-babafe65-ef2c-45bb-ac53-3833b2947719 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:06.031101 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-babafe65-ef2c-45bb-ac53-3833b2947719 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0941184 Mar 24 02:25:06.033845 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35584) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:06.062210 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fa85bcab-fd20-4231-8101-c2648b5d71a6 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0272670 Mar 24 02:25:06.064643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35586) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:06.069629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1514530138', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:06.153504 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:25:06.156802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:06.157495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:06.293852 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b9c477-8259-4b69-b154-020401d59b59 req-fe58e527-1508-4aea-9050-51cfbe701de2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:06.295398 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c6b9c477-8259-4b69-b154-020401d59b59 req-fe58e527-1508-4aea-9050-51cfbe701de2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 946 time: 0.0781682 Mar 24 02:25:06.359509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:05Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:06.387370 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Checking router: a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:25:06.387729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Updating router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe port d64c13ba-68ca-4812-819d-ba2881c9b900 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:25:06.412008 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c6b9c477-8259-4b69-b154-020401d59b59 req-2d48d668-2809-45a3-ad03-a5be2af1b97b tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0898659 Mar 24 02:25:06.416243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:06.424322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (6435867d-361b-4d42-8c41-5f594a08b4bf), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:06.488063 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Subnet': ['ID=6435867d-361b-4d42-8c41-5f594a08b4bf,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:06.495293 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Checking segment: {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:25:06.495648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network hostable DHCP agents. Network: aeaed783-a093-45d9-8d0b-20f353f1cddb, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:25:06.512663 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network aeaed783-a093-45d9-8d0b-20f353f1cddb is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:25:06.522115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, aeaed783-a093-45d9-8d0b-20f353f1cddb) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:25:06.526138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:06.527347 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:06.542306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-574bf5e3-139a-483e-86bd-5eeabdd106de None None] Network aeaed783-a093-45d9-8d0b-20f353f1cddb requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:25:06.543683 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-626257c7-52f0-48a2-95a1-516adbb7571f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.4780023 Mar 24 02:25:06.546482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35590) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:06.701214 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-aeaed783-a093-45d9-8d0b-20f353f1cddb', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:25:06.702051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:06.768423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Publish callbacks [] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:06.813168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:06.902020 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Attempting to bind port d64c13ba-68ca-4812-819d-ba2881c9b900 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:25:06.902771 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Attempting to bind port d64c13ba-68ca-4812-819d-ba2881c9b900 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:25:06.902771 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Attempting to bind port d64c13ba-68ca-4812-819d-ba2881c9b900 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:25:06.915142 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08cb063-ca3a-454a-b178-236e3c4a0283 None None] Pushing event updated for resources: {'Port': ['ID=d64c13ba-68ca-4812-819d-ba2881c9b900,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:06.919663 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 25, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:25:06.920041 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:25:06.920440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:06.920823 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:25:06.921298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Bound port: d64c13ba-68ca-4812-819d-ba2881c9b900, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:25:06.921677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:06.959473 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Allocated IP 172.20.0.2 (aeaed783-a093-45d9-8d0b-20f353f1cddb/6435867d-361b-4d42-8c41-5f594a08b4bf/17053cda-0c53-4276-8dec-8ae81f4dd5c2) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:25:06.980078 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.000076 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] For port d64c13ba-68ca-4812-819d-ba2881c9b900, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:25:07.041156 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] For port d64c13ba-68ca-4812-819d-ba2881c9b900, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d64c13ba-68ca-4812-819d-ba2881c9b900,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:25:07.048638 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.144283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08cb063-ca3a-454a-b178-236e3c4a0283 None None] Pushing event updated for resources: {'Port': ['ID=d64c13ba-68ca-4812-819d-ba2881c9b900,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:07.149267 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:07.149893 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:07.261978 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Publish callbacks [] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.272421 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.328125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Network aeaed783-a093-45d9-8d0b-20f353f1cddb is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:25:07.335335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:07.337572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:25:07.340582 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:25:07.409727 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Pushing event updated for resources: {'Port': ['ID=17053cda-0c53-4276-8dec-8ae81f4dd5c2,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:07.499118 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Attempting to bind port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:25:07.499497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Attempting to bind port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:25:07.499862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Attempting to bind port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 on network aeaed783-a093-45d9-8d0b-20f353f1cddb {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:25:07.509164 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 25, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:25:07.509538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Checking segment: {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:25:07.509947 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.510340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Bound using segment: {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:25:07.510852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Bound port: 17053cda-0c53-4276-8dec-8ae81f4dd5c2, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:25:07.511237 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.526301 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.1 (aeaed783-a093-45d9-8d0b-20f353f1cddb/6435867d-361b-4d42-8c41-5f594a08b4bf/f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:25:07.540111 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdda3d35-52f3-41ec-9742-09f5ad2a97aa req-e36a3908-f1a6-475f-9d6a-b21ae2ef998f tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:07.543175 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bdda3d35-52f3-41ec-9742-09f5ad2a97aa req-e36a3908-f1a6-475f-9d6a-b21ae2ef998f tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 946 time: 0.0583212 Mar 24 02:25:07.598127 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-bdda3d35-52f3-41ec-9742-09f5ad2a97aa req-3fcecdfc-4179-4e97-bf12-2b9d410dfc21 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0501509 Mar 24 02:25:07.665058 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.701551 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.754451 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network aeaed783-a093-45d9-8d0b-20f353f1cddb is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:25:07.761807 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:25:07.767711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:25:07.772957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:07.784643 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] For port 17053cda-0c53-4276-8dec-8ae81f4dd5c2, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:25:07.790125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] For port 17053cda-0c53-4276-8dec-8ae81f4dd5c2, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=17053cda-0c53-4276-8dec-8ae81f4dd5c2,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:25:07.799338 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.837129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:07.859206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:05Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:07.910388 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd9896d1-10e6-4c00-9728-8a5582f62f03 None None] The sync data for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv is: [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:05Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:25:07.916532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2603f9fa-04e3-4563-8684-8cccc6e9979d None None] Pushing event updated for resources: {'Port': ['ID=17053cda-0c53-4276-8dec-8ae81f4dd5c2,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:08.015616 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:08.083620 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1832ed2d-fc92-4cb6-a005-986a34e613d9 req-bcf39b67-731a-48ac-9298-82974861df97 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:08.100189 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1832ed2d-fc92-4cb6-a005-986a34e613d9 req-bcf39b67-731a-48ac-9298-82974861df97 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 946 time: 0.4293647 Mar 24 02:25:08.153004 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1832ed2d-fc92-4cb6-a005-986a34e613d9 req-7f537d25-e721-40a4-a0ef-1348b088c336 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0519285 Mar 24 02:25:08.182190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35596) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:08.269937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edeb5221-2575-4bee-8acf-8c96b48b5b28 tempest-TestVolumeBootPattern-513780323 tempest-TestVolumeBootPattern-513780323-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:08.273857 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-edeb5221-2575-4bee-8acf-8c96b48b5b28 tempest-TestVolumeBootPattern-513780323 tempest-TestVolumeBootPattern-513780323-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 1125 time: 0.0900745 Mar 24 02:25:08.276757 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35598) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:08.281427 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address': '172.20.0.13'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:08.312490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:08.423010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:08.429236 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:08.445743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:08.509120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:08.518622 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:08.568735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Allocated IP 172.26.2.252 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/b248e525-9401-41d4-8aef-07a50d8acd3e) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:25:08.619402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network aeaed783-a093-45d9-8d0b-20f353f1cddb is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:25:08.620918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:25:08.687093 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for port (b248e525-9401-41d4-8aef-07a50d8acd3e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:08.731732 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (b248e525-9401-41d4-8aef-07a50d8acd3e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:08.784986 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'Port': ['ID=b248e525-9401-41d4-8aef-07a50d8acd3e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:08.802146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:25:08.816382 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:25:08.818575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:25:08.823255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:25:08.921369 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 17053cda-0c53-4276-8dec-8ae81f4dd5c2 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:25:08.950795 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:25:08.958899 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-cb8cb2a5-188c-4e0c-ae2b-f88743a8b08f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4089651 Mar 24 02:25:08.959266 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35600) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:09.031028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:09.031990 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.098901 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e80a2447-5fcd-402f-af40-b8ed5f657eb5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.099465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e80a2447-5fcd-402f-af40-b8ed5f657eb5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.099850 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e80a2447-5fcd-402f-af40-b8ed5f657eb5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.100318 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e80a2447-5fcd-402f-af40-b8ed5f657eb5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.100777 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e80a2447-5fcd-402f-af40-b8ed5f657eb5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.101245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e80a2447-5fcd-402f-af40-b8ed5f657eb5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.105509 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e80a2447-5fcd-402f-af40-b8ed5f657eb5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4284 time: 0.1430757 Mar 24 02:25:09.105818 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35602) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:09.155395 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:09.156062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.181770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c81104c4-af67-4b11-99bb-a028d9ecd09f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.182712 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c81104c4-af67-4b11-99bb-a028d9ecd09f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.183202 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c81104c4-af67-4b11-99bb-a028d9ecd09f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.183718 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c81104c4-af67-4b11-99bb-a028d9ecd09f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.184174 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c81104c4-af67-4b11-99bb-a028d9ecd09f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.184641 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c81104c4-af67-4b11-99bb-a028d9ecd09f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:09.189130 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c81104c4-af67-4b11-99bb-a028d9ecd09f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4004 time: 0.0763772 Mar 24 02:25:09.190086 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35604) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:09.200242 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 17053cda-0c53-4276-8dec-8ae81f4dd5c2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=17053cda-0c53-4276-8dec-8ae81f4dd5c2,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:09.205493 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c05f70ae-0702-470d-813b-cfee1506ca53 None None] Network aeaed783-a093-45d9-8d0b-20f353f1cddb requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:25:09.209845 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.210946 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d64c13ba-68ca-4812-819d-ba2881c9b900 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:25:09.250301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (5349e727-025d-4bd6-a72d-1099b97e5644), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.335035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (b248e525-9401-41d4-8aef-07a50d8acd3e), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.361946 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2305eeba-b91e-4eb3-9d56-022eecf58a2e None None] Provisioning complete for port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:09.362331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2305eeba-b91e-4eb3-9d56-022eecf58a2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.363685 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8f1b6ca5-ef2d-4a78-b652-a760c30b2eee tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3046 time: 0.1719379 Mar 24 02:25:09.390806 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=17053cda-0c53-4276-8dec-8ae81f4dd5c2,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:09.438537 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d64c13ba-68ca-4812-819d-ba2881c9b900 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:09.438921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.508370 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for port (b248e525-9401-41d4-8aef-07a50d8acd3e), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.514204 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (b248e525-9401-41d4-8aef-07a50d8acd3e), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.537741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2305eeba-b91e-4eb3-9d56-022eecf58a2e None None] Current status of the port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:09.604101 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d64c13ba-68ca-4812-819d-ba2881c9b900 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:09.604501 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.607416 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event updated for resources: {'Port': ['ID=b248e525-9401-41d4-8aef-07a50d8acd3e,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:09.619243 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (5349e727-025d-4bd6-a72d-1099b97e5644), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.626973 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d64c13ba-68ca-4812-819d-ba2881c9b900, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d64c13ba-68ca-4812-819d-ba2881c9b900,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:09.639954 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.687238 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35608) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:09.695276 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-bfc97f7e-b70d-451f-987e-b209d10c9731 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1002271121', 'description': 'tempest-secgroup-smoke-1002271121 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:09.708449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d64c13ba-68ca-4812-819d-ba2881c9b900,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:09.721148 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfc97f7e-b70d-451f-987e-b209d10c9731 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.792154 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Floating IP 5349e727-025d-4bd6-a72d-1099b97e5644 associated. External IP: 172.26.2.252, port: f7cc65a8-3ed6-4a46-9edf-cc2afead1568. Mar 24 02:25:09.804140 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfc97f7e-b70d-451f-987e-b209d10c9731 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.810727 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfc97f7e-b70d-451f-987e-b209d10c9731 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.844270 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc97f7e-b70d-451f-987e-b209d10c9731 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:09.849970 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bfc97f7e-b70d-451f-987e-b209d10c9731 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.854304 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bfc97f7e-b70d-451f-987e-b209d10c9731 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1657839 Mar 24 02:25:09.855010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35610) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:09.859632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-3c8e805f-95f1-4793-b2d0-bb7c8dda033e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:09.873589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-19fdc7c1-81b0-4323-be6f-eec68c032d09 None None] Provisioning complete for port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:09.874283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-19fdc7c1-81b0-4323-be6f-eec68c032d09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.905932 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3c8e805f-95f1-4793-b2d0-bb7c8dda033e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (b8d90a6b-3f66-4e06-a496-ee043f49ee57), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:09.937365 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-19fdc7c1-81b0-4323-be6f-eec68c032d09 None None] Port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:25:09.960444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-19fdc7c1-81b0-4323-be6f-eec68c032d09 None None] Provisioning complete for port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:09.960817 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-19fdc7c1-81b0-4323-be6f-eec68c032d09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.003156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3c8e805f-95f1-4793-b2d0-bb7c8dda033e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (b8d90a6b-3f66-4e06-a496-ee043f49ee57), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.013561 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3c8e805f-95f1-4793-b2d0-bb7c8dda033e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (b8d90a6b-3f66-4e06-a496-ee043f49ee57), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.049665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c8e805f-95f1-4793-b2d0-bb7c8dda033e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b8d90a6b-3f66-4e06-a496-ee043f49ee57,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:10.058939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-3c8e805f-95f1-4793-b2d0-bb7c8dda033e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.063112 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3c8e805f-95f1-4793-b2d0-bb7c8dda033e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2071271 Mar 24 02:25:10.063721 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35612) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:10.069290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-73f1708b-c748-4485-8d1a-5e443d66093f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:10.113858 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-19fdc7c1-81b0-4323-be6f-eec68c032d09 None None] Current status of the port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:10.132021 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-73f1708b-c748-4485-8d1a-5e443d66093f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (d38afec5-a6b6-40f8-b329-a3cbd4647db9), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.191228 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Sync routers for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:25:10.192305 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Router d9d90a22-1adf-4945-a625-094e279f17a1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:25:10.212319 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:10.213057 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:10.227035 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-73f1708b-c748-4485-8d1a-5e443d66093f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (d38afec5-a6b6-40f8-b329-a3cbd4647db9), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.235800 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-73f1708b-c748-4485-8d1a-5e443d66093f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (d38afec5-a6b6-40f8-b329-a3cbd4647db9), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.242135 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-af18c6dd-989a-4f90-babc-237473455dab None None] Provisioning complete for port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:10.242901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-af18c6dd-989a-4f90-babc-237473455dab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.271316 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-73f1708b-c748-4485-8d1a-5e443d66093f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.281197 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-73f1708b-c748-4485-8d1a-5e443d66093f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2133543 Mar 24 02:25:10.281428 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35614) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:10.286865 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-ad83e7ae-1fac-4f6b-9c45-87feff1812c0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:10.289843 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73f1708b-c748-4485-8d1a-5e443d66093f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d38afec5-a6b6-40f8-b329-a3cbd4647db9,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:10.301580 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-af18c6dd-989a-4f90-babc-237473455dab None None] Port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:25:10.358985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad83e7ae-1fac-4f6b-9c45-87feff1812c0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (8d7d00f6-938a-4beb-96cd-5501f678e025), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.377348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:25:10.388917 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] Sync routers for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:25:10.397504 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:10.412602 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:10.413232 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:10.465496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.529705 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6d2a014b-596c-423f-9653-3fb27714506a tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.2412982 Mar 24 02:25:10.529705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:25:10.529705 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc" -d '{"events": [{"name": "network-changed", "server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:25:10.533235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad83e7ae-1fac-4f6b-9c45-87feff1812c0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (8d7d00f6-938a-4beb-96cd-5501f678e025), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.541255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad83e7ae-1fac-4f6b-9c45-87feff1812c0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (8d7d00f6-938a-4beb-96cd-5501f678e025), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.565327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad83e7ae-1fac-4f6b-9c45-87feff1812c0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8d7d00f6-938a-4beb-96cd-5501f678e025,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:10.575418 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ad83e7ae-1fac-4f6b-9c45-87feff1812c0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.576898 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ad83e7ae-1fac-4f6b-9c45-87feff1812c0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2948151 Mar 24 02:25:10.580103 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35620) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:10.586424 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7821ae8f-b685-4efe-a9e7-935f43ef2cbb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:10.591087 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:25:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-897797a8-650c-4a70-8994-c1e6d10b4477 x-openstack-request-id: req-897797a8-650c-4a70-8994-c1e6d10b4477 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:25:10.591391 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:25:10.591652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-897797a8-650c-4a70-8994-c1e6d10b4477 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:25:10.592098 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-897797a8-650c-4a70-8994-c1e6d10b4477'] response: {'name': 'network-changed', 'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'status': 'completed', 'code': 200} Mar 24 02:25:10.603304 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:10.635396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7821ae8f-b685-4efe-a9e7-935f43ef2cbb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c054e286-d687-4346-b318-d603f96b8123), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.683584 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:25:08Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:10.688484 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-45b10a8f-1aec-4e62-9af0-45cfaf78d88a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:10.690551 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-45b10a8f-1aec-4e62-9af0-45cfaf78d88a service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 1130 time: 0.0933361 Mar 24 02:25:10.721580 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7821ae8f-b685-4efe-a9e7-935f43ef2cbb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c054e286-d687-4346-b318-d603f96b8123), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.726125 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Checking router: a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:25:10.726711 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Updating router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:25:10.727528 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7821ae8f-b685-4efe-a9e7-935f43ef2cbb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (c054e286-d687-4346-b318-d603f96b8123), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.758471 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7821ae8f-b685-4efe-a9e7-935f43ef2cbb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.763084 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7821ae8f-b685-4efe-a9e7-935f43ef2cbb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1815109 Mar 24 02:25:10.763822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35622) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:10.769431 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-7fb94675-d60c-4436-8964-10b177cf2f5f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:10.775457 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7821ae8f-b685-4efe-a9e7-935f43ef2cbb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c054e286-d687-4346-b318-d603f96b8123,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:10.799283 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.799813 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-7fb94675-d60c-4436-8964-10b177cf2f5f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:25:10.807413 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7fb94675-d60c-4436-8964-10b177cf2f5f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (8ea87137-8579-48ea-8a2e-45e7330a8ee4), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.894486 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7fb94675-d60c-4436-8964-10b177cf2f5f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (8ea87137-8579-48ea-8a2e-45e7330a8ee4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.898925 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-6b06d884-2592-4434-8cd9-bdabd69a0e83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:10.902113 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7fb94675-d60c-4436-8964-10b177cf2f5f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (8ea87137-8579-48ea-8a2e-45e7330a8ee4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.902407 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-6b06d884-2592-4434-8cd9-bdabd69a0e83 service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.2047756 Mar 24 02:25:10.913754 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 17053cda-0c53-4276-8dec-8ae81f4dd5c2 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:25:10.917609 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-211d8e35-dceb-4a4f-a63d-78110c3d88af None None] Provisioning complete for port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:10.917980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-211d8e35-dceb-4a4f-a63d-78110c3d88af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.931201 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb94675-d60c-4436-8964-10b177cf2f5f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ea87137-8579-48ea-8a2e-45e7330a8ee4,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:10.950412 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-7fb94675-d60c-4436-8964-10b177cf2f5f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:10.952229 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7fb94675-d60c-4436-8964-10b177cf2f5f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1870236 Mar 24 02:25:10.954809 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35624) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:10.961150 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8cfb44fd-d34a-46fe-9746-6cca91ca76ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:10.995908 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-8cfb44fd-d34a-46fe-9746-6cca91ca76ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:25:11.009002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8cfb44fd-d34a-46fe-9746-6cca91ca76ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (36304ec3-1221-4785-a7b9-decb7ef36ba0), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.021946 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-0f874fb6-6ae8-4e73-9c5a-19b4bd4fc695 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7cc65a8-3ed6-4a46-9edf-cc2afead1568 HTTP/1.1" status: 200 len: 1000 time: 0.1139259 Mar 24 02:25:11.029797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-211d8e35-dceb-4a4f-a63d-78110c3d88af None None] Port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:25:11.053999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:11.054680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.105069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-da59bbe3-6686-470c-85d0-bbb9a185e68e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:11.106446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '5349e727-025d-4bd6-a72d-1099b97e5644', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.252', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1451, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:85:a6:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:25:09Z', 'updated_at': '2022-03-24T02:25:09Z', 'revision_number': 0, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}, {'id': '6d1e6138-f7e0-473d-bae4-c655f53ad785', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.143', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1413, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:22:45Z', 'updated_at': '2022-03-24T02:22:47Z', 'revision_number': 1, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:11.107183 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-da59bbe3-6686-470c-85d0-bbb9a185e68e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0784793 Mar 24 02:25:11.111736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8cfb44fd-d34a-46fe-9746-6cca91ca76ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (36304ec3-1221-4785-a7b9-decb7ef36ba0), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.116524 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8cfb44fd-d34a-46fe-9746-6cca91ca76ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (36304ec3-1221-4785-a7b9-decb7ef36ba0), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.139665 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cfb44fd-d34a-46fe-9746-6cca91ca76ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=36304ec3-1221-4785-a7b9-decb7ef36ba0,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:11.146055 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] Checking router: d9d90a22-1adf-4945-a625-094e279f17a1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:25:11.164127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:11.165162 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:11.167633 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8cfb44fd-d34a-46fe-9746-6cca91ca76ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.189849 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8cfb44fd-d34a-46fe-9746-6cca91ca76ee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2334757 Mar 24 02:25:11.206756 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-51f351b6-3312-486d-bd1d-cc052cc11cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:11.212191 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-51f351b6-3312-486d-bd1d-cc052cc11cc1 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0926077 Mar 24 02:25:11.270208 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Publish callbacks [] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.283616 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.293922 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:11.295095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d64c13ba-68ca-4812-819d-ba2881c9b900 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:25:11.329508 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-07c299d0-4fb5-4524-a9fc-72a40d878425 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1073818 Mar 24 02:25:11.344236 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce63bc3-f9da-40f4-97af-66498c7b4b10 None None] Pushing event updated for resources: {'Port': ['ID=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:11.388658 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:11.430073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d64c13ba-68ca-4812-819d-ba2881c9b900 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:11.430362 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.447759 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Attempting to bind port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:25:11.448284 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Attempting to bind port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:25:11.448717 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Attempting to bind port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 on network aeaed783-a093-45d9-8d0b-20f353f1cddb {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:25:11.455155 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 25, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:25:11.455622 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Checking segment: {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:25:11.456091 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.456692 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Bound using segment: {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:25:11.457765 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Bound port: f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:25:11.458214 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.479237 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-5e070ac1-284a-42c3-9990-89e86a5fdacd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1002271121&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.1473453 Mar 24 02:25:11.556933 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] For port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:25:11.566741 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] For port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:25:11.583458 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.637336 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a397c0-092b-44bd-be90-ade736af532f req-d8d12f42-30ec-4aad-bd5e-fdac38505f93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:11.639048 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-d8d12f42-30ec-4aad-bd5e-fdac38505f93 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/networks?id=aeaed783-a093-45d9-8d0b-20f353f1cddb HTTP/1.1" status: 200 len: 797 time: 0.1502028 Mar 24 02:25:11.653390 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:11.654235 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:11.670758 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-a24c142e-faa5-47c8-b2dc-1ebcb2aeaaac tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/quotas/6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 375 time: 0.0238683 Mar 24 02:25:11.675032 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2b6cadfb-5ec7-4d10-84e2-59c04a6d00dc req-89f4f74a-eaf2-48b8-96db-73846c4223b7 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2984903 Mar 24 02:25:11.732737 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d64c13ba-68ca-4812-819d-ba2881c9b900 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:11.774195 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-eab4c46b-ce9e-401f-9cce-188085ffc4b2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0971577 Mar 24 02:25:11.803790 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce63bc3-f9da-40f4-97af-66498c7b4b10 None None] Pushing event updated for resources: {'Port': ['ID=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:11.804020 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-7be2c105-7b85-417e-aab7-cc9faba18f20 None None] Provisioning complete for port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:11.804313 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7be2c105-7b85-417e-aab7-cc9faba18f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:11.839830 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:11.938218 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-e5a6344c-1cd3-4ae7-9248-632844a1ae7a service neutron] 10.222.0.20 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1460605 Mar 24 02:25:12.062760 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '5349e727-025d-4bd6-a72d-1099b97e5644', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.252', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1451, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:85:a6:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:25:09Z', 'updated_at': '2022-03-24T02:25:09Z', 'revision_number': 0, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}, {'id': '6d1e6138-f7e0-473d-bae4-c655f53ad785', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.143', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1413, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:22:45Z', 'updated_at': '2022-03-24T02:22:47Z', 'revision_number': 1, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:12.068957 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-de1161a5-7816-4714-80de-8ccdffa0f190 service neutron] 10.222.0.20 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1208944 Mar 24 02:25:12.095832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef9b926b-b9f9-411f-9611-6501065498b1 None None] The sync data for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv is: [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '5349e727-025d-4bd6-a72d-1099b97e5644', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.252', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1451, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:85:a6:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:25:09Z', 'updated_at': '2022-03-24T02:25:09Z', 'revision_number': 0, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}, {'id': '6d1e6138-f7e0-473d-bae4-c655f53ad785', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.143', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1413, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:22:45Z', 'updated_at': '2022-03-24T02:22:47Z', 'revision_number': 1, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:25:12.107724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7be2c105-7b85-417e-aab7-cc9faba18f20 None None] Current status of the port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:12.108120 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7be2c105-7b85-417e-aab7-cc9faba18f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:12.148774 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:25:11Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:12.176426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-7be2c105-7b85-417e-aab7-cc9faba18f20 None None] For port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:12.188878 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfa843b9-5a72-4489-a036-aadbfed0e635 None None] The sync data for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv is: [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:25:11Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:25:12.189670 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7be2c105-7b85-417e-aab7-cc9faba18f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:12.281060 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be2c105-7b85-417e-aab7-cc9faba18f20 None None] Pushing event updated for resources: {'Port': ['ID=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:12.333497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-56fb5e8c-d461-46cf-bdfe-8688d3834713 None None] Provisioning complete for port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:12.333901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-56fb5e8c-d461-46cf-bdfe-8688d3834713 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:12.350771 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3838ae81-035b-4dae-b4a4-e9042d4adccc req-418b9cf6-cef8-4ec9-bccb-62492415a45e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 210 time: 0.0499167 Mar 24 02:25:12.478886 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-56fb5e8c-d461-46cf-bdfe-8688d3834713 None None] Current status of the port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:12.491097 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30bc3d91-b6d8-46f7-89cc-ce3b3b88f1d5 None None] New status for floating IP 5349e727-025d-4bd6-a72d-1099b97e5644: ACTIVE {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:25:12.835608 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:25:12.913968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:12.914551 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:13.017032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:13.474554 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6fe156fe-212f-4c9e-8d64-fa2785c6973c req-4f22a7e4-af07-4ba7-af0f-03cda47b0df0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 210 time: 0.0336106 Mar 24 02:25:13.516532 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a397c0-092b-44bd-be90-ade736af532f req-3f2ab7ed-5f5a-494d-87a0-722cd8a6c915 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:13.518365 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-3f2ab7ed-5f5a-494d-87a0-722cd8a6c915 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=aeaed783-a093-45d9-8d0b-20f353f1cddb HTTP/1.1" status: 200 len: 797 time: 0.1520891 Mar 24 02:25:13.591364 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-e0792c4b-e9b4-466a-80ef-bc824cbfd269 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 380 time: 0.0586202 Mar 24 02:25:13.600228 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'device_id': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'admin_state_up': True, 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'security_groups': ['b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:13.704202 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:25:13.707658 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:14.129200 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.11 (aeaed783-a093-45d9-8d0b-20f353f1cddb/6435867d-361b-4d42-8c41-5f594a08b4bf/68c4542c-ed8b-43e3-8477-bd216f53af31) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:25:14.268106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:14.301647 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:14.340846 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network aeaed783-a093-45d9-8d0b-20f353f1cddb is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:25:14.343899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:25:14.348080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:25:14.375643 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=68c4542c-ed8b-43e3-8477-bd216f53af31,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:14.404924 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:14.405549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:14.422255 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-73c69943-cfcd-48ec-bf44-4a8a1d9dc115 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8256483 Mar 24 02:25:14.433448 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Request body: {'port': {'device_id': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:14.498096 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:14.612871 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-56863cd3-7d9c-4793-83df-165c2d54edc8 None None] Provisioning complete for port 68c4542c-ed8b-43e3-8477-bd216f53af31 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:14.613514 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-56863cd3-7d9c-4793-83df-165c2d54edc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:14.652457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-56863cd3-7d9c-4793-83df-165c2d54edc8 None None] Port 68c4542c-ed8b-43e3-8477-bd216f53af31 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:25:14.705842 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eaf2188-69fc-4ed9-82dd-e4a8eaa54996 req-663cce96-bdf4-444e-a907-a21da8f29c54 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:14.707857 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0eaf2188-69fc-4ed9-82dd-e4a8eaa54996 req-663cce96-bdf4-444e-a907-a21da8f29c54 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 932 time: 0.1572840 Mar 24 02:25:14.788347 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0eaf2188-69fc-4ed9-82dd-e4a8eaa54996 req-0e230bd9-18b2-4a45-abf5-3764eecd8ee6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0747571 Mar 24 02:25:14.839334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 68c4542c-ed8b-43e3-8477-bd216f53af31 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:25:14.846821 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Publish callbacks [] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:14.858546 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Transition to ACTIVE for port object 68c4542c-ed8b-43e3-8477-bd216f53af31 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:25:14.862125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:14.930049 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Pushing event updated for resources: {'Port': ['ID=68c4542c-ed8b-43e3-8477-bd216f53af31,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:14.992897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Attempting to bind port 68c4542c-ed8b-43e3-8477-bd216f53af31 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:25:14.993260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Attempting to bind port 68c4542c-ed8b-43e3-8477-bd216f53af31 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:25:14.993691 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Attempting to bind port 68c4542c-ed8b-43e3-8477-bd216f53af31 on network aeaed783-a093-45d9-8d0b-20f353f1cddb {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:25:14.998693 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Port 68c4542c-ed8b-43e3-8477-bd216f53af31 on network aeaed783-a093-45d9-8d0b-20f353f1cddb not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:25:14.999013 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Attempting to bind port 68c4542c-ed8b-43e3-8477-bd216f53af31 on network aeaed783-a093-45d9-8d0b-20f353f1cddb {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:25:15.004597 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 24, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:25:15.004928 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Checking segment: {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:25:15.005303 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Bound using segment: {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:25:15.005722 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Bound port: 68c4542c-ed8b-43e3-8477-bd216f53af31, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '333ac000-e3cb-48f8-b8cc-fe888c62fd7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:25:15.006075 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:15.047299 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:15.075407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] For port 68c4542c-ed8b-43e3-8477-bd216f53af31, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:25:15.078847 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] For port 68c4542c-ed8b-43e3-8477-bd216f53af31, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=68c4542c-ed8b-43e3-8477-bd216f53af31,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:25:15.085538 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:15.120609 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:15.121229 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:15.122711 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] 10.222.0.30 "PUT /v2.0/ports/68c4542c-ed8b-43e3-8477-bd216f53af31 HTTP/1.1" status: 200 len: 1094 time: 0.6934707 Mar 24 02:25:15.123152 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:25:15.125379 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f" -d '{"events": [{"name": "network-changed", "server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:25:15.149265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e412bad-5774-4af6-beae-2db2d59cb4bc service neutron] Pushing event updated for resources: {'Port': ['ID=68c4542c-ed8b-43e3-8477-bd216f53af31,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:15.178471 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:25:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0d2198a3-659a-4298-b8b9-4b1439b4bd13 x-openstack-request-id: req-0d2198a3-659a-4298-b8b9-4b1439b4bd13 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:25:15.178837 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:25:15.179037 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-0d2198a3-659a-4298-b8b9-4b1439b4bd13 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:25:15.179446 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0d2198a3-659a-4298-b8b9-4b1439b4bd13'] response: {'name': 'network-changed', 'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'status': 'completed', 'code': 200} Mar 24 02:25:15.217553 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a397c0-092b-44bd-be90-ade736af532f req-a14efc6e-49f9-439f-8fdf-cf279358fd76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:15.219098 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-a14efc6e-49f9-439f-8fdf-cf279358fd76 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 1128 time: 0.0511553 Mar 24 02:25:15.269330 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-794f2734-b5ca-45c6-9fc8-774fe12e1fe2 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=68c4542c-ed8b-43e3-8477-bd216f53af31 HTTP/1.1" status: 200 len: 217 time: 0.0397694 Mar 24 02:25:15.319279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a397c0-092b-44bd-be90-ade736af532f req-896babca-467c-471b-87d2-ff013ddbca17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:15.320742 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-896babca-467c-471b-87d2-ff013ddbca17 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=6435867d-361b-4d42-8c41-5f594a08b4bf HTTP/1.1" status: 200 len: 835 time: 0.0454171 Mar 24 02:25:15.367858 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a397c0-092b-44bd-be90-ade736af532f req-a3ac1ce8-092a-4528-9f5f-11957e5efd31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:15.369324 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-a3ac1ce8-092a-4528-9f5f-11957e5efd31 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=aeaed783-a093-45d9-8d0b-20f353f1cddb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0426681 Mar 24 02:25:15.462308 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-75c9987f-6be9-498a-b230-c93d7b04a590 service neutron] 10.222.0.30 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858080 Mar 24 02:25:15.558022 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-51a397c0-092b-44bd-be90-ade736af532f req-163a8167-dc09-4c51-b1a6-08f5c2d9e3d2 service neutron] 10.222.0.30 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815263 Mar 24 02:25:15.664322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-f2b8736b-0b28-4534-941a-a48ed80ed337 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:15.665801 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-f2b8736b-0b28-4534-941a-a48ed80ed337 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 1128 time: 0.0499895 Mar 24 02:25:15.754334 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-4fe50195-477c-4978-8506-4d7c49c2a748 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:15.755794 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-4fe50195-477c-4978-8506-4d7c49c2a748 service neutron] 10.222.0.30 "GET /v2.0/networks?id=aeaed783-a093-45d9-8d0b-20f353f1cddb HTTP/1.1" status: 200 len: 898 time: 0.0830424 Mar 24 02:25:15.810504 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-20ee2d41-70b3-4233-bf85-e8fba332992d service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=68c4542c-ed8b-43e3-8477-bd216f53af31 HTTP/1.1" status: 200 len: 217 time: 0.0347679 Mar 24 02:25:15.886336 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-011d6325-592c-4116-ab5d-571d547f5fbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:15.887824 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-011d6325-592c-4116-ab5d-571d547f5fbb service neutron] 10.222.0.30 "GET /v2.0/subnets?id=6435867d-361b-4d42-8c41-5f594a08b4bf HTTP/1.1" status: 200 len: 835 time: 0.0724061 Mar 24 02:25:15.937128 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea1b6eea-9a97-4725-b4c0-16e50df8930c req-abe22896-9a65-4840-bd4c-17cc3e2b8701 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:15.938629 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ea1b6eea-9a97-4725-b4c0-16e50df8930c req-abe22896-9a65-4840-bd4c-17cc3e2b8701 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 944 time: 0.0850496 Mar 24 02:25:15.964947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-77052f64-c943-45ad-b090-ce6e4278d742 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:15.966388 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-77052f64-c943-45ad-b090-ce6e4278d742 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=aeaed783-a093-45d9-8d0b-20f353f1cddb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0709705 Mar 24 02:25:16.037705 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ea1b6eea-9a97-4725-b4c0-16e50df8930c req-20acc4c4-7c69-4966-9361-ce1273934cd2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0928268 Mar 24 02:25:16.077476 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-fc4c548e-8fb4-4dbf-8a9f-10991603367d service neutron] 10.222.0.30 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0998924 Mar 24 02:25:16.164994 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f6f3c012-b3f8-4671-89c8-2a6de9dfb21f req-e840f0fb-630f-46e0-8247-b33fbd183668 service neutron] 10.222.0.30 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812411 Mar 24 02:25:17.168699 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad14009b-2589-4c10-870d-a72ba3225de9 req-ad12af51-3519-443b-b418-407eb2c5d3f6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:17.170328 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ad14009b-2589-4c10-870d-a72ba3225de9 req-ad12af51-3519-443b-b418-407eb2c5d3f6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 944 time: 0.0617170 Mar 24 02:25:17.220597 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ad14009b-2589-4c10-870d-a72ba3225de9 req-e9399525-121f-4ab9-88e3-5d1c1c996981 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440779 Mar 24 02:25:18.344467 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312ce686-06bc-47c8-8921-63a2b36630da req-47c9bdfa-6c10-40a6-bf66-f56ca5fb1cb9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:18.345867 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-312ce686-06bc-47c8-8921-63a2b36630da req-47c9bdfa-6c10-40a6-bf66-f56ca5fb1cb9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 944 time: 0.0576489 Mar 24 02:25:18.393450 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-312ce686-06bc-47c8-8921-63a2b36630da req-5ae26a1f-de23-4047-b66f-eed8ba802282 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420563 Mar 24 02:25:18.624391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 68c4542c-ed8b-43e3-8477-bd216f53af31 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:25:18.722487 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 68c4542c-ed8b-43e3-8477-bd216f53af31, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=68c4542c-ed8b-43e3-8477-bd216f53af31,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:18.733842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'port_id': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'mac_address': 'fa:16:3e:bc:6b:1c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:25:18.769680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 68c4542c-ed8b-43e3-8477-bd216f53af31 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:18.770097 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:18.782649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 68c4542c-ed8b-43e3-8477-bd216f53af31 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:25:18.805460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 68c4542c-ed8b-43e3-8477-bd216f53af31, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=68c4542c-ed8b-43e3-8477-bd216f53af31,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:18.809064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:18.853654 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=68c4542c-ed8b-43e3-8477-bd216f53af31,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:18.860349 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.860693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.861052 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.861369 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.861698 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.862022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.862342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.862692 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.863014 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.863333 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.864147 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.864472 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.864788 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.865102 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:18.865419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:19.133753 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['68c4542c-ed8b-43e3-8477-bd216f53af31'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:25:19.508160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3ef02e-8b6e-4b3d-9cc8-62707956da69 req-75b0024e-4506-4fd9-be32-834d8be2f3ed tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:19.509642 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-de3ef02e-8b6e-4b3d-9cc8-62707956da69 req-75b0024e-4506-4fd9-be32-834d8be2f3ed tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 945 time: 0.0521774 Mar 24 02:25:19.562935 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-de3ef02e-8b6e-4b3d-9cc8-62707956da69 req-3e9dcfbf-4fb6-4811-a647-59140e51df0e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476823 Mar 24 02:25:20.639664 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 68c4542c-ed8b-43e3-8477-bd216f53af31 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:25:20.677509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581222b5-b849-4e02-ad7d-884ee210496f req-11cc7fbd-8eab-41b8-b021-ac004758fd0d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:20.679034 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-581222b5-b849-4e02-ad7d-884ee210496f req-11cc7fbd-8eab-41b8-b021-ac004758fd0d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 945 time: 0.0528593 Mar 24 02:25:20.688619 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 68c4542c-ed8b-43e3-8477-bd216f53af31 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:25:20.693864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 68c4542c-ed8b-43e3-8477-bd216f53af31 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:25:20.694243 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:20.731055 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-581222b5-b849-4e02-ad7d-884ee210496f req-38dc96d9-70d6-4983-ab36-583d70665de6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464823 Mar 24 02:25:20.772497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 68c4542c-ed8b-43e3-8477-bd216f53af31 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:25:20.772879 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:20.794040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:25:20.796311 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4d66735-1b92-478f-8200-0e054ef981de" -d '{"events": [{"server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "name": "network-vif-plugged", "status": "completed", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:25:20.808363 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 68c4542c-ed8b-43e3-8477-bd216f53af31, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=68c4542c-ed8b-43e3-8477-bd216f53af31,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:25:20.812493 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:20.835439 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:25:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc173a2e-b1c3-4f2d-b46d-ed7f4f449135 x-openstack-request-id: req-fc173a2e-b1c3-4f2d-b46d-ed7f4f449135 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:25:20.835729 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "name": "network-vif-plugged", "status": "completed", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:25:20.835980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-fc173a2e-b1c3-4f2d-b46d-ed7f4f449135 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:25:20.836369 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fc173a2e-b1c3-4f2d-b46d-ed7f4f449135'] response: {'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'code': 200} Mar 24 02:25:20.860901 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=68c4542c-ed8b-43e3-8477-bd216f53af31,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:21.009626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94e1129-5c91-4d40-95a9-48c9de3ec3c9 req-e578204d-32ca-43d4-922d-0966e0bca1f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:21.011151 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a94e1129-5c91-4d40-95a9-48c9de3ec3c9 req-e578204d-32ca-43d4-922d-0966e0bca1f4 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 1130 time: 0.0439990 Mar 24 02:25:21.055211 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a94e1129-5c91-4d40-95a9-48c9de3ec3c9 req-2d921487-8295-45cb-8f22-649c63470a55 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375688 Mar 24 02:25:21.850568 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976b85e2-5561-4277-acf6-2848d34df243 req-01df8b80-b91e-4d9e-88ea-bf3c86555c57 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:21.852056 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-976b85e2-5561-4277-acf6-2848d34df243 req-01df8b80-b91e-4d9e-88ea-bf3c86555c57 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 946 time: 0.0564570 Mar 24 02:25:21.899093 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-976b85e2-5561-4277-acf6-2848d34df243 req-c9355fca-0331-44c2-a01b-c6271f7cee0d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416274 Mar 24 02:25:23.021674 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-177f71c2-5c22-417d-bd85-799fe42a6462 req-fca8437f-38a1-457e-9317-0c55ba66162c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:23.023088 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-177f71c2-5c22-417d-bd85-799fe42a6462 req-fca8437f-38a1-457e-9317-0c55ba66162c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 946 time: 0.0555601 Mar 24 02:25:23.072907 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-177f71c2-5c22-417d-bd85-799fe42a6462 req-506b75eb-ef65-4c11-ae58-386a1967bbe8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441837 Mar 24 02:25:23.197743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b6d7c0-a376-4428-ab95-e76d8ffd48d0 req-04bda317-0712-4c05-8f46-f06f3d34cdd0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:23.199257 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b4b6d7c0-a376-4428-ab95-e76d8ffd48d0 req-04bda317-0712-4c05-8f46-f06f3d34cdd0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 946 time: 0.0608969 Mar 24 02:25:23.246893 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b4b6d7c0-a376-4428-ab95-e76d8ffd48d0 req-16233424-60f1-4ae6-a752-aabeadb625a1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420382 Mar 24 02:25:23.267782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35680) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:23.341464 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86df9147-14b3-49ce-b38b-e8a92c6e2ce5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:23.343124 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-86df9147-14b3-49ce-b38b-e8a92c6e2ce5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 1125 time: 0.0743845 Mar 24 02:25:23.345781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35682) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:23.351058 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address': '172.20.0.11'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:25:23.372840 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:23.468768 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:23.574723 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.41 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/409f90e6-3a5c-499b-9fb3-a0a551139a1e) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:25:23.680972 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (409f90e6-3a5c-499b-9fb3-a0a551139a1e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:23.718625 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (409f90e6-3a5c-499b-9fb3-a0a551139a1e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:23.753493 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:25:23.756774 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:25:23.760373 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:25:23.785840 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=409f90e6-3a5c-499b-9fb3-a0a551139a1e,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:23.798743 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.799095 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.799437 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.799779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.800106 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.800436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.800762 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.801614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.801936 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.802288 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.802647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.802940 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.803261 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.803577 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:23.803892 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:25:24.192769 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (b291bc46-6290-44dd-a953-f43b9a734cbd), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:24.267457 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (409f90e6-3a5c-499b-9fb3-a0a551139a1e), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:24.415410 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (409f90e6-3a5c-499b-9fb3-a0a551139a1e), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:24.419860 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (409f90e6-3a5c-499b-9fb3-a0a551139a1e), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:24.485245 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=409f90e6-3a5c-499b-9fb3-a0a551139a1e,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:25:24.494929 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (b291bc46-6290-44dd-a953-f43b9a734cbd), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:24.604192 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP b291bc46-6290-44dd-a953-f43b9a734cbd associated. External IP: 172.26.2.41, port: 68c4542c-ed8b-43e3-8477-bd216f53af31. Mar 24 02:25:25.084329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:25:25.192968 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:25:25.202772 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] Sync routers for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:25:25.212165 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:25.213062 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:25.213743 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:25.242378 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-35814f91-9dfd-47fe-a379-b9bfbe52c821 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8954408 Mar 24 02:25:25.243034 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31'}] {{(pid=104036) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:25:25.245090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35684) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:25.245587 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d6177697792ca3fff01bbfc58b3e16cb8a22905a2f74e66d9151ebb6b50c8f9c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b" -d '{"events": [{"name": "network-changed", "server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31"}]}' {{(pid=104036) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:25:25.279866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:25:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-87d421c5-f6c0-4e2a-99fb-c268e33b36c0 x-openstack-request-id: req-87d421c5-f6c0-4e2a-99fb-c268e33b36c0 {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:25:25.280167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31", "status": "completed", "code": 200}]} {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:25:25.280427 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-87d421c5-f6c0-4e2a-99fb-c268e33b36c0 {{(pid=104036) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:25:25.280843 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.notifiers.nova [-] Nova event matching ['req-87d421c5-f6c0-4e2a-99fb-c268e33b36c0'] response: {'name': 'network-changed', 'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'status': 'completed', 'code': 200} Mar 24 02:25:25.329882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:25.391587 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-224e2315-1565-4fe3-a06d-e0ff396c84e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:25.393381 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-224e2315-1565-4fe3-a06d-e0ff396c84e5 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 1130 time: 0.0700159 Mar 24 02:25:25.413016 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cd3628b8-9d87-46e6-a649-0ac0cb9c55f8 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers/a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe HTTP/1.1" status: 200 len: 922 time: 0.1665695 Mar 24 02:25:25.415653 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35688) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:25.481560 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d4991c10-a319-48a6-b348-74bf04c12fcf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/b291bc46-6290-44dd-a953-f43b9a734cbd HTTP/1.1" status: 200 len: 991 time: 0.0641592 Mar 24 02:25:25.495258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-ddead34a-be83-44b6-8574-3aa666e6764d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:25.496742 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-ddead34a-be83-44b6-8574-3aa666e6764d service neutron] 10.222.0.30 "GET /v2.0/networks?id=aeaed783-a093-45d9-8d0b-20f353f1cddb HTTP/1.1" status: 200 len: 898 time: 0.0961986 Mar 24 02:25:25.556999 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'b291bc46-6290-44dd-a953-f43b9a734cbd', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.41', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'port_id': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1463, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'mac_address': 'fa:16:3e:bc:6b:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:25:24Z', 'updated_at': '2022-03-24T02:25:24Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:25:12Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:25.565797 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-68012571-d4f5-4566-8660-d839d1b82f22 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=68c4542c-ed8b-43e3-8477-bd216f53af31 HTTP/1.1" status: 200 len: 999 time: 0.0627220 Mar 24 02:25:25.586912 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] Checking router: a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:25:25.595545 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:25:25.596143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:25:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:25.621095 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-b9bd8b51-7ac0-45cb-9340-2a636e6e37f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:25.623388 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-b9bd8b51-7ac0-45cb-9340-2a636e6e37f3 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=6435867d-361b-4d42-8c41-5f594a08b4bf HTTP/1.1" status: 200 len: 835 time: 0.0463021 Mar 24 02:25:25.673161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-8c40c30e-d816-4149-a386-2a92262f051f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:25:25.674617 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-8c40c30e-d816-4149-a386-2a92262f051f service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=aeaed783-a093-45d9-8d0b-20f353f1cddb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0453787 Mar 24 02:25:25.703882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:25:25.772028 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-ecefea7e-d296-4f6d-8657-ea3dd1f6c1b7 service neutron] 10.222.0.30 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879548 Mar 24 02:25:25.863866 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-56d54c2f-8e35-429a-ac0c-cbd5cbb3a41b req-b6841d76-30c9-4998-b545-c3e5d2aeacf1 service neutron] 10.222.0.30 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856035 Mar 24 02:25:25.930471 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'b291bc46-6290-44dd-a953-f43b9a734cbd', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.41', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'port_id': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1463, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'mac_address': 'fa:16:3e:bc:6b:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:25:24Z', 'updated_at': '2022-03-24T02:25:24Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:25:12Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:25:25.956275 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d4d3f61-9501-4c42-90a2-c77f670c3887 None None] The sync data for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv is: [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'b291bc46-6290-44dd-a953-f43b9a734cbd', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.41', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'port_id': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1463, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'mac_address': 'fa:16:3e:bc:6b:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:25:24Z', 'updated_at': '2022-03-24T02:25:24Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:25:12Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:25:26.144063 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6beaf44-28f4-4114-a879-ab10af70bd01 None None] New status for floating IP b291bc46-6290-44dd-a953-f43b9a734cbd: ACTIVE {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:25:26.485524 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35690) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:25:26.553943 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1690cef5-9b06-4a75-a4c6-b1083ed03994 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/b291bc46-6290-44dd-a953-f43b9a734cbd HTTP/1.1" status: 200 len: 993 time: 0.0671923 Mar 24 02:25:27.400678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8777b243-0654-4205-ac96-0229091d17cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:30.517620 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4174e44d-5edb-4c9a-9617-6ec02ecfbc2f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:30.882540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:32.442310 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:33.708854 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:37.986401 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:25:45.050185 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:25:57.401091 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-272f2ff3-4b79-42f9-b5d2-fb9939a4a225 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:00.519086 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2950a7a5-aa44-4688-9a9d-22b58f5903ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:00.885038 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:02.483546 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:03.712091 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:14.984140 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:26:15.048599 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:27.402881 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1052a094-b2b2-42f7-973b-fca34020fe82 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:28.050352 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-eaf0260a-185e-4c34-9a55-7d08faac13c5 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0441139 Mar 24 02:26:28.136541 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-d61e7875-7a02-42fc-9c3b-4b527a122d97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:28.138007 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-d61e7875-7a02-42fc-9c3b-4b527a122d97 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 1130 time: 0.0438666 Mar 24 02:26:28.240886 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-aec0337e-b200-4e42-b363-ea2985f85e9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:28.242368 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-aec0337e-b200-4e42-b363-ea2985f85e9a service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.0852497 Mar 24 02:26:28.305238 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-8cfc56f4-beec-4194-b5d8-ddea76ac1454 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311 HTTP/1.1" status: 200 len: 1002 time: 0.0566521 Mar 24 02:26:28.354715 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-081359df-5dae-410a-a0b7-868e15f6c48b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:28.356088 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-081359df-5dae-410a-a0b7-868e15f6c48b service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0450053 Mar 24 02:26:28.402010 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-368571d5-5132-407a-a656-5c3083e0dc45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:28.403471 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-368571d5-5132-407a-a656-5c3083e0dc45 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0420067 Mar 24 02:26:28.488264 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-8ef62bf9-55cc-4ba6-8322-200e3b86c92f service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786307 Mar 24 02:26:28.583332 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a36c5de5-5167-459e-8a1e-50a9129a51af req-66e65c61-c886-45d0-957a-427374648507 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861714 Mar 24 02:26:29.234469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35726) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:29.407074 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8e14d284-e790-4f4a-a47e-4c237d6ed0cc tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers/a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.1714053 Mar 24 02:26:29.409862 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35730) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:29.525970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2193844d-da7e-4486-88da-a07359ba3f06 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Notify agent at dv-neutron-834874-3-hyperv the message router_removed_from_agent {{(pid=104037) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Mar 24 02:26:29.529002 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-2193844d-da7e-4486-88da-a07359ba3f06 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "DELETE /v2.0/agents/700661ac-903b-4270-9a73-7a0120212663/l3-routers/a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe HTTP/1.1" status: 204 len: 168 time: 0.1182396 Mar 24 02:26:29.531603 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35732) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:29.643318 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-dc8468fd-b010-4a62-8e84-dc0cfd21faac tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers/a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe/l3-agents HTTP/1.1" status: 200 len: 207 time: 0.1100934 Mar 24 02:26:29.645797 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35734) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:29.703171 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f2e6c598-7132-458b-bdfb-ee9688dceab7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/b291bc46-6290-44dd-a953-f43b9a734cbd HTTP/1.1" status: 200 len: 993 time: 0.0563784 Mar 24 02:26:30.029456 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb3c3eb-016b-4965-9dc1-454e5d1bb7f4 None None] New status for floating IP b291bc46-6290-44dd-a953-f43b9a734cbd: DOWN {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:26:30.520340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-af7c94ec-722b-4171-bd26-2d7d0e98be73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:30.706407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35736) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:30.770706 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-6274ebe6-178e-458b-b52c-a0fe5551e1f0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/b291bc46-6290-44dd-a953-f43b9a734cbd HTTP/1.1" status: 200 len: 991 time: 0.0629616 Mar 24 02:26:30.810780 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d64c13ba-68ca-4812-819d-ba2881c9b900 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:26:30.894673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d64c13ba-68ca-4812-819d-ba2881c9b900 is: ACTIVE; New status is: DOWN {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:30.895051 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:30.908070 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:30.916069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d64c13ba-68ca-4812-819d-ba2881c9b900, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d64c13ba-68ca-4812-819d-ba2881c9b900,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:30.919769 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:30.920440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:26:30.992972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d64c13ba-68ca-4812-819d-ba2881c9b900,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:31.001948 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.002297 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.002669 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.003009 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.003342 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.003673 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.004002 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.004328 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.004657 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.004982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.005309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.005631 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.005950 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.006268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.006611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:31.043400 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 is: ACTIVE; New status is: DOWN {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:31.044022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:31.078025 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:31.081594 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:31.127406 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,revision_number=6']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:31.869519 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35748) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:31.993294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8343a55-6334-49f2-8c5b-649d0f361392 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:26:31.993639 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8343a55-6334-49f2-8c5b-649d0f361392 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Notify agent at dv-neutron-834874-3-hyperv the message router_added_to_agent {{(pid=104037) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Mar 24 02:26:32.011984 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d8343a55-6334-49f2-8c5b-649d0f361392 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "POST /v2.0/agents/700661ac-903b-4270-9a73-7a0120212663/l3-routers HTTP/1.1" status: 201 len: 201 time: 0.1414232 Mar 24 02:26:32.014532 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35754) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:32.025526 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] Sync routers for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:26:32.034961 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:32.035569 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:32.126949 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-de0c669e-f52e-4858-aeb8-c7f585e309f4 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers/a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.1100237 Mar 24 02:26:32.129512 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35756) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:32.141122 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:32.189032 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-18209b4a-d78a-44f9-9b5d-f6277ba2e29a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/b291bc46-6290-44dd-a953-f43b9a734cbd HTTP/1.1" status: 200 len: 991 time: 0.0579405 Mar 24 02:26:32.353878 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:30Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'b291bc46-6290-44dd-a953-f43b9a734cbd', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.41', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'port_id': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1463, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'mac_address': 'fa:16:3e:bc:6b:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:25:24Z', 'updated_at': '2022-03-24T02:26:30Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:26:31Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:32.382711 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] Checking router: a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:26:32.390631 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:32.391221 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:32.450569 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:32.494468 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:32.705405 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:30Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'b291bc46-6290-44dd-a953-f43b9a734cbd', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.41', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'port_id': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1463, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'mac_address': 'fa:16:3e:bc:6b:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:25:24Z', 'updated_at': '2022-03-24T02:26:30Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:26:31Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:32.733754 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c020792-a7c1-4875-9df0-4d2c79bda24e None None] The sync data for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv is: [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:30Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': 'b291bc46-6290-44dd-a953-f43b9a734cbd', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.41', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'port_id': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1463, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'mac_address': 'fa:16:3e:bc:6b:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:25:24Z', 'updated_at': '2022-03-24T02:26:30Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:26:31Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:26:33.192338 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35758) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:33.258563 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-a5c9cb4b-ba31-4e5e-b28e-636d92295306 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/b291bc46-6290-44dd-a953-f43b9a734cbd HTTP/1.1" status: 200 len: 991 time: 0.0639095 Mar 24 02:26:33.716796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:34.251899 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-150dc193-5a3a-4a9c-b09d-54cb9cdb9592 None None] New status for floating IP b291bc46-6290-44dd-a953-f43b9a734cbd: ACTIVE {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:26:34.260279 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35760) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:34.319848 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ccfc69a2-d92f-44d7-b268-f6ead615d60b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/b291bc46-6290-44dd-a953-f43b9a734cbd HTTP/1.1" status: 200 len: 991 time: 0.0583763 Mar 24 02:26:34.848991 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d64c13ba-68ca-4812-819d-ba2881c9b900 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:35.040065 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d64c13ba-68ca-4812-819d-ba2881c9b900 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:35.040328 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:35.113461 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d64c13ba-68ca-4812-819d-ba2881c9b900 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:35.113762 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:35.133626 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d64c13ba-68ca-4812-819d-ba2881c9b900, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d64c13ba-68ca-4812-819d-ba2881c9b900,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:35.138096 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:35.138986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:35.212908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d64c13ba-68ca-4812-819d-ba2881c9b900,revision_number=6']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:35.225383 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:35.225756 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:35.298665 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:35.299056 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:35.323610 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35762) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:35.329748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:35.335589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:35.385095 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,revision_number=7']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:35.686062 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bc7f5924-b9a0-4978-8f90-a97b5f649d04 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/b291bc46-6290-44dd-a953-f43b9a734cbd HTTP/1.1" status: 200 len: 993 time: 0.3611538 Mar 24 02:26:35.932627 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35768) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:36.084114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 409f90e6-3a5c-499b-9fb3-a0a551139a1e {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:26:36.084459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (409f90e6-3a5c-499b-9fb3-a0a551139a1e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:36.157160 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (409f90e6-3a5c-499b-9fb3-a0a551139a1e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:36.157502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (409f90e6-3a5c-499b-9fb3-a0a551139a1e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:36.170861 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 409f90e6-3a5c-499b-9fb3-a0a551139a1e owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:26:36.314472 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (409f90e6-3a5c-499b-9fb3-a0a551139a1e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:36.343005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=409f90e6-3a5c-499b-9fb3-a0a551139a1e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:36.368249 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.368599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.368946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.369296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.369633 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.369969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.370302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.370655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.370987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.371317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.371644 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.371973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.372297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.372616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.372937 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:36.413132 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (b291bc46-6290-44dd-a953-f43b9a734cbd), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:36.413464 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP b291bc46-6290-44dd-a953-f43b9a734cbd disassociated (deleted). External IP: 172.26.2.41, port: 68c4542c-ed8b-43e3-8477-bd216f53af31. Mar 24 02:26:36.623312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:26:36.728069 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:26:36.733529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:36.738250 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] Sync routers for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:26:36.748199 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:36.748813 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:36.766029 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-108f554a-2e84-4c4a-8857-0966b910002c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/floatingips/b291bc46-6290-44dd-a953-f43b9a734cbd HTTP/1.1" status: 204 len: 168 time: 0.8323269 Mar 24 02:26:36.766667 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:26:36.769585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf" -d '{"events": [{"name": "network-changed", "server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:26:36.807495 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:26:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc2b3461-6a4a-4e1c-b06b-63d2534e03fa x-openstack-request-id: req-fc2b3461-6a4a-4e1c-b06b-63d2534e03fa {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:26:36.807802 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:26:36.808086 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-fc2b3461-6a4a-4e1c-b06b-63d2534e03fa {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:26:36.808516 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-fc2b3461-6a4a-4e1c-b06b-63d2534e03fa'] response: {'name': 'network-changed', 'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'status': 'completed', 'code': 200} Mar 24 02:26:36.856344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d64c13ba-68ca-4812-819d-ba2881c9b900 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:36.877313 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:36.886186 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-8a4bed1d-7983-4aa8-ac9b-612ae98c794d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:36.887719 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-8a4bed1d-7983-4aa8-ac9b-612ae98c794d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 1130 time: 0.0508611 Mar 24 02:26:36.931154 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d64c13ba-68ca-4812-819d-ba2881c9b900 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:36.931779 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:37.034335 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d64c13ba-68ca-4812-819d-ba2881c9b900 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:37.035489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:37.041140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-94f41ff5-dbee-4597-a85c-6c905f2828fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:37.042677 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-94f41ff5-dbee-4597-a85c-6c905f2828fe service neutron] 10.222.0.30 "GET /v2.0/networks?id=aeaed783-a093-45d9-8d0b-20f353f1cddb HTTP/1.1" status: 200 len: 898 time: 0.1485946 Mar 24 02:26:37.086350 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:37.086776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:37.090883 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-8ee58333-d106-493c-aef3-ce59b298a66b service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=68c4542c-ed8b-43e3-8477-bd216f53af31 HTTP/1.1" status: 200 len: 217 time: 0.0411470 Mar 24 02:26:37.103256 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f59e6e0-8299-42af-8362-b7bc535d3851 req-33995864-4165-44f5-9a47-1e47de01c687 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:37.104707 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9f59e6e0-8299-42af-8362-b7bc535d3851 req-33995864-4165-44f5-9a47-1e47de01c687 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 946 time: 0.1101866 Mar 24 02:26:37.169946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-97a067b5-96f7-44c2-9e81-f4b2390d57b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:37.171384 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-97a067b5-96f7-44c2-9e81-f4b2390d57b0 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=6435867d-361b-4d42-8c41-5f594a08b4bf HTTP/1.1" status: 200 len: 835 time: 0.0657861 Mar 24 02:26:37.172915 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:37.187436 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:26:35Z', 'revision_number': 7, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:37.214237 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] Checking router: a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:26:37.222448 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9f59e6e0-8299-42af-8362-b7bc535d3851 req-b50c9610-d921-4741-926d-885bfe63625c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0889587 Mar 24 02:26:37.222698 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:37.223376 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:37.240255 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-3e9e6b6b-a6ea-44e0-821d-502c8a9d676d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:37.241747 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-3e9e6b6b-a6ea-44e0-821d-502c8a9d676d service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=aeaed783-a093-45d9-8d0b-20f353f1cddb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0622072 Mar 24 02:26:37.330708 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:37.333123 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-e550ef06-3ce0-4ab0-ba2a-b2b6d1c6a443 service neutron] 10.222.0.30 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839548 Mar 24 02:26:37.428518 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a4f4b1fd-7820-4c6f-bd1b-f2864ab8d1cf req-d185fb1c-a81b-44bc-a9e3-1b71f2f13dfa service neutron] 10.222.0.30 "GET /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879238 Mar 24 02:26:37.526618 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:26:35Z', 'revision_number': 7, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:37.552336 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0071ad13-e83a-4d1e-9b75-92d36d93841b None None] The sync data for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv is: [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:25:07Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2', 'name': '', 'network_id': 'aeaed783-a093-45d9-8d0b-20f353f1cddb', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:11:9e:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:07Z', 'updated_at': '2022-03-24T02:26:35Z', 'revision_number': 7, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '6435867d-361b-4d42-8c41-5f594a08b4bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:26:38.175027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29fd08f5-452f-4dc0-94d0-afcf8bc05804 None None] New status for floating IP b291bc46-6290-44dd-a953-f43b9a734cbd: DOWN {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:26:38.345117 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b429c8c-e9b9-4f2c-a7bf-0dc0f3f2b56b req-7ad98181-12a8-434b-bb1f-7c65dc2ab1ab tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:38.347348 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3b429c8c-e9b9-4f2c-a7bf-0dc0f3f2b56b req-7ad98181-12a8-434b-bb1f-7c65dc2ab1ab tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 946 time: 0.0533040 Mar 24 02:26:38.397087 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3b429c8c-e9b9-4f2c-a7bf-0dc0f3f2b56b req-3745846e-aaa7-446f-b257-6d812cbb5fd3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437300 Mar 24 02:26:38.548284 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-51f197e4-a8ce-49d4-b672-e48c70d95bb5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:38.549765 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-51f197e4-a8ce-49d4-b672-e48c70d95bb5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports?device_id=16d828d6-c6f6-425d-b6f2-a2615cce7ebe HTTP/1.1" status: 200 len: 946 time: 0.0559843 Mar 24 02:26:38.644867 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 68c4542c-ed8b-43e3-8477-bd216f53af31 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:26:38.645202 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:38.733652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 68c4542c-ed8b-43e3-8477-bd216f53af31, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=68c4542c-ed8b-43e3-8477-bd216f53af31,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:38.734009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:38.747011 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 68c4542c-ed8b-43e3-8477-bd216f53af31 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:26:38.869578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (68c4542c-ed8b-43e3-8477-bd216f53af31), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:38.899305 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=68c4542c-ed8b-43e3-8477-bd216f53af31,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:38.944841 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] No DVR routers for this DVR port 68c4542c-ed8b-43e3-8477-bd216f53af31 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:26:38.947325 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:38.950808 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7339e5b1-dd75-4497-bec9-7110581ff9fb req-7f84db0f-e80a-492a-aff9-d9e07e4a7883 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "DELETE /v2.0/ports/68c4542c-ed8b-43e3-8477-bd216f53af31 HTTP/1.1" status: 204 len: 173 time: 0.3960247 Mar 24 02:26:38.951254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'name': 'network-vif-deleted', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:26:38.953992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9916aa1-c9a1-4be9-815e-57af6b91a290" -d '{"events": [{"server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "name": "network-vif-deleted", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:26:38.990430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:26:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4206b00f-4a04-4a35-9d9e-75cdf5a96b5c x-openstack-request-id: req-4206b00f-4a04-4a35-9d9e-75cdf5a96b5c {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:26:38.990760 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16d828d6-c6f6-425d-b6f2-a2615cce7ebe", "name": "network-vif-deleted", "tag": "68c4542c-ed8b-43e3-8477-bd216f53af31", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:26:38.991012 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-4206b00f-4a04-4a35-9d9e-75cdf5a96b5c {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:26:38.991425 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-4206b00f-4a04-4a35-9d9e-75cdf5a96b5c'] response: {'server_uuid': '16d828d6-c6f6-425d-b6f2-a2615cce7ebe', 'name': 'network-vif-deleted', 'tag': '68c4542c-ed8b-43e3-8477-bd216f53af31', 'status': 'completed', 'code': 200} Mar 24 02:26:39.453956 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35782) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:39.510178 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce7438db-69b7-4700-95bf-73911f102dee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:39.534660 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce7438db-69b7-4700-95bf-73911f102dee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:39.595100 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce7438db-69b7-4700-95bf-73911f102dee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:39.598226 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ce7438db-69b7-4700-95bf-73911f102dee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:39.599436 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ce7438db-69b7-4700-95bf-73911f102dee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/security-groups/b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde HTTP/1.1" status: 204 len: 168 time: 0.1444674 Mar 24 02:26:39.608366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce7438db-69b7-4700-95bf-73911f102dee tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3dfc8c2-40a7-46fa-90b5-eadfd2d84dde,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:39.631223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35786) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:39.985935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:40.242148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:26:40.242412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:40.328377 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:40.328736 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:40.341291 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:26:40.528995 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:40.552240 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:40.739992 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:40.958378 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:26:41.062177 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:26:41.067177 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f9c149b0-72b2-4b60-b507-51a0bea3ac35 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4354661 Mar 24 02:26:41.070839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35788) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:41.073359 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] Sync routers for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:26:41.084300 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:41.085015 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:41.122782 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-ddae9cc5-1e70-48a4-b70c-209a97a72590 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting subnet 6435867d-361b-4d42-8c41-5f594a08b4bf {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:26:41.126078 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddae9cc5-1e70-48a4-b70c-209a97a72590 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (6435867d-361b-4d42-8c41-5f594a08b4bf), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.168121 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddae9cc5-1e70-48a4-b70c-209a97a72590 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (6435867d-361b-4d42-8c41-5f594a08b4bf), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.191527 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:41.252652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddae9cc5-1e70-48a4-b70c-209a97a72590 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (6435867d-361b-4d42-8c41-5f594a08b4bf), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.308851 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddae9cc5-1e70-48a4-b70c-209a97a72590 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (6435867d-361b-4d42-8c41-5f594a08b4bf), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.339181 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-ddae9cc5-1e70-48a4-b70c-209a97a72590 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.343321 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-ddae9cc5-1e70-48a4-b70c-209a97a72590 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/subnets/6435867d-361b-4d42-8c41-5f594a08b4bf HTTP/1.1" status: 204 len: 168 time: 0.2707410 Mar 24 02:26:41.344538 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddae9cc5-1e70-48a4-b70c-209a97a72590 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Subnet': ['ID=6435867d-361b-4d42-8c41-5f594a08b4bf,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:41.345503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35790) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:41.346836 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42e61c6d-5197-438a-bf82-e15ff8eadb8d None None] Network aeaed783-a093-45d9-8d0b-20f353f1cddb requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:26:41.369930 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:40Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:41.400454 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] Checking router: a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:26:41.410243 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] Routers {'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:41.410869 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:41.469304 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.530863 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] Set router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:41.533976 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68aaa741-9a4e-4d8a-9d0f-bfbae3c85331 None None] DHCP port deletion for aeaed783-a093-45d9-8d0b-20f353f1cddb request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:26:41.583155 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-68aaa741-9a4e-4d8a-9d0f-bfbae3c85331 None None] Deleting port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:26:41.583590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68aaa741-9a4e-4d8a-9d0f-bfbae3c85331 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.589120 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.647458 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port d64c13ba-68ca-4812-819d-ba2881c9b900 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:26:41.647701 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.654118 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-68aaa741-9a4e-4d8a-9d0f-bfbae3c85331 None None] For port 17053cda-0c53-4276-8dec-8ae81f4dd5c2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=17053cda-0c53-4276-8dec-8ae81f4dd5c2,segment=NetworkSegment(333ac000-e3cb-48f8-b8cc-fe888c62fd7d),segment_id=333ac000-e3cb-48f8-b8cc-fe888c62fd7d)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:41.654536 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68aaa741-9a4e-4d8a-9d0f-bfbae3c85331 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.670512 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-68aaa741-9a4e-4d8a-9d0f-bfbae3c85331 None None] Calling delete_port for 17053cda-0c53-4276-8dec-8ae81f4dd5c2 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:26:41.719472 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:40Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:41.734226 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port d64c13ba-68ca-4812-819d-ba2881c9b900, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d64c13ba-68ca-4812-819d-ba2881c9b900,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:41.734716 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.745941 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9743ec2-4ff0-4fc3-9e55-efed3430811f None None] The sync data for ids ['a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe'] in dv-neutron-834874-3-hyperv is: [{'id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'name': 'tempest-TestNetworkBasicOps-router-450946370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234'}], 'enable_snat': True}, 'gw_port_id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:40Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd64c13ba-68ca-4812-819d-ba2881c9b900', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:5e:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1446, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:25:04Z', 'updated_at': '2022-03-24T02:26:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:26:41.749470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for d64c13ba-68ca-4812-819d-ba2881c9b900 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:26:41.756443 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-68aaa741-9a4e-4d8a-9d0f-bfbae3c85331 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (17053cda-0c53-4276-8dec-8ae81f4dd5c2), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.790444 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68aaa741-9a4e-4d8a-9d0f-bfbae3c85331 None None] No DVR routers for this DVR port 17053cda-0c53-4276-8dec-8ae81f4dd5c2 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:26:41.794344 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68aaa741-9a4e-4d8a-9d0f-bfbae3c85331 None None] Pushing event deleted for resources: {'Port': ['ID=17053cda-0c53-4276-8dec-8ae81f4dd5c2,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:41.927475 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d64c13ba-68ca-4812-819d-ba2881c9b900), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:41.954015 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=d64c13ba-68ca-4812-819d-ba2881c9b900,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:41.978977 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.979315 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.979659 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.980002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.980337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.980673 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.981003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.981342 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.981652 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.981975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.982302 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.982647 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.982973 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.983290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:41.983606 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:42.022340 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.122022 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.124330 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.174838 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.175474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Fanout notify agent at l3_agent the message router_deleted on router a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:26:42.182280 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.188794 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-56d9d1c6-abb4-4bf0-a691-ed2327fdce9a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/routers/a368bdfc-1fe9-4c96-9e7b-365c25a6f1fe HTTP/1.1" status: 204 len: 168 time: 0.8352194 Mar 24 02:26:42.188953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35794) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:42.267710 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (aeaed783-a093-45d9-8d0b-20f353f1cddb), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.669153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (aeaed783-a093-45d9-8d0b-20f353f1cddb), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.688869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aeaed783-a093-45d9-8d0b-20f353f1cddb']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:42.699190 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '333ac000-e3cb-48f8-b8cc-fe888c62fd7d') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:42.699402 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '333ac000-e3cb-48f8-b8cc-fe888c62fd7d') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:42.709712 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (333ac000-e3cb-48f8-b8cc-fe888c62fd7d), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.723670 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (333ac000-e3cb-48f8-b8cc-fe888c62fd7d), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.729587 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Releasing vlan 116 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:26:42.730116 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (333ac000-e3cb-48f8-b8cc-fe888c62fd7d), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:26:42.733360 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:26:42.794045 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (aeaed783-a093-45d9-8d0b-20f353f1cddb), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.801140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.804095 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/networks/aeaed783-a093-45d9-8d0b-20f353f1cddb HTTP/1.1" status: 204 len: 168 time: 0.6167419 Mar 24 02:26:42.815434 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2ac9628-0d27-4d9f-9993-6f31ba14e168 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Network': ['ID=aeaed783-a093-45d9-8d0b-20f353f1cddb,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:42.825854 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35796) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:42.831490 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'network': {'name': 'tempest-network-smoke--1972451179', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'port_security_enabled': True}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:42.832449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 17053cda-0c53-4276-8dec-8ae81f4dd5c2 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:26:42.850621 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'network': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:26:42.854250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.854425 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 17053cda-0c53-4276-8dec-8ae81f4dd5c2 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:26:42.854648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 17053cda-0c53-4276-8dec-8ae81f4dd5c2 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:26:42.855283 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:26:42.873948 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:26:42.874312 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f8f5bdf4-55fe-45d7-9a6e-95f464b9fec2 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:26:42.874738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d64c13ba-68ca-4812-819d-ba2881c9b900 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:26:42.876972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 146} {{(pid=104037) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:26:42.886305 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (c77ef4f5-b5d0-4072-b43f-d58debdb9fad), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.886673 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.segments_db [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Added segment c77ef4f5-b5d0-4072-b43f-d58debdb9fad of type vlan for network 912ee513-c0d0-4901-9961-9b70f013b1da Mar 24 02:26:42.894367 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d64c13ba-68ca-4812-819d-ba2881c9b900 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:26:42.894763 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d64c13ba-68ca-4812-819d-ba2881c9b900 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:26:42.926616 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (912ee513-c0d0-4901-9961-9b70f013b1da), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.950607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (912ee513-c0d0-4901-9961-9b70f013b1da), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:42.956241 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:42.956807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:43.024374 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1946158 Mar 24 02:26:43.024494 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35798) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:43.028654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-781c57eb-61df-488e-97b0-d306381f2243 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Network': ['ID=912ee513-c0d0-4901-9961-9b70f013b1da,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:43.028831 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'admin_state_up': True, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:43.038933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 912ee513-c0d0-4901-9961-9b70f013b1da details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:26:43.049088 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (26d517b6-e447-4b18-8e07-91453160827e), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:43.050153 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (26d517b6-e447-4b18-8e07-91453160827e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:43.088152 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 68c4542c-ed8b-43e3-8477-bd216f53af31 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:26:43.102859 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (26d517b6-e447-4b18-8e07-91453160827e), precommit_add_association {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:43.112457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 68c4542c-ed8b-43e3-8477-bd216f53af31 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:26:43.112802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 68c4542c-ed8b-43e3-8477-bd216f53af31 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:26:43.248053 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (26d517b6-e447-4b18-8e07-91453160827e), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:43.437957 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (26d517b6-e447-4b18-8e07-91453160827e), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:43.460770 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:43.562007 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.85 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/d81b4f83-b16c-4840-b8da-b0e9926dade5) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:26:43.664010 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:43.696718 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:43.731604 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:26:43.735966 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:26:43.742003 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:26:43.763541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=d81b4f83-b16c-4840-b8da-b0e9926dade5,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:43.988969 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (26d517b6-e447-4b18-8e07-91453160827e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:44.183883 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (26d517b6-e447-4b18-8e07-91453160827e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:44.310704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 26d517b6-e447-4b18-8e07-91453160827e is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104036) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:26:44.419918 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:26:44.429064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Sync routers for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:26:44.438366 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:44.439063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:44.440119 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:44.441346 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-d761a1fb-35e1-45cf-8ce8-1e21a87dffbf tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.4161453 Mar 24 02:26:44.444821 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35800) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:44.473242 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e5f4afae-17ed-4050-83f9-69a98c53907a tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=6c0b7eea99a4423dac22912b1fa60ca2&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0272698 Mar 24 02:26:44.475873 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35802) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:44.545205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:44.558963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45bd8b8d-a1d9-4d56-935a-7502613b8aa5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:44.560492 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-45bd8b8d-a1d9-4d56-935a-7502613b8aa5 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0837133 Mar 24 02:26:44.563303 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35804) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:44.595740 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-e8b510de-4eea-4ef7-bf4c-3198135dac68 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0313663 Mar 24 02:26:44.598470 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35806) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:44.603838 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-161018051', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'ip_version': 4, 'cidr': '172.20.0.0/28', 'dns_nameservers': ['1.2.3.4']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:44.694026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'subnet': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:26:44.697507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9331107'] for subnet (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:44.721719 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:43Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:44.751659 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Checking router: 26d517b6-e447-4b18-8e07-91453160827e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:26:44.752513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Updating router 26d517b6-e447-4b18-8e07-91453160827e port d81b4f83-b16c-4840-b8da-b0e9926dade5 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:26:44.780261 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:44.876655 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3241183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9331125'] for subnet (52e16ae2-5c77-43f2-9369-5ff2f989d728), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:44.941530 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Subnet': ['ID=52e16ae2-5c77-43f2-9369-5ff2f989d728,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:44.948848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Checking segment: {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:26:44.949205 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network hostable DHCP agents. Network: 912ee513-c0d0-4901-9961-9b70f013b1da, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104037) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:26:44.966234 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 912ee513-c0d0-4901-9961-9b70f013b1da is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104037) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:26:44.974993 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 912ee513-c0d0-4901-9961-9b70f013b1da) {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:26:44.978972 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:44.979626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:44.985561 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc5f5076-0c15-4638-bbe4-cb09dc4e1de8 None None] Network 912ee513-c0d0-4901-9961-9b70f013b1da requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:26:44.997526 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-70750106-742f-4de4-a644-96c9b47ca2e7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 0.3978572 Mar 24 02:26:45.000355 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35808) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:45.088234 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.093899 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Publish callbacks [] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.102839 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.184767 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72879d3-2bb6-4f97-9ed3-247be52a27b7 None None] Pushing event updated for resources: {'Port': ['ID=d81b4f83-b16c-4840-b8da-b0e9926dade5,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:45.187020 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Attempting to bind port d81b4f83-b16c-4840-b8da-b0e9926dade5 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:26:45.187391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Attempting to bind port d81b4f83-b16c-4840-b8da-b0e9926dade5 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:26:45.187755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Attempting to bind port d81b4f83-b16c-4840-b8da-b0e9926dade5 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:26:45.192353 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-912ee513-c0d0-4901-9961-9b70f013b1da', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:26:45.193183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.198435 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 26, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:26:45.198838 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:26:45.199235 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.199980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:26:45.200110 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Bound port: d81b4f83-b16c-4840-b8da-b0e9926dade5, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:26:45.200448 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.317925 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] For port d81b4f83-b16c-4840-b8da-b0e9926dade5, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:26:45.339930 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] For port d81b4f83-b16c-4840-b8da-b0e9926dade5, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d81b4f83-b16c-4840-b8da-b0e9926dade5,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:26:45.364328 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.426036 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Allocated IP 172.20.0.2 (912ee513-c0d0-4901-9961-9b70f013b1da/52e16ae2-5c77-43f2-9369-5ff2f989d728/e640e5d7-bc4a-4ca5-9816-6c88daf36d58) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:26:45.437342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.445814 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72879d3-2bb6-4f97-9ed3-247be52a27b7 None None] Pushing event updated for resources: {'Port': ['ID=d81b4f83-b16c-4840-b8da-b0e9926dade5,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:45.449610 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:45.450218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:45.775738 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:45.903445 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Publish callbacks [] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.917248 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:45.957780 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.1 (912ee513-c0d0-4901-9961-9b70f013b1da/52e16ae2-5c77-43f2-9369-5ff2f989d728/a36f4d36-8c48-422d-b6fe-6d12d0edb9f7) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:26:45.969298 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Network 912ee513-c0d0-4901-9961-9b70f013b1da is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:26:45.980986 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:26:45.984720 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:26:45.986545 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Pushing event updated for resources: {'Port': ['ID=e640e5d7-bc4a-4ca5-9816-6c88daf36d58,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:46.064184 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Attempting to bind port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:26:46.065115 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Attempting to bind port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:26:46.065479 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Attempting to bind port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 on network 912ee513-c0d0-4901-9961-9b70f013b1da {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:26:46.072962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 26, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:26:46.073340 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Checking segment: {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:26:46.073744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.073988 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.074129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Bound using segment: {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:26:46.074682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Bound port: e640e5d7-bc4a-4ca5-9816-6c88daf36d58, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:26:46.075071 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.108297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.119948 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:43Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:46.146195 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 912ee513-c0d0-4901-9961-9b70f013b1da is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:26:46.150648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a58ab4b-b5ae-4a80-8306-4b4cf7a00188 None None] The sync data for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv is: [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:43Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:26:46.151404 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:26:46.157935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:26:46.180420 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-cf01928d-d413-486c-908d-61be4104b91d None None] For port e640e5d7-bc4a-4ca5-9816-6c88daf36d58, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:26:46.183951 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-cf01928d-d413-486c-908d-61be4104b91d None None] For port e640e5d7-bc4a-4ca5-9816-6c88daf36d58, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e640e5d7-bc4a-4ca5-9816-6c88daf36d58,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:26:46.187785 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=a36f4d36-8c48-422d-b6fe-6d12d0edb9f7,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:46.191822 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.217394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (26d517b6-e447-4b18-8e07-91453160827e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.250718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf01928d-d413-486c-908d-61be4104b91d None None] Pushing event updated for resources: {'Port': ['ID=e640e5d7-bc4a-4ca5-9816-6c88daf36d58,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:46.394869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.724811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.730913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.807536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (26d517b6-e447-4b18-8e07-91453160827e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:46.809477 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=a36f4d36-8c48-422d-b6fe-6d12d0edb9f7,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:46.909286 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d81b4f83-b16c-4840-b8da-b0e9926dade5 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:46.917938 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 912ee513-c0d0-4901-9961-9b70f013b1da is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:26:46.920374 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:26:46.973640 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d81b4f83-b16c-4840-b8da-b0e9926dade5 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:46.974115 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.057939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 26d517b6-e447-4b18-8e07-91453160827e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:26:47.062363 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d81b4f83-b16c-4840-b8da-b0e9926dade5 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:47.062926 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.093415 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port d81b4f83-b16c-4840-b8da-b0e9926dade5, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d81b4f83-b16c-4840-b8da-b0e9926dade5,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:47.100151 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.101552 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e640e5d7-bc4a-4ca5-9816-6c88daf36d58 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:47.187341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:26:47.195995 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0214fe09-34d5-470d-88f9-c4077e4ec240 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/26d517b6-e447-4b18-8e07-91453160827e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1915841 Mar 24 02:26:47.196181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=d81b4f83-b16c-4840-b8da-b0e9926dade5,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:47.196318 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35810) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:47.209833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:47.209833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.292734 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:47.293322 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.306207 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a799d55-b228-4f53-a144-2e76b3216cc7 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.306728 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a799d55-b228-4f53-a144-2e76b3216cc7 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.307193 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a799d55-b228-4f53-a144-2e76b3216cc7 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.307649 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a799d55-b228-4f53-a144-2e76b3216cc7 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.308129 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a799d55-b228-4f53-a144-2e76b3216cc7 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.308557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a799d55-b228-4f53-a144-2e76b3216cc7 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.310636 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3a799d55-b228-4f53-a144-2e76b3216cc7 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4284 time: 0.1138103 Mar 24 02:26:47.313392 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35812) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:47.327416 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port e640e5d7-bc4a-4ca5-9816-6c88daf36d58, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e640e5d7-bc4a-4ca5-9816-6c88daf36d58,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:47.335380 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7bdd674-4958-4e4f-aa4e-821b9fb1c50d None None] Network 912ee513-c0d0-4901-9961-9b70f013b1da requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:26:47.338878 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.371228 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ee28ad8-dc93-4923-af6f-0c7b2d02f44f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.371782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ee28ad8-dc93-4923-af6f-0c7b2d02f44f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.372258 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ee28ad8-dc93-4923-af6f-0c7b2d02f44f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.372685 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ee28ad8-dc93-4923-af6f-0c7b2d02f44f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.373130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ee28ad8-dc93-4923-af6f-0c7b2d02f44f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.373570 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ee28ad8-dc93-4923-af6f-0c7b2d02f44f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:47.375349 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7ee28ad8-dc93-4923-af6f-0c7b2d02f44f tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4012 time: 0.0610504 Mar 24 02:26:47.378272 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35814) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:47.446252 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-e8f904d4-836a-401c-86cc-f3caf3cb4da5 None None] Provisioning complete for port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:47.446675 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e8f904d4-836a-401c-86cc-f3caf3cb4da5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.474165 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=e640e5d7-bc4a-4ca5-9816-6c88daf36d58,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:47.570000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e8f904d4-836a-401c-86cc-f3caf3cb4da5 None None] Current status of the port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:47.590803 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35816) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:47.620186 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-9bb9c68d-349f-425e-a67f-370b617e5a9c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3046 time: 0.2406790 Mar 24 02:26:47.773023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Deleting port b248e525-9401-41d4-8aef-07a50d8acd3e {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:26:47.773455 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (b248e525-9401-41d4-8aef-07a50d8acd3e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.796822 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8ad7b76e-d145-457f-afc6-40af2818cbd7 None None] Provisioning complete for port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:47.797332 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ad7b76e-d145-457f-afc6-40af2818cbd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.881632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (b248e525-9401-41d4-8aef-07a50d8acd3e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.882504 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (b248e525-9401-41d4-8aef-07a50d8acd3e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.894546 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8ad7b76e-d145-457f-afc6-40af2818cbd7 None None] Current status of the port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:47.903314 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Calling delete_port for b248e525-9401-41d4-8aef-07a50d8acd3e owned by network:floatingip {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:26:47.913306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-8ad7b76e-d145-457f-afc6-40af2818cbd7 None None] Provisioning complete for port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:47.913926 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8ad7b76e-d145-457f-afc6-40af2818cbd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.928542 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35820) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:47.933618 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-bf7d6d63-8828-4aa9-a54c-b8dd49404163 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-634792691', 'description': 'tempest-secgroup-smoke-634792691 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:47.965204 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf7d6d63-8828-4aa9-a54c-b8dd49404163 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:47.968556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-8ad7b76e-d145-457f-afc6-40af2818cbd7 None None] Port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:26:48.051632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf7d6d63-8828-4aa9-a54c-b8dd49404163 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.055355 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Sync routers for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:26:48.058627 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf7d6d63-8828-4aa9-a54c-b8dd49404163 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.075755 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:48.077812 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:48.095617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ed4b2bd6-19f1-4e6d-9634-73e5c6ad2d91 None None] Provisioning complete for port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:48.095617 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ed4b2bd6-19f1-4e6d-9634-73e5c6ad2d91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.103285 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf7d6d63-8828-4aa9-a54c-b8dd49404163 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:48.108124 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-bf7d6d63-8828-4aa9-a54c-b8dd49404163 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.109466 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-bf7d6d63-8828-4aa9-a54c-b8dd49404163 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1799164 Mar 24 02:26:48.112770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35822) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:48.117843 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c13a0ba6-50d1-4496-9f7e-c17ff3e46338 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd5ef20a1-1b2d-470c-9b2b-83b44dcffc7e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:48.135055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (b248e525-9401-41d4-8aef-07a50d8acd3e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.154850 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c13a0ba6-50d1-4496-9f7e-c17ff3e46338 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (53ae450d-4c44-4ac5-a8bf-0a7d8b3c8e4a), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.170946 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event deleted for resources: {'Port': ['ID=b248e525-9401-41d4-8aef-07a50d8acd3e,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:48.223771 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ed4b2bd6-19f1-4e6d-9634-73e5c6ad2d91 None None] Port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:26:48.233929 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c13a0ba6-50d1-4496-9f7e-c17ff3e46338 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (53ae450d-4c44-4ac5-a8bf-0a7d8b3c8e4a), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.245379 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c13a0ba6-50d1-4496-9f7e-c17ff3e46338 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (53ae450d-4c44-4ac5-a8bf-0a7d8b3c8e4a), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.259130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (5349e727-025d-4bd6-a72d-1099b97e5644), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.259774 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Floating IP 5349e727-025d-4bd6-a72d-1099b97e5644 disassociated (deleted). External IP: 172.26.2.252, port: f7cc65a8-3ed6-4a46-9edf-cc2afead1568. Mar 24 02:26:48.260064 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13a0ba6-50d1-4496-9f7e-c17ff3e46338 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=53ae450d-4c44-4ac5-a8bf-0a7d8b3c8e4a,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:48.264834 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:48.287813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c13a0ba6-50d1-4496-9f7e-c17ff3e46338 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.289487 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c13a0ba6-50d1-4496-9f7e-c17ff3e46338 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1756749 Mar 24 02:26:48.292312 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35824) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:48.302582 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-289c13b8-e98e-4a61-8123-006eb77b0a1b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd5ef20a1-1b2d-470c-9b2b-83b44dcffc7e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:48.331265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-289c13b8-e98e-4a61-8123-006eb77b0a1b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (f2e3f40d-a056-49a9-8b2f-d6d2795438f6), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.398394 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-289c13b8-e98e-4a61-8123-006eb77b0a1b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (f2e3f40d-a056-49a9-8b2f-d6d2795438f6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.403946 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-289c13b8-e98e-4a61-8123-006eb77b0a1b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (f2e3f40d-a056-49a9-8b2f-d6d2795438f6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.424298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-289c13b8-e98e-4a61-8123-006eb77b0a1b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f2e3f40d-a056-49a9-8b2f-d6d2795438f6,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:48.443064 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-289c13b8-e98e-4a61-8123-006eb77b0a1b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.444749 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-289c13b8-e98e-4a61-8123-006eb77b0a1b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1512113 Mar 24 02:26:48.448411 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35826) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:48.449920 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-e70af0d9-030e-4bcd-b0af-5b01732d5366 None None] Provisioning complete for port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:48.450576 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e70af0d9-030e-4bcd-b0af-5b01732d5366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.454462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-841f2209-b02e-47ae-b45d-3e66460f0ec9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd5ef20a1-1b2d-470c-9b2b-83b44dcffc7e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:48.489248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-841f2209-b02e-47ae-b45d-3e66460f0ec9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (e6dbba63-4c7a-4e44-80eb-e3cbe122f670), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.495923 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-e70af0d9-030e-4bcd-b0af-5b01732d5366 None None] Port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:26:48.557908 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-841f2209-b02e-47ae-b45d-3e66460f0ec9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (e6dbba63-4c7a-4e44-80eb-e3cbe122f670), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.561183 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-841f2209-b02e-47ae-b45d-3e66460f0ec9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (e6dbba63-4c7a-4e44-80eb-e3cbe122f670), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.580501 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-841f2209-b02e-47ae-b45d-3e66460f0ec9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e6dbba63-4c7a-4e44-80eb-e3cbe122f670,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:48.590894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-841f2209-b02e-47ae-b45d-3e66460f0ec9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.595491 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-841f2209-b02e-47ae-b45d-3e66460f0ec9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1421678 Mar 24 02:26:48.596656 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35828) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:48.601832 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-c4b31afb-3dc0-4d40-b5e4-74febe9951a7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd5ef20a1-1b2d-470c-9b2b-83b44dcffc7e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:48.629251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c4b31afb-3dc0-4d40-b5e4-74febe9951a7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (ed61f7a8-bcd5-4acd-9719-eb6c5edfb8ca), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.636569 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a36f4d36-8c48-422d-b6fe-6d12d0edb9f7', 'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:77:14:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:45Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:48.663345 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Checking router: 26d517b6-e447-4b18-8e07-91453160827e for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:26:48.663608 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Updating router 26d517b6-e447-4b18-8e07-91453160827e port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:26:48.691332 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.692820 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c4b31afb-3dc0-4d40-b5e4-74febe9951a7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (ed61f7a8-bcd5-4acd-9719-eb6c5edfb8ca), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.697369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c4b31afb-3dc0-4d40-b5e4-74febe9951a7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (ed61f7a8-bcd5-4acd-9719-eb6c5edfb8ca), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.717982 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b31afb-3dc0-4d40-b5e4-74febe9951a7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ed61f7a8-bcd5-4acd-9719-eb6c5edfb8ca,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:48.724158 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c4b31afb-3dc0-4d40-b5e4-74febe9951a7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.727957 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c4b31afb-3dc0-4d40-b5e4-74febe9951a7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1275001 Mar 24 02:26:48.728138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35830) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:48.732927 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-cb9ca3eb-d748-456a-a3fa-172906a15be8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd5ef20a1-1b2d-470c-9b2b-83b44dcffc7e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:48.764433 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-cb9ca3eb-d748-456a-a3fa-172906a15be8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:26:48.775481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cb9ca3eb-d748-456a-a3fa-172906a15be8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (1d83d6a5-108b-431c-8e83-8f8915962cb7), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.788736 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Router d9d90a22-1adf-4945-a625-094e279f17a1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:26:48.861840 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cb9ca3eb-d748-456a-a3fa-172906a15be8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (1d83d6a5-108b-431c-8e83-8f8915962cb7), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.869030 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cb9ca3eb-d748-456a-a3fa-172906a15be8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (1d83d6a5-108b-431c-8e83-8f8915962cb7), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.879509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d81b4f83-b16c-4840-b8da-b0e9926dade5 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:48.892187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb9ca3eb-d748-456a-a3fa-172906a15be8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d83d6a5-108b-431c-8e83-8f8915962cb7,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:48.906314 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-cb9ca3eb-d748-456a-a3fa-172906a15be8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.907579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-cb9ca3eb-d748-456a-a3fa-172906a15be8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1784494 Mar 24 02:26:48.916960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35832) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:26:48.917832 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:26:48.921753 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-1ee7d5bf-d8d7-4006-a28e-c74d9683b794 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'd5ef20a1-1b2d-470c-9b2b-83b44dcffc7e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:48.923388 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.931045 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] Sync routers for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:26:48.952975 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:48.953940 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:48.956604 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port d81b4f83-b16c-4840-b8da-b0e9926dade5 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:48.957047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:48.958333 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-1ee7d5bf-d8d7-4006-a28e-c74d9683b794 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:26:48.961492 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-bd64b860-d5ec-4158-8ed5-49a509282395 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "DELETE /v2.0/floatingips/5349e727-025d-4bd6-a72d-1099b97e5644 HTTP/1.1" status: 204 len: 168 time: 1.3691471 Mar 24 02:26:48.962213 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568'}] {{(pid=104036) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:26:48.965368 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d6177697792ca3fff01bbfc58b3e16cb8a22905a2f74e66d9151ebb6b50c8f9c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-92aea5f5-e947-4ab6-8123-dc9f040ccc72" -d '{"events": [{"name": "network-changed", "server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568"}]}' {{(pid=104036) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:26:48.980047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ee7d5bf-d8d7-4006-a28e-c74d9683b794 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (b680a21f-4946-4e45-9a35-82e9185c50cc), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.004664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:26:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4c84f1f-60a0-4767-94f1-82159b627678 x-openstack-request-id: req-e4c84f1f-60a0-4767-94f1-82159b627678 {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:26:49.005181 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568", "status": "completed", "code": 200}]} {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:26:49.005607 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-e4c84f1f-60a0-4767-94f1-82159b627678 {{(pid=104036) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:26:49.006217 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.notifiers.nova [-] Nova event matching ['req-e4c84f1f-60a0-4767-94f1-82159b627678'] response: {'name': 'network-changed', 'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'status': 'completed', 'code': 200} Mar 24 02:26:49.032884 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Publish callbacks [] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.043882 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.098263 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ee7d5bf-d8d7-4006-a28e-c74d9683b794 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (b680a21f-4946-4e45-9a35-82e9185c50cc), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.115487 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ee7d5bf-d8d7-4006-a28e-c74d9683b794 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (b680a21f-4946-4e45-9a35-82e9185c50cc), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.128080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-4e10e20a-f23f-44bc-bf7a-2679df2df82d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:49.131233 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-4e10e20a-f23f-44bc-bf7a-2679df2df82d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 1130 time: 0.1011178 Mar 24 02:26:49.149407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port d81b4f83-b16c-4840-b8da-b0e9926dade5 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:49.150934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e640e5d7-bc4a-4ca5-9816-6c88daf36d58 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:49.174606 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee7d5bf-d8d7-4006-a28e-c74d9683b794 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b680a21f-4946-4e45-9a35-82e9185c50cc,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:49.197764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:49.207420 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Pushing event updated for resources: {'Port': ['ID=a36f4d36-8c48-422d-b6fe-6d12d0edb9f7,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:49.219995 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.220343 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.220722 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.221056 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.221385 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.221711 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.222034 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.222357 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.222708 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.223031 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.223463 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.223659 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.223976 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.224290 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.224781 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:26:49.256577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-1ee7d5bf-d8d7-4006-a28e-c74d9683b794 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.257980 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1ee7d5bf-d8d7-4006-a28e-c74d9683b794 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3400495 Mar 24 02:26:49.259443 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Attempting to bind port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:26:49.259812 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Attempting to bind port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:26:49.260171 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Attempting to bind port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 on network 912ee513-c0d0-4901-9961-9b70f013b1da {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:26:49.265532 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:49.266782 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.279892 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 26, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:26:49.280294 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Checking segment: {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:26:49.280649 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.281035 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Bound using segment: {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:26:49.281498 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Bound port: a36f4d36-8c48-422d-b6fe-6d12d0edb9f7, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:26:49.281873 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.319044 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-9083f3c6-cda9-41fe-9095-a970ba4d270f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:49.321962 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-9083f3c6-cda9-41fe-9095-a970ba4d270f service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.1819015 Mar 24 02:26:49.351271 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] For port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:26:49.354965 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] For port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a36f4d36-8c48-422d-b6fe-6d12d0edb9f7,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:26:49.365256 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.386579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-593ca37d-0f6b-4558-a5a7-ce60447f3d6f service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7cc65a8-3ed6-4a46-9edf-cc2afead1568 HTTP/1.1" status: 200 len: 217 time: 0.0577562 Mar 24 02:26:49.420033 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:49.470290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-c0f02791-8c6b-4882-9456-b77741e70fce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:49.476901 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-c0f02791-8c6b-4882-9456-b77741e70fce service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0656192 Mar 24 02:26:49.491257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ddb0b80-7942-4222-be99-3c5574d87e5c req-cf1a0139-78fc-4cd1-92a4-ada6e4f399ce tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:49.497976 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9ddb0b80-7942-4222-be99-3c5574d87e5c req-cf1a0139-78fc-4cd1-92a4-ada6e4f399ce tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 946 time: 0.1588368 Mar 24 02:26:49.512237 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:49.512971 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:49.579192 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-19773dbe-ddd0-4e2f-9653-6728eaf79048 None None] Provisioning complete for port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:49.579564 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-19773dbe-ddd0-4e2f-9653-6728eaf79048 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.592996 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb3ff645-ddd8-44ee-9ed2-b39650e10cce None None] Pushing event updated for resources: {'Port': ['ID=a36f4d36-8c48-422d-b6fe-6d12d0edb9f7,revision_number=4']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:49.657567 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '6d1e6138-f7e0-473d-bae4-c655f53ad785', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.143', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1413, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:22:45Z', 'updated_at': '2022-03-24T02:22:47Z', 'revision_number': 1, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:49.668736 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:49.873603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] Checking router: d9d90a22-1adf-4945-a625-094e279f17a1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:26:49.894023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:26:49.894686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:26:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:49.898942 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-19773dbe-ddd0-4e2f-9653-6728eaf79048 None None] Current status of the port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:49.899337 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-19773dbe-ddd0-4e2f-9653-6728eaf79048 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:49.907403 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a36f4d36-8c48-422d-b6fe-6d12d0edb9f7', 'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:77:14:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:45Z', 'updated_at': '2022-03-24T02:26:49Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:49.934049 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb5fed9-2fa1-4804-b2ab-7e7d35cd47b0 None None] The sync data for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv is: [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a36f4d36-8c48-422d-b6fe-6d12d0edb9f7', 'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:77:14:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:45Z', 'updated_at': '2022-03-24T02:26:49Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:26:49.951987 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9ddb0b80-7942-4222-be99-3c5574d87e5c req-cac384f9-dc4b-461e-a04b-61c5b20f9fba tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4511473 Mar 24 02:26:49.954554 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-d0d6ba5a-add6-4c95-9fef-3e6bceb14190 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:49.956579 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-d0d6ba5a-add6-4c95-9fef-3e6bceb14190 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.4744194 Mar 24 02:26:49.960228 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-1362cd7a-83b6-4f6e-8e18-fc5ce5eb8dfc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-634792691&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.4488997 Mar 24 02:26:50.020795 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-19773dbe-ddd0-4e2f-9653-6728eaf79048 None None] For port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a36f4d36-8c48-422d-b6fe-6d12d0edb9f7,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:50.028112 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-19773dbe-ddd0-4e2f-9653-6728eaf79048 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:50.093116 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:26:50.187235 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-7d5efc99-69f1-4fc6-998e-7b01eacd4251 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:50.188723 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-7d5efc99-69f1-4fc6-998e-7b01eacd4251 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/networks?id=912ee513-c0d0-4901-9961-9b70f013b1da HTTP/1.1" status: 200 len: 797 time: 0.2222173 Mar 24 02:26:50.191170 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-9a08f52c-9364-4d99-bd2b-99da7d8f981f service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2275264 Mar 24 02:26:50.201603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19773dbe-ddd0-4e2f-9653-6728eaf79048 None None] Pushing event updated for resources: {'Port': ['ID=a36f4d36-8c48-422d-b6fe-6d12d0edb9f7,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:50.220122 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-4f7c7500-45c6-4f3d-be04-2e169e041885 None None] Provisioning complete for port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:50.220543 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4f7c7500-45c6-4f3d-be04-2e169e041885 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:50.221888 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-e3f54e52-20ff-4609-81e7-ce4a838bc10e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/quotas/6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 375 time: 0.0257177 Mar 24 02:26:50.340580 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9b489a1e-060a-4373-9014-c94d14264f27 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1175582 Mar 24 02:26:50.344296 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-92aea5f5-e947-4ab6-8123-dc9f040ccc72 req-bb05995b-0cc8-4ca9-9049-e22b3983fd10 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1397460 Mar 24 02:26:50.416755 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-4f7c7500-45c6-4f3d-be04-2e169e041885 None None] Current status of the port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:50.452856 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '6d1e6138-f7e0-473d-bae4-c655f53ad785', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.143', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1413, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:22:45Z', 'updated_at': '2022-03-24T02:22:47Z', 'revision_number': 1, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:26:50.456291 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-5eb6ac8f-2fed-462b-90af-da0eda49887d service neutron] 10.222.0.20 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0994096 Mar 24 02:26:50.484018 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5480fc1d-aae8-467b-bbf1-ea8d1d788647 None None] The sync data for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv is: [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '6d1e6138-f7e0-473d-bae4-c655f53ad785', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'floating_ip_address': '172.26.2.143', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'port_id': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1413, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'mac_address': 'fa:16:3e:38:2d:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ed61e09-6181-4944-af6d-175afaaf2402', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:22:45Z', 'updated_at': '2022-03-24T02:22:47Z', 'revision_number': 1, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:26:50.567417 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-f8607727-1007-4f87-8974-e964a02c8c91 service neutron] 10.222.0.20 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1031952 Mar 24 02:26:50.742708 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fe02fcfa-c0ac-4fb6-a8c6-570338c4ae70 req-04b1f3f2-96fb-44d1-80d1-78a3a2798201 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 210 time: 0.0292687 Mar 24 02:26:50.833095 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff1a1e14-183b-45cd-a425-5bb9d2362065 None None] New status for floating IP 5349e727-025d-4bd6-a72d-1099b97e5644: DOWN {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:26:50.879460 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:50.941983 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:50.942449 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:51.057695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-379cb7fe-c568-400b-bfc3-d27658ab09da tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:51.059333 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-379cb7fe-c568-400b-bfc3-d27658ab09da tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 946 time: 0.0912917 Mar 24 02:26:51.079509 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:51.190328 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-982d8241-2cb8-44ac-b67a-455cef814fa2 req-6deec808-4d8f-4d23-abcb-124677629806 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:51.191913 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-982d8241-2cb8-44ac-b67a-455cef814fa2 req-6deec808-4d8f-4d23-abcb-124677629806 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 946 time: 0.1315782 Mar 24 02:26:51.233722 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Deleting port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:26:51.234054 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:51.307199 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-982d8241-2cb8-44ac-b67a-455cef814fa2 req-29d5c7fe-ac4e-4d40-a3fd-ac3fbfeddb8e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1070747 Mar 24 02:26:51.353041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] For port f7cc65a8-3ed6-4a46-9edf-cc2afead1568, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:51.353493 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:51.366941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Calling delete_port for f7cc65a8-3ed6-4a46-9edf-cc2afead1568 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:26:51.492827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (f7cc65a8-3ed6-4a46-9edf-cc2afead1568), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:51.524330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event deleted for resources: {'Port': ['ID=f7cc65a8-3ed6-4a46-9edf-cc2afead1568,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:51.568740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] No DVR routers for this DVR port f7cc65a8-3ed6-4a46-9edf-cc2afead1568 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:26:51.571491 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:51.574900 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-045933cf-fe83-4b95-8fc9-ac208a2e0415 req-ceefcf2b-93d4-4004-bb9a-8d6d62685fe6 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "DELETE /v2.0/ports/f7cc65a8-3ed6-4a46-9edf-cc2afead1568 HTTP/1.1" status: 204 len: 173 time: 0.5045791 Mar 24 02:26:51.575342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'name': 'network-vif-deleted', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:26:51.577567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-867fde52-5d87-4581-be01-5461847ba412" -d '{"events": [{"server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "name": "network-vif-deleted", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:26:51.614094 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:26:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5814995-ebad-4eb0-980a-6da3abd5ae29 x-openstack-request-id: req-d5814995-ebad-4eb0-980a-6da3abd5ae29 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:26:51.614392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9aad6ef0-f69e-4a19-ada7-5fbe86972590", "name": "network-vif-deleted", "tag": "f7cc65a8-3ed6-4a46-9edf-cc2afead1568", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:26:51.614686 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-d5814995-ebad-4eb0-980a-6da3abd5ae29 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:26:51.615102 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d5814995-ebad-4eb0-980a-6da3abd5ae29'] response: {'server_uuid': '9aad6ef0-f69e-4a19-ada7-5fbe86972590', 'name': 'network-vif-deleted', 'tag': 'f7cc65a8-3ed6-4a46-9edf-cc2afead1568', 'status': 'completed', 'code': 200} Mar 24 02:26:51.780922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-dd31a65c-c124-4873-9698-40b64398a44b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:51.782693 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-dd31a65c-c124-4873-9698-40b64398a44b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=912ee513-c0d0-4901-9961-9b70f013b1da HTTP/1.1" status: 200 len: 797 time: 0.1091237 Mar 24 02:26:51.880249 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e57a20fc-0472-4c70-a30a-f1dbcd3018d4 req-883cf77d-9093-4ff2-b901-544014c9ab4a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 210 time: 0.0356414 Mar 24 02:26:51.904220 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-f7f12220-370b-4f09-a36f-e13b04f2cf33 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 379 time: 0.1127355 Mar 24 02:26:51.913648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'device_id': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'admin_state_up': True, 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'security_groups': ['d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:51.990985 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:26:52.036080 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:26:52.039782 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:52.166690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.13 (912ee513-c0d0-4901-9961-9b70f013b1da/52e16ae2-5c77-43f2-9369-5ff2f989d728/28e11ecf-858c-4b8b-ba0f-f0c136a4f370) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:26:52.309485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:52.344492 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:52.388270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 912ee513-c0d0-4901-9961-9b70f013b1da is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:26:52.405985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:26:52.422784 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:26:52.427719 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f9483a9d-a2d6-4da3-9d17-df9535c20790 req-43554ab0-198f-435c-85f5-45f47d1f3a36 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0413890 Mar 24 02:26:52.427940 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:52.476416 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:52.477146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:52.494486 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-99831db2-0840-4bc8-924e-c9d9b47b3711 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5849090 Mar 24 02:26:52.506022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Request body: {'port': {'device_id': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:26:52.576833 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:52.656282 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-da349d13-682b-4ca5-a9ce-94eb2335fe9c None None] Provisioning complete for port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:52.656882 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-da349d13-682b-4ca5-a9ce-94eb2335fe9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:52.694732 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-da349d13-682b-4ca5-a9ce-94eb2335fe9c None None] Port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:26:52.845646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:26:52.853184 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Publish callbacks [] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:52.866493 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Transition to ACTIVE for port object 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:26:52.870582 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:52.929613 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Pushing event updated for resources: {'Port': ['ID=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:53.039092 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Attempting to bind port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:26:53.039425 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Attempting to bind port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:26:53.039752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Attempting to bind port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 on network 912ee513-c0d0-4901-9961-9b70f013b1da {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:26:53.047941 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 on network 912ee513-c0d0-4901-9961-9b70f013b1da not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:26:53.048269 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Attempting to bind port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 on network 912ee513-c0d0-4901-9961-9b70f013b1da {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:26:53.057342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a942086-fe98-4af8-94d5-ef03f7e5d7ba req-e0ac561d-700d-404c-992c-b2c896936a76 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:53.058884 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1a942086-fe98-4af8-94d5-ef03f7e5d7ba req-e0ac561d-700d-404c-992c-b2c896936a76 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 944 time: 0.0802042 Mar 24 02:26:53.063657 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 26, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:26:53.063990 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Checking segment: {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:26:53.064945 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Bound using segment: {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:26:53.065518 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Bound port: 28e11ecf-858c-4b8b-ba0f-f0c136a4f370, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:26:53.065884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:53.171299 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1a942086-fe98-4af8-94d5-ef03f7e5d7ba req-83f5b317-a38e-45e5-a59c-9a64cbd65d9b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0960662 Mar 24 02:26:53.179308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] For port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:26:53.182419 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] For port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:26:53.193297 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:53.223955 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:53.224310 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:53.225943 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] 10.222.0.30 "PUT /v2.0/ports/28e11ecf-858c-4b8b-ba0f-f0c136a4f370 HTTP/1.1" status: 200 len: 1094 time: 0.7245889 Mar 24 02:26:53.259617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e154b29-c981-4ff4-bc09-13118b305f7b service neutron] Pushing event updated for resources: {'Port': ['ID=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:53.322496 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-3473344f-38ec-4ad6-ad6f-b3e539a61144 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:53.324562 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-3473344f-38ec-4ad6-ad6f-b3e539a61144 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 1128 time: 0.0525517 Mar 24 02:26:53.370020 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-6e6d7e23-9ccd-4d86-8712-6a8d09ac1a8c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370 HTTP/1.1" status: 200 len: 217 time: 0.0376496 Mar 24 02:26:53.427648 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-cbc4fbb8-1740-4636-9465-6ae19560e2ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:53.429148 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-cbc4fbb8-1740-4636-9465-6ae19560e2ed service neutron] 10.222.0.30 "GET /v2.0/subnets?id=52e16ae2-5c77-43f2-9369-5ff2f989d728 HTTP/1.1" status: 200 len: 843 time: 0.0535359 Mar 24 02:26:53.484654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-f3560152-44ed-4277-b0d4-47ec3b9be18d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:53.486832 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-f3560152-44ed-4277-b0d4-47ec3b9be18d service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=912ee513-c0d0-4901-9961-9b70f013b1da&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0507989 Mar 24 02:26:53.567191 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9b573248-be00-4958-9bed-f3481bc8cb0b req-ed3d7fdb-1011-4479-be14-30883da76ee2 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0571203 Mar 24 02:26:53.604586 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-22342c1c-8296-4536-9854-df801246247f service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1124177 Mar 24 02:26:53.617280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:26:53.619639 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f339b2c-1a87-4ac8-b53e-166d6da851bf" -d '{"events": [{"name": "network-changed", "server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:26:53.657459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:26:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e421478-ca10-4a3d-b5bd-7889547bf3ab x-openstack-request-id: req-7e421478-ca10-4a3d-b5bd-7889547bf3ab {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:26:53.657746 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:26:53.658481 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-7e421478-ca10-4a3d-b5bd-7889547bf3ab {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:26:53.658893 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-7e421478-ca10-4a3d-b5bd-7889547bf3ab'] response: {'name': 'network-changed', 'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'status': 'completed', 'code': 200} Mar 24 02:26:53.700448 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e41c361c-1a21-4042-87a0-35211fad9dbd req-72f15aa6-d43a-47b8-a5ab-7c81ef1d01d9 service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0903788 Mar 24 02:26:53.794493 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-2d1ff1cf-a45d-43db-b672-038144e41f6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:53.796008 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-2d1ff1cf-a45d-43db-b672-038144e41f6e service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 1128 time: 0.0496588 Mar 24 02:26:53.882887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-6b81d348-841f-494c-9dcd-4694334d7484 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:53.884267 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-6b81d348-841f-494c-9dcd-4694334d7484 service neutron] 10.222.0.30 "GET /v2.0/networks?id=912ee513-c0d0-4901-9961-9b70f013b1da HTTP/1.1" status: 200 len: 898 time: 0.0828626 Mar 24 02:26:53.925931 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-fd4bc4cd-fab4-4b4b-a652-67bc32bf03cd service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370 HTTP/1.1" status: 200 len: 217 time: 0.0359344 Mar 24 02:26:53.977809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-42dd7388-6a9d-469a-84b9-264ab056431e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:53.979376 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-42dd7388-6a9d-469a-84b9-264ab056431e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=52e16ae2-5c77-43f2-9369-5ff2f989d728 HTTP/1.1" status: 200 len: 843 time: 0.0480847 Mar 24 02:26:54.027400 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-b910b44a-b556-4d24-9734-a3f4bf4d89a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:54.028914 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-b910b44a-b556-4d24-9734-a3f4bf4d89a3 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=912ee513-c0d0-4901-9961-9b70f013b1da&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0441458 Mar 24 02:26:54.116155 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-521acd89-a66f-483f-a99c-48a476cdae40 service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812120 Mar 24 02:26:54.210490 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4f339b2c-1a87-4ac8-b53e-166d6da851bf req-6aea6a20-e433-4944-af1d-e18b4e7f8bb9 service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883994 Mar 24 02:26:54.292894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ebda36a-3748-4b27-be53-1f0a05039c7c req-8501bde3-8bdf-479e-a44a-64bd4b7b5b86 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:54.294369 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ebda36a-3748-4b27-be53-1f0a05039c7c req-8501bde3-8bdf-479e-a44a-64bd4b7b5b86 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 944 time: 0.0547221 Mar 24 02:26:54.342414 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-6ebda36a-3748-4b27-be53-1f0a05039c7c req-235628aa-66ca-42e4-a1d2-0ca26dfea823 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424490 Mar 24 02:26:54.665780 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0142294c-aa97-4a9f-87d4-6e74fef9cc7d req-bc633b18-d433-4a01-b247-328831a0e497 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0303750 Mar 24 02:26:55.121199 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device f7cc65a8-3ed6-4a46-9edf-cc2afead1568 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:26:55.142877 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: f7cc65a8-3ed6-4a46-9edf-cc2afead1568 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:26:55.143220 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device f7cc65a8-3ed6-4a46-9edf-cc2afead1568 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:26:55.458770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207baa3f-3a39-4938-9cb2-ffeab2776560 req-17f6464b-ee17-49b9-b32c-ecd623a68145 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:55.460142 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-207baa3f-3a39-4938-9cb2-ffeab2776560 req-17f6464b-ee17-49b9-b32c-ecd623a68145 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 944 time: 0.0522466 Mar 24 02:26:55.507701 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-207baa3f-3a39-4938-9cb2-ffeab2776560 req-aeadba9d-1751-444c-9a3d-3b852660295e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420809 Mar 24 02:26:55.758834 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2b0538c6-92b4-429c-8893-79b6caa18cad req-912d97ac-32b1-419c-a2cc-de22cb5e889e tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0266712 Mar 24 02:26:56.625471 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c07be4-88c9-4954-b023-db0a02f347c5 req-6e492b75-31de-4bc4-8d4c-05d0bc632e66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:56.626985 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-69c07be4-88c9-4954-b023-db0a02f347c5 req-6e492b75-31de-4bc4-8d4c-05d0bc632e66 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 944 time: 0.0524640 Mar 24 02:26:56.678956 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-69c07be4-88c9-4954-b023-db0a02f347c5 req-3f860dce-33c9-4f9d-a79b-c1d8f422d6b6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464303 Mar 24 02:26:56.856140 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-083b09cb-9136-4d38-844c-5d7fc77ceaf8 req-c9e25630-f404-47e7-a384-9d6b095a1e30 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0283337 Mar 24 02:26:57.120289 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:26:57.214264 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:57.228715 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'port_id': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'mac_address': 'fa:16:3e:ae:6a:9d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:26:57.264753 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:57.265162 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:57.278143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:26:57.296497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:57.300265 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:57.346048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:57.403749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8f398835-9c4b-48d4-9213-90e1d969b088 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:57.621983 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['28e11ecf-858c-4b8b-ba0f-f0c136a4f370'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:26:57.799626 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c2c41a-2f68-4a53-baae-22294aa6b976 req-58fd5e2e-2297-4242-b7b7-fbf26824abb7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:57.801836 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4c2c41a-2f68-4a53-baae-22294aa6b976 req-58fd5e2e-2297-4242-b7b7-fbf26824abb7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 945 time: 0.0549057 Mar 24 02:26:57.852741 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e4c2c41a-2f68-4a53-baae-22294aa6b976 req-bd6e8f7d-6ebc-4760-9ff3-3046b686b716 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446818 Mar 24 02:26:57.950392 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-59785552-7d6b-41b7-bba2-aba88ff1ef93 req-f5300a92-243f-4313-93ca-83b1b7a6b996 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0278685 Mar 24 02:26:58.976106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78f989f1-8295-435a-96c6-98c82ef96aa0 req-bdec11b2-7fc0-4d32-9e8f-7d8ceab56d4d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:58.977895 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-78f989f1-8295-435a-96c6-98c82ef96aa0 req-bdec11b2-7fc0-4d32-9e8f-7d8ceab56d4d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 945 time: 0.0562100 Mar 24 02:26:59.035017 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-78f989f1-8295-435a-96c6-98c82ef96aa0 req-113fe7cf-4b33-4446-9b4d-18ea1d786626 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518322 Mar 24 02:26:59.051154 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d07da7db-e1a1-4819-aefb-62b2f6156ab7 req-a6af2583-36d8-41d9-95eb-bec57f0c3ad4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0328770 Mar 24 02:26:59.136127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:26:59.187562 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:26:59.192652 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:26:59.193047 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:59.267836 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:26:59.268248 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:59.290369 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:26:59.292680 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf122ada-a01a-4ca3-b9cc-bdb4588654b3" -d '{"events": [{"server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "name": "network-vif-plugged", "status": "completed", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:26:59.305404 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:26:59.310091 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:26:59.333114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:26:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b2935065-5c61-446c-9324-81bca2c0975b x-openstack-request-id: req-b2935065-5c61-446c-9324-81bca2c0975b {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:26:59.333392 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "name": "network-vif-plugged", "status": "completed", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:26:59.333651 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-b2935065-5c61-446c-9324-81bca2c0975b {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:26:59.334048 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b2935065-5c61-446c-9324-81bca2c0975b'] response: {'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'code': 200} Mar 24 02:26:59.359213 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:26:59.500591 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a9e75d-3387-4783-af5e-18f9934e7d3b req-f53b62ed-18c7-4f83-abac-8e5d2a332ac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:26:59.502107 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46a9e75d-3387-4783-af5e-18f9934e7d3b req-f53b62ed-18c7-4f83-abac-8e5d2a332ac7 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 1130 time: 0.0447307 Mar 24 02:26:59.546318 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-46a9e75d-3387-4783-af5e-18f9934e7d3b req-9b0e5779-447b-476a-a0c4-fbde64bf6b36 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387619 Mar 24 02:27:00.171149 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-610bd719-f557-4d0c-aa7d-5bbc762f1a47 req-e242c0b0-0f6a-4dfd-bca9-28232dd33a80 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=9aad6ef0-f69e-4a19-ada7-5fbe86972590 HTTP/1.1" status: 200 len: 210 time: 0.0323923 Mar 24 02:27:00.191052 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87bdef6d-5e72-488b-8224-6c2862d0b14a req-27d2271c-568a-4e89-b058-bd912db44737 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:00.192523 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-87bdef6d-5e72-488b-8224-6c2862d0b14a req-27d2271c-568a-4e89-b058-bd912db44737 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 946 time: 0.0854118 Mar 24 02:27:00.244777 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-87bdef6d-5e72-488b-8224-6c2862d0b14a req-4a7ff144-281a-4882-845e-f157b61202d5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460346 Mar 24 02:27:00.521687 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-438dd373-5daa-4341-badf-7ccd59706b29 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:00.891843 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:01.368535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cf58e54-2047-4ba4-91a3-b827acc58db3 req-bc568685-0b93-4a9d-b9c7-ec06bf37c20f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:01.370047 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9cf58e54-2047-4ba4-91a3-b827acc58db3 req-bc568685-0b93-4a9d-b9c7-ec06bf37c20f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 946 time: 0.0548840 Mar 24 02:27:01.422965 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9cf58e54-2047-4ba4-91a3-b827acc58db3 req-9775220f-5159-4d71-a71d-f0bf88dfbdc8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470381 Mar 24 02:27:01.551157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eac2c33-63f6-4c67-81ac-2af71afdbe88 req-14758809-fcd8-411a-ab6a-c2d150b09ac1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:01.552621 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7eac2c33-63f6-4c67-81ac-2af71afdbe88 req-14758809-fcd8-411a-ab6a-c2d150b09ac1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 946 time: 0.0544047 Mar 24 02:27:01.601293 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7eac2c33-63f6-4c67-81ac-2af71afdbe88 req-87c4bf4b-20ea-4b7c-9ec8-a829145f369e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429785 Mar 24 02:27:01.622690 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35926) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:01.664766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1db2bf34-8f64-40a3-97c5-0ce97e69c160 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:01.666250 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-1db2bf34-8f64-40a3-97c5-0ce97e69c160 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 1125 time: 0.0425611 Mar 24 02:27:01.668981 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35928) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:01.673103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address': '172.20.0.13'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:27:01.692814 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:01.787619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:01.887942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.162 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/7af2511b-e867-442c-9416-c9d90c4a96f8) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:27:01.991302 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (7af2511b-e867-442c-9416-c9d90c4a96f8), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:02.025544 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (7af2511b-e867-442c-9416-c9d90c4a96f8), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:02.064848 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:27:02.072360 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:27:02.074916 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:27:02.078167 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=7af2511b-e867-442c-9416-c9d90c4a96f8,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:02.427140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (3d0b7122-50dc-48e7-a030-4aa34f24b5aa), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:02.454708 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:02.495811 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (7af2511b-e867-442c-9416-c9d90c4a96f8), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:02.641489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (7af2511b-e867-442c-9416-c9d90c4a96f8), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:02.645839 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (7af2511b-e867-442c-9416-c9d90c4a96f8), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:02.710777 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=7af2511b-e867-442c-9416-c9d90c4a96f8,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:02.720962 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (3d0b7122-50dc-48e7-a030-4aa34f24b5aa), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:03.148880 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP 3d0b7122-50dc-48e7-a030-4aa34f24b5aa associated. External IP: 172.26.2.162, port: 28e11ecf-858c-4b8b-ba0f-f0c136a4f370. Mar 24 02:27:03.357899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 26d517b6-e447-4b18-8e07-91453160827e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:27:03.466971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:27:03.476326 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] Sync routers for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:27:03.485452 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:03.487429 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:27:03.488385 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:27:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:03.515257 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-fd4990a1-28e8-47e4-a20f-3f2285660b2b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.8452184 Mar 24 02:27:03.515918 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:27:03.519032 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35934) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:03.519577 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f13d8ed5-a450-4700-aa6d-5677532aba09" -d '{"events": [{"name": "network-changed", "server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:27:03.556696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:27:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2567444-33a5-45d2-80f9-213dc90a0c84 x-openstack-request-id: req-d2567444-33a5-45d2-80f9-213dc90a0c84 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:27:03.557257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:27:03.557783 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-d2567444-33a5-45d2-80f9-213dc90a0c84 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:27:03.558454 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-d2567444-33a5-45d2-80f9-213dc90a0c84'] response: {'name': 'network-changed', 'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'status': 'completed', 'code': 200} Mar 24 02:27:03.592380 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-af6a22e8-c198-461e-9888-a38d0add98a0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/3d0b7122-50dc-48e7-a030-4aa34f24b5aa HTTP/1.1" status: 200 len: 992 time: 0.0709307 Mar 24 02:27:03.627884 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-6e016672-e461-468b-b504-7f9c347c6bee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:03.630231 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-6e016672-e461-468b-b504-7f9c347c6bee service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 1130 time: 0.0471852 Mar 24 02:27:03.633706 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:27:03.729015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-3e2cecee-7689-4f30-8e1a-8237b51a674a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:03.730802 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-3e2cecee-7689-4f30-8e1a-8237b51a674a service neutron] 10.222.0.30 "GET /v2.0/networks?id=912ee513-c0d0-4901-9961-9b70f013b1da HTTP/1.1" status: 200 len: 898 time: 0.0936685 Mar 24 02:27:03.742306 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:03.800506 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-8ffdddc5-f20c-46a1-b3ed-22bb48dcf880 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370 HTTP/1.1" status: 200 len: 1000 time: 0.0629799 Mar 24 02:27:03.853162 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-07d15183-d9b1-4894-9483-5ac211281e81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:03.854288 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-07d15183-d9b1-4894-9483-5ac211281e81 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=52e16ae2-5c77-43f2-9369-5ff2f989d728 HTTP/1.1" status: 200 len: 843 time: 0.0487568 Mar 24 02:27:03.872770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '3d0b7122-50dc-48e7-a030-4aa34f24b5aa', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.162', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '26d517b6-e447-4b18-8e07-91453160827e', 'port_id': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1482, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'mac_address': 'fa:16:3e:ae:6a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:27:02Z', 'updated_at': '2022-03-24T02:27:02Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a36f4d36-8c48-422d-b6fe-6d12d0edb9f7', 'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:77:14:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:45Z', 'updated_at': '2022-03-24T02:26:49Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:03.904114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] Checking router: 26d517b6-e447-4b18-8e07-91453160827e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:27:03.904567 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-8cd35d8f-efb2-429d-bd7d-5c5ea62830d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:03.906360 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-8cd35d8f-efb2-429d-bd7d-5c5ea62830d3 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=912ee513-c0d0-4901-9961-9b70f013b1da&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0463190 Mar 24 02:27:03.913874 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:27:03.914489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:27:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:03.997506 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-36bd0ede-84e7-4120-be45-4927952e77da service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849531 Mar 24 02:27:04.022419 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:27:04.102018 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f13d8ed5-a450-4700-aa6d-5677532aba09 req-8c5c90ed-f269-4000-a18b-dcf5af56888b service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0989306 Mar 24 02:27:04.394995 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '3d0b7122-50dc-48e7-a030-4aa34f24b5aa', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.162', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '26d517b6-e447-4b18-8e07-91453160827e', 'port_id': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1482, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'mac_address': 'fa:16:3e:ae:6a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:27:02Z', 'updated_at': '2022-03-24T02:27:02Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a36f4d36-8c48-422d-b6fe-6d12d0edb9f7', 'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:77:14:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:45Z', 'updated_at': '2022-03-24T02:26:49Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:04.424079 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec5212d-e88d-4579-becd-5476f7106116 None None] The sync data for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv is: [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '3d0b7122-50dc-48e7-a030-4aa34f24b5aa', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.162', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '26d517b6-e447-4b18-8e07-91453160827e', 'port_id': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1482, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'mac_address': 'fa:16:3e:ae:6a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:27:02Z', 'updated_at': '2022-03-24T02:27:02Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a36f4d36-8c48-422d-b6fe-6d12d0edb9f7', 'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:77:14:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:45Z', 'updated_at': '2022-03-24T02:26:49Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:27:04.593939 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35940) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:04.621132 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be3318b0-44f8-4bbd-9e2b-a0b8ae511414 None None] New status for floating IP 3d0b7122-50dc-48e7-a030-4aa34f24b5aa: ACTIVE {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:27:04.665041 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-3892be4c-3737-4c82-b3b5-053346339187 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/3d0b7122-50dc-48e7-a030-4aa34f24b5aa HTTP/1.1" status: 200 len: 992 time: 0.0698032 Mar 24 02:27:05.668296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 35944) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:05.733170 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-7ea89dfe-832c-45d0-9309-0620db894d3e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/floatingips/3d0b7122-50dc-48e7-a030-4aa34f24b5aa HTTP/1.1" status: 200 len: 994 time: 0.0593476 Mar 24 02:27:09.734220 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35958) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:09.894033 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Deleting port a82cfa68-c1b8-4343-9aa3-696b112fab32 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:27:09.894371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a82cfa68-c1b8-4343-9aa3-696b112fab32), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:09.973034 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a82cfa68-c1b8-4343-9aa3-696b112fab32), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:09.973288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (a82cfa68-c1b8-4343-9aa3-696b112fab32), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:09.984891 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Calling delete_port for a82cfa68-c1b8-4343-9aa3-696b112fab32 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:27:10.129711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a82cfa68-c1b8-4343-9aa3-696b112fab32), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:10.157090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event deleted for resources: {'Port': ['ID=a82cfa68-c1b8-4343-9aa3-696b112fab32,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:10.219768 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (6d1e6138-f7e0-473d-bae4-c655f53ad785), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:10.220606 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Floating IP 6d1e6138-f7e0-473d-bae4-c655f53ad785 disassociated (deleted). External IP: 172.26.2.143, port: 42b4c550-82ba-45d7-bc38-e7dbcfff4311. Mar 24 02:27:10.442042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Router d9d90a22-1adf-4945-a625-094e279f17a1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:27:10.556326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:27:10.561192 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:10.567027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] Sync routers for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:27:10.576902 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:27:10.577635 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:27:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:10.596458 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-7f0fde2f-5a09-4ff3-9bd9-ab4a925585f4 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "DELETE /v2.0/floatingips/6d1e6138-f7e0-473d-bae4-c655f53ad785 HTTP/1.1" status: 204 len: 168 time: 0.8605707 Mar 24 02:27:10.597070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:27:10.599371 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fef8c74e-663d-46da-b709-89717f4049c1" -d '{"events": [{"name": "network-changed", "server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:27:10.653714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:27:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59972514-42b8-413a-b30b-16da284ae4f6 x-openstack-request-id: req-59972514-42b8-413a-b30b-16da284ae4f6 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:27:10.655015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:27:10.655465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-59972514-42b8-413a-b30b-16da284ae4f6 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:27:10.656092 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-59972514-42b8-413a-b30b-16da284ae4f6'] response: {'name': 'network-changed', 'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'status': 'completed', 'code': 200} Mar 24 02:27:10.702391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:27:10.740897 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef8c74e-663d-46da-b709-89717f4049c1 req-21f15a47-8960-448d-9787-87dde172c274 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:10.742354 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fef8c74e-663d-46da-b709-89717f4049c1 req-21f15a47-8960-448d-9787-87dde172c274 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=534ec00707834d9cbfb4f670cfeda590&device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 1130 time: 0.0576203 Mar 24 02:27:10.916682 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fe90a6-16ce-4b15-a083-f49131daf5a4 req-ad013084-3f63-49dd-9184-c54c88a7be86 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:10.918179 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-43fe90a6-16ce-4b15-a083-f49131daf5a4 req-ad013084-3f63-49dd-9184-c54c88a7be86 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 946 time: 0.0897985 Mar 24 02:27:10.919741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef8c74e-663d-46da-b709-89717f4049c1 req-1faf5b88-93d0-48c5-a5f2-35dd2c8e767e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:10.921413 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fef8c74e-663d-46da-b709-89717f4049c1 req-1faf5b88-93d0-48c5-a5f2-35dd2c8e767e service neutron] 10.222.0.30 "GET /v2.0/networks?id=1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 200 len: 911 time: 0.1701674 Mar 24 02:27:10.927069 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:10.957494 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] Checking router: d9d90a22-1adf-4945-a625-094e279f17a1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:27:10.965815 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:27:10.966436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:27:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:10.977225 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fef8c74e-663d-46da-b709-89717f4049c1 req-c66c8070-42ff-42e9-a79a-87853626a920 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311 HTTP/1.1" status: 200 len: 217 time: 0.0456665 Mar 24 02:27:11.037455 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-43fe90a6-16ce-4b15-a083-f49131daf5a4 req-99e5df03-5c33-4a81-b011-b4a3acd83f19 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1119204 Mar 24 02:27:11.046510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef8c74e-663d-46da-b709-89717f4049c1 req-e6286e26-d765-496a-be1c-1e127e90650d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:11.047962 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fef8c74e-663d-46da-b709-89717f4049c1 req-e6286e26-d765-496a-be1c-1e127e90650d service neutron] 10.222.0.30 "GET /v2.0/subnets?id=7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 200 len: 849 time: 0.0603013 Mar 24 02:27:11.078482 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:27:11.105390 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef8c74e-663d-46da-b709-89717f4049c1 req-b804a6ce-a4eb-4ed8-b569-01f283ac9aa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:11.107482 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fef8c74e-663d-46da-b709-89717f4049c1 req-b804a6ce-a4eb-4ed8-b569-01f283ac9aa7 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=1c7b4ca8-c501-4e72-9eba-3ca17999702e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0525138 Mar 24 02:27:11.207812 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fef8c74e-663d-46da-b709-89717f4049c1 req-dc9eec64-46c5-40f3-bd6b-b23ea87aecb4 service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0938096 Mar 24 02:27:11.285770 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:11.306881 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-fef8c74e-663d-46da-b709-89717f4049c1 req-13e8d337-4d40-4900-a573-46f2dfdc609f service neutron] 10.222.0.30 "GET /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871909 Mar 24 02:27:11.312136 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1225c3a6-a748-4808-9809-b7b51ce7a70a None None] The sync data for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv is: [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:19:00Z', 'revision_number': 4, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8', 'name': '', 'network_id': '1c7b4ca8-c501-4e72-9eba-3ca17999702e', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'mac_address': 'fa:16:3e:77:f8:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1247, 'fixed_ips': [{'subnet_id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:59Z', 'updated_at': '2022-03-24T02:19:05Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'subnets': [{'id': '7098e0b3-a3e5-4826-921e-69dc9ba94ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:27:11.559534 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51cf426c-2406-4385-9c72-6f6b78db7518 None None] New status for floating IP 6d1e6138-f7e0-473d-bae4-c655f53ad785: DOWN {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:27:12.170509 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7341f1e4-c689-4593-969e-23a28554620d req-20ffd567-faf4-4c89-a137-1d3d23d94d54 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:12.172143 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7341f1e4-c689-4593-969e-23a28554620d req-20ffd567-faf4-4c89-a137-1d3d23d94d54 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 946 time: 0.0593023 Mar 24 02:27:12.220720 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7341f1e4-c689-4593-969e-23a28554620d req-d6c22ae1-3fbb-483b-87fa-490d31f54764 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/security-groups?id=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419641 Mar 24 02:27:12.469584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-e87e0972-a430-4edd-88b4-78bff4bde255 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:27:12.471569 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-e87e0972-a430-4edd-88b4-78bff4bde255 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 946 time: 0.0513673 Mar 24 02:27:12.568370 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Deleting port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:27:12.568711 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:12.654423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] For port 42b4c550-82ba-45d7-bc38-e7dbcfff4311, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=42b4c550-82ba-45d7-bc38-e7dbcfff4311,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:27:12.654809 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:12.667976 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Calling delete_port for 42b4c550-82ba-45d7-bc38-e7dbcfff4311 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:27:12.805182 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (42b4c550-82ba-45d7-bc38-e7dbcfff4311), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:12.837975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event deleted for resources: {'Port': ['ID=42b4c550-82ba-45d7-bc38-e7dbcfff4311,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:12.876082 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] No DVR routers for this DVR port 42b4c550-82ba-45d7-bc38-e7dbcfff4311 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:27:12.878502 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:12.881822 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4296e146-a666-4912-99f4-06f3d2a733e2 req-4a8b709a-218b-4bfe-997c-6277a445f7dd tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.30 "DELETE /v2.0/ports/42b4c550-82ba-45d7-bc38-e7dbcfff4311 HTTP/1.1" status: 204 len: 173 time: 0.4027607 Mar 24 02:27:12.882258 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'name': 'network-vif-deleted', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:27:12.884489 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e0cf2404-5216-4241-91e2-61b4fa25ed47" -d '{"events": [{"server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "name": "network-vif-deleted", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:27:12.921327 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:27:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0183427a-04f9-4d9d-ab6c-0f9799322449 x-openstack-request-id: req-0183427a-04f9-4d9d-ab6c-0f9799322449 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:27:12.921623 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ed61e09-6181-4944-af6d-175afaaf2402", "name": "network-vif-deleted", "tag": "42b4c550-82ba-45d7-bc38-e7dbcfff4311", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:27:12.921944 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-0183427a-04f9-4d9d-ab6c-0f9799322449 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:27:12.922379 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-0183427a-04f9-4d9d-ab6c-0f9799322449'] response: {'server_uuid': '5ed61e09-6181-4944-af6d-175afaaf2402', 'name': 'network-vif-deleted', 'tag': '42b4c550-82ba-45d7-bc38-e7dbcfff4311', 'status': 'completed', 'code': 200} Mar 24 02:27:13.321677 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9694cdf7-4f3e-47da-9a66-12462cc33538 req-3b77ab5b-a60a-4404-a150-cc57d91f51f3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0329916 Mar 24 02:27:14.417315 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-1ee39ac7-b549-45d6-b4ef-f783266d5e98 req-d6d75001-3c67-4ec5-b1c7-812615608ca0 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0273726 Mar 24 02:27:15.058937 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:15.217556 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 42b4c550-82ba-45d7-bc38-e7dbcfff4311 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:27:15.237733 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 42b4c550-82ba-45d7-bc38-e7dbcfff4311 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:27:15.238073 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 42b4c550-82ba-45d7-bc38-e7dbcfff4311 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:27:15.511368 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c1036186-b481-47dc-b248-d67436dfbaf7 req-be34f300-ffc9-4e8b-a255-f794d1ecd6ec tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0277276 Mar 24 02:27:16.604208 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b2b58e0a-9fae-466a-8d0b-5434d6330f18 req-8eb96b88-43af-47a6-8ecd-00e5472eae0c tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0276761 Mar 24 02:27:17.695872 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-00d1f3ad-862a-4be1-b6c7-3733574c61e2 req-4d1fce73-9fa5-4837-bbb8-eb7b4cbe54d8 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0272496 Mar 24 02:27:18.792374 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2b87995d-270d-454f-accb-601033971ba5 req-af4082e9-e7cc-491f-80ed-857a22f94970 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0308423 Mar 24 02:27:19.894694 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-801fa4f9-246c-4e6a-8f77-bc28403ff33b req-3f965d30-7e6f-4c3b-aacb-692e64da2618 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0275824 Mar 24 02:27:20.989904 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-ddb0aef0-b686-43c2-a6d9-a21914c1a2af req-3079ce58-5fee-4b16-99d7-63d0f1a42618 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "GET /v2.0/ports?device_id=5ed61e09-6181-4944-af6d-175afaaf2402 HTTP/1.1" status: 200 len: 210 time: 0.0273397 Mar 24 02:27:22.044280 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 35992) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:22.164765 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Deleting port 5caea9a0-6078-47ba-9a6c-ed3adfb0390f {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:27:22.165103 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (5caea9a0-6078-47ba-9a6c-ed3adfb0390f), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:22.248757 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (5caea9a0-6078-47ba-9a6c-ed3adfb0390f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:22.249074 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (5caea9a0-6078-47ba-9a6c-ed3adfb0390f), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:22.260441 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Calling delete_port for 5caea9a0-6078-47ba-9a6c-ed3adfb0390f owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:27:22.389018 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (5caea9a0-6078-47ba-9a6c-ed3adfb0390f), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:22.415635 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event deleted for resources: {'Port': ['ID=5caea9a0-6078-47ba-9a6c-ed3adfb0390f,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:22.473142 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for floatingip (b84362c7-d8e0-4ed8-b907-8d4838657519), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:22.475709 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:22.476837 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-be4a0590-7c32-476b-8923-4a78ef52ebb3 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "DELETE /v2.0/floatingips/b84362c7-d8e0-4ed8-b907-8d4838657519 HTTP/1.1" status: 204 len: 168 time: 0.4315560 Mar 24 02:27:27.406953 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b636759a-4aa6-440b-83b6-a2367496a2a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:27.882215 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36012) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:27.940053 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-49fb6292-b800-4201-a826-1ec79c48d538 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group (8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:27.964978 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-49fb6292-b800-4201-a826-1ec79c48d538 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group (8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:28.027047 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-49fb6292-b800-4201-a826-1ec79c48d538 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:28.029640 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-49fb6292-b800-4201-a826-1ec79c48d538 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:28.031362 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-49fb6292-b800-4201-a826-1ec79c48d538 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] 10.222.0.20 "DELETE /v2.0/security-groups/8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182 HTTP/1.1" status: 204 len: 168 time: 0.1474798 Mar 24 02:27:28.040579 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49fb6292-b800-4201-a826-1ec79c48d538 tempest-TestVolumeBootPattern-1331020182 tempest-TestVolumeBootPattern-1331020182-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ad4b595-4c1b-47bc-b5dc-6f9d66d1b182,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:28.098409 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36016) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:28.599563 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (d9d90a22-1adf-4945-a625-094e279f17a1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:28.854837 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Deleting port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:27:28.855097 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:28.933084 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] For port dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:27:28.933435 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:28.946025 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Calling delete_port for dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:27:28.991241 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:27:29.134149 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:29.159878 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Pushing event deleted for resources: {'Port': ['ID=dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:29.346689 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (d9d90a22-1adf-4945-a625-094e279f17a1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:29.564842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Router d9d90a22-1adf-4945-a625-094e279f17a1 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:27:29.668232 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:27:29.673301 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-dc9cd283-af90-4f53-a813-c58cfb85d5db admin admin] 10.222.0.20 "PUT /v2.0/routers/d9d90a22-1adf-4945-a625-094e279f17a1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5721512 Mar 24 02:27:29.675816 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36020) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:29.678506 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] Sync routers for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:27:29.689004 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:27:29.689623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:27:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:29.788326 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks [] for router (d9d90a22-1adf-4945-a625-094e279f17a1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:29.799971 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:27:29.897144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks [] for router_gateway (d9d90a22-1adf-4945-a625-094e279f17a1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:29.950242 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Deleting port 272a6cba-c4b7-4416-a198-f7d9c9a96554 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:27:29.950601 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:29.976508 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:27:29Z', 'revision_number': 5, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port': {'id': '272a6cba-c4b7-4416-a198-f7d9c9a96554', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:23:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1242, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:18:57Z', 'updated_at': '2022-03-24T02:19:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:30.002591 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] Checking router: d9d90a22-1adf-4945-a625-094e279f17a1 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:27:30.010614 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] Routers {'d9d90a22-1adf-4945-a625-094e279f17a1'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:27:30.011213 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:27:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['d9d90a22-1adf-4945-a625-094e279f17a1'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:30.029999 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] For port 272a6cba-c4b7-4416-a198-f7d9c9a96554, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=272a6cba-c4b7-4416-a198-f7d9c9a96554,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:27:30.030359 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.042900 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Calling delete_port for 272a6cba-c4b7-4416-a198-f7d9c9a96554 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:27:30.100852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] Set router d9d90a22-1adf-4945-a625-094e279f17a1 gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:27:30.154870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:27:29Z', 'revision_number': 6, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:30.183000 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acaa24aa-1589-466d-a17c-7bd36bbb54e0 None None] The sync data for ids ['d9d90a22-1adf-4945-a625-094e279f17a1'] in dv-neutron-834874-3-hyperv is: [{'id': 'd9d90a22-1adf-4945-a625-094e279f17a1', 'name': 'tempest-TestVolumeBootPattern-87137205-router', 'tenant_id': '534ec00707834d9cbfb4f670cfeda590', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:18:56Z', 'updated_at': '2022-03-24T02:27:29Z', 'revision_number': 6, 'project_id': '534ec00707834d9cbfb4f670cfeda590', 'gw_port_host': None}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:27:30.218199 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (272a6cba-c4b7-4416-a198-f7d9c9a96554), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.244221 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Pushing event deleted for resources: {'Port': ['ID=272a6cba-c4b7-4416-a198-f7d9c9a96554,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:30.306779 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (d9d90a22-1adf-4945-a625-094e279f17a1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.394155 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (d9d90a22-1adf-4945-a625-094e279f17a1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.396156 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks [] for router_controller (d9d90a22-1adf-4945-a625-094e279f17a1), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.437233 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (d9d90a22-1adf-4945-a625-094e279f17a1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.437765 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Fanout notify agent at l3_agent the message router_deleted on router d9d90a22-1adf-4945-a625-094e279f17a1 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:27:30.441913 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.443069 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6e75409e-5ff3-4ec1-982f-2b2c9747670f admin admin] 10.222.0.20 "DELETE /v2.0/routers/d9d90a22-1adf-4945-a625-094e279f17a1 HTTP/1.1" status: 204 len: 168 time: 0.7663584 Mar 24 02:27:30.445890 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36022) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:30.490935 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-e7459fc1-16d2-4d35-b094-291d2962bf55 admin admin] Deleting subnet 7098e0b3-a3e5-4826-921e-69dc9ba94ef6 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:27:30.495201 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7459fc1-16d2-4d35-b094-291d2962bf55 admin admin] Publish callbacks [] for subnet (7098e0b3-a3e5-4826-921e-69dc9ba94ef6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.524653 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f536f018-5a54-4e7a-84ca-6da3b22fb0b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.531320 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7459fc1-16d2-4d35-b094-291d2962bf55 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (7098e0b3-a3e5-4826-921e-69dc9ba94ef6), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.613730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7459fc1-16d2-4d35-b094-291d2962bf55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (7098e0b3-a3e5-4826-921e-69dc9ba94ef6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.662742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7459fc1-16d2-4d35-b094-291d2962bf55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (7098e0b3-a3e5-4826-921e-69dc9ba94ef6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.686766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7459fc1-16d2-4d35-b094-291d2962bf55 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7098e0b3-a3e5-4826-921e-69dc9ba94ef6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:30.690454 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e7459fc1-16d2-4d35-b094-291d2962bf55 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.693898 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e7459fc1-16d2-4d35-b094-291d2962bf55 admin admin] 10.222.0.20 "DELETE /v2.0/subnets/7098e0b3-a3e5-4826-921e-69dc9ba94ef6 HTTP/1.1" status: 204 len: 168 time: 0.2466075 Mar 24 02:27:30.696219 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aaf902be-4320-4beb-9895-9767568cb6c4 None None] Network 1c7b4ca8-c501-4e72-9eba-3ca17999702e requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:27:30.696970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36024) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:30.763888 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (1c7b4ca8-c501-4e72-9eba-3ca17999702e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.824070 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Deleting port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:27:30.824407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.885237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] For port 9290aaff-5709-409c-b6ed-11dc73f0c4e0, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=9290aaff-5709-409c-b6ed-11dc73f0c4e0,segment=NetworkSegment(cd8dc1cb-883d-457f-8089-73af87a1a574),segment_id=cd8dc1cb-883d-457f-8089-73af87a1a574)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:27:30.885507 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.892745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:30.899734 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Calling delete_port for 9290aaff-5709-409c-b6ed-11dc73f0c4e0 owned by network:dhcp {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:27:30.985589 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7177428b-27a8-443d-9bd8-c76d5eaa1f5e None None] DHCP port deletion for 1c7b4ca8-c501-4e72-9eba-3ca17999702e request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:27:30.991781 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (9290aaff-5709-409c-b6ed-11dc73f0c4e0), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:31.009888 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-7177428b-27a8-443d-9bd8-c76d5eaa1f5e None None] The port '9290aaff-5709-409c-b6ed-11dc73f0c4e0' was deleted {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2024}} Mar 24 02:27:31.015457 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9290aaff-5709-409c-b6ed-11dc73f0c4e0 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:27:31.024146 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Pushing event deleted for resources: {'Port': ['ID=9290aaff-5709-409c-b6ed-11dc73f0c4e0,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:31.026116 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] No DVR routers for this DVR port 9290aaff-5709-409c-b6ed-11dc73f0c4e0 on host dv-neutron-834874-3-hyperv {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:27:31.044115 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 9290aaff-5709-409c-b6ed-11dc73f0c4e0 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:27:31.044459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 9290aaff-5709-409c-b6ed-11dc73f0c4e0 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:27:31.044872 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 272a6cba-c4b7-4416-a198-f7d9c9a96554 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:27:31.072378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 272a6cba-c4b7-4416-a198-f7d9c9a96554 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:27:31.072971 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 272a6cba-c4b7-4416-a198-f7d9c9a96554 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:27:31.073387 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:27:31.093250 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:27:31.093682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device dcde8ffe-7ef3-4ba8-9fc8-2f0b1773a3c8 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:27:31.101222 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (1c7b4ca8-c501-4e72-9eba-3ca17999702e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:31.121187 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1c7b4ca8-c501-4e72-9eba-3ca17999702e']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:31.131788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cd8dc1cb-883d-457f-8089-73af87a1a574') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:31.132090 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cd8dc1cb-883d-457f-8089-73af87a1a574') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:31.142726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (cd8dc1cb-883d-457f-8089-73af87a1a574), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:31.156290 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (cd8dc1cb-883d-457f-8089-73af87a1a574), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:31.164430 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Releasing vlan 111 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:27:31.164740 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (cd8dc1cb-883d-457f-8089-73af87a1a574), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:27:31.166852 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:27:31.230322 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (1c7b4ca8-c501-4e72-9eba-3ca17999702e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:31.247501 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:31.251337 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] 10.222.0.20 "DELETE /v2.0/networks/1c7b4ca8-c501-4e72-9eba-3ca17999702e HTTP/1.1" status: 204 len: 168 time: 0.5528827 Mar 24 02:27:31.254476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36026) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:31.261294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d8841b4-1236-4403-95f6-727eb1e5c091 admin admin] Pushing event deleted for resources: {'Network': ['ID=1c7b4ca8-c501-4e72-9eba-3ca17999702e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:31.608094 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (47fea142-65a5-4020-a53c-bd6100f56181), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:32.128249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Deleting port 46c15fce-88e8-4997-93a7-a523664f7da2 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:27:32.128581 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:32.209329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] For port 46c15fce-88e8-4997-93a7-a523664f7da2, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=46c15fce-88e8-4997-93a7-a523664f7da2,segment=NetworkSegment(054b2715-ebd3-4b55-9daf-6e8904f5eae9),segment_id=054b2715-ebd3-4b55-9daf-6e8904f5eae9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:27:32.209694 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:32.222009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Calling delete_port for 46c15fce-88e8-4997-93a7-a523664f7da2 owned by network:router_interface {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:27:32.398263 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (46c15fce-88e8-4997-93a7-a523664f7da2), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:32.422576 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Pushing event deleted for resources: {'Port': ['ID=46c15fce-88e8-4997-93a7-a523664f7da2,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:32.456394 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:32.593603 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (47fea142-65a5-4020-a53c-bd6100f56181), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:32.819711 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Router 47fea142-65a5-4020-a53c-bd6100f56181 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:27:32.932383 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:27:32.937318 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a58ab286-44d6-4b65-99f8-79c3f246485d admin admin] 10.222.0.20 "PUT /v2.0/routers/47fea142-65a5-4020-a53c-bd6100f56181/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6810060 Mar 24 02:27:32.939841 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36028) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:32.942168 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] Sync routers for ids ['47fea142-65a5-4020-a53c-bd6100f56181'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:27:32.952776 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] Routers {'47fea142-65a5-4020-a53c-bd6100f56181'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:27:32.953386 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:27:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['47fea142-65a5-4020-a53c-bd6100f56181'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:33.045541 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks [] for router (47fea142-65a5-4020-a53c-bd6100f56181), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.057562 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] Set router 47fea142-65a5-4020-a53c-bd6100f56181 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:27:33.150404 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks [] for router_gateway (47fea142-65a5-4020-a53c-bd6100f56181), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.205023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Deleting port f5e80362-8679-4245-af8b-39639e759fd4 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:27:33.205354 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (f5e80362-8679-4245-af8b-39639e759fd4), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.234391 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '47fea142-65a5-4020-a53c-bd6100f56181', 'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250'}], 'enable_snat': True}, 'gw_port_id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:27:32Z', 'revision_number': 5, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'gw_port': {'id': 'f5e80362-8679-4245-af8b-39639e759fd4', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:9e:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47fea142-65a5-4020-a53c-bd6100f56181', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:19:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:33.260430 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] Checking router: 47fea142-65a5-4020-a53c-bd6100f56181 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:27:33.268955 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] Routers {'47fea142-65a5-4020-a53c-bd6100f56181'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:27:33.269542 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:27:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['47fea142-65a5-4020-a53c-bd6100f56181'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:33.285386 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] For port f5e80362-8679-4245-af8b-39639e759fd4, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=f5e80362-8679-4245-af8b-39639e759fd4,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:27:33.285745 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (f5e80362-8679-4245-af8b-39639e759fd4), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.298335 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Calling delete_port for f5e80362-8679-4245-af8b-39639e759fd4 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:27:33.441184 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] Set router 47fea142-65a5-4020-a53c-bd6100f56181 gateway port host: None {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:27:33.467361 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (f5e80362-8679-4245-af8b-39639e759fd4), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.493118 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Pushing event deleted for resources: {'Port': ['ID=f5e80362-8679-4245-af8b-39639e759fd4,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:33.497640 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '47fea142-65a5-4020-a53c-bd6100f56181', 'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:27:33Z', 'revision_number': 6, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:33.525074 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29aece24-eda1-4b54-ac96-1873d1afde4b None None] The sync data for ids ['47fea142-65a5-4020-a53c-bd6100f56181'] in dv-neutron-834874-3-hyperv is: [{'id': '47fea142-65a5-4020-a53c-bd6100f56181', 'name': 'tempest-TestVolumeBootPattern-1243700301-router', 'tenant_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:19:05Z', 'updated_at': '2022-03-24T02:27:33Z', 'revision_number': 6, 'project_id': 'ff354ea51c3e49b88dd9920ceae4dc09', 'gw_port_host': None}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:27:33.566500 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (47fea142-65a5-4020-a53c-bd6100f56181), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.660287 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (47fea142-65a5-4020-a53c-bd6100f56181), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.662482 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks [] for router_controller (47fea142-65a5-4020-a53c-bd6100f56181), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.706951 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (47fea142-65a5-4020-a53c-bd6100f56181), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.707485 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 47fea142-65a5-4020-a53c-bd6100f56181 {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:27:33.711748 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.712900 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a901988e-bdc1-4509-8dcb-304a5dda4cd2 admin admin] 10.222.0.20 "DELETE /v2.0/routers/47fea142-65a5-4020-a53c-bd6100f56181 HTTP/1.1" status: 204 len: 168 time: 0.7721512 Mar 24 02:27:33.715496 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36030) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:33.724125 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.760144 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_v2 [None req-8e6865a7-10c9-41d4-8de5-4c226ae1e353 admin admin] Deleting subnet a7b61086-a0a8-47c4-8975-c7a7a2a41661 {{(pid=104036) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:27:33.763150 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e6865a7-10c9-41d4-8de5-4c226ae1e353 admin admin] Publish callbacks [] for subnet (a7b61086-a0a8-47c4-8975-c7a7a2a41661), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.801009 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e6865a7-10c9-41d4-8de5-4c226ae1e353 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3662080'] for subnet (a7b61086-a0a8-47c4-8975-c7a7a2a41661), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.876899 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e6865a7-10c9-41d4-8de5-4c226ae1e353 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (a7b61086-a0a8-47c4-8975-c7a7a2a41661), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.926831 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e6865a7-10c9-41d4-8de5-4c226ae1e353 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8966592', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3298565'] for subnet (a7b61086-a0a8-47c4-8975-c7a7a2a41661), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.952335 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6865a7-10c9-41d4-8de5-4c226ae1e353 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a7b61086-a0a8-47c4-8975-c7a7a2a41661,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:33.954265 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e6865a7-10c9-41d4-8de5-4c226ae1e353 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:33.957400 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8e6865a7-10c9-41d4-8de5-4c226ae1e353 admin admin] 10.222.0.20 "DELETE /v2.0/subnets/a7b61086-a0a8-47c4-8975-c7a7a2a41661 HTTP/1.1" status: 204 len: 168 time: 0.2409909 Mar 24 02:27:33.959129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a8ce724-a783-4cdf-86f9-c95661018506 None None] Network 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:27:33.959866 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36032) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:34.036396 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (5c3ada7d-b3db-49b1-9de8-6d179e82dad1), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.093529 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Deleting port 700c8088-095d-4a41-98e8-db1644d20754 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:27:34.093879 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (700c8088-095d-4a41-98e8-db1644d20754), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.165043 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] For port 700c8088-095d-4a41-98e8-db1644d20754, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=700c8088-095d-4a41-98e8-db1644d20754,segment=NetworkSegment(054b2715-ebd3-4b55-9daf-6e8904f5eae9),segment_id=054b2715-ebd3-4b55-9daf-6e8904f5eae9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:27:34.165407 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (700c8088-095d-4a41-98e8-db1644d20754), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.179456 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Calling delete_port for 700c8088-095d-4a41-98e8-db1644d20754 owned by network:dhcp {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:27:34.261428 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (700c8088-095d-4a41-98e8-db1644d20754), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.289856 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] No DVR routers for this DVR port 700c8088-095d-4a41-98e8-db1644d20754 on host dv-neutron-834874-3-hyperv {{(pid=104036) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:27:34.291447 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Pushing event deleted for resources: {'Port': ['ID=700c8088-095d-4a41-98e8-db1644d20754,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:34.291778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb662b13-825c-4ffb-aac0-31a10e852e80 None None] DHCP port deletion for 5c3ada7d-b3db-49b1-9de8-6d179e82dad1 request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:27:34.365614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (5c3ada7d-b3db-49b1-9de8-6d179e82dad1), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.385558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c3ada7d-b3db-49b1-9de8-6d179e82dad1']}} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:34.395109 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '054b2715-ebd3-4b55-9daf-6e8904f5eae9') {'for_net_delete': True} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:34.395402 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.services.segments.db [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '054b2715-ebd3-4b55-9daf-6e8904f5eae9') {} {{(pid=104036) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:27:34.404470 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3662137'] for segment (054b2715-ebd3-4b55-9daf-6e8904f5eae9), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.418205 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (054b2715-ebd3-4b55-9daf-6e8904f5eae9), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.424320 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=104036) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:27:34.424699 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8968034'] for segment (054b2715-ebd3-4b55-9daf-6e8904f5eae9), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: Traceback (most recent call last): Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: timer() Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: cb(*args, **kw) Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: return func(*args, **kwargs) Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: self._notify() Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: self.callback(batched_events) Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: event.method(event) Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: return f(self, *a, **k) Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._get(url).json() Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: return self.request(url, 'GET', **kwargs) Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:27:34.426485 dv-neutron-834874-3-hyperv neutron-server[104036]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:27:34.480013 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (5c3ada7d-b3db-49b1-9de8-6d179e82dad1), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.485350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.488490 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] 10.222.0.20 "DELETE /v2.0/networks/5c3ada7d-b3db-49b1-9de8-6d179e82dad1 HTTP/1.1" status: 204 len: 168 time: 0.5276461 Mar 24 02:27:34.504771 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ea96ab-063e-4ecf-9c33-547edaa6df6e admin admin] Pushing event deleted for resources: {'Network': ['ID=5c3ada7d-b3db-49b1-9de8-6d179e82dad1,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:34.600487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36036) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:34.643426 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c8f69742-cfef-456d-9220-951bc8240ee6 admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=534ec00707834d9cbfb4f670cfeda590&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0416737 Mar 24 02:27:34.645723 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36038) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:34.692481 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ac259453-53c3-4db6-a8ad-ee2fe3b31a8c admin admin] Publish callbacks [] for security_group (e6255aad-3437-474a-958e-6d538ee75a4c), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.713869 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ac259453-53c3-4db6-a8ad-ee2fe3b31a8c admin admin] Publish callbacks [] for security_group (e6255aad-3437-474a-958e-6d538ee75a4c), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.760246 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ac259453-53c3-4db6-a8ad-ee2fe3b31a8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (e6255aad-3437-474a-958e-6d538ee75a4c), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.763002 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-ac259453-53c3-4db6-a8ad-ee2fe3b31a8c admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:34.764173 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-ac259453-53c3-4db6-a8ad-ee2fe3b31a8c admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/e6255aad-3437-474a-958e-6d538ee75a4c HTTP/1.1" status: 204 len: 168 time: 0.1175792 Mar 24 02:27:34.772289 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac259453-53c3-4db6-a8ad-ee2fe3b31a8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6255aad-3437-474a-958e-6d538ee75a4c,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:34.852268 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f5e80362-8679-4245-af8b-39639e759fd4 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:27:34.872325 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: f5e80362-8679-4245-af8b-39639e759fd4 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:27:34.872677 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device f5e80362-8679-4245-af8b-39639e759fd4 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:27:34.873097 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 46c15fce-88e8-4997-93a7-a523664f7da2 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:27:34.894778 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 46c15fce-88e8-4997-93a7-a523664f7da2 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:27:34.895044 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 46c15fce-88e8-4997-93a7-a523664f7da2 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:27:34.895454 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 700c8088-095d-4a41-98e8-db1644d20754 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:27:34.919819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: 700c8088-095d-4a41-98e8-db1644d20754 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:27:34.920318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 700c8088-095d-4a41-98e8-db1644d20754 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:27:35.083059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36044) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:35.122041 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c5350302-d8af-4e60-a843-67d4cdd752bc admin admin] 10.222.0.20 "GET /v2.0/security-groups?tenant_id=ff354ea51c3e49b88dd9920ceae4dc09&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0378375 Mar 24 02:27:35.124549 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36046) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:27:35.170148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78df3764-441d-4048-babb-fbb207336c0c admin admin] Publish callbacks [] for security_group (0c135692-c0d5-484d-a14f-478919ec76e6), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:35.191529 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78df3764-441d-4048-babb-fbb207336c0c admin admin] Publish callbacks [] for security_group (0c135692-c0d5-484d-a14f-478919ec76e6), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:35.242043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78df3764-441d-4048-babb-fbb207336c0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (0c135692-c0d5-484d-a14f-478919ec76e6), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:35.244823 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-78df3764-441d-4048-babb-fbb207336c0c admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:35.246003 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-78df3764-441d-4048-babb-fbb207336c0c admin admin] 10.222.0.20 "DELETE /v2.0/security-groups/0c135692-c0d5-484d-a14f-478919ec76e6 HTTP/1.1" status: 204 len: 168 time: 0.1205552 Mar 24 02:27:35.254098 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78df3764-441d-4048-babb-fbb207336c0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c135692-c0d5-484d-a14f-478919ec76e6,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:27:45.058686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:27:57.409819 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6e9a10e9-45b5-4d17-b11a-2e4e173e9866 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:00.526943 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-751a2f5d-6104-41ee-988a-9d42125ebb41 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:00.895686 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:02.509611 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:03.726022 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:05.990147 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:28:15.062863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:27.413864 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-96d09553-05cb-4a39-96f8-f3c2149765fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:30.154674 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-de841df4-fd16-4c76-afa3-32dfdb3c50a2 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1737523 Mar 24 02:28:30.239423 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-6f03fde7-c284-4a43-adc6-71c4c3240ebc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:28:30.240812 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-6f03fde7-c284-4a43-adc6-71c4c3240ebc service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 1130 time: 0.0456126 Mar 24 02:28:30.340513 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-7441dfaa-78d6-4fdc-9348-de34a1c8faa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:28:30.341966 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-7441dfaa-78d6-4fdc-9348-de34a1c8faa6 service neutron] 10.222.0.30 "GET /v2.0/networks?id=912ee513-c0d0-4901-9961-9b70f013b1da HTTP/1.1" status: 200 len: 898 time: 0.0834870 Mar 24 02:28:30.407695 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-901650db-7b81-44f2-ab95-bb95a42a9882 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370 HTTP/1.1" status: 200 len: 1002 time: 0.0600080 Mar 24 02:28:30.454460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-1fbc662a-ad8f-4390-b59f-38c116c07a70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:28:30.455879 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-1fbc662a-ad8f-4390-b59f-38c116c07a70 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=52e16ae2-5c77-43f2-9369-5ff2f989d728 HTTP/1.1" status: 200 len: 843 time: 0.0421607 Mar 24 02:28:30.501656 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-6cbe1c09-9334-4d19-8ce9-a4fdbe4e879e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:28:30.503021 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-6cbe1c09-9334-4d19-8ce9-a4fdbe4e879e service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=912ee513-c0d0-4901-9961-9b70f013b1da&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0415342 Mar 24 02:28:30.527473 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3f514158-ca31-44f9-843a-1fc71626f50f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:30.594685 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-8cd5a613-cee2-4cec-8b4c-09237dc26432 service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856876 Mar 24 02:28:30.899157 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:30.996109 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-461d7334-929a-42fa-9dde-ad275ca718e4 req-fc62c925-a656-4a74-8ef5-2838a12a5950 service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3956864 Mar 24 02:28:32.460477 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:33.727751 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:42.989349 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:28:45.063593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:28:57.415781 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-fe48507c-99b5-41b0-a4ac-2db6122455c6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:00.528442 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-59a4ef3e-c3a7-490c-b96b-adea6ef9cec1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:00.901538 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:02.462911 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:03.729354 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:15.066597 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:19.988650 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:29:20.439538 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [req-10fa3671-8ce8-4ad2-b8bd-c59ebf40bbf9 req-d231ebd5-b0cc-41d1-9d63-0ba6cecbc8b6 tempest-ServersTestJSON-506841013 tempest-ServersTestJSON-506841013-project] (104036) timed out ('10.222.0.30', 58679) {{(pid=104036) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Mar 24 02:29:27.417409 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-dbec23b7-d2df-41a9-be5e-58aac5694b49 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:30.528862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7fde1366-ba8a-46cc-94a5-31b09b524667 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:30.903537 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:31.520126 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36078) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:29:31.526754 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'subnet': {'dns_nameservers': ['9.8.7.6']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:29:31.612276 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-9331132'] for subnet (52e16ae2-5c77-43f2-9369-5ff2f989d728), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:31.750615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8790618889355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-3241109'] for subnet (52e16ae2-5c77-43f2-9369-5ff2f989d728), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:31.780881 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:29:31.781410 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:31.783065 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/subnets/52e16ae2-5c77-43f2-9369-5ff2f989d728 HTTP/1.1" status: 200 len: 835 time: 0.2615914 Mar 24 02:29:31.789623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4b15cb0-4362-4080-b82e-b093029f08a0 None None] Network 912ee513-c0d0-4901-9961-9b70f013b1da requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:29:31.802970 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Subnet': ['ID=52e16ae2-5c77-43f2-9369-5ff2f989d728,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:29:31.810144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.810497 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.810870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.811214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.811551 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.812375 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.812704 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.813034 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.813365 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.813692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.814022 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.814356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.814707 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.815156 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:31.815469 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d45546ad-3d3e-4bf3-a106-e63663a2a9da tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:29:32.025905 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-6a107506-ae2b-46d9-abf4-c76dfafa75b9 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0456545 Mar 24 02:29:32.117257 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-39ce2226-01de-4ccc-8308-5458fe717c07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:29:32.118782 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-39ce2226-01de-4ccc-8308-5458fe717c07 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 1130 time: 0.0453069 Mar 24 02:29:32.175436 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2fa52967-b99d-4de0-9c81-878d0510d4fa None None] Provisioning complete for port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:29:32.175764 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2fa52967-b99d-4de0-9c81-878d0510d4fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:32.228940 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-f847bfd5-de5d-4527-81a0-6ec14eb92beb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:29:32.230424 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-f847bfd5-de5d-4527-81a0-6ec14eb92beb service neutron] 10.222.0.30 "GET /v2.0/networks?id=912ee513-c0d0-4901-9961-9b70f013b1da HTTP/1.1" status: 200 len: 898 time: 0.0918922 Mar 24 02:29:32.251402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2fa52967-b99d-4de0-9c81-878d0510d4fa None None] Current status of the port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:29:32.261150 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2fa52967-b99d-4de0-9c81-878d0510d4fa None None] Provisioning complete for port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:29:32.261517 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2fa52967-b99d-4de0-9c81-878d0510d4fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:32.295078 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-77cbfbfc-e96a-4d25-910e-311863386c9c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370 HTTP/1.1" status: 200 len: 1002 time: 0.0584245 Mar 24 02:29:32.340577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2fa52967-b99d-4de0-9c81-878d0510d4fa None None] Current status of the port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:29:32.345356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-3a03f09e-ef02-484a-a125-d7a2b5e12cbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:29:32.346873 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-3a03f09e-ef02-484a-a125-d7a2b5e12cbd service neutron] 10.222.0.30 "GET /v2.0/subnets?id=52e16ae2-5c77-43f2-9369-5ff2f989d728 HTTP/1.1" status: 200 len: 843 time: 0.0468328 Mar 24 02:29:32.350397 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-2fa52967-b99d-4de0-9c81-878d0510d4fa None None] Provisioning complete for port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:29:32.350798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-2fa52967-b99d-4de0-9c81-878d0510d4fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:32.395296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-0fb37afe-74bc-4218-b768-61519c1d8f3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:29:32.396793 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-0fb37afe-74bc-4218-b768-61519c1d8f3b service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=912ee513-c0d0-4901-9961-9b70f013b1da&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0435030 Mar 24 02:29:32.426852 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-2fa52967-b99d-4de0-9c81-878d0510d4fa None None] Current status of the port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:29:32.464341 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:32.485519 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-10782813-e526-4fa1-907e-8e23075b0416 service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820570 Mar 24 02:29:32.579658 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af7ba702-183e-4ac4-a49f-2a5f55cc4ce6 req-9a84145a-9713-438b-907e-13f00e41c5df service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882213 Mar 24 02:29:33.731717 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:45.064307 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:29:56.987346 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:29:57.418921 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e8fd88f1-e05f-43db-bb54-196fcf167731 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:00.530892 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9fcb4add-e756-4183-8c60-05e413d93c6e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:00.907826 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:02.514533 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:03.733381 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:15.082369 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:15.480153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36088) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:15.638237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 7af2511b-e867-442c-9416-c9d90c4a96f8 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:30:15.638584 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (7af2511b-e867-442c-9416-c9d90c4a96f8), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:15.719801 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (7af2511b-e867-442c-9416-c9d90c4a96f8), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:15.720101 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (7af2511b-e867-442c-9416-c9d90c4a96f8), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:15.731813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 7af2511b-e867-442c-9416-c9d90c4a96f8 owned by network:floatingip {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:30:15.876429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (7af2511b-e867-442c-9416-c9d90c4a96f8), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:15.900913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=7af2511b-e867-442c-9416-c9d90c4a96f8,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:15.965161 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (3d0b7122-50dc-48e7-a030-4aa34f24b5aa), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:15.965483 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP 3d0b7122-50dc-48e7-a030-4aa34f24b5aa disassociated (deleted). External IP: 172.26.2.162, port: 28e11ecf-858c-4b8b-ba0f-f0c136a4f370. Mar 24 02:30:16.176315 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 26d517b6-e447-4b18-8e07-91453160827e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:30:16.282459 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:30:16.287367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:16.291877 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] Sync routers for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:30:16.301896 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:16.302499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:16.316979 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f7b7b128-6d4d-4382-ad25-0b45f78636c6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/floatingips/3d0b7122-50dc-48e7-a030-4aa34f24b5aa HTTP/1.1" status: 204 len: 168 time: 0.8358264 Mar 24 02:30:16.317560 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:30:16.319815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af0dabbe-5506-467a-b108-255b27bb650f" -d '{"events": [{"name": "network-changed", "server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:30:16.412217 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:16.526367 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:30:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3338543-08ac-4f61-b412-f59f9cf857ed x-openstack-request-id: req-a3338543-08ac-4f61-b412-f59f9cf857ed {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:30:16.526913 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:30:16.527031 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-a3338543-08ac-4f61-b412-f59f9cf857ed {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:30:16.527356 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-a3338543-08ac-4f61-b412-f59f9cf857ed'] response: {'name': 'network-changed', 'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'status': 'completed', 'code': 200} Mar 24 02:30:16.617536 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a36f4d36-8c48-422d-b6fe-6d12d0edb9f7', 'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:77:14:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:45Z', 'updated_at': '2022-03-24T02:26:49Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:16.633365 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7073a7-c13c-48ee-ac42-1657d92f2873 req-85b6a331-d556-4dcf-b3ac-1944b38e096d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:16.634861 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2c7073a7-c13c-48ee-ac42-1657d92f2873 req-85b6a331-d556-4dcf-b3ac-1944b38e096d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 946 time: 0.1443548 Mar 24 02:30:16.637566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af0dabbe-5506-467a-b108-255b27bb650f req-cf271507-fb59-4dbd-9f7c-3b1662bd58b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:16.638954 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af0dabbe-5506-467a-b108-255b27bb650f req-cf271507-fb59-4dbd-9f7c-3b1662bd58b6 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 1130 time: 0.0808849 Mar 24 02:30:16.646942 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] Checking router: 26d517b6-e447-4b18-8e07-91453160827e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:30:16.655869 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:16.656503 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:16.740773 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2c7073a7-c13c-48ee-ac42-1657d92f2873 req-1e11bebf-a831-44e4-837d-a3a6bba423bb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1000593 Mar 24 02:30:16.761514 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af0dabbe-5506-467a-b108-255b27bb650f req-8730bada-036d-44c2-bcc4-7a7e7b918162 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:16.763066 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af0dabbe-5506-467a-b108-255b27bb650f req-8730bada-036d-44c2-bcc4-7a7e7b918162 service neutron] 10.222.0.30 "GET /v2.0/networks?id=912ee513-c0d0-4901-9961-9b70f013b1da HTTP/1.1" status: 200 len: 898 time: 0.1168733 Mar 24 02:30:16.767573 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:16.805382 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af0dabbe-5506-467a-b108-255b27bb650f req-e9bc3044-1ded-410c-a104-b6f48cfb0432 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370 HTTP/1.1" status: 200 len: 217 time: 0.0353112 Mar 24 02:30:16.853458 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af0dabbe-5506-467a-b108-255b27bb650f req-92d2e8f3-7d42-4825-af8c-c3315ad87f15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:16.854937 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af0dabbe-5506-467a-b108-255b27bb650f req-92d2e8f3-7d42-4825-af8c-c3315ad87f15 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=52e16ae2-5c77-43f2-9369-5ff2f989d728 HTTP/1.1" status: 200 len: 843 time: 0.0436399 Mar 24 02:30:16.910149 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af0dabbe-5506-467a-b108-255b27bb650f req-96ebfa80-3413-48b9-825c-3e5a7c5c21ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:16.911684 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af0dabbe-5506-467a-b108-255b27bb650f req-96ebfa80-3413-48b9-825c-3e5a7c5c21ee service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=912ee513-c0d0-4901-9961-9b70f013b1da&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0506425 Mar 24 02:30:16.960196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a36f4d36-8c48-422d-b6fe-6d12d0edb9f7', 'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:77:14:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:45Z', 'updated_at': '2022-03-24T02:26:49Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:16.985540 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-224246fa-da08-4bf1-8f37-675680c1d436 None None] The sync data for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv is: [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:46Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': 'a36f4d36-8c48-422d-b6fe-6d12d0edb9f7', 'name': '', 'network_id': '912ee513-c0d0-4901-9961-9b70f013b1da', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:77:14:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1470, 'fixed_ips': [{'subnet_id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:45Z', 'updated_at': '2022-03-24T02:26:49Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': '52e16ae2-5c77-43f2-9369-5ff2f989d728', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:30:17.010506 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af0dabbe-5506-467a-b108-255b27bb650f req-e902dbc2-8b2c-4b1f-852c-5751f6525f27 service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0900567 Mar 24 02:30:17.108725 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-af0dabbe-5506-467a-b108-255b27bb650f req-0fdfe874-01a8-460f-b73f-3904f804f8ee service neutron] 10.222.0.30 "GET /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905817 Mar 24 02:30:17.206755 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c0eb012-c32c-4715-9754-af8b85ed8b20 None None] New status for floating IP 3d0b7122-50dc-48e7-a030-4aa34f24b5aa: DOWN {{(pid=104039) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:30:17.910951 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31f867e0-5266-44d6-8144-8110fa8e62d8 req-b327623a-6e4f-4ed7-a739-5613f2f64681 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:17.912400 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-31f867e0-5266-44d6-8144-8110fa8e62d8 req-b327623a-6e4f-4ed7-a739-5613f2f64681 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 946 time: 0.1008065 Mar 24 02:30:17.960343 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-31f867e0-5266-44d6-8144-8110fa8e62d8 req-7d04f27d-c90f-4da8-9eef-5811c7818544 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424612 Mar 24 02:30:18.056960 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-5ef5cc18-e509-4a2f-8729-087b029b617d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:18.058423 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-5ef5cc18-e509-4a2f-8729-087b029b617d tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/ports?device_id=939c498a-9b6a-4aba-83bf-8a57b4d44fa2 HTTP/1.1" status: 200 len: 946 time: 0.0521946 Mar 24 02:30:18.150586 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:30:18.150930 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:18.237605 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:18.237968 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:18.250703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 owned by compute:nova {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:30:18.383060 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (28e11ecf-858c-4b8b-ba0f-f0c136a4f370), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:18.410815 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=28e11ecf-858c-4b8b-ba0f-f0c136a4f370,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:18.456351 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] No DVR routers for this DVR port 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 on host hv-neutron-8348 {{(pid=104037) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:30:18.458788 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:18.462038 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7c1528d8-c2a8-4129-992f-e27e6fe93d1d req-526bcbb2-57a9-459b-addd-128cfaaa0a2c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "DELETE /v2.0/ports/28e11ecf-858c-4b8b-ba0f-f0c136a4f370 HTTP/1.1" status: 204 len: 173 time: 0.3988326 Mar 24 02:30:18.528932 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'name': 'network-vif-deleted', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:30:18.531953 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cdbaa4da-2be4-4ee7-ba01-b3c8afeff41b" -d '{"events": [{"server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "name": "network-vif-deleted", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:30:18.571139 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:30:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ebdc7173-021d-475f-9d28-7e4eca6676a9 x-openstack-request-id: req-ebdc7173-021d-475f-9d28-7e4eca6676a9 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:30:18.571435 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "939c498a-9b6a-4aba-83bf-8a57b4d44fa2", "name": "network-vif-deleted", "tag": "28e11ecf-858c-4b8b-ba0f-f0c136a4f370", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:30:18.571692 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-ebdc7173-021d-475f-9d28-7e4eca6676a9 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:30:18.572107 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-ebdc7173-021d-475f-9d28-7e4eca6676a9'] response: {'server_uuid': '939c498a-9b6a-4aba-83bf-8a57b4d44fa2', 'name': 'network-vif-deleted', 'tag': '28e11ecf-858c-4b8b-ba0f-f0c136a4f370', 'status': 'completed', 'code': 200} Mar 24 02:30:19.015742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36118) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:19.071172 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9aaae4b-c90b-4781-a1de-3c4951759c96 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:19.095887 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9aaae4b-c90b-4781-a1de-3c4951759c96 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:19.157043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9aaae4b-c90b-4781-a1de-3c4951759c96 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:19.159813 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-c9aaae4b-c90b-4781-a1de-3c4951759c96 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:19.161011 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-c9aaae4b-c90b-4781-a1de-3c4951759c96 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/security-groups/d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e HTTP/1.1" status: 204 len: 168 time: 0.1442890 Mar 24 02:30:19.170140 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9aaae4b-c90b-4781-a1de-3c4951759c96 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5ef20a1-1b2d-470c-9b2b-83b44dcffc7e,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:20.204652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36124) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:20.553172 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1622598'] for router_interface (26d517b6-e447-4b18-8e07-91453160827e), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:20.801169 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 {{(pid=104037) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:30:20.801536 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:20.887342 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port a36f4d36-8c48-422d-b6fe-6d12d0edb9f7, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=a36f4d36-8c48-422d-b6fe-6d12d0edb9f7,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104037) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:20.887702 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:20.901620 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.plugin [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 owned by network:router_interface {{(pid=104037) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:30:21.084005 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (a36f4d36-8c48-422d-b6fe-6d12d0edb9f7), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:21.112940 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=a36f4d36-8c48-422d-b6fe-6d12d0edb9f7,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:21.293911 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1600327', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1622518'] for router_interface (26d517b6-e447-4b18-8e07-91453160827e), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:21.818600 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 26d517b6-e447-4b18-8e07-91453160827e has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:30:21.922880 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:30:21.927770 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-b2fb36e4-6b4f-4232-8d1d-7e6f7602a8e6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/26d517b6-e447-4b18-8e07-91453160827e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7221012 Mar 24 02:30:21.930409 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36126) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:21.933005 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] Sync routers for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:30:21.983179 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_v2 [None req-197c26f0-bdc6-4a13-9f2b-d5eb6c59eda7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting subnet 52e16ae2-5c77-43f2-9369-5ff2f989d728 {{(pid=104037) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1066}} Mar 24 02:30:21.986742 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-197c26f0-bdc6-4a13-9f2b-d5eb6c59eda7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (52e16ae2-5c77-43f2-9369-5ff2f989d728), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.028683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-197c26f0-bdc6-4a13-9f2b-d5eb6c59eda7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2192992'] for subnet (52e16ae2-5c77-43f2-9369-5ff2f989d728), precommit_delete_associations {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.087303 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 no longer exists at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:30:22.090378 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:22.091021 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:22.116791 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-197c26f0-bdc6-4a13-9f2b-d5eb6c59eda7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7464788'] for subnet (52e16ae2-5c77-43f2-9369-5ff2f989d728), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.138088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] No Port match for: 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:30:22.138439 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 28e11ecf-858c-4b8b-ba0f-f0c136a4f370 not bound to the agent host hv-neutron-8348 {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:30:22.177714 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-197c26f0-bdc6-4a13-9f2b-d5eb6c59eda7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7464781', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3241118', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9331086'] for subnet (52e16ae2-5c77-43f2-9369-5ff2f989d728), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.207517 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-197c26f0-bdc6-4a13-9f2b-d5eb6c59eda7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.211655 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-197c26f0-bdc6-4a13-9f2b-d5eb6c59eda7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/subnets/52e16ae2-5c77-43f2-9369-5ff2f989d728 HTTP/1.1" status: 204 len: 168 time: 0.2802272 Mar 24 02:30:22.212489 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:22.212689 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-197c26f0-bdc6-4a13-9f2b-d5eb6c59eda7 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Subnet': ['ID=52e16ae2-5c77-43f2-9369-5ff2f989d728,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:22.214337 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36128) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:22.267683 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d003f7e1-f3bd-4ee2-98bc-3dea5429e969 None None] Network 912ee513-c0d0-4901-9961-9b70f013b1da requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:30:22.324290 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (26d517b6-e447-4b18-8e07-91453160827e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.428928 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (26d517b6-e447-4b18-8e07-91453160827e), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.465690 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85'}], 'enable_snat': True}, 'gw_port_id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:30:21Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'd81b4f83-b16c-4840-b8da-b0e9926dade5', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:a0:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26d517b6-e447-4b18-8e07-91453160827e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1467, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:26:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:22.486646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Deleting port d81b4f83-b16c-4840-b8da-b0e9926dade5 {{(pid=104036) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:30:22.486996 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), before_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.493634 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] Checking router: 26d517b6-e447-4b18-8e07-91453160827e for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:30:22.502972 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] Routers {'26d517b6-e447-4b18-8e07-91453160827e'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:22.503577 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['26d517b6-e447-4b18-8e07-91453160827e'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:22.542724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] DHCP port deletion for 912ee513-c0d0-4901-9961-9b70f013b1da request from dv-neutron-834874-3-hyperv {{(pid=104038) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Mar 24 02:30:22.568870 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.db [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] For port d81b4f83-b16c-4840-b8da-b0e9926dade5, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=d81b4f83-b16c-4840-b8da-b0e9926dade5,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104036) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:22.569229 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.582450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.plugin [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Calling delete_port for d81b4f83-b16c-4840-b8da-b0e9926dade5 owned by network:router_gateway {{(pid=104036) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:30:22.620945 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] Set router 26d517b6-e447-4b18-8e07-91453160827e gateway port host: None {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:22.675423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:30:22Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port_host': None}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:22.709048 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e26dbf0-3c57-48eb-b729-76c9479d4bbe None None] The sync data for ids ['26d517b6-e447-4b18-8e07-91453160827e'] in dv-neutron-834874-3-hyperv is: [{'id': '26d517b6-e447-4b18-8e07-91453160827e', 'name': 'tempest-TestNetworkBasicOps-router-1383085056', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:26:43Z', 'updated_at': '2022-03-24T02:30:22Z', 'revision_number': 6, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port_host': None}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:30:22.716473 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Deleting port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 {{(pid=104038) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2002}} Mar 24 02:30:22.716796 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8790618881567'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), before_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.763350 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (d81b4f83-b16c-4840-b8da-b0e9926dade5), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.793043 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Port': ['ID=d81b4f83-b16c-4840-b8da-b0e9926dade5,revision_number=None']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:22.793414 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] For port e640e5d7-bc4a-4ca5-9816-6c88daf36d58, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=e640e5d7-bc4a-4ca5-9816-6c88daf36d58,segment=NetworkSegment(c77ef4f5-b5d0-4072-b43f-d58debdb9fad),segment_id=c77ef4f5-b5d0-4072-b43f-d58debdb9fad)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:22.793827 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1627476'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), precommit_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.811032 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Calling delete_port for e640e5d7-bc4a-4ca5-9816-6c88daf36d58 owned by network:dhcp {{(pid=104038) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2080}} Mar 24 02:30:22.824037 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.824394 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.824744 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.825191 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.825552 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.825888 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.826297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.826573 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.826950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.827283 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.827612 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.827927 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.828369 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.828569 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.828885 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104036) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.876729 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1624076'] for router_gateway (26d517b6-e447-4b18-8e07-91453160827e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.920166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8790618889346', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8790618353156'] for port (e640e5d7-bc4a-4ca5-9816-6c88daf36d58), after_delete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:22.948230 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Pushing event deleted for resources: {'Port': ['ID=e640e5d7-bc4a-4ca5-9816-6c88daf36d58,revision_number=None']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:22.958933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] No DVR routers for this DVR port e640e5d7-bc4a-4ca5-9816-6c88daf36d58 on host dv-neutron-834874-3-hyperv {{(pid=104038) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Mar 24 02:30:22.961109 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.961684 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.962206 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.962992 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.963499 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.964009 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.964520 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.965023 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.965870 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.966379 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.967114 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.967304 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.968166 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.968496 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:22.968824 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d52c95d5-4d61-474a-9bac-41584ce88891 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104038) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:23.018172 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1637856', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2698'] for router (26d517b6-e447-4b18-8e07-91453160827e), precommit_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.020501 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (26d517b6-e447-4b18-8e07-91453160827e), precommit_delete_associations {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.068553 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1637871'] for router (26d517b6-e447-4b18-8e07-91453160827e), after_delete {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.069179 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Fanout notify agent at l3_agent the message router_deleted on router 26d517b6-e447-4b18-8e07-91453160827e {{(pid=104036) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Mar 24 02:30:23.077819 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.082076 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-5f1773e4-5c4c-48b7-927e-8a8476d16b07 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/routers/26d517b6-e447-4b18-8e07-91453160827e HTTP/1.1" status: 204 len: 168 time: 0.8664212 Mar 24 02:30:23.082254 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36132) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:23.166794 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7343387'] for network (912ee513-c0d0-4901-9961-9b70f013b1da), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.256787 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7452897', 'neutron.services.segments.db._delete_segments_for_network-8790618681155'] for network (912ee513-c0d0-4901-9961-9b70f013b1da), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.279323 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['912ee513-c0d0-4901-9961-9b70f013b1da']}} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:23.290026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad') {'for_net_delete': True} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:23.290412 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.services.segments.db [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c77ef4f5-b5d0-4072-b43f-d58debdb9fad') {} {{(pid=104037) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:23.306358 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:30:23.310985 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8790618679884', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2192985'] for segment (c77ef4f5-b5d0-4072-b43f-d58debdb9fad), before_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.325288 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (c77ef4f5-b5d0-4072-b43f-d58debdb9fad), precommit_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.331975 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:30:23.332407 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device a36f4d36-8c48-422d-b6fe-6d12d0edb9f7 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:30:23.332833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e640e5d7-bc4a-4ca5-9816-6c88daf36d58 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:30:23.332971 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=104037) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Mar 24 02:30:23.333214 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3240508'] for segment (c77ef4f5-b5d0-4072-b43f-d58debdb9fad), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: Traceback (most recent call last): Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: timer() Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: cb(*args, **kw) Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: return func(*args, **kwargs) Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: self._notify() Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: self.callback(batched_events) Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: event.method(event) Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_id = self._get_aggregate_id(event.segment_id) Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: aggregate_uuid = self.p_client.list_aggregates( Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: return f(self, *a, **k) Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._get(url).json() Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: return self._client.get(url, endpoint_filter=self._ks_filter, Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: return self.request(url, 'GET', **kwargs) Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: base_url = self.get_endpoint(auth, allow=allow, Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: auth = self._auth_required(auth, 'determine endpoint URL') Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Mar 24 02:30:23.336411 dv-neutron-834874-3-hyperv neutron-server[104037]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Mar 24 02:30:23.352360 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: e640e5d7-bc4a-4ca5-9816-6c88daf36d58 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:30:23.352705 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device e640e5d7-bc4a-4ca5-9816-6c88daf36d58 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:30:23.400786 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7452890', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1624176'] for network (912ee513-c0d0-4901-9961-9b70f013b1da), after_delete {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.407751 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.411211 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "DELETE /v2.0/networks/912ee513-c0d0-4901-9961-9b70f013b1da HTTP/1.1" status: 204 len: 168 time: 0.3274219 Mar 24 02:30:23.423503 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36134) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:23.424296 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ea0c05-d9c2-45af-afd6-9d5f7488ff7b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event deleted for resources: {'Network': ['ID=912ee513-c0d0-4901-9961-9b70f013b1da,revision_number=None']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:23.430023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'network': {'name': 'tempest-network-smoke--1846233649', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'port_security_enabled': True}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:23.449674 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'network': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:30:23.453842 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for network (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.478632 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 108} {{(pid=104036) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Mar 24 02:30:23.489184 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7465549'] for segment (409dd6ae-dfe2-48bd-af92-a71fcc09d3fb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.489529 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.segments_db [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Added segment 409dd6ae-dfe2-48bd-af92-a71fcc09d3fb of type vlan for network 513167f7-2f09-4967-8ab3-31d31374b29d Mar 24 02:30:23.532782 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8790618320954'] for network (513167f7-2f09-4967-8ab3-31d31374b29d), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.561971 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656525', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328'] for network (513167f7-2f09-4967-8ab3-31d31374b29d), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.567011 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:23.567672 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for network (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.630845 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2050979 Mar 24 02:30:23.633644 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36136) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:23.638356 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-454196089', 'admin_state_up': True, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:23.642405 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7cc104e-fee3-477c-a18e-b939bd769846 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Network': ['ID=513167f7-2f09-4967-8ab3-31d31374b29d,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:23.653053 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Network 513167f7-2f09-4967-8ab3-31d31374b29d details requested by agent ovs-agent-dv-neutron-834874-3-hyperv with host dv-neutron-834874-3-hyperv {{(pid=104038) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Mar 24 02:30:23.661265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1636926', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2724'] for router (50f8650b-bc8c-402f-bf9c-bac5b5eb2205), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.662313 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1637806', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1624317', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1581345', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2707'] for router (50f8650b-bc8c-402f-bf9c-bac5b5eb2205), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.714040 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_controller (50f8650b-bc8c-402f-bf9c-bac5b5eb2205), precommit_add_association {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:23.854417 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (50f8650b-bc8c-402f-bf9c-bac5b5eb2205), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:24.044486 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (50f8650b-bc8c-402f-bf9c-bac5b5eb2205), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:24.067947 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:24.175612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.10 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/fb466638-bb6b-4812-a050-d5fd40219808) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:30:24.280958 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (fb466638-bb6b-4812-a050-d5fd40219808), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:24.314429 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (fb466638-bb6b-4812-a050-d5fd40219808), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:24.352319 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:30:24.355198 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:30:24.361982 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:30:24.367578 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=fb466638-bb6b-4812-a050-d5fd40219808,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:24.611819 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router_gateway (50f8650b-bc8c-402f-bf9c-bac5b5eb2205), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:24.807987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1637813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1624104'] for router (50f8650b-bc8c-402f-bf9c-bac5b5eb2205), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:24.882026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d81b4f83-b16c-4840-b8da-b0e9926dade5 no longer exists at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Mar 24 02:30:24.902352 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] No Port match for: d81b4f83-b16c-4840-b8da-b0e9926dade5 {{(pid=104038) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2340}} Mar 24 02:30:24.902798 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device d81b4f83-b16c-4840-b8da-b0e9926dade5 not bound to the agent host dv-neutron-834874-3-hyperv {{(pid=104038) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Mar 24 02:30:24.935347 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 is scheduled to L3 agent 700661ac-903b-4270-9a73-7a0120212663 with binding_index 1 {{(pid=104037) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Mar 24 02:30:25.041407 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:30:25.055988 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Sync routers for ids ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:30:25.065534 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Routers {'50f8650b-bc8c-402f-bf9c-bac5b5eb2205'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:25.066135 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:25.069551 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for router (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.071447 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5613f4fa-0da7-4b23-92e8-e03e3a6e5f22 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 1.4364123 Mar 24 02:30:25.075043 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36138) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:25.107065 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f3ff284c-2889-4a99-80f0-f91ff76a0e51 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?project_id=6c0b7eea99a4423dac22912b1fa60ca2&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0313718 Mar 24 02:30:25.109599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36140) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:25.167906 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Set router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:25.204237 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16f4d6d3-a466-464f-b3ca-f90f8bf0a5e8 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:25.205735 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-16f4d6d3-a466-464f-b3ca-f90f8bf0a5e8 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0952365 Mar 24 02:30:25.208520 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36142) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:25.236051 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-0fae1630-84b1-4039-8287-9bcb8d329e41 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets?network_id=87077e4c-2cae-4de7-847c-fab7ddedd260&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0264976 Mar 24 02:30:25.238642 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36144) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:25.243758 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-910213747', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:25.328857 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'subnet': 1} {{(pid=104036) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:30:25.332273 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3298600'] for subnet (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.346274 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:24Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:25.373104 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Checking router: 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:30:25.373469 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Updating router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 port fb466638-bb6b-4812-a050-d5fd40219808 binding host dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:30:25.402495 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fb466638-bb6b-4812-a050-d5fd40219808), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.522958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1662584', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8966529', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3298622'] for subnet (b99c86c5-5954-49d0-ab58-eaf5fd70ee11), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.585074 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Subnet': ['ID=b99c86c5-5954-49d0-ab58-eaf5fd70ee11,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:25.595557 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Checking segment: {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104036) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:30:25.595921 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network hostable DHCP agents. Network: 513167f7-2f09-4967-8ab3-31d31374b29d, hostable agents: ['8aeface5-bae1-4042-b03b-b97904f320d4'], hosted agents: [] {{(pid=104036) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Mar 24 02:30:25.616028 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 513167f7-2f09-4967-8ab3-31d31374b29d is scheduled to be hosted by DHCP agent 8aeface5-bae1-4042-b03b-b97904f320d4 with binding_index 1 {{(pid=104036) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Mar 24 02:30:25.625626 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-834874-3-hyperv, 513167f7-2f09-4967-8ab3-31d31374b29d) {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:30:25.636863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52e728fb-f573-453f-ae20-8db5393635ff None None] Network 513167f7-2f09-4967-8ab3-31d31374b29d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:30:25.637457 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:25.638048 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for subnet (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.654126 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Publish callbacks [] for port (fb466638-bb6b-4812-a050-d5fd40219808), precommit_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.660575 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-70a1d55a-18ec-4999-99c9-ab01cef87968 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.4183164 Mar 24 02:30:25.660783 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fb466638-bb6b-4812-a050-d5fd40219808), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.661249 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36146) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:25.707746 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Attempting to bind port fb466638-bb6b-4812-a050-d5fd40219808 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:30:25.708118 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Attempting to bind port fb466638-bb6b-4812-a050-d5fd40219808 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:30:25.708474 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Attempting to bind port fb466638-bb6b-4812-a050-d5fd40219808 on network 87077e4c-2cae-4de7-847c-fab7ddedd260 {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:30:25.721541 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 30, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:30:25.721912 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Checking segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104039) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:30:25.722314 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.722736 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Bound using segment: {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'} {{(pid=104039) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:30:25.723214 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.managers [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Bound port: fb466638-bb6b-4812-a050-d5fd40219808, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '264954c7-3886-4156-b0b1-3c7a748de9f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260'}}] {{(pid=104039) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:30:25.723841 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fb466638-bb6b-4812-a050-d5fd40219808), before_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.756094 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Pushing event updated for resources: {'Port': ['ID=fb466638-bb6b-4812-a050-d5fd40219808,revision_number=2']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:25.759129 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp153db93c-524e-5961-a1ad-95666485512a-513167f7-2f09-4967-8ab3-31d31374b29d', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11'}]}} from dv-neutron-834874-3-hyperv. {{(pid=104038) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Mar 24 02:30:25.760104 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.777262 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.777517 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.778071 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.778408 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.778754 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.779079 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.779588 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.779973 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.780288 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.780607 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.780929 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.781246 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.781557 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.781868 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.782178 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104039) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:25.796832 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] For port fb466638-bb6b-4812-a050-d5fd40219808, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104039) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:30:25.800373 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.plugins.ml2.db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] For port fb466638-bb6b-4812-a050-d5fd40219808, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fb466638-bb6b-4812-a050-d5fd40219808,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104039) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:30:25.805918 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron_lib.callbacks.manager [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fb466638-bb6b-4812-a050-d5fd40219808), after_update {{(pid=104039) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:25.881082 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Routers {'50f8650b-bc8c-402f-bf9c-bac5b5eb2205'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:25.881809 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:25.885260 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f462115f-64b2-4028-a134-22130aff4e4b None None] Pushing event updated for resources: {'Port': ['ID=fb466638-bb6b-4812-a050-d5fd40219808,revision_number=3']} {{(pid=104039) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:25.909739 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.db_base_plugin_common [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Allocated IP 172.20.0.2 (513167f7-2f09-4967-8ab3-31d31374b29d/b99c86c5-5954-49d0-ab58-eaf5fd70ee11/15e269e2-dcdd-4612-b6ad-921abbd94bb1) {{(pid=104038) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:30:25.996128 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] Set router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:26.066832 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Publish callbacks [] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), precommit_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:26.074180 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631'] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), after_create {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:26.122064 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Network 513167f7-2f09-4967-8ab3-31d31374b29d is already hosted by enough agents. {{(pid=104038) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:30:26.128749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.scheduler.base_scheduler [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Resources bound (agent type, host, resource id): {{(pid=104038) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:30:26.133257 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Received port after_create {{(pid=104038) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:30:26.136452 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Pushing event updated for resources: {'Port': ['ID=15e269e2-dcdd-4612-b6ad-921abbd94bb1,revision_number=1']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:26.191272 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Attempting to bind port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:30:26.191644 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Attempting to bind port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:30:26.192009 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Attempting to bind port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 on network 513167f7-2f09-4967-8ab3-31d31374b29d {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:30:26.197309 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 30, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:30:26.197682 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Checking segment: {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:30:26.198088 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:26.198481 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Bound using segment: {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:30:26.198982 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Bound port: 15e269e2-dcdd-4612-b6ad-921abbd94bb1, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:30:26.199386 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:26.213335 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:24Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:26.239771 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c368904-06b4-4b7f-b60c-cea6634582e1 None None] The sync data for ids ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'] in dv-neutron-834874-3-hyperv is: [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:24Z', 'revision_number': 3, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv'}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:30:26.265092 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] For port 15e269e2-dcdd-4612-b6ad-921abbd94bb1, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:30:26.268530 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] For port 15e269e2-dcdd-4612-b6ad-921abbd94bb1, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=15e269e2-dcdd-4612-b6ad-921abbd94bb1,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:30:26.279209 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:26.345042 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-452b272c-9ffd-42d3-ae2a-c1236869fe1b None None] Pushing event updated for resources: {'Port': ['ID=15e269e2-dcdd-4612-b6ad-921abbd94bb1,revision_number=2']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:26.447162 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:26.788586 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.1 (513167f7-2f09-4967-8ab3-31d31374b29d/b99c86c5-5954-49d0-ab58-eaf5fd70ee11/319b9254-2709-4310-8e0c-37e2f3d15386) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:30:26.921077 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (319b9254-2709-4310-8e0c-37e2f3d15386), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:26.956036 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:26.995689 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fb466638-bb6b-4812-a050-d5fd40219808 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:30:27.012945 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 513167f7-2f09-4967-8ab3-31d31374b29d is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:30:27.016817 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:30:27.023911 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:30:27.030564 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=319b9254-2709-4310-8e0c-37e2f3d15386,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:27.057759 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fb466638-bb6b-4812-a050-d5fd40219808 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:27.058241 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fb466638-bb6b-4812-a050-d5fd40219808), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.100371 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1622781'] for router_interface (50f8650b-bc8c-402f-bf9c-bac5b5eb2205), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.155846 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fb466638-bb6b-4812-a050-d5fd40219808 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:27.156318 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (fb466638-bb6b-4812-a050-d5fd40219808), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.186883 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port fb466638-bb6b-4812-a050-d5fd40219808, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=fb466638-bb6b-4812-a050-d5fd40219808,segment=NetworkSegment(264954c7-3886-4156-b0b1-3c7a748de9f9),segment_id=264954c7-3886-4156-b0b1-3c7a748de9f9)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:27.194184 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (fb466638-bb6b-4812-a050-d5fd40219808), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.195707 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 15e269e2-dcdd-4612-b6ad-921abbd94bb1 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:30:27.274445 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.302143 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=fb466638-bb6b-4812-a050-d5fd40219808,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:27.306027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:27.306470 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.385225 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:27.385625 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.577963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (319b9254-2709-4310-8e0c-37e2f3d15386), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.582887 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.588355 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18880633-9c04-42be-8387-4620f0d0005a None None] Network 513167f7-2f09-4967-8ab3-31d31374b29d requested from dv-neutron-834874-3-hyperv {{(pid=104038) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Mar 24 02:30:27.595962 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] For port 15e269e2-dcdd-4612-b6ad-921abbd94bb1, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=15e269e2-dcdd-4612-b6ad-921abbd94bb1,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:27.631839 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-8acbfce4-49cf-499b-8d39-fa6561ef8903 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.634029 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.660130 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1600350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1622633'] for router_interface (50f8650b-bc8c-402f-bf9c-bac5b5eb2205), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.661990 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=319b9254-2709-4310-8e0c-37e2f3d15386,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:27.687193 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-20011d72-3b52-4c21-8c08-8c2c624254a1 None None] Provisioning complete for port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:27.687572 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-20011d72-3b52-4c21-8c08-8c2c624254a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:27.749725 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Pushing event updated for resources: {'Port': ['ID=15e269e2-dcdd-4612-b6ad-921abbd94bb1,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:27.776822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 513167f7-2f09-4967-8ab3-31d31374b29d is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:30:27.778811 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:30:27.833077 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-20011d72-3b52-4c21-8c08-8c2c624254a1 None None] Current status of the port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:27.931444 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:30:28.126101 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:30:28.143801 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-b6cf1e99-0ed6-448c-9191-e96ccc805dc0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "PUT /v2.0/routers/50f8650b-bc8c-402f-bf9c-bac5b5eb2205/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4812744 Mar 24 02:30:28.143983 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36148) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:28.166105 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b18ade33-6904-4936-bd0a-b49a23059ae4 None None] Provisioning complete for port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:28.166648 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b18ade33-6904-4936-bd0a-b49a23059ae4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:28.209943 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Sync routers for ids ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'] in dv-neutron-834874-3-hyperv {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:30:28.251666 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Routers {'50f8650b-bc8c-402f-bf9c-bac5b5eb2205'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:28.252200 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:28.301767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66b67c9a-cae7-4f5e-a6d5-c04024d89959 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:28.302501 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66b67c9a-cae7-4f5e-a6d5-c04024d89959 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:28.303130 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66b67c9a-cae7-4f5e-a6d5-c04024d89959 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:28.303607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66b67c9a-cae7-4f5e-a6d5-c04024d89959 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:28.305376 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-66b67c9a-cae7-4f5e-a6d5-c04024d89959 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2886 time: 0.1606946 Mar 24 02:30:28.308014 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36150) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:28.375770 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26cba76e-f73f-4601-9bd5-9a7537af1c61 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:28.376632 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26cba76e-f73f-4601-9bd5-9a7537af1c61 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:28.377248 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26cba76e-f73f-4601-9bd5-9a7537af1c61 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:28.377878 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26cba76e-f73f-4601-9bd5-9a7537af1c61 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:28.379763 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-26cba76e-f73f-4601-9bd5-9a7537af1c61 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2727 time: 0.0708339 Mar 24 02:30:28.382694 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36152) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:28.383287 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b18ade33-6904-4936-bd0a-b49a23059ae4 None None] Current status of the port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:28.411218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-b18ade33-6904-4936-bd0a-b49a23059ae4 None None] Provisioning complete for port 319b9254-2709-4310-8e0c-37e2f3d15386 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:28.411623 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-b18ade33-6904-4936-bd0a-b49a23059ae4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:28.449807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-b18ade33-6904-4936-bd0a-b49a23059ae4 None None] Port 319b9254-2709-4310-8e0c-37e2f3d15386 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:30:28.464488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Set router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:28.551201 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-8e7e8200-e99d-45cb-b16f-2f874e480beb tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1606 time: 0.1666064 Mar 24 02:30:28.621630 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-ebafbc98-d0ee-4739-92f6-0ce16a0d8439 None None] Provisioning complete for port 319b9254-2709-4310-8e0c-37e2f3d15386 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:28.622302 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ebafbc98-d0ee-4739-92f6-0ce16a0d8439 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:28.664063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-ebafbc98-d0ee-4739-92f6-0ce16a0d8439 None None] Port 319b9254-2709-4310-8e0c-37e2f3d15386 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:30:28.745834 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '319b9254-2709-4310-8e0c-37e2f3d15386', 'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:43:bd:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_interface', 'standard_attr_id': 1489, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:26Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 2, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:28.775713 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Checking router: 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 for host: dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:30:28.776063 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Updating router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 port 319b9254-2709-4310-8e0c-37e2f3d15386 binding host dv-neutron-834874-3-hyperv {{(pid=104038) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Mar 24 02:30:28.806734 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d9391d48-7a21-4f43-ba72-83aa15d72218 None None] Provisioning complete for port 319b9254-2709-4310-8e0c-37e2f3d15386 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:28.807108 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d9391d48-7a21-4f43-ba72-83aa15d72218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:28.811124 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:28.874802 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d9391d48-7a21-4f43-ba72-83aa15d72218 None None] Port 319b9254-2709-4310-8e0c-37e2f3d15386 cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:30:28.973958 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device fb466638-bb6b-4812-a050-d5fd40219808 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:30:29.081696 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port fb466638-bb6b-4812-a050-d5fd40219808 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:29.082101 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (fb466638-bb6b-4812-a050-d5fd40219808), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.153474 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36156) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:29.160296 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8e72db34-1103-4796-add9-58aa270123ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1356064588', 'description': 'tempest-secgroup-smoke-1356064588 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:29.183664 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e72db34-1103-4796-add9-58aa270123ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.227163 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port fb466638-bb6b-4812-a050-d5fd40219808 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:29.228148 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 15e269e2-dcdd-4612-b6ad-921abbd94bb1 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:30:29.252165 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e72db34-1103-4796-add9-58aa270123ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (6a8d97d5-b1c3-4063-aec0-cc06feadd820), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.257628 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e72db34-1103-4796-add9-58aa270123ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (6a8d97d5-b1c3-4063-aec0-cc06feadd820), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.269351 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Publish callbacks [] for port (319b9254-2709-4310-8e0c-37e2f3d15386), precommit_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.278440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.287515 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8e72db34-1103-4796-add9-58aa270123ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.291716 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36158) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:29.292233 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8e72db34-1103-4796-add9-58aa270123ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1382341 Mar 24 02:30:29.297494 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5cba3862-da03-47e7-8f06-ad226022725a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6a8d97d5-b1c3-4063-aec0-cc06feadd820', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:29.300745 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e72db34-1103-4796-add9-58aa270123ba tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6a8d97d5-b1c3-4063-aec0-cc06feadd820,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:29.327828 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f40b70-dad4-443c-94a7-6677eefa8003 None None] Pushing event updated for resources: {'Port': ['ID=319b9254-2709-4310-8e0c-37e2f3d15386,revision_number=3']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:29.329329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5cba3862-da03-47e7-8f06-ad226022725a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (ec95deb7-ff05-499f-8cfb-0c93e7d9e8fe), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.378553 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:29.378553 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (15e269e2-dcdd-4612-b6ad-921abbd94bb1), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.428469 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Attempting to bind port 319b9254-2709-4310-8e0c-37e2f3d15386 on host dv-neutron-834874-3-hyperv for vnic_type normal with profile {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:30:29.428842 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Attempting to bind port 319b9254-2709-4310-8e0c-37e2f3d15386 by drivers openvswitch,hyperv on host dv-neutron-834874-3-hyperv at level 0 using segments [{'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:30:29.429215 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Attempting to bind port 319b9254-2709-4310-8e0c-37e2f3d15386 on network 513167f7-2f09-4967-8ab3-31d31374b29d {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:30:29.440773 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Checking agent: {'id': '8133f75a-3236-4200-aa56-d8deaa4bd072', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-834874-3-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 4, 4), 'started_at': datetime.datetime(2022, 3, 24, 2, 4, 34), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 30, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-834874-3-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'Agent': '1.1', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'NDPProxy': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.3', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:30:29.441144 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Checking segment: {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104038) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:30:29.441551 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.441934 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Bound using segment: {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'} {{(pid=104038) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:30:29.442079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5cba3862-da03-47e7-8f06-ad226022725a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (ec95deb7-ff05-499f-8cfb-0c93e7d9e8fe), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.442398 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.managers [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Bound port: 319b9254-2709-4310-8e0c-37e2f3d15386, host: dv-neutron-834874-3-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'}}] {{(pid=104038) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:30:29.442862 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.449228 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5cba3862-da03-47e7-8f06-ad226022725a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (ec95deb7-ff05-499f-8cfb-0c93e7d9e8fe), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.469631 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cba3862-da03-47e7-8f06-ad226022725a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ec95deb7-ff05-499f-8cfb-0c93e7d9e8fe,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:29.494485 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5cba3862-da03-47e7-8f06-ad226022725a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.499079 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5cba3862-da03-47e7-8f06-ad226022725a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2056422 Mar 24 02:30:29.501922 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36160) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:29.512696 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-55a27231-a375-4d84-a4c6-8574fe20617c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6a8d97d5-b1c3-4063-aec0-cc06feadd820', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:29.543504 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 15e269e2-dcdd-4612-b6ad-921abbd94bb1 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:29.551148 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55a27231-a375-4d84-a4c6-8574fe20617c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c97ebcfe-6356-4ad6-9c5b-cebdcfa9771d), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.556131 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] For port 319b9254-2709-4310-8e0c-37e2f3d15386, host dv-neutron-834874-3-hyperv, cleared binding levels {{(pid=104038) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:30:29.559317 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] For port 319b9254-2709-4310-8e0c-37e2f3d15386, host dv-neutron-834874-3-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=319b9254-2709-4310-8e0c-37e2f3d15386,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:30:29.572369 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.626619 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55a27231-a375-4d84-a4c6-8574fe20617c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (c97ebcfe-6356-4ad6-9c5b-cebdcfa9771d), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.631203 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55a27231-a375-4d84-a4c6-8574fe20617c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (c97ebcfe-6356-4ad6-9c5b-cebdcfa9771d), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.631757 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Routers {'50f8650b-bc8c-402f-bf9c-bac5b5eb2205'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104038) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:29.633085 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'], 'active': True} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:29.649266 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55a27231-a375-4d84-a4c6-8574fe20617c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c97ebcfe-6356-4ad6-9c5b-cebdcfa9771d,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:29.660278 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-55a27231-a375-4d84-a4c6-8574fe20617c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.661562 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-55a27231-a375-4d84-a4c6-8574fe20617c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1567802 Mar 24 02:30:29.664487 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36162) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:29.669111 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-84fa1068-9cc4-4a3a-96e4-80228c30051b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6a8d97d5-b1c3-4063-aec0-cc06feadd820', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:29.703522 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84fa1068-9cc4-4a3a-96e4-80228c30051b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (1bb46e1b-0250-46dc-8fdd-e152d117cda4), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.776024 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84fa1068-9cc4-4a3a-96e4-80228c30051b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (1bb46e1b-0250-46dc-8fdd-e152d117cda4), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.781822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84fa1068-9cc4-4a3a-96e4-80228c30051b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (1bb46e1b-0250-46dc-8fdd-e152d117cda4), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.803840 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84fa1068-9cc4-4a3a-96e4-80228c30051b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1bb46e1b-0250-46dc-8fdd-e152d117cda4,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:29.813646 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-84fa1068-9cc4-4a3a-96e4-80228c30051b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.817585 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-84fa1068-9cc4-4a3a-96e4-80228c30051b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1495118 Mar 24 02:30:29.817894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36164) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:29.822703 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-e9a0f317-4f08-46b6-bf64-bef21eb89140 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6a8d97d5-b1c3-4063-aec0-cc06feadd820', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:29.851585 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e9a0f317-4f08-46b6-bf64-bef21eb89140 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (54ce7fb2-ed8d-4d8a-aaf2-47dde61a3d1e), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.867462 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f40b70-dad4-443c-94a7-6677eefa8003 None None] Pushing event updated for resources: {'Port': ['ID=319b9254-2709-4310-8e0c-37e2f3d15386,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:29.892440 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-024987cf-d1d7-4942-b903-badacaf5a7cf None None] Provisioning complete for port 319b9254-2709-4310-8e0c-37e2f3d15386 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:29.892808 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-024987cf-d1d7-4942-b903-badacaf5a7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.913085 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e9a0f317-4f08-46b6-bf64-bef21eb89140 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (54ce7fb2-ed8d-4d8a-aaf2-47dde61a3d1e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.919397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e9a0f317-4f08-46b6-bf64-bef21eb89140 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (54ce7fb2-ed8d-4d8a-aaf2-47dde61a3d1e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.936223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9a0f317-4f08-46b6-bf64-bef21eb89140 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=54ce7fb2-ed8d-4d8a-aaf2-47dde61a3d1e,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:29.946051 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-e9a0f317-4f08-46b6-bf64-bef21eb89140 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:29.947659 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-e9a0f317-4f08-46b6-bf64-bef21eb89140 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1283853 Mar 24 02:30:29.950042 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36166) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:29.954902 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-efdfcc45-01b9-46c6-874b-e58ab27eeae1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6a8d97d5-b1c3-4063-aec0-cc06feadd820', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:29.956797 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_dvr_db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] Set router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104038) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:29.975202 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.securitygroups_db [None req-efdfcc45-01b9-46c6-874b-e58ab27eeae1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:30:29.980027 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-efdfcc45-01b9-46c6-874b-e58ab27eeae1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7b2e475d-26d0-49bd-81be-d865a138d7e2), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.040917 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-efdfcc45-01b9-46c6-874b-e58ab27eeae1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (7b2e475d-26d0-49bd-81be-d865a138d7e2), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.044778 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-efdfcc45-01b9-46c6-874b-e58ab27eeae1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (7b2e475d-26d0-49bd-81be-d865a138d7e2), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.062870 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efdfcc45-01b9-46c6-874b-e58ab27eeae1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7b2e475d-26d0-49bd-81be-d865a138d7e2,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:30.080735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-efdfcc45-01b9-46c6-874b-e58ab27eeae1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.081997 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-efdfcc45-01b9-46c6-874b-e58ab27eeae1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1309888 Mar 24 02:30:30.085135 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36168) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:30.089953 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-8bfa6484-4c4d-4d6d-8768-6756b122edf8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': '6a8d97d5-b1c3-4063-aec0-cc06feadd820', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:30.104551 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-024987cf-d1d7-4942-b903-badacaf5a7cf None None] Current status of the port 319b9254-2709-4310-8e0c-37e2f3d15386 is: DOWN; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:30.104940 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-024987cf-d1d7-4942-b903-badacaf5a7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.110774 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-8bfa6484-4c4d-4d6d-8768-6756b122edf8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:30:30.116221 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8bfa6484-4c4d-4d6d-8768-6756b122edf8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (a8fa7009-2b80-41b7-bbd6-12eac346b358), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.167251 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-024987cf-d1d7-4942-b903-badacaf5a7cf None None] For port 319b9254-2709-4310-8e0c-37e2f3d15386, host dv-neutron-834874-3-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-834874-3-hyperv',level=0,port_id=319b9254-2709-4310-8e0c-37e2f3d15386,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:30.173214 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-024987cf-d1d7-4942-b903-badacaf5a7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.177773 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8bfa6484-4c4d-4d6d-8768-6756b122edf8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (a8fa7009-2b80-41b7-bbd6-12eac346b358), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.181087 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8bfa6484-4c4d-4d6d-8768-6756b122edf8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (a8fa7009-2b80-41b7-bbd6-12eac346b358), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.196734 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bfa6484-4c4d-4d6d-8768-6756b122edf8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a8fa7009-2b80-41b7-bbd6-12eac346b358,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:30.209122 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-8bfa6484-4c4d-4d6d-8768-6756b122edf8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.210679 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-8bfa6484-4c4d-4d6d-8768-6756b122edf8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1242573 Mar 24 02:30:30.249744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-024987cf-d1d7-4942-b903-badacaf5a7cf None None] Pushing event updated for resources: {'Port': ['ID=319b9254-2709-4310-8e0c-37e2f3d15386,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:30.265027 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.l3_hamode_db [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '319b9254-2709-4310-8e0c-37e2f3d15386', 'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:43:bd:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_interface', 'standard_attr_id': 1489, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:26Z', 'updated_at': '2022-03-24T02:30:29Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104038) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:30.301809 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6373c17a-4059-4dda-bbc9-bed5855c69b5 None None] The sync data for ids ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'] in dv-neutron-834874-3-hyperv is: [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_interfaces': [{'id': '319b9254-2709-4310-8e0c-37e2f3d15386', 'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:43:bd:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_interface', 'standard_attr_id': 1489, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:26Z', 'updated_at': '2022-03-24T02:30:29Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104038) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:30:30.313880 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-d19bd3cd-cab8-40b6-b6e3-af62db58f2cd None None] Provisioning complete for port 319b9254-2709-4310-8e0c-37e2f3d15386 triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:30.314402 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-d19bd3cd-cab8-40b6-b6e3-af62db58f2cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.420749 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-d19bd3cd-cab8-40b6-b6e3-af62db58f2cd None None] Current status of the port 319b9254-2709-4310-8e0c-37e2f3d15386 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:30.442014 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-8de4f00a-61a4-438f-9bc5-39dc320b1262 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1356064588&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.0541856 Mar 24 02:30:30.533745 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-168dc786-ebbe-47f4-8ab6-11ed8fb2e3de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.562106 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-23951853-2e2b-4337-90c6-240c228fbfa2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:30.563715 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-23951853-2e2b-4337-90c6-240c228fbfa2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 797 time: 0.1142831 Mar 24 02:30:30.579027 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-e93b90af-1bc7-4af6-92c0-082b66f2cca3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/quotas/6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 375 time: 0.0097473 Mar 24 02:30:30.638110 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-b82a9b70-8bd4-4135-a3c2-95aa1ceff435 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0533509 Mar 24 02:30:30.778589 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-826d24ad-4f7c-4bfd-87e5-f3e6381b00d9 service neutron] 10.222.0.20 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1284580 Mar 24 02:30:30.874427 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-61edf9f2-e2e1-467d-a143-44b320edab3b service neutron] 10.222.0.20 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889821 Mar 24 02:30:30.918025 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:30.981224 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Device 319b9254-2709-4310-8e0c-37e2f3d15386 up at agent ovs-agent-dv-neutron-834874-3-hyperv {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:30:31.037472 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Provisioning complete for port 319b9254-2709-4310-8e0c-37e2f3d15386 triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:31.037839 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (319b9254-2709-4310-8e0c-37e2f3d15386), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:31.080376 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2f96f116-d91b-4b23-adc6-a76b51f4b666 req-f09a3ada-7930-4e11-9d84-3ccbd7ac1d27 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 210 time: 0.0507705 Mar 24 02:30:31.122968 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Current status of the port 319b9254-2709-4310-8e0c-37e2f3d15386 is: ACTIVE; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:32.158347 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7ebd9ec2-141e-4d13-836d-96e4d36896ce req-7e9e5a89-6027-4133-a22d-83a24ad255e9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 210 time: 0.0291758 Mar 24 02:30:32.472182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:33.236166 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9e21c4f8-bea2-4b08-b626-a50dd2dd366a req-8aedad6b-f3ec-4ed2-9e2a-6b681eab5f64 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 210 time: 0.0311329 Mar 24 02:30:33.736886 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:33.985954 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:30:34.311829 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0a5e3fae-da18-4466-ace0-aa9d90bb1675 req-9658b00f-674b-46ff-9967-42334ee80f58 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 210 time: 0.0259011 Mar 24 02:30:35.406962 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-50045b6d-e36b-4e17-9af6-29dd73308946 req-ca31a583-0b9f-489c-a353-a23614c35ea3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 210 time: 0.0305119 Mar 24 02:30:36.441669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-f863d4c2-624c-4649-af1e-93a5d34e0ed6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:36.443132 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-f863d4c2-624c-4649-af1e-93a5d34e0ed6 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 797 time: 0.4261060 Mar 24 02:30:36.516675 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d3eea8d6-aba1-4ae7-8add-a502a2436bd8 req-826d66d7-b735-4e15-b93c-9a37aef4114e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 210 time: 0.0399642 Mar 24 02:30:36.536386 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-9f6114d5-9897-473e-ae2e-4c8a5a24ee28 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 380 time: 0.0838206 Mar 24 02:30:36.545895 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'device_id': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'admin_state_up': True, 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'security_groups': ['6a8d97d5-b1c3-4063-aec0-cc06feadd820']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:36.652735 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:30:36.656366 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:36.776835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.7 (513167f7-2f09-4967-8ab3-31d31374b29d/b99c86c5-5954-49d0-ab58-eaf5fd70ee11/0458383f-f9f4-4fcb-b044-155164c4847c) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:30:36.914799 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (0458383f-f9f4-4fcb-b044-155164c4847c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:36.947505 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:36.988385 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 513167f7-2f09-4967-8ab3-31d31374b29d is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:30:36.991393 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:30:36.997704 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:30:37.022213 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=0458383f-f9f4-4fcb-b044-155164c4847c,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:37.037361 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.037629 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Agent changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.037974 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.038317 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.038675 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.039008 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type NDPProxy changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.039329 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.039652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.039975 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type PortForwarding changed None to 1.3 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.040294 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.040615 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.040936 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.041251 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.041566 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.041879 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-834874-3-hyperv {{(pid=104037) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Mar 24 02:30:37.060965 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:37.061607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:37.078902 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-6604c38d-65da-444a-8d5a-af0ca55c588f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5369720 Mar 24 02:30:37.089861 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Request body: {'port': {'device_id': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:37.155612 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:37.242590 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-806560ab-80b2-4768-9ac8-641f6584277f None None] Provisioning complete for port 0458383f-f9f4-4fcb-b044-155164c4847c triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:37.243693 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-806560ab-80b2-4768-9ac8-641f6584277f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:37.277863 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-806560ab-80b2-4768-9ac8-641f6584277f None None] Port 0458383f-f9f4-4fcb-b044-155164c4847c cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:30:37.417730 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0458383f-f9f4-4fcb-b044-155164c4847c {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:30:37.425443 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Publish callbacks [] for port (0458383f-f9f4-4fcb-b044-155164c4847c), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:37.438904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Transition to ACTIVE for port object 0458383f-f9f4-4fcb-b044-155164c4847c will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:30:37.442725 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:37.493652 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Pushing event updated for resources: {'Port': ['ID=0458383f-f9f4-4fcb-b044-155164c4847c,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:37.568789 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Attempting to bind port 0458383f-f9f4-4fcb-b044-155164c4847c on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:30:37.569270 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Attempting to bind port 0458383f-f9f4-4fcb-b044-155164c4847c by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:30:37.569611 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Attempting to bind port 0458383f-f9f4-4fcb-b044-155164c4847c on network 513167f7-2f09-4967-8ab3-31d31374b29d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:30:37.574816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Port 0458383f-f9f4-4fcb-b044-155164c4847c on network 513167f7-2f09-4967-8ab3-31d31374b29d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:30:37.575137 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Attempting to bind port 0458383f-f9f4-4fcb-b044-155164c4847c on network 513167f7-2f09-4967-8ab3-31d31374b29d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:30:37.580741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 30, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:30:37.581083 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Checking segment: {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:30:37.581607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Bound using segment: {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:30:37.582041 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Bound port: 0458383f-f9f4-4fcb-b044-155164c4847c, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:30:37.582399 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:37.684816 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fa16b25-0126-4745-b032-e81d1771f0cc req-a84c9929-9298-4148-896d-a5bb1bc7c55a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:37.686785 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3fa16b25-0126-4745-b032-e81d1771f0cc req-a84c9929-9298-4148-896d-a5bb1bc7c55a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 943 time: 0.0945790 Mar 24 02:30:37.690460 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] For port 0458383f-f9f4-4fcb-b044-155164c4847c, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:30:37.694067 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] For port 0458383f-f9f4-4fcb-b044-155164c4847c, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=0458383f-f9f4-4fcb-b044-155164c4847c,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:30:37.704973 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:37.766125 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:37.766772 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:37.768174 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] 10.222.0.30 "PUT /v2.0/ports/0458383f-f9f4-4fcb-b044-155164c4847c HTTP/1.1" status: 200 len: 1093 time: 0.6826978 Mar 24 02:30:37.768752 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'tag': '0458383f-f9f4-4fcb-b044-155164c4847c'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:30:37.770882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49837f7d-928b-46df-b7f2-c36215583083" -d '{"events": [{"name": "network-changed", "server_uuid": "2bbcd9e1-d232-462d-9e85-ca96ba83d61a", "tag": "0458383f-f9f4-4fcb-b044-155164c4847c"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:30:37.808155 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3fa16b25-0126-4745-b032-e81d1771f0cc req-d8192adf-9389-4dd3-872d-6869103a4f43 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1124597 Mar 24 02:30:37.837601 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:30:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b67279b-2834-4c3f-a42b-7f286eef2866 x-openstack-request-id: req-9b67279b-2834-4c3f-a42b-7f286eef2866 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:30:37.837899 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2bbcd9e1-d232-462d-9e85-ca96ba83d61a", "tag": "0458383f-f9f4-4fcb-b044-155164c4847c", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:30:37.838157 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-9b67279b-2834-4c3f-a42b-7f286eef2866 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:30:37.838590 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-9b67279b-2834-4c3f-a42b-7f286eef2866'] response: {'name': 'network-changed', 'server_uuid': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'tag': '0458383f-f9f4-4fcb-b044-155164c4847c', 'status': 'completed', 'code': 200} Mar 24 02:30:37.840614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b723b2-7468-4ad3-bf1f-507621dee4fb service neutron] Pushing event updated for resources: {'Port': ['ID=0458383f-f9f4-4fcb-b044-155164c4847c,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:37.863967 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c23d46f0-5aeb-4cb6-9115-30b62d919701 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:37.865602 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c23d46f0-5aeb-4cb6-9115-30b62d919701 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 1127 time: 0.0565856 Mar 24 02:30:37.912464 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-d36b16fe-19c9-4d60-8b12-6e772ff1b0eb service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0458383f-f9f4-4fcb-b044-155164c4847c HTTP/1.1" status: 200 len: 217 time: 0.0408609 Mar 24 02:30:37.962347 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-afd03bec-636a-4b9a-84e0-5b96902dafb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:37.963893 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-afd03bec-636a-4b9a-84e0-5b96902dafb1 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0454695 Mar 24 02:30:38.014209 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-a4fd991e-8a8e-49d4-ab90-3221f685d4c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:38.015777 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-a4fd991e-8a8e-49d4-ab90-3221f685d4c4 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0455744 Mar 24 02:30:38.106098 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-9c85aa62-9e80-45f7-be8e-5942d81ae477 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840583 Mar 24 02:30:38.193186 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-19936539-7f43-4f05-a65d-7b8b7470e496 req-c3f0f50a-ec56-4909-8053-9bf2657cafb1 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815032 Mar 24 02:30:38.281679 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49837f7d-928b-46df-b7f2-c36215583083 req-3ff40b7a-300c-4d5b-8fda-182021dbae07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:38.283100 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49837f7d-928b-46df-b7f2-c36215583083 req-3ff40b7a-300c-4d5b-8fda-182021dbae07 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 1127 time: 0.0444708 Mar 24 02:30:38.376077 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49837f7d-928b-46df-b7f2-c36215583083 req-b68f9d34-b5e9-45a6-9eca-4b25062da69c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:38.377521 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49837f7d-928b-46df-b7f2-c36215583083 req-b68f9d34-b5e9-45a6-9eca-4b25062da69c service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.0887039 Mar 24 02:30:38.417640 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49837f7d-928b-46df-b7f2-c36215583083 req-d9d9117e-28c3-47b3-9c88-deccbac58984 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0458383f-f9f4-4fcb-b044-155164c4847c HTTP/1.1" status: 200 len: 217 time: 0.0343871 Mar 24 02:30:38.468354 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49837f7d-928b-46df-b7f2-c36215583083 req-1b5d61ed-4383-47b3-bb26-d0b73b5bdde2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:38.469780 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49837f7d-928b-46df-b7f2-c36215583083 req-1b5d61ed-4383-47b3-bb26-d0b73b5bdde2 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0463600 Mar 24 02:30:38.516805 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49837f7d-928b-46df-b7f2-c36215583083 req-d40058e4-3c47-4f53-9630-4f994506ea86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:38.518310 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49837f7d-928b-46df-b7f2-c36215583083 req-d40058e4-3c47-4f53-9630-4f994506ea86 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0428965 Mar 24 02:30:38.604674 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49837f7d-928b-46df-b7f2-c36215583083 req-31a0c5fd-6672-4fa3-a7fd-f2435504934d service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800900 Mar 24 02:30:38.698007 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49837f7d-928b-46df-b7f2-c36215583083 req-966602a0-0ae0-4a66-93b9-6c12ea5f4f39 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863838 Mar 24 02:30:38.931915 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966c6b17-b7ec-4a79-9a5e-c2fd47cbaaac req-bf565b25-848c-4c1e-981a-0ed279795502 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:38.933380 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-966c6b17-b7ec-4a79-9a5e-c2fd47cbaaac req-bf565b25-848c-4c1e-981a-0ed279795502 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 943 time: 0.0522940 Mar 24 02:30:38.980922 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-966c6b17-b7ec-4a79-9a5e-c2fd47cbaaac req-219d58c8-5502-48b4-b970-8f2b57e13016 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413182 Mar 24 02:30:40.104825 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b4a95c-0380-481a-87f7-0843d06ac42a req-5e1f4fe7-1cdb-4101-869b-2ea767240bea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:40.106985 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-29b4a95c-0380-481a-87f7-0843d06ac42a req-5e1f4fe7-1cdb-4101-869b-2ea767240bea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 943 time: 0.0607510 Mar 24 02:30:40.168781 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-29b4a95c-0380-481a-87f7-0843d06ac42a req-10f1f76a-5e70-4374-9cde-79026dd37c28 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0560272 Mar 24 02:30:41.284253 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f165de34-8930-4c77-abac-30614481232a req-e193bffb-d01b-46b8-aa43-5245b9fc6e57 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:41.285715 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f165de34-8930-4c77-abac-30614481232a req-e193bffb-d01b-46b8-aa43-5245b9fc6e57 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 943 time: 0.0516977 Mar 24 02:30:41.332924 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-f165de34-8930-4c77-abac-30614481232a req-65ba8f0e-8b41-42f7-b9b9-af8f6ab1a213 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417049 Mar 24 02:30:42.096776 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 0458383f-f9f4-4fcb-b044-155164c4847c details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:30:42.192446 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 0458383f-f9f4-4fcb-b044-155164c4847c, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=0458383f-f9f4-4fcb-b044-155164c4847c,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:42.203816 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': '0458383f-f9f4-4fcb-b044-155164c4847c', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'port_id': '0458383f-f9f4-4fcb-b044-155164c4847c', 'mac_address': 'fa:16:3e:8f:fb:e4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:30:42.239742 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 0458383f-f9f4-4fcb-b044-155164c4847c is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:42.240128 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:42.252775 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0458383f-f9f4-4fcb-b044-155164c4847c {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:30:42.270649 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 0458383f-f9f4-4fcb-b044-155164c4847c, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=0458383f-f9f4-4fcb-b044-155164c4847c,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:42.274469 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:42.318926 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=0458383f-f9f4-4fcb-b044-155164c4847c,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:42.450144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee6ea4f-2b17-4b94-aa65-3512a5bbfcd6 req-470dc485-4c61-468c-b56e-bb2c7f1a2693 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:42.451723 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4ee6ea4f-2b17-4b94-aa65-3512a5bbfcd6 req-470dc485-4c61-468c-b56e-bb2c7f1a2693 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 944 time: 0.0529478 Mar 24 02:30:42.499982 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4ee6ea4f-2b17-4b94-aa65-3512a5bbfcd6 req-97339ecf-8507-43b1-a72b-242f1e8228d3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426328 Mar 24 02:30:42.666991 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['0458383f-f9f4-4fcb-b044-155164c4847c'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:30:43.621499 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809463be-a29e-4a19-8dd2-173d72019f31 req-93507eec-317f-4337-b745-9afacaf34f50 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:43.623037 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-809463be-a29e-4a19-8dd2-173d72019f31 req-93507eec-317f-4337-b745-9afacaf34f50 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 944 time: 0.0562429 Mar 24 02:30:43.671247 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-809463be-a29e-4a19-8dd2-173d72019f31 req-cab93ead-1252-4f8c-acc7-7a19679cd945 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426455 Mar 24 02:30:44.096807 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device 0458383f-f9f4-4fcb-b044-155164c4847c up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:30:44.147026 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port 0458383f-f9f4-4fcb-b044-155164c4847c completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:30:44.151183 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port 0458383f-f9f4-4fcb-b044-155164c4847c triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:44.151562 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:44.230495 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port 0458383f-f9f4-4fcb-b044-155164c4847c is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:44.230833 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:44.253740 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0458383f-f9f4-4fcb-b044-155164c4847c'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:30:44.256079 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-107a94fd-eead-4602-b1d3-8fc4f75dcad0" -d '{"events": [{"server_uuid": "2bbcd9e1-d232-462d-9e85-ca96ba83d61a", "name": "network-vif-plugged", "status": "completed", "tag": "0458383f-f9f4-4fcb-b044-155164c4847c"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:30:44.273037 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port 0458383f-f9f4-4fcb-b044-155164c4847c, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=0458383f-f9f4-4fcb-b044-155164c4847c,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:44.278215 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (0458383f-f9f4-4fcb-b044-155164c4847c), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:44.331613 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=0458383f-f9f4-4fcb-b044-155164c4847c,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:44.364792 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:30:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8eca371-2b3a-4d29-b090-8be25603d566 x-openstack-request-id: req-b8eca371-2b3a-4d29-b090-8be25603d566 {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:30:44.365090 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2bbcd9e1-d232-462d-9e85-ca96ba83d61a", "name": "network-vif-plugged", "status": "completed", "tag": "0458383f-f9f4-4fcb-b044-155164c4847c", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:30:44.365347 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-b8eca371-2b3a-4d29-b090-8be25603d566 {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:30:44.365985 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-b8eca371-2b3a-4d29-b090-8be25603d566'] response: {'server_uuid': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0458383f-f9f4-4fcb-b044-155164c4847c', 'code': 200} Mar 24 02:30:44.537510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28cf03c-5bd8-4589-9c30-72640283d357 req-aebc7065-c24d-4a2e-8a65-92a104c1a93d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:44.539129 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a28cf03c-5bd8-4589-9c30-72640283d357 req-aebc7065-c24d-4a2e-8a65-92a104c1a93d service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 1129 time: 0.0455275 Mar 24 02:30:44.586884 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-a28cf03c-5bd8-4589-9c30-72640283d357 req-27d83a3e-63c6-4185-a73c-97b720027fc3 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412235 Mar 24 02:30:44.792782 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ec17a7-1c0e-4e18-ade5-dd39fd45cd9e req-0d387f72-7410-49aa-9863-7458bdb1ccb5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:44.794308 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-44ec17a7-1c0e-4e18-ade5-dd39fd45cd9e req-0d387f72-7410-49aa-9863-7458bdb1ccb5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 945 time: 0.0575278 Mar 24 02:30:44.844200 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-44ec17a7-1c0e-4e18-ade5-dd39fd45cd9e req-35cdbec1-5680-4f3f-a4e2-b23c54bf92f0 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437260 Mar 24 02:30:45.079743 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:45.970607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1bd1c91-1947-4537-8340-6cef8a935d2a req-7458530b-f4db-4c37-8f9d-578d35a2f3a8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:45.972090 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d1bd1c91-1947-4537-8340-6cef8a935d2a req-7458530b-f4db-4c37-8f9d-578d35a2f3a8 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 945 time: 0.0557616 Mar 24 02:30:46.022664 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-d1bd1c91-1947-4537-8340-6cef8a935d2a req-df3edea8-12f4-44a1-8b0c-4d054601c53b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449355 Mar 24 02:30:46.141943 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-036e98dc-f44b-4b2a-93e8-796f5c7226b4 req-6d9f6454-ccba-45a8-a9c4-1ed517d9d6d3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:46.143422 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-036e98dc-f44b-4b2a-93e8-796f5c7226b4 req-6d9f6454-ccba-45a8-a9c4-1ed517d9d6d3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 945 time: 0.0534902 Mar 24 02:30:46.197527 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-036e98dc-f44b-4b2a-93e8-796f5c7226b4 req-f533c70a-af79-4cee-bdd8-8e2e445209f9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=6a8d97d5-b1c3-4063-aec0-cc06feadd820&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485499 Mar 24 02:30:46.219698 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36248) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:46.266079 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d530f3e-d798-47e6-a276-1eca58fdc19c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104036) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:46.267945 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-2d530f3e-d798-47e6-a276-1eca58fdc19c tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 1124 time: 0.0472684 Mar 24 02:30:46.270763 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36250) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:46.275260 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': '0458383f-f9f4-4fcb-b044-155164c4847c', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address': '172.20.0.7'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:46.297098 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:46.398419 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:46.502476 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.db_base_plugin_common [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.44 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/41f1a0dd-e3c8-4817-8792-434b97901fdb) {{(pid=104036) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:30:46.610039 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (41f1a0dd-e3c8-4817-8792-434b97901fdb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:46.644436 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8967985'] for port (41f1a0dd-e3c8-4817-8792-434b97901fdb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:46.684450 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104036) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:30:46.689874 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.base_scheduler [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104036) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:30:46.694465 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104036) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:30:46.697860 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=41f1a0dd-e3c8-4817-8792-434b97901fdb,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:47.052950 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (4a4d3c93-8f4e-4571-b066-6e07f16a936a), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:47.132146 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (41f1a0dd-e3c8-4817-8792-434b97901fdb), before_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:47.289963 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (41f1a0dd-e3c8-4817-8792-434b97901fdb), precommit_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:47.295788 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8967942'] for port (41f1a0dd-e3c8-4817-8792-434b97901fdb), after_update {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:47.367937 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=41f1a0dd-e3c8-4817-8792-434b97901fdb,revision_number=2']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:47.383158 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (4a4d3c93-8f4e-4571-b066-6e07f16a936a), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:47.487974 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.l3_db [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP 4a4d3c93-8f4e-4571-b066-6e07f16a936a associated. External IP: 172.26.2.44, port: 0458383f-f9f4-4fcb-b044-155164c4847c. Mar 24 02:30:47.700813 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104036) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:30:47.813600 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104036) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:30:47.824208 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] Sync routers for ids ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:30:47.834965 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:47.840041 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] Routers {'50f8650b-bc8c-402f-bf9c-bac5b5eb2205'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:47.840818 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:47.866206 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c25af027-b458-4266-b713-42968a3bf38b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.5943737 Mar 24 02:30:47.866982 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'tag': '0458383f-f9f4-4fcb-b044-155164c4847c'}] {{(pid=104036) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:30:47.868876 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36252) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:47.879704 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d6177697792ca3fff01bbfc58b3e16cb8a22905a2f74e66d9151ebb6b50c8f9c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c05f45a5-f313-4a12-98c6-ac170a1486a5" -d '{"events": [{"name": "network-changed", "server_uuid": "2bbcd9e1-d232-462d-9e85-ca96ba83d61a", "tag": "0458383f-f9f4-4fcb-b044-155164c4847c"}]}' {{(pid=104036) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:30:47.922622 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c85137e-145f-443f-a083-f1b5ba2a3202 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:47.926701 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5c85137e-145f-443f-a083-f1b5ba2a3202 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 1124 time: 0.0542872 Mar 24 02:30:47.977547 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] Set router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:47.999495 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:30:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-294b221b-c566-40be-9976-f4fa3af62b68 x-openstack-request-id: req-294b221b-c566-40be-9976-f4fa3af62b68 {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:30:47.999802 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2bbcd9e1-d232-462d-9e85-ca96ba83d61a", "tag": "0458383f-f9f4-4fcb-b044-155164c4847c", "status": "completed", "code": 200}]} {{(pid=104036) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:30:48.000068 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-294b221b-c566-40be-9976-f4fa3af62b68 {{(pid=104036) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:30:48.000630 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.notifiers.nova [-] Nova event matching ['req-294b221b-c566-40be-9976-f4fa3af62b68'] response: {'name': 'network-changed', 'server_uuid': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'tag': '0458383f-f9f4-4fcb-b044-155164c4847c', 'status': 'completed', 'code': 200} Mar 24 02:30:48.085301 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-4dc84c50-9cbe-4230-a327-674dbe72cb24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:48.089022 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-4dc84c50-9cbe-4230-a327-674dbe72cb24 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 1129 time: 0.0663443 Mar 24 02:30:48.146700 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36260) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:48.151558 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-4d1fc2aa-e267-4d2f-a6d3-5d3b9514693e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1403092750', 'description': 'tempest-secgroup-smoke-1403092750 description', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:48.183539 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d1fc2aa-e267-4d2f-a6d3-5d3b9514693e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.208503 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-542221ad-50c6-404d-aa69-ee37592315a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:48.210288 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-542221ad-50c6-404d-aa69-ee37592315a6 service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.1151335 Mar 24 02:30:48.278072 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d1fc2aa-e267-4d2f-a6d3-5d3b9514693e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (f2d99138-eb88-432c-8abc-1b556b4d8d9e), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.282401 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-794fc9de-38d6-4c63-b2ee-c2d717e6e05c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0458383f-f9f4-4fcb-b044-155164c4847c HTTP/1.1" status: 200 len: 998 time: 0.0660961 Mar 24 02:30:48.283617 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d1fc2aa-e267-4d2f-a6d3-5d3b9514693e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1656356'] for security_group (f2d99138-eb88-432c-8abc-1b556b4d8d9e), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.319329 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-4d1fc2aa-e267-4d2f-a6d3-5d3b9514693e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.320818 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-4d1fc2aa-e267-4d2f-a6d3-5d3b9514693e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1729808 Mar 24 02:30:48.323595 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36262) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:48.332624 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-92d4f115-cd57-4877-9cad-69edc08fb2ea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'f2d99138-eb88-432c-8abc-1b556b4d8d9e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:48.342987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-b4cf5462-a934-4f09-ba32-7136ef53f857 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:48.344796 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-b4cf5462-a934-4f09-ba32-7136ef53f857 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0569680 Mar 24 02:30:48.347461 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '4a4d3c93-8f4e-4571-b066-6e07f16a936a', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.44', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'port_id': '0458383f-f9f4-4fcb-b044-155164c4847c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1501, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'mac_address': 'fa:16:3e:8f:fb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:30:46Z', 'updated_at': '2022-03-24T02:30:46Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '319b9254-2709-4310-8e0c-37e2f3d15386', 'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:43:bd:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_interface', 'standard_attr_id': 1489, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:26Z', 'updated_at': '2022-03-24T02:30:30Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:48.347960 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d1fc2aa-e267-4d2f-a6d3-5d3b9514693e tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f2d99138-eb88-432c-8abc-1b556b4d8d9e,revision_number=1']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:48.380687 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] Checking router: 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:30:48.382268 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-92d4f115-cd57-4877-9cad-69edc08fb2ea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (5eb3087b-4ee7-4101-8873-3bf7e8cad8fb), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.393702 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] Routers {'50f8650b-bc8c-402f-bf9c-bac5b5eb2205'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:30:48.394474 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:30:31Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:48.413199 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-4471594b-3215-464b-94f2-b3f9e5015c74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:48.415735 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-4471594b-3215-464b-94f2-b3f9e5015c74 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0655975 Mar 24 02:30:48.457697 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-92d4f115-cd57-4877-9cad-69edc08fb2ea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (5eb3087b-4ee7-4101-8873-3bf7e8cad8fb), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.466900 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-92d4f115-cd57-4877-9cad-69edc08fb2ea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (5eb3087b-4ee7-4101-8873-3bf7e8cad8fb), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.487726 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d4f115-cd57-4877-9cad-69edc08fb2ea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5eb3087b-4ee7-4101-8873-3bf7e8cad8fb,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:48.500167 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-92d4f115-cd57-4877-9cad-69edc08fb2ea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.506898 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-92d4f115-cd57-4877-9cad-69edc08fb2ea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1819503 Mar 24 02:30:48.507250 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36264) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:48.514743 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-5daa871a-68f3-4296-af48-9909666f3400 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'f2d99138-eb88-432c-8abc-1b556b4d8d9e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:48.525182 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] Set router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:30:48.535702 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-e257612e-966c-404f-b7d7-885606d3f8ee service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1140611 Mar 24 02:30:48.597741 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5daa871a-68f3-4296-af48-9909666f3400 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (301b0be7-330a-4bfe-b9b9-7bc0db8e349c), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.676867 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-c05f45a5-f313-4a12-98c6-ac170a1486a5 req-19729169-d04d-4da4-912b-ed8e29f91706 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1324468 Mar 24 02:30:48.690959 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5daa871a-68f3-4296-af48-9909666f3400 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (301b0be7-330a-4bfe-b9b9-7bc0db8e349c), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.696905 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5daa871a-68f3-4296-af48-9909666f3400 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (301b0be7-330a-4bfe-b9b9-7bc0db8e349c), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.722882 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5daa871a-68f3-4296-af48-9909666f3400 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=301b0be7-330a-4bfe-b9b9-7bc0db8e349c,revision_number=0']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:48.728872 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-5daa871a-68f3-4296-af48-9909666f3400 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.734621 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-5daa871a-68f3-4296-af48-9909666f3400 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2263131 Mar 24 02:30:48.734789 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36266) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:48.740365 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-a4e007d3-7a37-434f-94b5-e56cdf4e1bdd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'f2d99138-eb88-432c-8abc-1b556b4d8d9e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:48.777880 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4e007d3-7a37-434f-94b5-e56cdf4e1bdd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (3aed9813-2805-4bab-9c1e-699593958131), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.786465 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '4a4d3c93-8f4e-4571-b066-6e07f16a936a', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.44', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'port_id': '0458383f-f9f4-4fcb-b044-155164c4847c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1501, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'mac_address': 'fa:16:3e:8f:fb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:30:46Z', 'updated_at': '2022-03-24T02:30:46Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '319b9254-2709-4310-8e0c-37e2f3d15386', 'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:43:bd:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_interface', 'standard_attr_id': 1489, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:26Z', 'updated_at': '2022-03-24T02:30:30Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:30:48.816968 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f8d801f-37ba-4b10-bac0-1f76c1187fc0 None None] The sync data for ids ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'] in dv-neutron-834874-3-hyperv is: [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '4a4d3c93-8f4e-4571-b066-6e07f16a936a', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.44', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'port_id': '0458383f-f9f4-4fcb-b044-155164c4847c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1501, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'mac_address': 'fa:16:3e:8f:fb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:30:46Z', 'updated_at': '2022-03-24T02:30:46Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '319b9254-2709-4310-8e0c-37e2f3d15386', 'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:43:bd:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_interface', 'standard_attr_id': 1489, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:26Z', 'updated_at': '2022-03-24T02:30:30Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:30:48.848317 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4e007d3-7a37-434f-94b5-e56cdf4e1bdd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (3aed9813-2805-4bab-9c1e-699593958131), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.854023 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4e007d3-7a37-434f-94b5-e56cdf4e1bdd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (3aed9813-2805-4bab-9c1e-699593958131), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.876134 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e007d3-7a37-434f-94b5-e56cdf4e1bdd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3aed9813-2805-4bab-9c1e-699593958131,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:48.885390 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-a4e007d3-7a37-434f-94b5-e56cdf4e1bdd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.888996 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-a4e007d3-7a37-434f-94b5-e56cdf4e1bdd tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1506929 Mar 24 02:30:48.889735 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36268) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:48.894121 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-abd2ee09-28f8-4a7b-82b6-61de615109d5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'f2d99138-eb88-432c-8abc-1b556b4d8d9e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:48.923211 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abd2ee09-28f8-4a7b-82b6-61de615109d5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (8f3adb08-4b67-4a9f-ada4-f55f7efa3367), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.989962 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abd2ee09-28f8-4a7b-82b6-61de615109d5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (8f3adb08-4b67-4a9f-ada4-f55f7efa3367), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:48.994270 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abd2ee09-28f8-4a7b-82b6-61de615109d5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (8f3adb08-4b67-4a9f-ada4-f55f7efa3367), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.013740 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd2ee09-28f8-4a7b-82b6-61de615109d5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8f3adb08-4b67-4a9f-ada4-f55f7efa3367,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:49.020360 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-abd2ee09-28f8-4a7b-82b6-61de615109d5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.024370 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-abd2ee09-28f8-4a7b-82b6-61de615109d5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1315424 Mar 24 02:30:49.024925 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36270) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:49.030627 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-6aa5b2aa-2480-4741-985d-427f8740d3d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'f2d99138-eb88-432c-8abc-1b556b4d8d9e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:49.057025 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2d065d0-027a-4916-944d-293ccb7f6f28 None None] New status for floating IP 4a4d3c93-8f4e-4571-b066-6e07f16a936a: ACTIVE {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:30:49.061487 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-6aa5b2aa-2480-4741-985d-427f8740d3d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:30:49.068038 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6aa5b2aa-2480-4741-985d-427f8740d3d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (e83d0ea4-bc6a-421e-b9f3-a64fea6098f3), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.133575 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6aa5b2aa-2480-4741-985d-427f8740d3d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (e83d0ea4-bc6a-421e-b9f3-a64fea6098f3), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.137822 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6aa5b2aa-2480-4741-985d-427f8740d3d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (e83d0ea4-bc6a-421e-b9f3-a64fea6098f3), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.156297 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aa5b2aa-2480-4741-985d-427f8740d3d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e83d0ea4-bc6a-421e-b9f3-a64fea6098f3,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:49.164055 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-6aa5b2aa-2480-4741-985d-427f8740d3d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.169738 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-6aa5b2aa-2480-4741-985d-427f8740d3d1 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1417632 Mar 24 02:30:49.170614 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [-] (104036) accepted ('10.222.0.20', 36272) {{(pid=104036) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:30:49.175768 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.v2.base [None req-c62387f7-c31b-4416-8f5c-d68ffba09772 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'security_group_rule': {'security_group_id': 'f2d99138-eb88-432c-8abc-1b556b4d8d9e', 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=104036) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:49.199858 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.db.securitygroups_db [None req-c62387f7-c31b-4416-8f5c-d68ffba09772 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Project 6c0b7eea99a4423dac22912b1fa60ca2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Mar 24 02:30:49.205781 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c62387f7-c31b-4416-8f5c-d68ffba09772 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (e114a4de-b2e7-46bd-b175-6b1eef37e49b), before_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.269975 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c62387f7-c31b-4416-8f5c-d68ffba09772 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (e114a4de-b2e7-46bd-b175-6b1eef37e49b), precommit_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.274749 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c62387f7-c31b-4416-8f5c-d68ffba09772 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1666666'] for security_group_rule (e114a4de-b2e7-46bd-b175-6b1eef37e49b), after_create {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.294391 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c62387f7-c31b-4416-8f5c-d68ffba09772 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e114a4de-b2e7-46bd-b175-6b1eef37e49b,revision_number=0']} {{(pid=104036) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:49.304309 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron_lib.callbacks.manager [None req-c62387f7-c31b-4416-8f5c-d68ffba09772 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=104036) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:49.305626 dv-neutron-834874-3-hyperv neutron-server[104036]: INFO neutron.wsgi [None req-c62387f7-c31b-4416-8f5c-d68ffba09772 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1338060 Mar 24 02:30:49.462400 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-d5db8f64-5978-413a-9a74-3bd09a7d9ef2 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1403092750&fields=id&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 267 time: 0.0485098 Mar 24 02:30:49.572604 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-ef2171f2-4055-4f46-9787-16d91d225c5a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:49.576999 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-ef2171f2-4055-4f46-9787-16d91d225c5a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 797 time: 0.1041832 Mar 24 02:30:49.594616 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-eb8a2a1b-e938-4d3c-8436-1f3e5d20d8a9 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/quotas/6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 375 time: 0.0092728 Mar 24 02:30:49.648462 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-f9a34b04-c4b1-4754-9dbc-6a6618c204ac tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0530775 Mar 24 02:30:49.796101 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-89296503-687f-42c1-b395-36a030d59c26 service neutron] 10.222.0.20 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1361649 Mar 24 02:30:49.890850 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-5b132373-5d97-4196-9f5a-1e6a40e202d0 service neutron] 10.222.0.20 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886412 Mar 24 02:30:50.065563 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7c76fc02-ac5b-49a4-b0bf-4c6965629e07 req-f74c1b5d-058e-4658-9744-55761197c14c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 210 time: 0.0340095 Mar 24 02:30:51.020514 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-69520632-5019-4079-a638-0d86ca27aa08 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:51.021960 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-69520632-5019-4079-a638-0d86ca27aa08 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 797 time: 0.1104696 Mar 24 02:30:51.114565 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-d2864654-46c9-4f0a-be46-18a7e5ca497a tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c0b7eea99a4423dac22912b1fa60ca2 HTTP/1.1" status: 200 len: 473 time: 0.0847120 Mar 24 02:30:51.124156 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'port': {'device_id': '4c57f800-ef2e-47be-b342-b671ffe21638', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'admin_state_up': True, 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'security_groups': ['f2d99138-eb88-432c-8abc-1b556b4d8d9e']}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:51.200852 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-b4490050-7a9b-4af8-a587-5897eed064c5 req-66331de9-5794-4382-a0a2-ac6408f66c5c tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 210 time: 0.0375423 Mar 24 02:30:51.259894 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Made reservation on behalf of 6c0b7eea99a4423dac22912b1fa60ca2 for: {'port': 1} {{(pid=104037) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Mar 24 02:30:51.263295 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:51.388720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.20.0.3 (513167f7-2f09-4967-8ab3-31d31374b29d/b99c86c5-5954-49d0-ab58-eaf5fd70ee11/ae07d99c-0d48-441b-9f63-8734cc45470e) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:30:51.536718 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:51.574024 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:51.616969 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 513167f7-2f09-4967-8ab3-31d31374b29d is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:30:51.620079 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:30:51.622575 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:30:51.664153 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=ae07d99c-0d48-441b-9f63-8734cc45470e,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:51.692954 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:51.718713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:51.728599 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-c1c57113-78e8-4c65-b237-e135591377a5 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6088555 Mar 24 02:30:51.741188 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Request body: {'port': {'device_id': '4c57f800-ef2e-47be-b342-b671ffe21638', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8348'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:30:51.803330 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:51.935170 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-867f8327-b47d-4079-b7dc-dc611040e43c None None] Provisioning complete for port ae07d99c-0d48-441b-9f63-8734cc45470e triggered by entity DHCP. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:51.936191 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-867f8327-b47d-4079-b7dc-dc611040e43c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:51.972935 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-867f8327-b47d-4079-b7dc-dc611040e43c None None] Port ae07d99c-0d48-441b-9f63-8734cc45470e cannot update to ACTIVE because it is not bound. {{(pid=104038) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Mar 24 02:30:52.071357 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ae07d99c-0d48-441b-9f63-8734cc45470e {{(pid=104037) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:30:52.079510 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Publish callbacks [] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:52.091133 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.provisioning_blocks [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Transition to ACTIVE for port object ae07d99c-0d48-441b-9f63-8734cc45470e will not be triggered until provisioned by entity L2. {{(pid=104037) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:74}} Mar 24 02:30:52.095827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:52.144369 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Pushing event updated for resources: {'Port': ['ID=ae07d99c-0d48-441b-9f63-8734cc45470e,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:52.222596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Attempting to bind port ae07d99c-0d48-441b-9f63-8734cc45470e on host hv-neutron-8348 for vnic_type normal with profile {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Mar 24 02:30:52.222987 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Attempting to bind port ae07d99c-0d48-441b-9f63-8734cc45470e by drivers openvswitch,hyperv on host hv-neutron-8348 at level 0 using segments [{'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Mar 24 02:30:52.223265 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Attempting to bind port ae07d99c-0d48-441b-9f63-8734cc45470e on network 513167f7-2f09-4967-8ab3-31d31374b29d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:30:52.228326 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Port ae07d99c-0d48-441b-9f63-8734cc45470e on network 513167f7-2f09-4967-8ab3-31d31374b29d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8348 {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Mar 24 02:30:52.228646 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Attempting to bind port ae07d99c-0d48-441b-9f63-8734cc45470e on network 513167f7-2f09-4967-8ab3-31d31374b29d {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Mar 24 02:30:52.234614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Checking agent: {'id': 'ed26ad49-ce2d-450b-8685-ef2d8cce960e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8348', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'started_at': datetime.datetime(2022, 3, 24, 2, 10, 15), 'heartbeat_timestamp': datetime.datetime(2022, 3, 24, 2, 30, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Mar 24 02:30:52.234614 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Checking segment: {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=104037) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Mar 24 02:30:52.234869 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Bound using segment: {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'} {{(pid=104037) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Mar 24 02:30:52.235298 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.managers [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Bound port: ae07d99c-0d48-441b-9f63-8734cc45470e, host: hv-neutron-8348, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '409dd6ae-dfe2-48bd-af92-a71fcc09d3fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d'}}] {{(pid=104037) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Mar 24 02:30:52.235654 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:52.339589 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] For port ae07d99c-0d48-441b-9f63-8734cc45470e, host hv-neutron-8348, cleared binding levels {{(pid=104037) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Mar 24 02:30:52.354720 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.plugins.ml2.db [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] For port ae07d99c-0d48-441b-9f63-8734cc45470e, host hv-neutron-8348, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=ae07d99c-0d48-441b-9f63-8734cc45470e,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104037) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Mar 24 02:30:52.361885 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:52.400287 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e7ce5c7-678c-4b07-8524-dc37e8f545e6 req-25d0fa8f-0e68-4183-82a1-9ff991e76426 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:52.401827 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5e7ce5c7-678c-4b07-8524-dc37e8f545e6 req-25d0fa8f-0e68-4183-82a1-9ff991e76426 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 943 time: 0.1071448 Mar 24 02:30:52.406417 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:52.407114 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for port (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:52.408479 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] 10.222.0.30 "PUT /v2.0/ports/ae07d99c-0d48-441b-9f63-8734cc45470e HTTP/1.1" status: 200 len: 1093 time: 0.6716869 Mar 24 02:30:52.408933 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c57f800-ef2e-47be-b342-b671ffe21638', 'tag': 'ae07d99c-0d48-441b-9f63-8734cc45470e'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:30:52.411216 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-230445ac-6524-4538-a546-7f0310a5160e" -d '{"events": [{"name": "network-changed", "server_uuid": "4c57f800-ef2e-47be-b342-b671ffe21638", "tag": "ae07d99c-0d48-441b-9f63-8734cc45470e"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:30:52.483308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:30:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42d43e6c-7c41-4ef7-bab3-89d9b4a7d1a2 x-openstack-request-id: req-42d43e6c-7c41-4ef7-bab3-89d9b4a7d1a2 {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:30:52.483524 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c57f800-ef2e-47be-b342-b671ffe21638", "tag": "ae07d99c-0d48-441b-9f63-8734cc45470e", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:30:52.483774 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-42d43e6c-7c41-4ef7-bab3-89d9b4a7d1a2 {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:30:52.484176 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-42d43e6c-7c41-4ef7-bab3-89d9b4a7d1a2'] response: {'name': 'network-changed', 'server_uuid': '4c57f800-ef2e-47be-b342-b671ffe21638', 'tag': 'ae07d99c-0d48-441b-9f63-8734cc45470e', 'status': 'completed', 'code': 200} Mar 24 02:30:52.490835 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9541c9e1-a052-4f78-ad8b-fec77d9a8a5f service neutron] Pushing event updated for resources: {'Port': ['ID=ae07d99c-0d48-441b-9f63-8734cc45470e,revision_number=3']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:52.521783 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-5e7ce5c7-678c-4b07-8524-dc37e8f545e6 req-247709d2-4e33-4978-a8ae-2b256a680024 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1056085 Mar 24 02:30:52.532228 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-08301396-e9e1-4f2a-83ea-33b0a01c2564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:52.533753 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-08301396-e9e1-4f2a-83ea-33b0a01c2564 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 1127 time: 0.0840712 Mar 24 02:30:52.580700 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-ffe012e0-d3f4-472a-9751-0bc3c39ee636 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ae07d99c-0d48-441b-9f63-8734cc45470e HTTP/1.1" status: 200 len: 217 time: 0.0371099 Mar 24 02:30:52.629397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-d2502b09-a523-4a98-a22c-ab63d4458ef8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:52.630898 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-d2502b09-a523-4a98-a22c-ab63d4458ef8 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0449309 Mar 24 02:30:52.682540 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-fc352c9a-936d-4061-b10e-ed9e1916d654 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:52.683953 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-fc352c9a-936d-4061-b10e-ed9e1916d654 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0474617 Mar 24 02:30:52.769079 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-e7eed1e1-450a-4f9d-a40b-078fb17d69c3 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786655 Mar 24 02:30:52.855776 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-41309649-0e04-4bfe-b105-66020b9c2a68 req-760d1de4-424c-421f-a01d-080f9913a4be service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816393 Mar 24 02:30:52.943138 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230445ac-6524-4538-a546-7f0310a5160e req-ebbb2bfc-5b00-4f54-bfd9-c2a12f7f8f1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:52.944642 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-230445ac-6524-4538-a546-7f0310a5160e req-ebbb2bfc-5b00-4f54-bfd9-c2a12f7f8f1c service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 1127 time: 0.0443356 Mar 24 02:30:53.030548 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230445ac-6524-4538-a546-7f0310a5160e req-d0eba9c9-7661-48ec-9430-b002fa4c4a2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:53.031936 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-230445ac-6524-4538-a546-7f0310a5160e req-d0eba9c9-7661-48ec-9430-b002fa4c4a2c service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.0815814 Mar 24 02:30:53.073980 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-230445ac-6524-4538-a546-7f0310a5160e req-101e0c60-3019-4af2-847a-30683758f0d2 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ae07d99c-0d48-441b-9f63-8734cc45470e HTTP/1.1" status: 200 len: 217 time: 0.0364771 Mar 24 02:30:53.120695 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230445ac-6524-4538-a546-7f0310a5160e req-c2a0d2bd-cd0c-4c8c-a59f-ca8274c159b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:53.122140 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-230445ac-6524-4538-a546-7f0310a5160e req-c2a0d2bd-cd0c-4c8c-a59f-ca8274c159b9 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0428240 Mar 24 02:30:53.170827 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230445ac-6524-4538-a546-7f0310a5160e req-43787ef0-46a6-4c0d-a640-894c1d6047a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:53.172328 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-230445ac-6524-4538-a546-7f0310a5160e req-43787ef0-46a6-4c0d-a640-894c1d6047a4 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0443447 Mar 24 02:30:53.588047 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-230445ac-6524-4538-a546-7f0310a5160e req-241f8107-f344-4e85-bde6-e717793ce3da service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4093552 Mar 24 02:30:53.700115 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5ecca8-986c-4d63-94d7-7ceafaed6f9f req-5dfb9749-2e71-4a94-bc4b-c1538d8f346b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:53.702176 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cf5ecca8-986c-4d63-94d7-7ceafaed6f9f req-5dfb9749-2e71-4a94-bc4b-c1538d8f346b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 943 time: 0.1092746 Mar 24 02:30:53.721220 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-230445ac-6524-4538-a546-7f0310a5160e req-70b5e3bb-a899-4305-9706-8e8547311610 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1203218 Mar 24 02:30:53.757259 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-cf5ecca8-986c-4d63-94d7-7ceafaed6f9f req-80ac0f9c-2d00-4678-80b4-baa341deb616 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468073 Mar 24 02:30:54.872545 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be6f4f8-f649-4cbd-96da-d027b5e17c29 req-5ef3777c-1fd4-4205-ba59-9f44f6e7981f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:54.874493 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7be6f4f8-f649-4cbd-96da-d027b5e17c29 req-5ef3777c-1fd4-4205-ba59-9f44f6e7981f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 943 time: 0.0518987 Mar 24 02:30:54.921417 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7be6f4f8-f649-4cbd-96da-d027b5e17c29 req-5e391d50-47ec-405f-b963-81fd38819eeb tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412834 Mar 24 02:30:56.040028 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986798d2-0294-4713-addf-cdb3179857e9 req-7e764cb0-8f96-4117-a93f-87f0b09501bc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:56.041487 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-986798d2-0294-4713-addf-cdb3179857e9 req-7e764cb0-8f96-4117-a93f-87f0b09501bc tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 943 time: 0.0543275 Mar 24 02:30:56.090869 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-986798d2-0294-4713-addf-cdb3179857e9 req-689233d9-1d31-467a-aa76-521706d0c842 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432997 Mar 24 02:30:56.127933 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device ae07d99c-0d48-441b-9f63-8734cc45470e details requested by agent hyperv_hv-neutron-8348 with host hv-neutron-8348 {{(pid=104038) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Mar 24 02:30:56.222731 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port ae07d99c-0d48-441b-9f63-8734cc45470e, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=ae07d99c-0d48-441b-9f63-8734cc45470e,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:56.234182 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Returning: {'device': 'ae07d99c-0d48-441b-9f63-8734cc45470e', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'port_id': 'ae07d99c-0d48-441b-9f63-8734cc45470e', 'mac_address': 'fa:16:3e:5a:11:25', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=104038) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Mar 24 02:30:56.269336 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port ae07d99c-0d48-441b-9f63-8734cc45470e is: DOWN; New status is: BUILD {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:56.269718 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:56.281624 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ae07d99c-0d48-441b-9f63-8734cc45470e {{(pid=104038) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Mar 24 02:30:56.300630 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port ae07d99c-0d48-441b-9f63-8734cc45470e, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=ae07d99c-0d48-441b-9f63-8734cc45470e,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:56.304491 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:56.349459 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=ae07d99c-0d48-441b-9f63-8734cc45470e,revision_number=4']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:56.622331 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] get_ports_and_sgs() called for port_ids ['ae07d99c-0d48-441b-9f63-8734cc45470e'] {{(pid=104038) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Mar 24 02:30:57.206009 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-630a8016-f698-4cc3-940e-e43f46380616 req-56298a82-fe57-4813-b364-522b06687016 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:57.207527 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-630a8016-f698-4cc3-940e-e43f46380616 req-56298a82-fe57-4813-b364-522b06687016 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 944 time: 0.0523007 Mar 24 02:30:57.255110 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-630a8016-f698-4cc3-940e-e43f46380616 req-4e55ce9b-a0b2-4b88-a529-c2aee5354cfe tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420809 Mar 24 02:30:57.426908 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-9c1f4dc9-363a-4996-a0bb-30c5c5eaccfc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:58.127505 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Device ae07d99c-0d48-441b-9f63-8734cc45470e up at agent hyperv_hv-neutron-8348 {{(pid=104038) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Mar 24 02:30:58.176558 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning for port ae07d99c-0d48-441b-9f63-8734cc45470e completed by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Mar 24 02:30:58.180426 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.db.provisioning_blocks [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Provisioning complete for port ae07d99c-0d48-441b-9f63-8734cc45470e triggered by entity L2. {{(pid=104038) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Mar 24 02:30:58.180801 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7451512'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), provisioning_complete {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:58.254678 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.plugin [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Current status of the port ae07d99c-0d48-441b-9f63-8734cc45470e is: BUILD; New status is: ACTIVE {{(pid=104038) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2256}} Mar 24 02:30:58.255067 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), before_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:58.276748 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c57f800-ef2e-47be-b342-b671ffe21638', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ae07d99c-0d48-441b-9f63-8734cc45470e'}] {{(pid=104038) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:30:58.278980 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70522a1bfdf224fc7d02f2832dc936a9fa164177513be83059247634b2b0c5ba" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1375b21-eb79-49f0-9cd3-580909d37705" -d '{"events": [{"server_uuid": "4c57f800-ef2e-47be-b342-b671ffe21638", "name": "network-vif-plugged", "status": "completed", "tag": "ae07d99c-0d48-441b-9f63-8734cc45470e"}]}' {{(pid=104038) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:30:58.295994 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.plugins.ml2.db [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] For port ae07d99c-0d48-441b-9f63-8734cc45470e, host hv-neutron-8348, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8348',level=0,port_id=ae07d99c-0d48-441b-9f63-8734cc45470e,segment=NetworkSegment(409dd6ae-dfe2-48bd-af92-a71fcc09d3fb),segment_id=409dd6ae-dfe2-48bd-af92-a71fcc09d3fb)] {{(pid=104038) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Mar 24 02:30:58.301127 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183'] for port (ae07d99c-0d48-441b-9f63-8734cc45470e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:30:58.324168 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 24 Mar 2022 02:30:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18abb09f-8cfc-493d-8688-d1035455af8e x-openstack-request-id: req-18abb09f-8cfc-493d-8688-d1035455af8e {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:30:58.324465 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4c57f800-ef2e-47be-b342-b671ffe21638", "name": "network-vif-plugged", "status": "completed", "tag": "ae07d99c-0d48-441b-9f63-8734cc45470e", "code": 200}]} {{(pid=104038) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:30:58.324717 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-18abb09f-8cfc-493d-8688-d1035455af8e {{(pid=104038) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:30:58.325114 dv-neutron-834874-3-hyperv neutron-server[104038]: INFO neutron.notifiers.nova [-] Nova event matching ['req-18abb09f-8cfc-493d-8688-d1035455af8e'] response: {'server_uuid': '4c57f800-ef2e-47be-b342-b671ffe21638', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ae07d99c-0d48-441b-9f63-8734cc45470e', 'code': 200} Mar 24 02:30:58.351811 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Pushing event updated for resources: {'Port': ['ID=ae07d99c-0d48-441b-9f63-8734cc45470e,revision_number=5']} {{(pid=104038) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:30:58.452397 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324b24a3-e739-460a-9196-2bd50a1e5ab6 req-cf2f2258-6d03-420b-969b-c34e3c530491 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:58.453799 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-324b24a3-e739-460a-9196-2bd50a1e5ab6 req-cf2f2258-6d03-420b-969b-c34e3c530491 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 945 time: 0.0641026 Mar 24 02:30:58.536168 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-324b24a3-e739-460a-9196-2bd50a1e5ab6 req-46aa7db2-e7d2-4cdf-89d5-2714f602dc0b tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0767562 Mar 24 02:30:58.540683 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015c7b6f-b189-4c3c-b631-72d48661fa2e req-adf004c7-47f6-4f56-ab1d-c1d730f44e90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:58.542094 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-015c7b6f-b189-4c3c-b631-72d48661fa2e req-adf004c7-47f6-4f56-ab1d-c1d730f44e90 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 1129 time: 0.0770826 Mar 24 02:30:58.586795 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-015c7b6f-b189-4c3c-b631-72d48661fa2e req-6acceffd-ffd0-4868-a8b9-5e6a967a0a4c service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392997 Mar 24 02:30:59.651462 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49fd4503-f95a-4fd4-a1f9-887a5e056118 req-678b7b15-d3f1-426f-8fb5-aecb0f58c300 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:30:59.652905 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49fd4503-f95a-4fd4-a1f9-887a5e056118 req-678b7b15-d3f1-426f-8fb5-aecb0f58c300 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 945 time: 0.0511067 Mar 24 02:30:59.703544 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-49fd4503-f95a-4fd4-a1f9-887a5e056118 req-101feb3d-4d49-4695-9802-7a08e1c79eff tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445619 Mar 24 02:31:00.535825 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a40aee32-7ced-4f81-9b0b-5074bae39022 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:00.822859 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f50a343-0ac4-48b2-885f-188351a2d742 req-6356ce18-35c6-4eb2-a48a-b3ef8885f06f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:00.824328 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f50a343-0ac4-48b2-885f-188351a2d742 req-6356ce18-35c6-4eb2-a48a-b3ef8885f06f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 945 time: 0.0560422 Mar 24 02:31:00.871118 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-3f50a343-0ac4-48b2-885f-188351a2d742 req-4073102d-6c84-4fd9-a5bd-58df5cb0dfea tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411584 Mar 24 02:31:00.913875 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:00.988007 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78a96ddd-3c0a-4a25-b294-76402d14e94f req-c6490441-e058-4cbf-a102-4e2ae908085f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:00.989459 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-78a96ddd-3c0a-4a25-b294-76402d14e94f req-c6490441-e058-4cbf-a102-4e2ae908085f tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 945 time: 0.0518382 Mar 24 02:31:01.035974 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-78a96ddd-3c0a-4a25-b294-76402d14e94f req-6771ec9d-7165-4d38-ad0e-c5256d4b3bb3 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "GET /v2.0/security-groups?id=f2d99138-eb88-432c-8abc-1b556b4d8d9e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411198 Mar 24 02:31:01.057035 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36328) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:31:01.099541 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4d496fb-a358-4f4f-9988-af5f65f9b704 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:01.100962 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-f4d496fb-a358-4f4f-9988-af5f65f9b704 tempest-TestNetworkBasicOps-783587344 tempest-TestNetworkBasicOps-783587344-project-admin] 10.222.0.20 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 1124 time: 0.0429552 Mar 24 02:31:01.103774 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [-] (104037) accepted ('10.222.0.20', 36330) {{(pid=104037) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Mar 24 02:31:01.108535 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.v2.base [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Request body: {'floatingip': {'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'port_id': 'ae07d99c-0d48-441b-9f63-8734cc45470e', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address': '172.20.0.3'}} {{(pid=104037) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Mar 24 02:31:01.128465 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:01.225656 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (None), before_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:01.328308 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.db_base_plugin_common [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Allocated IP 172.26.2.97 (87077e4c-2cae-4de7-847c-fab7ddedd260/955ffda0-7483-48fb-907d-2aae140ffeb8/c63e898f-2b98-4ccc-a9f8-e7cee5802c13) {{(pid=104037) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Mar 24 02:31:01.424380 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (c63e898f-2b98-4ccc-a9f8-e7cee5802c13), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:01.457026 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8790618352631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3240559'] for port (c63e898f-2b98-4ccc-a9f8-e7cee5802c13), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:01.498729 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Network 87077e4c-2cae-4de7-847c-fab7ddedd260 is already hosted by enough agents. {{(pid=104037) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Mar 24 02:31:01.502726 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.base_scheduler [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Resources bound (agent type, host, resource id): {{(pid=104037) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Mar 24 02:31:01.504669 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=c63e898f-2b98-4ccc-a9f8-e7cee5802c13,revision_number=1']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:31:01.506766 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Received port after_create {{(pid=104037) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Mar 24 02:31:01.850348 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for floatingip (15b3380e-757e-4629-8763-015733144dd6), precommit_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:01.920273 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7570794'] for port (c63e898f-2b98-4ccc-a9f8-e7cee5802c13), before_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:02.063800 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks [] for port (c63e898f-2b98-4ccc-a9f8-e7cee5802c13), precommit_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:02.067939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7570729', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-44831', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1600328', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8790618889364', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8790618353165', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8790618353183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3240536'] for port (c63e898f-2b98-4ccc-a9f8-e7cee5802c13), after_update {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:02.136341 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Pushing event updated for resources: {'Port': ['ID=c63e898f-2b98-4ccc-a9f8-e7cee5802c13,revision_number=2']} {{(pid=104037) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Mar 24 02:31:02.148060 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1624134'] for floatingip (15b3380e-757e-4629-8763-015733144dd6), after_create {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:02.248937 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.db.l3_db [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Floating IP 15b3380e-757e-4629-8763-015733144dd6 associated. External IP: 172.26.2.97, port: ae07d99c-0d48-441b-9f63-8734cc45470e. Mar 24 02:31:02.456059 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 has already been hosted by L3 agent 700661ac-903b-4270-9a73-7a0120212663 {{(pid=104037) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Mar 24 02:31:02.475145 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:02.563708 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Notify agent at l3_agent.dv-neutron-834874-3-hyperv the message routers_updated {{(pid=104037) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Mar 24 02:31:02.573471 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] Sync routers for ids ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'] in dv-neutron-834874-3-hyperv {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Mar 24 02:31:02.581964 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron_lib.callbacks.manager [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-233362'] for floatingip (None), before_response {{(pid=104037) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:02.583167 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] Routers {'50f8650b-bc8c-402f-bf9c-bac5b5eb2205'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:31:02.583785 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:31:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:31:02.628484 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [None req-54bb08e3-04d2-4f90-a90b-b15320bc3b62 tempest-TestNetworkBasicOps-1890933406 tempest-TestNetworkBasicOps-1890933406-project] 10.222.0.20 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.5105605 Mar 24 02:31:02.628484 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c57f800-ef2e-47be-b342-b671ffe21638', 'tag': 'ae07d99c-0d48-441b-9f63-8734cc45470e'}] {{(pid=104037) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Mar 24 02:31:02.628484 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.20/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}80a9f1aee2c7d3eff065c34d69ec3b08ff10db35c02ad9bc22af466f9aa2e116" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036" -d '{"events": [{"name": "network-changed", "server_uuid": "4c57f800-ef2e-47be-b342-b671ffe21638", "tag": "ae07d99c-0d48-441b-9f63-8734cc45470e"}]}' {{(pid=104037) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Mar 24 02:31:02.652373 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 24 Mar 2022 02:31:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a8c19e3-46ba-4bb7-bc83-4acf7302401c x-openstack-request-id: req-8a8c19e3-46ba-4bb7-bc83-4acf7302401c {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Mar 24 02:31:02.652681 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c57f800-ef2e-47be-b342-b671ffe21638", "tag": "ae07d99c-0d48-441b-9f63-8734cc45470e", "status": "completed", "code": 200}]} {{(pid=104037) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Mar 24 02:31:02.652942 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.20/compute/v2.1/os-server-external-events used request id req-8a8c19e3-46ba-4bb7-bc83-4acf7302401c {{(pid=104037) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Mar 24 02:31:02.653415 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.notifiers.nova [-] Nova event matching ['req-8a8c19e3-46ba-4bb7-bc83-4acf7302401c'] response: {'name': 'network-changed', 'server_uuid': '4c57f800-ef2e-47be-b342-b671ffe21638', 'tag': 'ae07d99c-0d48-441b-9f63-8734cc45470e', 'status': 'completed', 'code': 200} Mar 24 02:31:02.691814 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] Set router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:31:02.724830 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-b358ddee-9e6a-45e3-aad8-3474d7b64e6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:02.726264 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-b358ddee-9e6a-45e3-aad8-3474d7b64e6b service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 1129 time: 0.0457880 Mar 24 02:31:02.815599 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-820f22ef-a0d7-47ca-87c9-a6b8434f90c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:02.817070 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-820f22ef-a0d7-47ca-87c9-a6b8434f90c8 service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.0834136 Mar 24 02:31:02.886042 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-a048c23f-77c1-4f65-95ed-224baffe1f8c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ae07d99c-0d48-441b-9f63-8734cc45470e HTTP/1.1" status: 200 len: 998 time: 0.0625136 Mar 24 02:31:02.918685 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '15b3380e-757e-4629-8763-015733144dd6', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.97', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'port_id': 'ae07d99c-0d48-441b-9f63-8734cc45470e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1513, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'mac_address': 'fa:16:3e:5a:11:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c57f800-ef2e-47be-b342-b671ffe21638', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:31:01Z', 'updated_at': '2022-03-24T02:31:01Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}, {'id': '4a4d3c93-8f4e-4571-b066-6e07f16a936a', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.44', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'port_id': '0458383f-f9f4-4fcb-b044-155164c4847c', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 1501, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'mac_address': 'fa:16:3e:8f:fb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:30:46Z', 'updated_at': '2022-03-24T02:30:49Z', 'revision_number': 1, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '319b9254-2709-4310-8e0c-37e2f3d15386', 'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:43:bd:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_interface', 'standard_attr_id': 1489, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:26Z', 'updated_at': '2022-03-24T02:30:30Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:31:02.934401 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-16242288-9f2b-4a6e-a64f-8712aca6741b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:02.935986 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-16242288-9f2b-4a6e-a64f-8712aca6741b service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0428448 Mar 24 02:31:02.947371 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] Checking router: 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 for host: dv-neutron-834874-3-hyperv {{(pid=104039) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Mar 24 02:31:02.956117 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvrscheduler_db [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] Routers {'50f8650b-bc8c-402f-bf9c-bac5b5eb2205'} bound to L3 agent in host dv-neutron-834874-3-hyperv {{(pid=104039) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Mar 24 02:31:02.956721 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-834874-3-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-03-24T02:04:00Z,description=,heartbeat_timestamp=2022-03-24T02:31:01Z,host='dv-neutron-834874-3-hyperv',id=700661ac-903b-4270-9a73-7a0120212663,load=0,resource_versions=,resources_synced=,started_at=2022-03-24T02:04:00Z,topic='l3_agent')) {'router_ids': ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'], 'active': True} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:31:02.983904 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-0e543627-9503-4e48-857e-70af3d939295 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:02.985309 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-0e543627-9503-4e48-857e-70af3d939295 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0440459 Mar 24 02:31:03.057635 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_dvr_db [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] Set router 50f8650b-bc8c-402f-bf9c-bac5b5eb2205 gateway port host: dv-neutron-834874-3-hyperv {{(pid=104039) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Mar 24 02:31:03.075469 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-187b4dbb-0e8d-4be3-899c-5621b641d1a2 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839250 Mar 24 02:31:03.166917 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-0f64d6c6-35cd-43ca-9fee-3e7fdaa5d036 req-2bc12ad4-7c87-4c08-a936-01cee2c34089 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857971 Mar 24 02:31:03.288890 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.l3_hamode_db [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '15b3380e-757e-4629-8763-015733144dd6', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.97', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'port_id': 'ae07d99c-0d48-441b-9f63-8734cc45470e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1513, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'mac_address': 'fa:16:3e:5a:11:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c57f800-ef2e-47be-b342-b671ffe21638', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:31:01Z', 'updated_at': '2022-03-24T02:31:01Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}, {'id': '4a4d3c93-8f4e-4571-b066-6e07f16a936a', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.44', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'port_id': '0458383f-f9f4-4fcb-b044-155164c4847c', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 1501, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'mac_address': 'fa:16:3e:8f:fb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:30:46Z', 'updated_at': '2022-03-24T02:30:49Z', 'revision_number': 1, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '319b9254-2709-4310-8e0c-37e2f3d15386', 'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:43:bd:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_interface', 'standard_attr_id': 1489, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:26Z', 'updated_at': '2022-03-24T02:30:30Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-834874-3-hyperv', False) {} {{(pid=104039) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Mar 24 02:31:03.314183 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-290e89bf-add3-4795-b846-d0292b0e9348 None None] The sync data for ids ['50f8650b-bc8c-402f-bf9c-bac5b5eb2205'] in dv-neutron-834874-3-hyperv is: [{'id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'name': 'tempest-TestNetworkBasicOps-router-454196089', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'external_fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10'}], 'enable_snat': True}, 'gw_port_id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-03-24T02:30:23Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'gw_port': {'id': 'fb466638-bb6b-4812-a050-d5fd40219808', 'name': '', 'network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:ff:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1486, 'fixed_ips': [{'subnet_id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'ip_address': '172.26.2.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:24Z', 'updated_at': '2022-03-24T02:30:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '955ffda0-7483-48fb-907d-2aae140ffeb8', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-834874-3-hyperv', '_floatingips': [{'id': '15b3380e-757e-4629-8763-015733144dd6', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.97', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'port_id': 'ae07d99c-0d48-441b-9f63-8734cc45470e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1513, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'mac_address': 'fa:16:3e:5a:11:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c57f800-ef2e-47be-b342-b671ffe21638', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:31:01Z', 'updated_at': '2022-03-24T02:31:01Z', 'revision_number': 0, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}, {'id': '4a4d3c93-8f4e-4571-b066-6e07f16a936a', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'floating_ip_address': '172.26.2.44', 'floating_network_id': '87077e4c-2cae-4de7-847c-fab7ddedd260', 'router_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'port_id': '0458383f-f9f4-4fcb-b044-155164c4847c', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 1501, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'mac_address': 'fa:16:3e:8f:fb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bbcd9e1-d232-462d-9e85-ca96ba83d61a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-03-24T02:30:46Z', 'updated_at': '2022-03-24T02:30:49Z', 'revision_number': 1, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '319b9254-2709-4310-8e0c-37e2f3d15386', 'name': '', 'network_id': '513167f7-2f09-4967-8ab3-31d31374b29d', 'tenant_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'mac_address': 'fa:16:3e:43:bd:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f8650b-bc8c-402f-bf9c-bac5b5eb2205', 'device_owner': 'network:router_interface', 'standard_attr_id': 1489, 'fixed_ips': [{'subnet_id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-834874-3-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-03-24T02:30:26Z', 'updated_at': '2022-03-24T02:30:30Z', 'revision_number': 5, 'project_id': '6c0b7eea99a4423dac22912b1fa60ca2', 'subnets': [{'id': 'b99c86c5-5954-49d0-ab58-eaf5fd70ee11', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=104039) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Mar 24 02:31:03.504084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a70cf82-874e-464f-aa22-93864031e4b9 None None] New status for floating IP 15b3380e-757e-4629-8763-015733144dd6: ACTIVE {{(pid=104038) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Mar 24 02:31:03.738222 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:10.985185 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:31:15.083488 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:22.537958 dv-neutron-834874-3-hyperv neutron-server[104036]: DEBUG neutron.wsgi [req-ff4ba95a-cbf0-47e9-a931-fee8045c21f8 req-104ada71-4497-4572-9fdb-94668d7f77bb service neutron] (104036) timed out ('10.222.0.30', 58695) {{(pid=104036) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Mar 24 02:31:27.427977 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-f4b6f436-65dc-4b69-b57a-5326cdf739d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:30.536697 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-590f47c2-64b2-4b70-b9e4-949ac4d5c5ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:30.915653 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:32.478815 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:33.739714 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:36.053988 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-a14aa607-2bdc-43f1-82ee-4b367449d25d service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0444820 Mar 24 02:31:36.141380 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-82cc49b3-daae-428e-9a59-6517bcababa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:36.142912 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-82cc49b3-daae-428e-9a59-6517bcababa3 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 1129 time: 0.0443966 Mar 24 02:31:36.245223 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-31972ef1-be29-4151-b17e-3f9bdcbed241 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:36.246710 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-31972ef1-be29-4151-b17e-3f9bdcbed241 service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.0862470 Mar 24 02:31:36.310744 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-aa6a0fdd-1df0-477f-8dbd-300e3fcb92ad service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0458383f-f9f4-4fcb-b044-155164c4847c HTTP/1.1" status: 200 len: 1000 time: 0.0570045 Mar 24 02:31:36.360617 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-be7af841-c8d6-48f6-8586-6b4cb26b2d35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:36.362075 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-be7af841-c8d6-48f6-8586-6b4cb26b2d35 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0454202 Mar 24 02:31:36.412763 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-b9cd82d1-80b7-4b5b-9a6b-bae37eeefe3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:31:36.414246 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-b9cd82d1-80b7-4b5b-9a6b-bae37eeefe3d service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0466261 Mar 24 02:31:36.500159 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-055ad925-5fa8-4b32-9f71-7ffbf08f8535 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798328 Mar 24 02:31:36.588338 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-e5b40865-adc4-4e80-a821-29c95f4d8fb6 req-d76b4fa7-3fd6-457f-b4cf-b10558a9f4d7 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817180 Mar 24 02:31:45.087650 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:31:47.984174 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:31:57.429276 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6aada2a2-7256-4343-a969-3ffc463994ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:00.538118 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-34c82695-3d0b-472e-87f8-da7971f736b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:00.917943 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:02.513599 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:03.741513 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:15.093084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:24.983800 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:32:27.429658 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4d01bf59-cc34-4b12-be68-265333b7ce28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:30.539290 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5f64c8e9-3456-4832-855d-531c6f799cdd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:30.920744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:32.485181 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:33.743213 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:36.030561 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-77e5da18-1ed9-4c8e-8458-07f3a08c4dae service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0444987 Mar 24 02:32:36.096569 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-d06c4951-3aeb-4161-8d22-4e4da0e165c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:32:36.098062 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-d06c4951-3aeb-4161-8d22-4e4da0e165c7 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 1129 time: 0.0468769 Mar 24 02:32:36.196767 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-bcdf8a01-98b6-4246-a40c-e02445d37f50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:32:36.198222 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-bcdf8a01-98b6-4246-a40c-e02445d37f50 service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.0830674 Mar 24 02:32:36.265886 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-81822307-692d-4805-acfd-176668181efd service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ae07d99c-0d48-441b-9f63-8734cc45470e HTTP/1.1" status: 200 len: 1000 time: 0.0607870 Mar 24 02:32:36.311716 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-5dfe3d81-49ed-40e2-a156-b5a533201bce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:32:36.313094 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-5dfe3d81-49ed-40e2-a156-b5a533201bce service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0417821 Mar 24 02:32:36.360066 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-9ae96cad-ec38-4243-81bb-ee74394515b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:32:36.361501 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-9ae96cad-ec38-4243-81bb-ee74394515b3 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0428998 Mar 24 02:32:36.370596 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-c0ce6d12-66da-41c9-8dcd-5901c36a7315 service neutron] http://10.222.0.20:9696/v2.0/extensions returned with HTTP 200 {{(pid=104037) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Mar 24 02:32:36.371516 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-c0ce6d12-66da-41c9-8dcd-5901c36a7315 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0047696 Mar 24 02:32:36.460249 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-c1c85f43-6532-4bd6-946a-23c06ad9051a service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823872 Mar 24 02:32:36.544768 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-30be0d4a-7fc2-4433-a8a8-1aae131fc176 req-ba48d0f3-9526-427b-8643-de5df12bfe37 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0788589 Mar 24 02:32:45.102438 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:32:57.431418 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-e751f499-741d-4661-ae8c-9e15cf5503b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:00.539475 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-0ac9f69b-25ba-403f-b349-d1bdc4370e0e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:00.923940 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:01.983113 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:33:02.488207 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:03.748061 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:15.113393 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:27.434276 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-37dfca5c-2841-4941-ab38-5bc875ec9540 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:30.540214 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4b9ad74a-cef7-44ed-b6f5-8099c2dbca1a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:30.926028 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:32.491364 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:33.748814 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:36.065752 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-dd94486d-3950-4168-a707-b002a0003ad0 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0812798 Mar 24 02:33:36.148246 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-1805961c-58ee-4aba-814e-4d50153059ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:33:36.149748 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-1805961c-58ee-4aba-814e-4d50153059ed service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 1129 time: 0.0435402 Mar 24 02:33:36.252713 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-ae837aa3-81b3-44df-95ff-43abbf5ff25d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:33:36.254114 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-ae837aa3-81b3-44df-95ff-43abbf5ff25d service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.0848310 Mar 24 02:33:36.316539 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-7b6b28f4-6d45-4138-b8e9-8dd28eeadab9 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0458383f-f9f4-4fcb-b044-155164c4847c HTTP/1.1" status: 200 len: 1000 time: 0.0569713 Mar 24 02:33:36.363015 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-8d8d5600-e521-41a0-bd79-e8a03af2066f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:33:36.364390 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-8d8d5600-e521-41a0-bd79-e8a03af2066f service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0420353 Mar 24 02:33:36.413451 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-3cc82d46-87dd-4d53-81fb-bcf08314c2d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:33:36.414966 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-3cc82d46-87dd-4d53-81fb-bcf08314c2d1 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0448620 Mar 24 02:33:36.500863 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-5ebb0e79-c23c-4c33-8fbd-8d4f27040d69 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0790966 Mar 24 02:33:36.588851 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-7beb517b-d243-42e8-85a2-e2e2f7d23af4 req-2c060daa-11be-4b97-8918-95b75e468d81 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820405 Mar 24 02:33:38.982562 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:33:45.134919 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:33:57.436481 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-cf175166-5ca8-423f-b049-408b3c68a601 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:00.544040 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7ff64365-9469-4129-ae72-c2ffb12201bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:00.928478 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:02.527497 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:03.750100 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:15.166593 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:15.981884 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:34:27.438070 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-de917053-6dd3-45d0-bad8-4f23bb8d2a3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:30.544291 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-246928da-5d31-4ade-bf66-cb9ed759515e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:30.930223 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:32.496786 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:33.751724 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:37.021420 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-03632569-0f6e-40fe-89e9-49ea7bb3572a service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0433447 Mar 24 02:34:37.086849 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-10c1dcd5-8f16-42e8-9bc4-4be5048d2645 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:34:37.088329 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-10c1dcd5-8f16-42e8-9bc4-4be5048d2645 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 1129 time: 0.0451643 Mar 24 02:34:37.189144 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-d99994e6-bd62-4124-b086-185b20579a4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:34:37.190654 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-d99994e6-bd62-4124-b086-185b20579a4a service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.0837910 Mar 24 02:34:37.258215 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-2df49d7b-d72e-419d-9c57-b7e9876669a6 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ae07d99c-0d48-441b-9f63-8734cc45470e HTTP/1.1" status: 200 len: 1000 time: 0.0608015 Mar 24 02:34:37.305405 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-de11a55c-5822-478b-8f61-4798a42c70c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:34:37.306832 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-de11a55c-5822-478b-8f61-4798a42c70c5 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0425801 Mar 24 02:34:37.353260 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-2647e144-775b-4572-bbf7-a78184d5c9cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:34:37.354721 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-2647e144-775b-4572-bbf7-a78184d5c9cd service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0418839 Mar 24 02:34:37.443752 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-249d21a3-cfd8-4c81-bdbc-a63416378933 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829825 Mar 24 02:34:37.530587 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-2cd6ecb2-987c-495c-9ecf-fc0409bffe6c req-2827db50-eff4-4387-ab96-6fc3cb1c96de service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799963 Mar 24 02:34:45.169202 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:34:52.980508 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:34:57.438744 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-74564d50-3cc5-4ddc-a9cd-fba25264c906 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:00.545610 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-7867f8f7-b4e1-4b40-a4b6-7e323d42be7d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:00.932423 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:02.500829 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:03.752939 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:15.179093 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:27.439391 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1a67f2d9-73b8-45f3-b682-f6b12332a00e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:29.979677 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:35:30.546922 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-23f5711c-d084-493f-a271-ef496c3c9642 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:30.936348 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:32.503218 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:33.754205 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:37.010416 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-228d3ff2-4afe-4625-aba4-a0168afc865f service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0417411 Mar 24 02:35:37.092807 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-f7bcc34a-b8cb-415a-8d0a-d646a57c8429 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:35:37.094257 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-f7bcc34a-b8cb-415a-8d0a-d646a57c8429 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=2bbcd9e1-d232-462d-9e85-ca96ba83d61a HTTP/1.1" status: 200 len: 1129 time: 0.0451238 Mar 24 02:35:37.196607 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-fc768970-4478-4689-93c9-39563700f514 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:35:37.198347 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-fc768970-4478-4689-93c9-39563700f514 service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.0866795 Mar 24 02:35:37.262713 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-9cdfc2be-24b2-4f4e-81b2-66288b28186f service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0458383f-f9f4-4fcb-b044-155164c4847c HTTP/1.1" status: 200 len: 1000 time: 0.0580814 Mar 24 02:35:37.311392 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-1b184dec-0d01-4dfd-8736-bb6160653c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:35:37.312869 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-1b184dec-0d01-4dfd-8736-bb6160653c06 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0450735 Mar 24 02:35:37.363939 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-b12bac9d-97a1-4389-9b95-ddb2079b716c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:35:37.365331 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-b12bac9d-97a1-4389-9b95-ddb2079b716c service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0472014 Mar 24 02:35:37.452621 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-c1cf578f-4035-4a7d-b7b4-e97950cde816 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802631 Mar 24 02:35:37.542192 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-9dd7565f-1c6a-4f2c-9d2d-156ba48f6f8e req-95ad1d46-c207-4772-b1b0-72c7f03d2cda service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841007 Mar 24 02:35:45.193105 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:35:57.440511 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-1b026d0d-6ca6-4b92-8345-cf5666bf7744 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:00.548196 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-df6c5677-1cec-4c11-9813-3d6a92feed7b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:00.941072 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:02.526741 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:03.754084 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:06.978146 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:36:15.196690 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:27.442049 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-4adadac8-5b8f-4d1d-941a-5501eea6e932 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:30.548620 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6bb1536f-ea15-4d5f-acdb-925cd92d8698 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (700661ac-903b-4270-9a73-7a0120212663), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:30.944443 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-5c6a535b-e028-4363-a242-aa4badddbec0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (bbf24590-ef09-4188-ad9b-a30659d885f3), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:32.510553 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-ee799ed3-8088-4bae-89f8-2948c5e8b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (286f0809-704e-48d9-81ad-6eafdad3c3bc), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:33.757622 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-6f2c5284-1f13-4959-8e83-fb3548fb4761 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8133f75a-3236-4200-aa56-d8deaa4bd072), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:37.015891 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-233b9009-5c87-4c1a-86bf-603567c27af5 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=4c57f800-ef2e-47be-b342-b671ffe21638&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0429428 Mar 24 02:36:37.080523 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-6842b6bf-3b22-4788-8e19-d5d2c98d7332 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:36:37.082052 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-6842b6bf-3b22-4788-8e19-d5d2c98d7332 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=6c0b7eea99a4423dac22912b1fa60ca2&device_id=4c57f800-ef2e-47be-b342-b671ffe21638 HTTP/1.1" status: 200 len: 1129 time: 0.0455787 Mar 24 02:36:37.185286 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-3276cf70-f71d-4612-812e-fc949cc4f4f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:36:37.187452 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-3276cf70-f71d-4612-812e-fc949cc4f4f1 service neutron] 10.222.0.30 "GET /v2.0/networks?id=513167f7-2f09-4967-8ab3-31d31374b29d HTTP/1.1" status: 200 len: 898 time: 0.0870454 Mar 24 02:36:37.251021 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-ed8235f7-b5a0-49cf-85ad-b0714a5406e1 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ae07d99c-0d48-441b-9f63-8734cc45470e HTTP/1.1" status: 200 len: 1000 time: 0.0566700 Mar 24 02:36:37.302071 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-c149c220-5bea-460d-b6ec-67388c96ada4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:36:37.304165 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-c149c220-5bea-460d-b6ec-67388c96ada4 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=b99c86c5-5954-49d0-ab58-eaf5fd70ee11 HTTP/1.1" status: 200 len: 834 time: 0.0463319 Mar 24 02:36:37.350959 dv-neutron-834874-3-hyperv neutron-server[104037]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-dcee93aa-1ede-49dc-9105-bd11f0cf4923 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=104037) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Mar 24 02:36:37.352389 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-dcee93aa-1ede-49dc-9105-bd11f0cf4923 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=513167f7-2f09-4967-8ab3-31d31374b29d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1214 time: 0.0424604 Mar 24 02:36:37.437437 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-b96ac8bc-1a33-4f23-ac58-9088efbbebf3 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0781772 Mar 24 02:36:37.527378 dv-neutron-834874-3-hyperv neutron-server[104037]: INFO neutron.wsgi [req-4a96ad1f-3eea-4cdf-8e61-5a2d3388597f req-215ec51e-cfb7-4192-b1a5-2bd349675d06 service neutron] 10.222.0.30 "GET /v2.0/networks/513167f7-2f09-4967-8ab3-31d31374b29d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839078 Mar 24 02:36:43.977391 dv-neutron-834874-3-hyperv neutron-server[104039]: DEBUG neutron.db.agents_db [None req-cfcf7561-1d2c-4bab-8a17-407f11ad7d81 None None] Agent healthcheck: found 6 active agents {{(pid=104039) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Mar 24 02:36:45.195603 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-a22d7bc2-c17d-4e4b-87e9-4ffc670386dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (ed26ad49-ce2d-450b-8685-ef2d8cce960e), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Mar 24 02:36:57.443566 dv-neutron-834874-3-hyperv neutron-server[104038]: DEBUG neutron_lib.callbacks.manager [None req-3cb2196b-98ed-4c22-b3af-fb1cad67b48f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8790618681137', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7451426'] for agent (8aeface5-bae1-4042-b03b-b97904f320d4), after_update {{(pid=104038) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}}